R help - Nov 2021 - tidyverse: read_csv() misses column

More explicitly... look at rows past the first row. If your csv has 300 rows and
column 1 has something non-numeric in row 299 then the whole column gets
imported as character data. Try

cor_disc[[ 1 ]] |> as.numeric() |> is.na() |> where()

to find suspect rows. You may want to read about the na argument to read_csv in
?read_csv.

On November 1, 2021 9:50:23 AM PDT, Kevin Thorpe <kevin.thorpe at
utoronto.ca> wrote:
>I do not have a specific answer to your particular problem. All I can say is
when a CSV import doesn?t work, it can mean there is something in the CSV file
that is unexpected. When read_csv() fails, I will try read.csv() to compare the
results.
>
>Kevin
>
>
>> On Nov 1, 2021, at 12:40 PM, Rich Shepard <rshepard at
appl-ecosys.com> wrote:
>> 
>> The data file, cor-disc.csv begins with:
>> site_nbr,year,mon,day,hr,min,tz,disc
>> 14171600,2009,10,23,00,00,PDT,8750
>> 
>> The first 7 columns are character strings; the 8th column is an
integer.
>> 
>> After loading library(tidyverse) I ran read_csv() with this result:
>>> cor_disc <- read_csv("../data/cor-disc.csv")
>>                                                                        
Rows: 415263 Columns: 8
>> ?? Column specification
????????????????????????????????????????????????????????????????????????????
>> Delimiter: ","
>> chr (5): mon, day, hr, min, tz
>> dbl (2): site_nbr, year
>> 
>> ? Use `spec()` to retrieve the full column specification for this data.
>> ? Specify the column types or set `show_col_types = FALSE` to quiet
this message.
>> 
>> 1. What happed to the values in column 'disc?'
>> 
>> 2. Why are site_nbr and year seen as doubles when they're character
strings?
>> 
>> I've not found answers in the book or in ?read_csv.
>> 
>> What am I missing?
>> 
>> Rich
>> 
>> ______________________________________________
>> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
>> https://stat.ethz.ch/mailman/listinfo/r-help
>> PLEASE do read the posting guide
http://www.R-project.org/posting-guide.html
>> and provide commented, minimal, self-contained, reproducible code.
>
-- 
Sent from my phone. Please excuse my brevity.

On Mon, 1 Nov 2021, Jeff Newmiller wrote:
> More explicitly... look at rows past the first row. If your csv has 300
> rows and column 1 has something non-numeric in row 299 then the whole
> column gets imported as character data. Try
> cor_disc[[ 1 ]] |> as.numeric() |> is.na() |> where()
> to find suspect rows. You may want to read about the na argument to
read_csv in ?read_csv.
Jeff,

cor_disc has 415264 rows.
> cor_disc[[ 1 ]] |> as.numeric() |> is.na() |> where()
Error in where(is.na(as.numeric(cor_disc[[1]]))) :
   could not find function "where"

Searching for 'where' in ?read_csv finds only
where each character represents one column:

And, if there was such a non-numeric in any row of column 1 wouldn't
read.csv() also catch it and throw an error?

Thanks,

Rich