similar to: A very frustrating read.table error message

Hi, I am looking for an efficient way of skipping big chunks of lines on a connection (not necessarily at the beginning of the file). One way is to use read lines, e.g. readLines(1e6), but a) this incurs the overhead of construction of the return char vector and b) has a (fairly remote) potential to blow up the memory. Another way would be to use scan(), e.g. scan(con, skip=1e6, nmax=0)

I'm trying to import a table into R the file is about 700MB. Here's my first try: > DD<-read.table("01uklicsam-20070301.dat",header=TRUE) Error: cannot allocate vector of size 15.6 Mb In addition: Warning messages: 1: In scan(file, what, nmax, sep, dec, quote, skip, nlines, na.strings, : Reached total allocation of 1535Mb: see help(memory.size) 2: In scan(file, what,

I found it easy to use R when typing data manually into it. Now I need to read data from a file, and I get the following errors: > refdata = > read.table("K:\\MerchantData\\RiskModel\\refund_distribution.csv", header > = TRUE) Error in scan(file, what, nmax, sep, dec, quote, skip, nlines, na.strings, : line 1 did not have 42 elements > refdata = >

Hello R-User I have a table as tab-delimited textfile (291 rows, 83 columns). The first row are labels and the first line the variable names. I used the following code several times with different similar tables and it always worked. But now: setClass("of") setAs("character", "of", function(from) as.ordered(from)) Classe82<-cclasses <-

Hello, I'm using a very large data set (n > 100,000 for 7 columns), for which I'm pretty happy dealing with pairwise-deleted correlations to populate my correlation table. E.g., a <- cor(cbind(col1, col2, col3),use="pairwise.complete.obs") ...however, I am interested in the number of cases used to compute each cell of the correlation table. I am unable to find such a

Hola a todos, Me gustaria leer el texto que se encuentra en http://dl.dropboxusercontent.com/u/9601860/txt.txt He intentado txt <- 'http://dl.dropboxusercontent.com/u/9601860/txt.txt' r <- scan(txt) #Error in scan(file, what, nmax, sep, dec, quote, skip, nlines, na.strings, : # invalid multibyte string at '<ff><fe>M' r <- read.table(txt, header = FALSE)

Dear R-users, I have encountered the following problem every now and then. But I was dealing with a very small dataset before, so it wasn't a problem (I just edited the dataset in Openoffice speadsheet). This time I have to deal with many large datasets containing commuting flow data. I appreciate if anyone could give me a hint or clue to get out of this problem. I have a .dat file

Dear all, I have a tab-delimited text (.txt) file which I'm trying to read into R. This file is of column format - there are in fact 3 columns and 259201 rows (including the column headers). I've been using the following commands, but receive an error each time which prevents the data from being read in: > Jan <- read.table("JanuaryAvBurntArea.txt", header=TRUE) Error in

Dear colleagues, I've been running some principal components analyses, which generate tables of loadings that I'm interested in looking at. print(f1$rot$load,cutoff=.4) is what I use, and it gives me what I want. However, I'm now interested in comparing these loadings across a few data sets. In other words, I would like R to match the loadings on rownames() and display them next

Dear Colleagues, I've been searching for a post or article or something which explains why having na.rm=FALSE or na.action=na.fail as the default is a better choice than TRUE or na.omit. I understand the basic argument: it does not make sense to average a nonexistance into an aggregate, and removing them implicitly leads to accidental pairwise deletion in some cases, and sum(x) /

Dear R-users, When i try - Data1<-read.table("/Users/kama/Analysis/GDP10.csv",header=TRUE,sep=";") i am getting this error: Warning message: In scan(file, what, nmax, sep, dec, quote, skip, nlines, na.strings, : number of items read is not a multiple of the number of columns I wonder what Iam doing wrong. i guess it is something simple, however, i do not understand

Dear colleagues, Has anybody any experience using the sem package to fit structural equation models using a fitting function other than ML? I have heard tell that OLS may provide better estimates when using standardized matrices generated from small sample sizes, so I was interested in comparing the two for a few models. However, ML appears to be hard-coded into the source for sem...but maybe

Hola Jorge, Algo pasa con el fichero... He abierto el link de Dropbox, y he salvado el texto como "txt.txt" en local. Pruebo a abrirlo en R y...: > scan(file="txt.txt")Error in scan(file, what, nmax, sep, dec, quote, skip, nlines, na.strings, : scan() expected 'a real', got 'ÿþM'> getwd()[1] "C:/Users/xIs12136/Downloads" Pruebo a abrirlo

Hola. Con r <- scan(txt, character(0)) creo que debiera montarse el texto carácter a carácter. He comprobado que funciona pero no he validado la importación del texto. Igual es un camino que lleva a alguna parte.... Un Saludo, Miguel. -----Mensaje original----- De: r-help-es-bounces en r-project.org [mailto:r-help-es-bounces en r-project.org] En nombre de Carlos Ortega Enviado el:

Estimados Tengo un archivo CSV con 1.200.000 registros separados por ";" y cuando quiero abrirlo me da el siguiente error: form<-read.csv("Usr1.csv" , sep=';' , na.strings = "NA", header=T) Mensajes de aviso perdidos In scan(file, what, nmax, sep, dec, quote, skip, nlines, na.strings, : entrada inválida encontrada en la conexión de entrada

No matter how I´ve tried o find a solution for this simple question, I can´t. Sorry for bothering with such a matter. I have an excel-files with some empty cells=missing values. How do I tell R that these should be NA´s? > TRFLP1 <-(read.table(file="S://SEDIM//Kokeilu//TRFLP1.txt",col.names= c("Dye_Sample Peak", "Sample_File_Name", "Size",

It seems to me the following should work (in fact, it comes from someone's SPlus file). Instead, it reads the first 8 lines and then spits out syntax errors. Using nlines=36 works. Using nmax does not. Intel RH5.2 with R90.0. Debugging shows it must be internal. Jim junk <- scan(file="",list(i=0,r1=0,r2=0,lull="",day=""),n=5*36) 1 3 5 no 1 2 1

Hello, Here is a link to some data: http://www.epa.gov/emap/html/data/surfwatr/data/mastreams/9396/wchem/chmval.txt I am trying to read this in, and want to use: chmval <- read.table("http://www.epa.gov/emap/html/data/surfwatr/data/mastreams/9396/wchem/chmval.txt", sep=",", skip= 84, header=T) the # 84, for 84 lines skipped needs to be derived from the 5th line of the

Hello all, I seem to be having a problem importing a data set from Excel into R. I'm using the "read.table" command to import the data with the following line of code: > newborn<-read.table("newborn edit.csv", header=T, sep=",") where "newborn edit.csv" is the name of the file. Unfortunately, I'm getting back the following error message:

Hola, Estoy tratando de leer una base de datos: tengo 39 columnas, de las cuales 38 son variables y una es el nombre de las empresas. Por lo que escribo el siguiente codigo: Variables <- read.csv("C:/Users/usuario/Documents/variables2.csv", header=TRUE, sep=";", comment.char="" , colClasses=c(Empresas="character",