similar to: importing csv gets me all 16,000 columns with "NA"

*Dear R users, Ive just started using the ff package. There is a csv file (~4Gb) with 7 columns and 6e+7 rows. I want to read only column from the file, skipping the first 100 rows. Below Ive provided different outcomes, which will clarify my problem * > sessionInfo() R version 2.14.2 (2012-02-29) Platform: x86_64-pc-mingw32/x64 (64-bit) locale: ... attached base packages: [1] tools

Hi I'm trying to speed my loop up. Any Suggestions?? At the moment it takes a few days to run. THE CODE --------------------------------------------------------------------------------------------------- for(i in 1:11) { for (j in 3:12) { for (k in 1:273107) { y[k,1] <- x[i,j,k] print(y) Rainfall_dataset <- read.table("1km_grid_nzmg.csv",

Hi, I have big .csv file. I would like to filter that file into a new table. For example, I have .csv file as below: f1 f2 f3 f4 f5 f6 f7 f9 f10 f11 t1 1 0 1 0 1 0 0 0 0 1 t2 1 0 0 0 0 1 1 1 1 1 t3 0 0 0 0 0 0 0 0 0 0 t4 1 0 0 0 1 0 0 0 0 0 t5 0 0 0 0 0 0 0 0 0 0 t6 0 0 0 0 0 0 0 0 0 0

The following code results in a seg fault. > sessionInfo() R version 2.6.0 Under development (unstable) (2007-06-21 r42013) x86_64-unknown-linux-gnu locale: LC_CTYPE=en_US;LC_NUMERIC=C;LC_TIME=en_US;LC_COLLATE=en_US;LC_MONETARY=en_US;LC_MESSAGES=en_US;LC_PAPER=en_US;LC_NAME=C;LC_ADDRESS=C;LC_TELEPHONE=C;LC_MEASUREMENT=en_US;LC_IDENTIFICATION=C attached base packages: [1] stats graphics

Hi, Trying to learn Search::Xapian and be better at perl at the same time, I'm stuck, at the DB_CREATE_OR_OPEN error. Perl says this: ~/dev/sandbox/Xapian-perl$ ./Index1-Xap.pl 100-objects-v1.csv db "db" is not exported by the Search::Xapian module Can't continue after import errors at ./Index1-Xap.pl line 7. BEGIN failed--compilation aborted at ./Index1-Xap.pl line 7. What I

I have a dataset and a list of labels. I simply want to apply the labels to the variables, all at once. The only way I was able to do it was using a loop:     for (i in 1:length(data))  label(data[,i]) <- data.labels[i] I'd like to find the non-loop way to do it, using apply or the like... Any help appreciated. [[alternative HTML version deleted]]

Hey Folks, I''ve written a script to generate a list of all files on a machine, then zip the results. ?I''m going to stick a web front end on it, and use it to audit some file servers. The problem is that the ZIP compression/decompression isn''t working, but its not what you might think. ?The script completes, but seems to not actually write anything. Here is a short

I have a site on a shared host at TextDrive. I have an import process that imports a CSV file into the database using a ruby script executed using script/runner. TextDrive has a memory limit which I am hitting and the process gets killed. I get through to about 400 records before it dies. I guess each time I instantate a new object for each record I am using more memory but thought I was using

I have big .csv file. I would like to filter that file into a new table. For example, I have .csv file as below: f1 f2 f3 f4 f5 f6 f7 f9 f10 f11 t1 1 0 1 0 1 0 0 0 0 1 t2 1 0 0 0 0 1 1 1 1 1 t3 0 0 0 0 0 0 0 0 0 0 t4 1 0 0 0 1 0 0 0 0 0 t5 0 0 0 0 0 0 0 0 0 0 t6 0 0 0 0 0 0

i m using a package NbClust for cluster analysis. in the following algorithm ->NbClust(m, diss="NULL", distance = "euclidean", min.nc=2, max.nc=15, method = "ward", index = "all", alphaBeale = 0.1) i want to define my own dissimilarity matrix of dimension 38*38. my original data "m" is a matrix of 365*38. whenever i define my own dissimilarity

Hello ALL, Can any body help me in writing a code where i can import a CSV file in to mysql database using rails. I dont want to write any models for importing because there are large number of tables and each table does not have its model. I can get the table name from the parameters So is there any generic way for me ,so that i can import with just the tablename Thanks Jagan

Hi guys, another question today: If I import an external csv-file with headers (with read.csv2), the blanks are interpreted as points. So "Test 1" becomes "Test.1". Is there a way to change this? Thanks, Thomas I'm using XP and R 2.6.1 [[alternative HTML version deleted]]

Dear R users, Suppose the csv file contains header names such as *"Nike, dunk"*, *"Converse, All stars"* etc When imported to R (with header = T option), the column names are given by: *"Nike..dunk"* *"Converse..All.stars"* I have tried the following command to convert these column names to the original names as in the input source.

I'm trying to import a CSV file into R and when it gets imported, the entries get numbered down the left side. How do I get rid of that? Thanks, Jason *> read.csv(file="C:\\Program Files\\R\\Test Data\\sales.csv",head=TRUE) Month Sales 1 January 422 2 February 151 3 March 451 4 April 175 5 May 131 6 June 307 7 July 47 8

hey, i have this website (with ajax also) with lot of records of employee, and as an extra feature i want that the customer can import his employeelist (perhaps 100+ records), lot of work to do this manually. i would create a template like this Firstname Lastname Phone xxxx xxxxx xxxxx yyyy yyyyy yyyyy then they upload the excel file or save it as csv file

There is a recurring need for importing large csv files quickly. David Baird's dataload is a standalone program that will directly create .rda files from .csv (it also handles many other conversions). Unfortunately dataload is no longer publicly available because of some kind of relationship with Stat/Transfer. The idea is a good one, though. I wonder if anyone would volunteer to

Hi, I'm trying to load .csv file into R (3790 by 30). I'm having an odd difficulty. After I type: read.csv("niwage.csv", header = TRUE) the data appears on the screen. The last thirty or so observations appear on the screen and they have been read in correctly. However, when I type: dim(data) I see: NULL This seems odd to me--R seems to be recognizing the data but not

Hi, I am trying to import csv file in R console I have saved my data in a file on the desktop named R and here is my problematic script > load("C:\\Users\\Anthi\\Desktop\\R\\A.csv") Error: bad restore file magic number (file may be corrupted) -- no data loaded In addition: Warning message: file ‘A.csv’ has magic number ';Abra' Use of save versions prior to 2 is deprecated

For some reason, I''ve posted this question to this forum 4 times now and it never appears in the daily consolidated email I get daily? I''ve written a routine allowing the client user to declare where their .csv import file resides and then send it to the server to import the many rows into an existing model table, and then throw it away. I''ve imported many graphic files

Dear all, I'm trying to import a csv file into sqlite3 and from there into R. Everything looks fine exepct that R outputs the character values in an odd fashion: they are shown as "\"CHARACTER\"" instead of "CHARACTER", but only if I show the character variable as a vector. Does someone know why this happens? Below is a sample code. The first part is written in