a data file (close to 60M) with 90,000 rows and 173 columns. Is it too big for R? Thanks.
It might be too big to R on the machine your are using, and it's also highly dependent on what you want to do with it. E.g., if you try to cluster the rows using something that requires the full distance matrix, you're most likely out of luck. I've dealt with data with 20,000 rows but more than 5000 columns in R with no problem. Andy> From: Wensui Liu > > a data file (close to 60M) with 90,000 rows and 173 columns. Is it too > big for R? > > Thanks. > > ______________________________________________ > R-help at stat.math.ethz.ch mailing list > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide! > http://www.R-project.org/posting-guide.html > > >
I regularly work with data frames with around 144000 rows and 23 columns. In fact, I work with two of them in the same session, one in .GlobalEnv and the other in search()[2], attached using attach() on a file previously saved with save(). -Don At 9:11 AM -0500 3/22/05, Wensui Liu wrote:>a data file (close to 60M) with 90,000 rows and 173 columns. Is it too >big for R? > >Thanks. > >______________________________________________ >R-help at stat.math.ethz.ch mailing list >https://stat.ethz.ch/mailman/listinfo/r-help >PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html-- -------------------------------------- Don MacQueen Environmental Protection Department Lawrence Livermore National Laboratory Livermore, CA, USA
Seemingly Similar Threads
- a Q about R in unix
- OT: any recommendation for scripting language
- Is it possible to create highly customized report in *.xls format by using R/S+?
- recommendation on r scripting tutorial?
- how to rescale the limits of yaxis rather than using the data range by default?