Dear R-Users, I am looking for packages that could read large files in R? any suggestions are welcome. Regards, ML
A little more detail would be appropriate. How large is "large"? What is the format of the file? What do you wnat to do with the data? Do you have to have it all in memory at once? Does it exist in a data base already? What type of system are you running on? How much memory do you have? ............ On Wed, Aug 19, 2009 at 4:51 AM, Mohamed Lajnef<Mohamed.lajnef at inserm.fr> wrote:> Dear R-Users, > > I am looking for packages that could read large files in R? > any suggestions are welcome. > Regards, > ML > > ______________________________________________ > R-help at r-project.org mailing list > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide http://www.R-project.org/posting-guide.html > and provide commented, minimal, self-contained, reproducible code. >-- Jim Holtman Cincinnati, OH +1 513 646 9390 What is the problem that you are trying to solve?
On Wed, Aug 19, 2009 at 10:51 AM, Mohamed Lajnef<Mohamed.lajnef at inserm.fr> wrote:> I am looking for packages that could read large files in R? > any suggestions are welcome.As already pointed out by Jim, your question is not very specific. My wild guess is that you probably have some memory issues -- if that is the case, maybe the package "bigmemory" can alleviate your pain. Best, Michael -- Michael Knudsen micknudsen at gmail.com http://lifeofknudsen.blogspot.com/
Dear Jim & Michael the file contains 1000 lines and 1.200.000 columns, txt format and i wish to read all the file with R if possible, or read a few columns? I tried without success to turn bigmemory and colbycol packages, also scan and readLines function but It takes a long time without anything. I have windows X64 bits 8 Go In advance thanks ML jim holtman a ?crit :> A little more detail would be appropriate. How large is "large"? > What is the format of the file? What do you wnat to do with the data? > Do you have to have it all in memory at once? Does it exist in a > data base already? What type of system are you running on? How much > memory do you have? ............ > > On Wed, Aug 19, 2009 at 4:51 AM, Mohamed Lajnef<Mohamed.lajnef at inserm.fr> wrote: > >> Dear R-Users, >> >> I am looking for packages that could read large files in R? >> any suggestions are welcome. >> Regards, >> ML >> >> ______________________________________________ >> R-help at r-project.org mailing list >> https://stat.ethz.ch/mailman/listinfo/r-help >> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html >> and provide commented, minimal, self-contained, reproducible code. >> >> > > > >