[R] reading large data sets

salvatore barbaro
Mon, 08 Jul 2002 08:02:49 -0000

Dear Rama Giorgia,

if you are using R under Unix you should call R with

R --vsize=600M --nsize=25000k

Further, use scan() directly. It works much more better than
read.table().

Greetings

s.




On 3 Jul 2002, at 9:49, Rama Giorgia wrote:


I have some difficulties in reading big dataset; I have to import a
dataset with 1'661'852 observations saved in a 51.4Mb - txt file.
 I was wandering if this is a memory size problem or if I realy can't
 import such big datasets. If the memory allocated to my R is not
 enough, I would like to know exactly which comands I should use
in
 order to read and use my large dataset.

I Looking forward to hearing from you.

    Giorgia Rama
-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.
-.-.-.-.- r-help mailing list -- Read
http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html Send "info",
"help",
or "[un]subscribe" (in the "body", not the subject !)  To:
r-help-request at stat.math.ethz.ch
_._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._.
_._._._._

salvatore barbaro
department of public economics
platz der g?ttinger sieben 3
37073 g?ttingen
tel.: +49 551 3919704
fax:  +49 551 39 7353