I have some difficulties in reading big dataset; I have to import a dataset with
1'661'852 observations saved in a 51.4Mb - txt file.
I was wandering if this is a memory size problem or if I realy can't import
such big datasets.
If the memory allocated to my R is not enough, I would like to know exactly
which comands I should use in order to read and use my large dataset.
I Looking forward to hearing from you.
Giorgia Rama
-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-
r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !) To: r-help-request at
stat.math.ethz.ch
_._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._
As far as I know, whether or not you can read the dataset will just depend on how much memory your computer has. For example, I have a GNU/Linux machine with 1GB of RAM and can read 50MB file quite easily. -roger _______________________________ UCLA Department of Statistics rpeng at stat.ucla.edu http://www.stat.ucla.edu/~rpeng On Wed, 3 Jul 2002, Rama Giorgia wrote:> > I have some difficulties in reading big dataset; I have to import a > dataset with 1'661'852 observations saved in a 51.4Mb - txt file. > I was wandering if this is a memory size problem or if I realy can't > import such big datasets. > If the memory allocated to my R is not enough, I would like to know > exactly which comands I should use in order to read and use my large > dataset. > > I Looking forward to hearing from you. > > Giorgia Rama > -.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.- > r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html > Send "info", "help", or "[un]subscribe" > (in the "body", not the subject !) To: r-help-request at stat.math.ethz.ch > _._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._ >-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.- r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html Send "info", "help", or "[un]subscribe" (in the "body", not the subject !) To: r-help-request at stat.math.ethz.ch _._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._
Dear Rama Giorgia,
if you are using R under Unix you should call R with
R --vsize=600M --nsize=25000k
Further, use scan() directly. It works much more better than
read.table().
Greetings
s.
On 3 Jul 2002, at 9:49, Rama Giorgia wrote:
I have some difficulties in reading big dataset; I have to import a
dataset with 1'661'852 observations saved in a 51.4Mb - txt file.
I was wandering if this is a memory size problem or if I realy can't
import such big datasets. If the memory allocated to my R is not
enough, I would like to know exactly which comands I should use
in
order to read and use my large dataset.
I Looking forward to hearing from you.
Giorgia Rama
-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.
-.-.-.-.- r-help mailing list -- Read
http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html Send "info",
"help",
or "[un]subscribe" (in the "body", not the subject !) To:
r-help-request at stat.math.ethz.ch
_._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._.
_._._._._
salvatore barbaro
department of public economics
platz der g?ttinger sieben 3
37073 g?ttingen
tel.: +49 551 3919704
fax: +49 551 39 7353
-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-
r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !) To: r-help-request at
stat.math.ethz.ch
_._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._