My guess is memory is not the issue here. It appears that you 500+MB of
system memory and that should suffice for a 71MB dataset. Additionally, a
dataset of that size should load in much less time than 30 minutes.
You should read-up on the read.fwf options to ensure that the file is being
read correctly. Submitting your read.fwf code fragment and a fragment of
the data file (like the top 10 lines) will help us diagnose the situation.
Also, if you reduce your data file to something like 10 lines, it's easier
and quicker to iterate and trouble shoot the loading process.
----- Original Message -----
From: "Vito Ricci" <vito_ricci at yahoo.com>
To: <r-help at stat.math.ethz.ch>
Sent: Thursday, August 31, 2006 4:47 AM
Subject: [R] Error in memory allocation
> Dear UseRs,
>
> I need a litle help.
> I'm trying to read a .dat file of about 71 MB using
> read.fwf (as data recorded are in fixed width
> formatted data). R starts in reading data, but after
> some time, about 1/2 hour, I get this error:
>
> Error in .signalSimpleWarning("Reached total
> allocation of 510: see help(memory.size)"
>
> memory.size()
> 529880586
>
> R is running under windows:
>
> sysname release
> "Windows" "NT 5.1"
> version nodename
> "(build 2600) Service Pack 2" "PC-TULIP"
> machine login
> "x86" "Utente-01"
> user "Utente-01"
>
> Can anyone help me? I need to read those data!
>
> Thanks in advance.
>
> Regards.
>
> Vito Ricci
>
>
>
>
> Se non ora, quando?
> Se non qui, dove?
> Se non tu, chi?
>
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>