R help - Sep 2008 - data import

Dear All,

I have a data set containing 2,122,164 records and 38198952 fields.
I can not import this data due to "momory problem".
Is  there a way to solve this problem?

Thanks  
 

	[[alternative HTML version deleted]]

> I have a data set containing 2,122,164 records and 38198952 fields.
> I can not import this data due to "momory problem".
> Is  there a way to solve this problem?
1. Filter the data before you import it.  Do you really need all 38 
million fields?  Can you ignore some of the 2 million records?  Chapter 4 
of the R Data Import/Export Manual may help.

2. Failing that, buy more memory for your PC.

Regards,
Richie.

Mathematical Sciences Unit
HSL


------------------------------------------------------------------------
ATTENTION:

This message contains privileged and confidential inform...{{dropped:20}}

You can use a "connection" and read a portion of the data in at a time
and process it.  Do you need all the data at once? If so, I would
agree that you either need more memory (and possibly a 64-bit version
of the system), or you come up with a different approach to your
processing.  You have not indicated what problem you are trying to
solve with the data.

On Thu, Sep 11, 2008 at 3:32 AM, afshin fallah <fallahaf at modares.ac.ir>
wrote:
> Dear All,
>
> I have a data set containing 2,122,164 records and 38198952 fields.
> I can not import this data due to "momory problem".
> Is  there a way to solve this problem?
>
> Thanks
>
>
>        [[alternative HTML version deleted]]
>
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>


-- 
Jim Holtman
Cincinnati, OH
+1 513 646 9390

What is the problem that you are trying to solve?