Hi All, I want to read 256 1000x1000 matrices into R. I understand that it is unlikely that I can do this but In the hope that somebody can help me I am mailing this list. I have tried increasing my memory size (I understand that it is the minimum of 1024 or the computers RAM in my case 512) Does anyone think this is possible in R, could it be tried in Splus for example. Any help is greatly appreciated. Niall Fitzgerald Phd Candidate.
On Fri, 13 May 2005, s104100026 wrote:> Hi All, > > I want to read 256 1000x1000 matrices into R. I understand that it is unlikely > that I can do this but In the hope that somebody can help me I am mailing this > list.What sort of matrix? If these are real numbers that is 2Gb.> I have tried increasing my memory size (I understand that it is the minimum of > 1024 or the computers RAM in my case 512) > > Does anyone think this is possible in R, could it be tried in Splus for > example.It is possible in R, but you will need a 64-bit version of R. Since you don't state your OS, my guess is it is Windows or MacOS, for neither of which we have a 64-bit port as yet. -- Brian D. Ripley, ripley at stats.ox.ac.uk Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/ University of Oxford, Tel: +44 1865 272861 (self) 1 South Parks Road, +44 1865 272860 (secr) Oxford OX1 3TG, UK Fax: +44 1865 272595
Hallo On 13 May 2005 at 13:38, s104100026 wrote:> Hi All, > > I want to read 256 1000x1000 matrices into R. I understand that it is > unlikely that I can do this but In the hope that somebody can help me > I am mailing this list.Why do you think that. I easilly read files from data logging equipment.> 60min*24h*15days*130variables from text file which has[1] 2808000 items just by read.table() in few whiles on quite old (4 years) and not superbly equipped PC (1G memory). So you can read your matrices sequentially. But if you want to work with all 256 matrices at once it could be problem. Depends on what you want to do with them. Cheers Petr> > I have tried increasing my memory size (I understand that it is the > minimum of 1024 or the computers RAM in my case 512) > > Does anyone think this is possible in R, could it be tried in Splus > for example. > > Any help is greatly appreciated. > > Niall Fitzgerald > Phd Candidate. > > ______________________________________________ > R-help at stat.math.ethz.ch mailing list > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide! > http://www.R-project.org/posting-guide.htmlPetr Pikal petr.pikal at precheza.cz
s104100026 wrote:> Hi All, > > I want to read 256 1000x1000 matrices into R. I understand that it is unlikely > that I can do this but In the hope that somebody can help me I am mailing this > list. > > I have tried increasing my memory size (I understand that it is the minimum of > 1024 or the computers RAM in my case 512) > > Does anyone think this is possible in R, could it be tried in Splus for > example.Given the matrices are numeric, you will need 256*1000*1000*8 = 2Gb of memory just to hold them in memory, in order to apply calculations, objects are frequently doubled ....... So you should really handle those matrices separately, either by getting them from a database or by saving them in form of separate Rdata objects. Uwe Ligges> Any help is greatly appreciated. > > Niall Fitzgerald > Phd Candidate. > > ______________________________________________ > R-help at stat.math.ethz.ch mailing list > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html
On 5/13/05, s104100026 <n.d.fitzgerald at mars.ucc.ie> wrote:> Hi All, > > I want to read 256 1000x1000 matrices into R. I understand that it is unlikely > that I can do this but In the hope that somebody can help me I am mailing this > list. > > I have tried increasing my memory size (I understand that it is the minimum of > 1024 or the computers RAM in my case 512) > > Does anyone think this is possible in R, could it be tried in Splus for > example. >If they are sparse you could try the SparseM package.