pedrosmarques at portugalmail.pt
2007-Dec-09 10:21 UTC
[R] Problems working with large matrix (using package R.huge)
Hi all, Since I was having several problems trying to work with a large matrix I started to use the package R.huge but I'm having the following problem> x<-FileByteMatrix("covtype.data",nrow=581012,ncol=55)Error: cannot allocate vector of size 770.8 Mb In addition: Warning messages: 1: Reached total allocation of 447Mb: see help(memory.size) in: readChar(con = con, nchar = len) 2: Reached total allocation of 447Mb: see help(memory.size) in: readChar(con = con, nchar = len) 3: Reached total allocation of 447Mb: see help(memory.size) in: readChar(con = con, nchar = len) 4: Reached total allocation of 447Mb: see help(memory.size) in: readChar(con = con, nchar = len) How can I solve this?? Best regards
Henrik Bengtsson
2007-Dec-09 10:53 UTC
[R] Problems working with large matrix (using package R.huge)
Hi, I'm sorry, but I will most likely withdraw R.huge from CRAN anytime soon. The File***Matrix classes had some problems, which when solved made it too slow. See BufferedMatrix package in Bioconductor instead. /Henrik On 09/12/2007, pedrosmarques at portugalmail.pt <pedrosmarques at portugalmail.pt> wrote:> > > Hi all, > > Since I was having several problems trying to work with a large matrix I started to use the package R.huge but I'm having the following problem > > > x<-FileByteMatrix("covtype.data",nrow=581012,ncol=55) > Error: cannot allocate vector of size 770.8 Mb > In addition: Warning messages: > 1: Reached total allocation of 447Mb: see help(memory.size) in: readChar(con = con, nchar = len) > 2: Reached total allocation of 447Mb: see help(memory.size) in: readChar(con = con, nchar = len) > 3: Reached total allocation of 447Mb: see help(memory.size) in: readChar(con = con, nchar = len) > 4: Reached total allocation of 447Mb: see help(memory.size) in: readChar(con = con, nchar = len) > > > How can I solve this?? > > Best regards > > ______________________________________________ > R-help at r-project.org mailing list > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide http://www.R-project.org/posting-guide.html > and provide commented, minimal, self-contained, reproducible code. >