Amit Patel
2011-May-18 17:55 UTC
[R] Help with Memory Problems (cannot allocate vector of size)
While doing pls I found the following problem> BHPLS1 <- plsr(GroupingList ~ PCIList, ncomp = 10, data = PLSdata, jackknife = >FALSE, validation = "LOO")when not enabling jackknife the command works fine, but when trying to enable jackknife i get the following error.>BHPLS1 <- plsr(GroupingList ~ PCIList, ncomp = 10, data = PLSdata, jackknife = >TRUE, validation = "LOO")Error: cannot allocate vector of size 289.1 Mb I am dealing with a very large dataset>str(PLSdata)'data.frame': 40 obs. of 2 variables: $ GroupingList: int 1 1 1 1 1 1 1 1 1 1 ... $ PCIList : AsIs [1:40, 1:94727] 0 0 0 0 0 0 0 0 0 0 ... ..- attr(*, "dimnames")=List of 2 .. ..$ : chr "X" "X.1" "X.12" "X.13" ... .. ..$ : NULL>object.size(PLSdata)/104860028.9113560938394 bytes How can i get around this memory shortage [[alternative HTML version deleted]]
Jannis
2011-May-18 21:33 UTC
[R] Help with Memory Problems (cannot allocate vector of size)
How about reading the posting guide and afterwards searching the list archive: http://r.789695.n4.nabble.com/R-help-f789696.html Searching for "Error: cannot allocate vector of size" will give you hundreds of results as this question is asked VERY frequently! Jannis On 05/18/2011 07:55 PM, Amit Patel wrote:> While doing pls I found the following problem > >> BHPLS1<- plsr(GroupingList ~ PCIList, ncomp = 10, data = PLSdata, jackknife >> FALSE, validation = "LOO") > when not enabling jackknife the command works fine, but when trying to enable > jackknife i get the following error. > > > >> BHPLS1<- plsr(GroupingList ~ PCIList, ncomp = 10, data = PLSdata, jackknife >> TRUE, validation = "LOO") > Error: cannot allocate vector of size 289.1 Mb > > I am dealing with a very large dataset > >> str(PLSdata) > 'data.frame': 40 obs. of 2 variables: > $ GroupingList: int 1 1 1 1 1 1 1 1 1 1 ... > $ PCIList : AsIs [1:40, 1:94727] 0 0 0 0 0 0 0 0 0 0 ... > ..- attr(*, "dimnames")=List of 2 > .. ..$ : chr "X" "X.1" "X.12" "X.13" ... > .. ..$ : NULL > >> object.size(PLSdata)/1048600 > 28.9113560938394 bytes > > How can i get around this memory shortage > [[alternative HTML version deleted]] > > ______________________________________________ > R-help at r-project.org mailing list > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide http://www.R-project.org/posting-guide.html > and provide commented, minimal, self-contained, reproducible code. >