Tom.Mulholland@dpi.wa.gov.au
2005-Oct-20 06:47 UTC
[Rd] Windows 2000 crash while using rbind (PR#8225)
Windows 2000 reports that "Rgui.exe has generated errors and will be closed
by Windows. You will need to restart the program." when using rbind.=20
df1 <- data.frame(cbind(x=3D1, y=3D1:1000), fac=3Dsample(LETTERS[1:3], 1000,
repl=3DTRUE))
df2 <- data.frame(cbind(x=3D1, y=3D1:10), fac=3Dsample(LETTERS[4:6], 10,
repl=3DTRUE))
df3 <- data.frame(cbind(x=3D1, y=3D1:1000000), fac=3Dsample(LETTERS[1:3],
1000000, repl=3DTRUE))
df4 <- rbind(df1,df2)
df5 <- rbind(df2,df3)
=20
=20
Since this only happens intermittantly and appears to be related to the size of
the objects I ran the following code.
sink("rbind test.txt")
df1 <- data.frame(cbind(x=3D1, y=3D1:10), fac=3Dsample(LETTERS[4:6], 10,
repl=3DTRUE))
for (j in seq(100000,1000000,10000)){
df2 <- data.frame(cbind(x=3D1, y=3D1:j), fac=3Dsample(LETTERS[1:3], j,
repl=3DTRUE))
print(j)
df3 <- rbind(df2,df1)
}
sink()
the output of rbind test.txt is
[1] 100000
[1] 110000
[1] 120000
...
[1] 510000
[1] 520000
I then ran=20
sink("rbind test 2.txt")
df1 <- data.frame(cbind(a =3D 1, b =3D 2, c =3D 3, d =3D 4, e =3D 5, f =3D 6,
x=3D1, y=3D1:10), fac=3Dsample(LETTERS[4:6], 10, repl=3DTRUE))
for (j in seq(100000,1000000,10000)){
df2 <- data.frame(cbind(a =3D 1, b =3D 2, c =3D 3, d =3D 4, e =3D 5, f =3D
6, x=3D1, y=3D1:j), fac=3Dsample(LETTERS[1:3], j, repl=3DTRUE))
print(j)
df3 <- rbind(df2,df1)
}
sink()
which also stopped at 520000.
I tried to narrow down where the crash takes place but it would appear that it
is a moving feast, however both pieces of code always stopped with the same
number, somewhere around 520000.
> version
_ =20
platform i386-pc-mingw32
arch i386 =20
os mingw32 =20
system i386, mingw32 =20
status =20
major 2 =20
minor 2.0 =20
year 2005 =20
month 10 =20
day 06 =20
svn rev 35749 =20
language R=20
One of the examples that has failed for me looks like
pop <- rbind(om.tp[,c(6,2,4,5,3)],eas[,c(2,1,3,4,5)])
> str(om.tp[,c(6,2,4,5,3)])
`data.frame': 1001384 obs. of 5 variables:
$ age5 : Factor w/ 18 levels "0 to 4","5 to 9",..: 1 1 1 1
1 2 2 2 2 2 ...
$ sex : Factor w/ 2 levels "Females","Males": 1 1 1 1 1 1
1 1 1 1 ...
$ lga : Factor w/ 142 levels "Albany (C)","Armadale
(C)",..: 21 21 21 21 21 21 21 21 21 21 ...
$ count: num 7.33 7.45 7.05 6.31 5.71 ...
$ year : Factor w/ 41 levels "2001","2002",..: 1 1 1 1 1 1
1 1 1 1 ...> str(eas[,c(2,1,3,4,5)])
`data.frame': 25342 obs. of 5 variables:
$ age5 : Factor w/ 18 levels "0 to 4","5 to 9",..: 1 1 1 1
1 1 1 1 1 1 ...
$ sex : Factor w/ 2 levels "Females","Males": 2 2 2 2 2 2
2 2 2 2 ...
$ lga : Factor w/ 142 levels "Albany (C)","Armadale
(C)",..: 1 2 3 4 5 6 7 8 9 10 ...
$ count: num 1107 2163 532 294 479 ...
$ year : Factor w/ 5 levels "1991","1996",..: 1 1 1 1 1 1 1
1 1 1 ...> gc()
used (Mb) gc trigger (Mb) max used (Mb)
Ncells 3255820 87.0 6193578 165.4 5266303 140.7
Vcells 22096825 168.6 32770865 250.1 32114295 245.1
Tom Mulholland
Senior Demographer
Spatial Information and Research
State and Regional Policy
Department for Planning and Infrastructure
Perth, Western Australia
+61 (08) 9264 7936
ripley@stats.ox.ac.uk
2005-Oct-20 07:08 UTC
[Rd] Windows 2000 crash while using rbind (PR#8225)
This is a stack-size issue. Windows provides only a small stack by default (2Mb in R 2.2.0). Your example will work in R-patched (which has a 10Mb stack) and R-devel (which has 10Mb and some stack-checking). The non-technical summary is that you ran out of resources. Fortunately we have been working on that issue and have builds with more resources. Why this calculation is taking so much stack needs further investigation. On Thu, 20 Oct 2005 Tom.Mulholland at dpi.wa.gov.au wrote:> Windows 2000 reports that "Rgui.exe has generated errors and will be > closed by Windows. You will need to restart the program." when using > rbind.=20 > > > df1 <- data.frame(cbind(x=3D1, y=3D1:1000), fac=3Dsample(LETTERS[1:3], > 1000, repl=3DTRUE)) > df2 <- data.frame(cbind(x=3D1, y=3D1:10), fac=3Dsample(LETTERS[4:6], > 10, repl=3DTRUE)) > df3 <- data.frame(cbind(x=3D1, y=3D1:1000000), > fac=3Dsample(LETTERS[1:3], 1000000, repl=3DTRUE)) > df4 <- rbind(df1,df2) > df5 <- rbind(df2,df3) > =20 > =20 > Since this only happens intermittantly and appears to be related to the > size of the objects I ran the following code. > > sink("rbind test.txt") > df1 <- data.frame(cbind(x=3D1, y=3D1:10), fac=3Dsample(LETTERS[4:6], 10, > repl=3DTRUE)) > for (j in seq(100000,1000000,10000)){ > df2 <- data.frame(cbind(x=3D1, y=3D1:j), fac=3Dsample(LETTERS[1:3], j, > repl=3DTRUE)) > print(j) > df3 <- rbind(df2,df1) > } > sink() > > the output of rbind test.txt is > [1] 100000 > [1] 110000 > [1] 120000 > ... > [1] 510000 > [1] 520000 > > I then ran=20 > > > sink("rbind test 2.txt") > df1 <- data.frame(cbind(a =3D 1, b =3D 2, c =3D 3, d =3D 4, e =3D 5, f > =3D 6, x=3D1, y=3D1:10), fac=3Dsample(LETTERS[4:6], 10, repl=3DTRUE)) > for (j in seq(100000,1000000,10000)){ > df2 <- data.frame(cbind(a =3D 1, b =3D 2, c =3D 3, d =3D 4, e =3D 5, f > =3D 6, x=3D1, y=3D1:j), fac=3Dsample(LETTERS[1:3], j, repl=3DTRUE)) > print(j) > df3 <- rbind(df2,df1) > } > sink() > > which also stopped at 520000. > > I tried to narrow down where the crash takes place but it would appear > that it is a moving feast, however both pieces of code always stopped > with the same number, somewhere around 520000. > >> version > _ =20 > platform i386-pc-mingw32 > arch i386 =20 > os mingw32 =20 > system i386, mingw32 =20 > status =20 > major 2 =20 > minor 2.0 =20 > year 2005 =20 > month 10 =20 > day 06 =20 > svn rev 35749 =20 > language R=20 > > One of the examples that has failed for me looks like > pop <- rbind(om.tp[,c(6,2,4,5,3)],eas[,c(2,1,3,4,5)]) > > >> str(om.tp[,c(6,2,4,5,3)]) > `data.frame': 1001384 obs. of 5 variables: > $ age5 : Factor w/ 18 levels "0 to 4","5 to 9",..: 1 1 1 1 1 2 2 2 2 2 > ... > $ sex : Factor w/ 2 levels "Females","Males": 1 1 1 1 1 1 1 1 1 1 ... > $ lga : Factor w/ 142 levels "Albany (C)","Armadale (C)",..: 21 21 21 > 21 21 21 21 21 21 21 ... > $ count: num 7.33 7.45 7.05 6.31 5.71 ... > $ year : Factor w/ 41 levels "2001","2002",..: 1 1 1 1 1 1 1 1 1 1 ... >> str(eas[,c(2,1,3,4,5)]) > `data.frame': 25342 obs. of 5 variables: > $ age5 : Factor w/ 18 levels "0 to 4","5 to 9",..: 1 1 1 1 1 1 1 1 1 1 > ... > $ sex : Factor w/ 2 levels "Females","Males": 2 2 2 2 2 2 2 2 2 2 ... > $ lga : Factor w/ 142 levels "Albany (C)","Armadale (C)",..: 1 2 3 4 5 > 6 7 8 9 10 ... > $ count: num 1107 2163 532 294 479 ... > $ year : Factor w/ 5 levels "1991","1996",..: 1 1 1 1 1 1 1 1 1 1 ... >> gc() > used (Mb) gc trigger (Mb) max used (Mb) > Ncells 3255820 87.0 6193578 165.4 5266303 140.7 > Vcells 22096825 168.6 32770865 250.1 32114295 245.1 > > Tom Mulholland > Senior Demographer > Spatial Information and Research > State and Regional Policy > Department for Planning and Infrastructure > Perth, Western Australia > +61 (08) 9264 7936 > > ______________________________________________ > R-devel at r-project.org mailing list > https://stat.ethz.ch/mailman/listinfo/r-devel > >-- Brian D. Ripley, ripley at stats.ox.ac.uk Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/ University of Oxford, Tel: +44 1865 272861 (self) 1 South Parks Road, +44 1865 272866 (PA) Oxford OX1 3TG, UK Fax: +44 1865 272595
Apparently Analagous Threads
- Duplicate rows when I combine two data.frames with merge!
- Antwort: Re: R on Windows crashes when using certain (PR#14143)
- List of tables rather than an extra dimension in the table or (l)apply(xtabs)
- Bug in format.default(): na.encode does not have any effect for (PR#12318)
- Inverting a square... (PR#13762)