Hello fellow R'ers, I have a simple calculation with a very large data set being generated (34.9 million values) on a somewhat unreliable XP box that will likely take ~ 74hrs. I wanted to know if there is a way to have my script automatically "save.image()" throughout the calculation in case of a crash. This could be on the basis of output generated or time elapsed. I checked the archive, and only got a hint of it from: https://stat.ethz.ch/pipermail/r-help/1997-May/001611.html Any quick suggestions would be greatly appreciated, John Morrow [[alternative HTML version deleted]]
On 8/11/2006 4:05 PM, John Morrow wrote:> Hello fellow R'ers, I have a simple calculation with a very large data set > being generated (34.9 million values) on a somewhat unreliable XP box that > will likely take ~ 74hrs. I wanted to know if there is a way to have my > script automatically "save.image()" throughout the calculation in case of a > crash. This could be on the basis of output generated or time elapsed. I > checked the archive, and only got a hint of it from: > https://stat.ethz.ch/pipermail/r-help/1997-May/001611.html > > > > Any quick suggestions would be greatly appreciated,I don't know of anything exactly as you describe. I'd recommend thinking about suitable restart points in the computation, and manually using save() or save.image() in your script. Duncan Murdoch
John Morrow a ?crit :> Hello fellow R'ers, I have a simple calculation with a very large data set > being generated (34.9 million values) on a somewhat unreliable XP box that > will likely take ~ 74hrs. I wanted to know if there is a way to have my > script automatically "save.image()" throughout the calculation in case of a > crash. This could be on the basis of output generated or time elapsed. I > checked the archive, and only got a hint of it from: > https://stat.ethz.ch/pipermail/r-help/1997-May/001611.html > Any quick suggestions would be greatly appreciated, > John Morrow# make a save every hour minutes = substr(date(),...); if (minutes=='00') save_my_stuff; hih
You could try something like: http://finzi.psych.upenn.edu/R/Rhelp02a/archive/0334.html replacing the time-stamp with save.image() or save(). Not sure how it works in BATCH though... HTH, Andy From: John Morrow> > Hello fellow R'ers, I have a simple calculation with a very > large data set being generated (34.9 million values) on a > somewhat unreliable XP box that will likely take ~ 74hrs. I > wanted to know if there is a way to have my script > automatically "save.image()" throughout the calculation in > case of a crash. This could be on the basis of output > generated or time elapsed. I checked the archive, and only > got a hint of it from: > https://stat.ethz.ch/pipermail/r-help/1997-May/001611.html > > > > Any quick suggestions would be greatly appreciated, > > > > John Morrow > > > > > [[alternative HTML version deleted]] > > ______________________________________________ > R-help at stat.math.ethz.ch mailing list > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide > http://www.R-project.org/posting-guide.html > and provide commented, minimal, self-contained, reproducible code. > >