Displaying 1 result from an estimated 1 matches for "hdf5samples".
2001 Mar 23
2
Memory problems, HDF5 library and R-1.2.2 garbage collection
Hello:
I've recently started using R to process data in HDF5 format. My files
come in 1.5MB chunks, but they can be as big as 50MB.
The problem I am facing with R-1.2.2 is that when I try to load 50 of
the 1.5MB HDF5 files (using the hdf5 library) in a loop, my Linux box
gets close to its memory limit around the file #15 (256MB RAM and
256MB swap). This happens even if I load file ->