Displaying 2 results from an estimated 2 matches for "1273976io".
2015 Jan 15
4
Request to speed up save()
...one of my smaller datasets, having only
read in the raw data:
============
# Dumped an ascii image
save.image(file='test', ascii=TRUE)
# At the shell prompt:
ls -l test
-rw-rw-r--. 1 swmorris swmorris 1794473126 Jan 14 17:33 test
time bzip2 -9 test
364.702u 3.148s 6:14.01 98.3% 0+0k 48+1273976io 1pf+0w
time pbzip2 -9 test
422.080u 18.708s 0:11.49 3836.2% 0+0k 0+1274176io 0pf+0w
============
As you can see, bzip2 on its own took over 6 minutes whereas pbzip2 took
11 seconds, admittedly on a 64 core machine (running at 50% load). Most
modern machines are multicore so everyone would get s...
2015 Jan 15
0
Request to speed up save()
...aw data:
>
> ============
> # Dumped an ascii image
> save.image(file='test', ascii=TRUE)
>
> # At the shell prompt:
> ls -l test
> -rw-rw-r--. 1 swmorris swmorris 1794473126 Jan 14 17:33 test
>
> time bzip2 -9 test
> 364.702u 3.148s 6:14.01 98.3% 0+0k 48+1273976io 1pf+0w
>
> time pbzip2 -9 test
> 422.080u 18.708s 0:11.49 3836.2% 0+0k 0+1274176io 0pf+0w
> ============
>
> As you can see, bzip2 on its own took over 6 minutes whereas pbzip2 took 11 seconds, admittedly on a 64 core machine (running at 50% load). Most modern machines are multi...