Displaying 1 result from an estimated 1 matches for "r1129".
Did you mean:
1129
2014 Mar 15
0
allocation error and high CPU usage from kworker and migration: memory fragmentation?
...rker task is from R trying to
re-arrange things in memory to make space for my large objects.
2 machines:
- 128 and 256 GiB RAM,
- dual processor Xeons (16 cores + hyperthreading, 32 total 'cores'),
- Ubuntu 13.10 and 13.04 (both 64 bit),
- R 3.0.2,
- data.table 1.8.11 (svn r1129).*
Data: We have main fact tables stored in about 1000 R data files that
range up to 3 GiB in size on disk; so up to like 50 GiB in RAM.
Questions:
- Why is R skipping around cores so much? I've never seen that happen
before with other R scripts or with other statistical software. Is it...