Santiago BeguerĂa PortuguĂ©s
2012-Jul-26 15:27 UTC
[R] snow apparently using only one CPU (on Mac OS X)
Hi,
I am trying to optimize a complex model calibration using a genetic algorithm. I
choose rgenoud package because it allows for easy parallelization through snow
package. I am on a Mac Pro with 2 x 2.66 GHz 6-Core Intel Xeon machine, i.e. I
have 12 CPUs available.
So I set the cluster options as:
setDefaultClusterOptions(rshcmd='echo ', user='> /dev/null',
master='localhost')
then I start a SOCK type cluster with:
cl <- makeCluster(rep(';',12), type='SOCK')
and then I use:
gnoud(..., cluster=cl)
Then when I check the activity of the CPUs I realize that 12 processes have
already started, but the CPU load of each process is extremely low (<4% most
of the time). If I use other cluster configurations (i.e., a different number of
CPUs) the CPU load per process increases inversely proportional to the number of
CPUs. I believe that snow is only using one CPU and sharing the computing time
within all the processes. Does anyone have the same experience with snow?
Cheers,
Santiago Beguer?a