Displaying 1 result from an estimated 1 matches for "marraydata".
Did you mean:
array_data
2008 Nov 30
2
Snow and multi-processing
...n the list, the 500,000 line by x column matrix had to be shipped along with the item in the list and the traffic time was actually longer than the computing time.
However, if I export the 500,000 object first across the spawned processes as in this mock script
cl <- makeCluster(nnodes,method)
mArrayData <- getData(experiments)
clusterExport(cl, 'mArrayData')
Results <- parLapply(cl, theMapList, function(x) t.testFnc(x))
With a function that define the mArrayData argument as a default parameter as in
t.testFnc <- function(probeList, array=mArrayData){
x <- array[probeList...