similar to: Help with makeClusters for Snow

(Posted also to debian-user) In my office network I have access to a debian powerpc server and 2 freebsd 6 servers (actually one of them is my notebook). Experienced user of the statistical software R, I have now a go at parallel computation via (r-)pvm and snow under R to enhance the performance of a heavy duty statistical problem involving many iteration on the calculation of models. I moved

Dear Friends, I'm trying to learn to use parallel computation using snow & rpvm Now, I have two boxes: 1) Pentium 4, pvm 3.4.5, R 2.2.0 with FreeBSD 5.4 (box uffbsd); 2) PowerPC, pvm 3.4.5, R 2.1.1 with Debian Linux latest stable (box powerpclinux); I'm using the instructions in (found in snow.pdf) http://www.stat.uiowa. edu/~luke/R/cluster/cluster.html. Now ** from the box

Caveat: I've only played with this a couple of years ago... I believe you can just add each host _twice_ (or as many times as the number of CPUs at that host) to get both CPUs to work. Andy From: Paul Y. Peng > > Hi, > > does anybody know how to use the dual processors in the > machines of a cluster? I am using R with rpvm and snow > packages. I usually start pvm

hello, I'm using R 1.8.1 with the lastest snow package on FreeBSD 4.9. However, when I try to using socket clusters, it's very unstable. Sometimes it dies half way when I run parSapply(), sometimes it dies when cluster connection is idle. I create a socket cluster by following cmd cl = makeCluster("foo", type = "SOCK", outfile="/tmp/rafanlog");

Oh, I completely missed that one. It's very neat as it seems to work both on Windows and Unix. Thanks! Xavier On 10/02/15 10:52, Martyn Plummer wrote: > The CRAN package snow is superseded by the parallel package which is > distributed with R since version 2.14.0. Here are the release notes > > \item There is a new package \pkg{parallel}. > > It incorporates (slightly

Hi, does anybody know how to use the dual processors in the machines of a cluster? I am using R with rpvm and snow packages. I usually start pvm daemon and add host machines first, and then run R to start my computing work. But I find that only one processor in each machine is used in this way and the other one always stays idle. Is there any simple way to tell pvm to use the two processors at

I see about 7 different R packages for multi-process parallel programming. Which do you think is the best, most complete, and most robust to pick for general purpose Erlang-style message-passing programming in R, and why? First here's my use case, and then my analysis so far. I often have code whose basic organization looks something like this: 1. Fetch step: For each date, gather up or

The CRAN package snow is superseded by the parallel package which is distributed with R since version 2.14.0. Here are the release notes \item There is a new package \pkg{parallel}. It incorporates (slightly revised) copies of packages \CRANpkg{multicore} and \CRANpkg{snow} (excluding MPI, PVM and NWS clusters). Code written to use the higher-level API functions in those packages should

Hi, I am using caretNWS on a RHEL x86_64 system and I am getting an error message that is nearly identical to the one occuring in http://www.r-project.org/nosvn/R.check/r-release-macosx-ix86/caretNWS-00check.txt Error in socketConnection(serverHost, port = port, open = "a+b", blocking = TRUE) : unable to open connection Calls: system.time ... .local -> tryCatch -> tryCatchList

When trying to create (a very simple) cluster using makeSOCKcluster or makeCluster I get the following error message: > library(snow) > cl <- makeSOCKcluster("localhost") Fatal error: kann Datei '~/R/i686-suse-linux-gnu-library/2.8/snow/RSOCKnode.R' nicht ?ffnen: Datei oder Verzeichnis nicht gefunden (translation: could not open file [...]: File or directory not

Thanks to Luke Tiernay and some experimenting I found out some issues. I don't claim this infomation is complete, but it may be helpful for anyone experimenting with SNOW on Linux: - environment variables PATH and R_SNOW_LIB need to be set on master and slaves. (manually or permanent in ~/.bashrc (adjust your pathnames accordingly). Don't use ~ for home directory, instead specify

Dear list, I just realized that one of the examples given in the help page to the function makeCluster of the library(snow) has a small syntax error : ## to get started library(snow) ?makeCluster .. will open a halp page containing the command towards the end of the examples : cl <- makeCluster(c(rep(list(macOptions), 2), rep(list(lnxOptions), 2), rep(list(winOptions),

Hello, I was using snow to parallel-process some code in R-2.10 (32-bit windows. ). The code is as follows: require(foreach) require(doSNOW) cl <- makeCluster(6, type='SOCK') registerDoSNOW(cl) bl2 <- foreach(i=icount(length(unqmrno))) %dopar% { (some code here) } stopCluster(cl) When I run the same code in Windows R-2.11 (either 32-bit or 64-bit), R hangs at

Dear list, When I run an R CMD check --as-cran on my package (pROC) I get the following note: > Uses the superseded package: ?doSNOW? The fact that it uses the doSNOW package is correct as I have the following example in an .Rd file: > #ifdef windows > if (require(doSNOW)) { > registerDoSNOW(cl <- makeCluster(2, type = "SOCK")) > ci(roc2,

The command which hangs: I'm hoping there is a simple explanation, but I searched on-line and nothing jumped out. > cl <- makeCluster(type="SOCK",c("localhost"),manual=TRUE) Manually start worker on localhost with C:/PROGRA~1/R/R-214~1.2/bin/Rscript.exe "C:/Program Files/R/R-2.14.2/library/snow/RSOCKnode.R" MASTER=localhost PORT=11944 OUT=/dev/null

Hi all, I would like to know what would happen if using snow I create a cluster of size 50, for example using makeCluster(50,type='SOCK') on a machine with 2 Cores and run a function. Does snow run 25 and 25 functions on each of my 2 "real" processors or it just run 50 functions in one processor ? Thanks.

Hello All, I can run the "lower level" functions OK, but many of the higher level (eg. parSApply) functions are generating errors. When running the example (from the snow help docs) for parApply on MacOSX 10.5.5, I get the following error: cl <- makeSOCKcluster(c("localhost","localhost")) sum(parApply(cl, matrix(1:100,10), 1, sum)) Error in

At office, using the internal LAN at my disposal, I'm having a go at parallel computing - to begin with - with pvm, rpvm & snow. The two boxes are as follows Remote machine uffbsd: CPU: Intel(R) Pentium(R) 4 CPU 2.00GHz (1994.13-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf24 Stepping = 4 real memory = 260046848 (248 MB) This machine NbBSD: CPU: Mobile Intel(R)

Hi, I am trying to (live-)migrate a paravirtualized machine from hosta to hostb: -----8<---- hosta:~ # xm list pvm Name ID Mem VCPUs State Time(s) pvm 64 384 1 -b---- 0.5 hostb:~ # xm list pvm Error: Domain ''pvm'' does not exist. hosta:~ # xm migrate pvm 192.168.0.2 Error:

I have a network of four machines set up. I'm having trouble spawning my slaves on these machines. All the examples I have found so far use makeCluster with type="MPI", and I guess I'm missing some kind of cluster configuration in my environment variables because all my clusters are formed on the machine where my initial session is running. Can anyone refer me to a link that