similar to: rmpi vs snow - which one is better from communication overhead point of view

Hello, I try to write parts of my code in C to accelerate the for-loops. But basic operations I want to do in R (e.g. start cluster). My R code looks something like this: library(Rmpi) mpi.spawn.Rslaves() mpi.remote.exec(....) dyn.load("test.so") erg <- .Call("test", ....) .... mpi.close.Rslaves() mpi.quit() And my C function looks something like this: #include

Hi all, now I'm testing R in a "virtual cluster", made it with VirtualBox. This one has 3 nodes, running CentOS 5 and OpenMPI 1.2.8, and the principal node (called "server") exports the /home to other nodes. I have installed R and OpenMPI in /home, in fact, it seems work OK. Editing the openmpi-default-hostfile and run "mpirun -np 3 hostname" I can see the

Has anybody tried to use Rmpi with the OpenMPI library instead of LAM/MPI? LAM appears to be somewhat hardcoded in the Rmpi setup. Before I start to experiment with changing this, has anybody else tried Rmpi with non-LAM MPI implementations? Dirk -- Hell, there are no rules here - we're trying to accomplish something. -- Thomas A. Edison

Hi, I have few high-level questions about the Snow and Rmpi packages . I understand that Snow uses Rmpi as one of possible transport layers, yet my questions about user experience, not technical details: 1. Does Snow install and work well in Windows? 2. Interruptibility. I understand that currently it is impossible to interrupt a running top-level command in Snow ( Ctl-c or the likes), the

A new version of the 'snow' package for parallel computing in R is available at http://www.stat.uiowa.edu/~luke/R/cluster/snow_0.3-3.tar.gz This substantially revises the way in which worker processes are started to allow snow to be used on Windows and Mac/Windows/Linux combinations. I have successfully used the SOCK version on a standalone Windows machine and combinations of

Dear R People: I am having some trouble with the snow package. It requires MPICH2 and Rmpi. Rmpi is fine. However, I downloaded the MPICH2 package, and installed. There is no mpicc, mpirun, etc. Does anyone have any suggestions, please? Thanks in advance! Sincerely, Erin Hodgess Associate Professor Department of Computer and Mathematical Sciences University of Houston - Downtown mailto:

Hi, I am using a cluster with LAM 7.1.3/MPI 2 and R 2.6.0. Rmpi version 0.5-5 is working very well. Now I have tested "Rmpi 0.5-6". During spawning the Rslaves I get an error: MPI_Error_string: error spawning process > sessionInfo() R version 2.6.0 (2007-10-03) x86_64-unknown-linux-gnu locale:

Hi, I'm testing affyPara on Debian lenny with R 2.7 from unstable, and the corresponding bioconductor packages from bioconductor.org downloaded using biocLite as per usual. The command cl = makeMPIcluster(k) succeeds, but spawns k R slaves which promptly soak up all available CPU, which is odd since they are not doing anything yet. This looks like a bug to me. Similar behaviour is shown

I have a network of four machines set up. I'm having trouble spawning my slaves on these machines. All the examples I have found so far use makeCluster with type="MPI", and I guess I'm missing some kind of cluster configuration in my environment variables because all my clusters are formed on the machine where my initial session is running. Can anyone refer me to a link that

Hi, I'm testing the efficiency of the Rmpi package regarding parallelization using a cluster. I've found and tried the task pull programming method, but even if it is described as the best method, it seems to cause deadlock, anyone could help me in using this method? here is the code I've found and tried: # Initialize MPI library("Rmpi") # Notice we just say "give us

Hello, the package snow is not working on a windows cluster with MPICH2 and Rmpi. There is an error in makeCluster: launch failed: CreateProcess(/usr/bin/env "RPROG="C:\Programme\R\R-2.5.1\bin\R" "OUT=/dev/null" "R_LIBS=" C:/Programme/R/R-2.5.1/library/snow/RMPInode.sh) on 'cl1' failed, error 3 - Das System kann den angegbenen Pfad nicht finden. I

Hello everyone, I've been fiddling around with the snow and Rmpi packages on my new Intel Mac, and have run into a few problems. When I make a cluster on my machine, both slaves start up just fine, and everything works as expected. When I try to make a cluster including another networked machine it hangs. I've followed the suggestions at

Dear R Users, I am attempting to use the snow package for clustering. Is there a way to identfy, in the environment of each node, a rank for that node and also, the total size of the cluster ? By way of analogy, I am looking for the functions in snow equivalent to mpi.comm.rank() and mpi.comm.size() from RMPI, in case that makes things clearer. Thanks in advance, Tolga Generally, this

Hello, I've installed R on my RHEL3 cluster and I am trying to get Rmpi to work properly. R is installed using the following ./configure --prefix=/home/apps/R-2.2.0 I installed snow using R CMD INSTALL /home/apps/snow And finaly Rmpi R CMD INSTALL /home/apps/Rmpi --configure-args=--with-mpi=/path/to/lam There were no errors or warnings upon installation. However when i perform the test

After several trial and error attempts, I managed to install the Rmpi package without error on my Linux machine, running Fedora 5. I installed lam-7.1.2, lam-devel-7.1.2 and R-2.4.1, R-devel-2.4.1 The Package Rmpi_5.0-3.tar.gz, I installed once from within R and once from the command line to make sure, I link the right libraries: R CMD INSTALL Rmpi_5.0-3.tar.gz

I am running R 2.14.1 on a Windows XP (32 bit) system, and am trying to install the package 'Rmpi' to allow me to parallel process on all cores of a quad-core PC (and if that works well, I want to add extra slaves from a dual-core laptop). Rmpi appears to install OK (see below), but I am encountering the following error when I try and load the package: > utils:::menuInstallLocal()

Hello everybody, I am trying to install Rmpi on 64-bit HP-Proliant server. I am facing the following error: * Installing *source* package 'Rmpi' ... Try to find mpi.h ... Found in /usr/local/mpich-1.2.7p1/include Try to find libmpi or libmpich ... Found libmpich in /usr/local/mpich-1.2.7p1/lib Try to find liblam ... checking for main in -llam... no liblam not found. Probably not LAM-MPI

Hi Folks, I've recently transitioned to Debian 8.0 and was having a hard time getting Rmpi to work. I believed I'd successfully installed dependencies via > sudo apt-get install r-cran-rmpi > apt-show-versions r-cran-rmpi r-cran-rmpi:amd64/jessie 0.6-5-1 uptodate but when installing the package I was still getting checking mpi.h presence... no checking for mpi.h... no

I try to install Rmpi as root with install.packages("Rmpi"). It fails with: ... checking for x86_64-pc-linux-gnu-gcc -std=gnu99 option to accept ISO C89... none needed I am here /usr and it is OpenMPI Trying to find mpi.h ... Found in /usr/include Trying to find libmpi.so or libmpich.a ... Found libmpi in /usr/lib checking for openpty in -lutil... yes checking for main in -lpthread...

I'm just curious if anyone else has had problems with this configuration. I added the CRAN repository to apt and installed 2.5.0 with apt-get. I then did an install.packages("Rmpi") on cluster nodes. Rmpi loads and lamhosts() shows the nodes, but mpi.spawn.Rslaves() fails (something to do with temp files?). Rmpi works fine with the Edgy-native version of R (2.3.x) and installing