similar to: Erlang-style message-passing in R: Rmpi, Snow, NetWorkSpaces, etc.

All, We are researching approaches to parallel R with the end goal of running R in a distributed manner on a Linux cluster. We expect of course to do some work decomposing our problems to be task-parallel or data-parallel, but wouldn't mind getting an initial boost working with "embarrassingly parallel" code sections and one of the approaches below. Incidentally our environment

OK, my journey to make lab machines automagically install & update all desirable R packages is nearing an end! The only question I have now is this: How can I control where the system prints the *.Rout file that is created automatically when the R batch program runs. In "man R" I don't find any information about it. When the cron job runs "R_installAll.sh" (see

I upgraded from Fedora Core 4 to Fedora Core 5 and I find a lot of previously installed packages won't run because shared libraries or other system things have changed "out from under" the installed R libraries. I do not know for sure if the R version now from Fedora-Extras (2.2.1) is exactly the same one I was using in FC4. I see problems in many packages. Example, Hmisc: unable

Dear All, I found Andy Liaw's suggestion about using a NUMA (instead of SMP) kernel when running R on amd64 with > 1 CPU http://finzi.psych.upenn.edu/R/Rhelp02a/archive/35109.html A couple of questions: 1. Is this still the case with the newer dual-core opterons (e.g., the 275 et al., families) running Linux (kernel 2.6)? 2. How does this affect using Rmpi (and snow, papply, et al.)

Hello, I have a question that I was wondering if anyone had a fairly straightforward answer to: what is the quickest and easiest way to take advantage of the extra cores / processors that are now commonplace on modern machines? And how do I do that in Windows? I realise that this is a complex question that is not answered easily, so let me refine it some more. The type of scripts that I'm

Hello, which possibilities are available in R for simultaneous or parallel computing? I only could find biopara (http://cran.r-project.org/src/contrib/Descriptions/biopara.html) Are there other possibilities? Are there special groups working on simultaneous computing with R? Thanks Markus -- Dipl.-Tech. Math. Markus Schmidberger Ludwig-Maximilians-Universit?t M?nchen IBE - Institut f?r

Hello, we are doing some computations with MPI and Rmpi. Therefore papply is a very comfortable function. Is it possible to reuse calculated data on slaves? We do some calculation with papply, then we have to do some overall calculation at the master then we want to do some calculation on the slaves with the old results and some new results from the master. We do not want to send all data

Hi, I have few high-level questions about the Snow and Rmpi packages . I understand that Snow uses Rmpi as one of possible transport layers, yet my questions about user experience, not technical details: 1. Does Snow install and work well in Windows? 2. Interruptibility. I understand that currently it is impossible to interrupt a running top-level command in Snow ( Ctl-c or the likes), the

Rmpi is not currently available on CRAN, and I don't think it has been for a few months. It is available at http://www.stats.uwo.ca/faculty/yu/Rmpi/ Does anyone know its current status? A few months ago I corresponded with the author, who noted some build problems (specifically on Debian) were the hang up, and seemed to be working on it. I wasn't able to get it to work then (on a

Dear R-dev, I would like to accelerate my R computation by using parallel OpenMP compilers (e.g from Pathscale) on a 2-processor AMD server and I would like to know whether R is a tread safe library. The main kernel of the OpenMP parallelization is a C SEXP function that performs the computational routine in parallel with: ******************* SEXP example(SEXP list, SEXP expr, SEXP rho) {

Hello, I'd like to take a look at how the taskPR package performs on our computational cluster, and this morning I've spend some time trying to do a test install of this package on one of our linux machines. Unfortunately I've been unsuccessful in completing the install, and I wondered if someone could please advise me. As I've noted I working on a linux machine, and it's

Dear all, I installed Rmpi (without error messages), but when I try to load the library in R I get the following error message: > library(Rmpi) Error in dyn.load(file, ...) : unable to load shared library '/Users/ebruch/Library/R/2.6/library/ Rmpi/libs/i386/Rmpi.so': dlopen(/Users/ebruch/Library/R/2.6/library/Rmpi/libs/i386/Rmpi.so, 6): Library not loaded:

Hi guys, I'm trying to install Rmpi on the slave nodes of my cluster. The installation seems to work with no errors or warnings using this command: R CMD INSTALL --configure-args="--with-Rmpi-include=/usr/lib64/openmpi/1.3.2-gcc/include --with-Rmpi-libpath=/usr/lib64/openmpi/1.3.2-gcc/lib --with-Rmpi-type=OPENMPI" Rmpi_0.5-8.tar.gz But when I attempt to load Rmpi I get the

After several trial and error attempts, I managed to install the Rmpi package without error on my Linux machine, running Fedora 5. I installed lam-7.1.2, lam-devel-7.1.2 and R-2.4.1, R-devel-2.4.1 The Package Rmpi_5.0-3.tar.gz, I installed once from within R and once from the command line to make sure, I link the right libraries: R CMD INSTALL Rmpi_5.0-3.tar.gz

I am running R 2.14.1 on a Windows XP (32 bit) system, and am trying to install the package 'Rmpi' to allow me to parallel process on all cores of a quad-core PC (and if that works well, I want to add extra slaves from a dual-core laptop). Rmpi appears to install OK (see below), but I am encountering the following error when I try and load the package: > utils:::menuInstallLocal()

Hello, I've installed R on my RHEL3 cluster and I am trying to get Rmpi to work properly. R is installed using the following ./configure --prefix=/home/apps/R-2.2.0 I installed snow using R CMD INSTALL /home/apps/snow And finaly Rmpi R CMD INSTALL /home/apps/Rmpi --configure-args=--with-mpi=/path/to/lam There were no errors or warnings upon installation. However when i perform the test

Dear R People: I am trying to put Rmpi with R-2.6.0 on an Ubuntu operating system. When I do the installation, all is well. But when I go into R and fire up the library, this is what I get: > library(Rmpi) Error in dyn.load(file, ...) : unable to load shared library '/home/cms/Desktop/R-2.6.0/library/Rmpi/libs/Rmpi.so': /home/cms/Desktop/R-2.6.0/library/Rmpi/libs/Rmpi.so:

Hello everybody, I am trying to install Rmpi on 64-bit HP-Proliant server. I am facing the following error: * Installing *source* package 'Rmpi' ... Try to find mpi.h ... Found in /usr/local/mpich-1.2.7p1/include Try to find libmpi or libmpich ... Found libmpich in /usr/local/mpich-1.2.7p1/lib Try to find liblam ... checking for main in -llam... no liblam not found. Probably not LAM-MPI

This is a rather obscure question, I realize. I have written to the package author but have not heard back as of yet. I have read the README in the package, as well, but it didn't give me enough detail to diagnose the problems that I am having. (I did edit out the LAM-MPI check in zzz.R.in.) I am working to install Rmpi on top of MPICH on a beowulf cluster. Below is the output of the

Hi team, I am beginning on R and I try to install Rmpi library and I have problems, I have installed LAM-MPI on Rocks; [rcnavarro at hpc-cip ~]$ laminfo LAM/MPI: 7.1.1 Prefix: /opt/lam/gnu Architecture: x86_64-unknown-linux-gnu Configured by: root Configured on: Wed Oct 19 18:12:25 EDT 2005 Configure host: rocks-156.sdsc.edu Memory