similar to: how to setup parallel environment?

I see about 7 different R packages for multi-process parallel programming. Which do you think is the best, most complete, and most robust to pick for general purpose Erlang-style message-passing programming in R, and why? First here's my use case, and then my analysis so far. I often have code whose basic organization looks something like this: 1. Fetch step: For each date, gather up or

Thanks to Luke Tierney, Agustin Lobo, Stephen Eglen, A.J. Rossini, Simon Wood and Timothy H. Keitt for responding to my question about poor man's parallel processing. Much of the substantive material was cc'ed to r-help already, but my take is as follows. 1) Currently, there is nothing "simple" for solving my problem. 2) I thought that Timothy Keitt's description of the use

It turns out that my web host doesn't allow direct links. Try going to http://www.warnes.net/downloads or getting it from the sourceforge snippet library https://sourceforge.net/snippet/detail.php?type=snippet&id=101149. -Greg > -----Original Message----- > From: Warnes, Gregory R [mailto:gregory_r_warnes at groton.pfizer.com] > Sent: Monday, May 13, 2002 10:15 AM > To:

The package `snow' (Simple Network of Workstations), originally announced in early form about a year ago on this list, is now available from CRAN. Snow implements a simple mechanism for using a workstation cluster for ``embarrassingly parallel'' computations in R. The interface, which is based in part on the Python CoW (Cluster of Workstations; http://www.scipy.org/) package, is

We have published the 2003/1 issue of R News on http://cran.R-project.org/doc/Rnews where you can download the newsletter as PDF or Postscript file. It will propagate to the CRAN mirrors within a day or two. Contents of this issue: Name Space Management for R Converting Packages to S4 The genetics Package Variance Inflation Factors 13 Building Microsoft Windows Versions of R and R

We have published the 2003/1 issue of R News on http://cran.R-project.org/doc/Rnews where you can download the newsletter as PDF or Postscript file. It will propagate to the CRAN mirrors within a day or two. Contents of this issue: Name Space Management for R Converting Packages to S4 The genetics Package Variance Inflation Factors 13 Building Microsoft Windows Versions of R and R

All, We are researching approaches to parallel R with the end goal of running R in a distributed manner on a Linux cluster. We expect of course to do some work decomposing our problems to be task-parallel or data-parallel, but wouldn't mind getting an initial boost working with "embarrassingly parallel" code sections and one of the approaches below. Incidentally our environment

Dear Friends, I'm trying to learn to use parallel computation using snow & rpvm Now, I have two boxes: 1) Pentium 4, pvm 3.4.5, R 2.2.0 with FreeBSD 5.4 (box uffbsd); 2) PowerPC, pvm 3.4.5, R 2.1.1 with Debian Linux latest stable (box powerpclinux); I'm using the instructions in (found in snow.pdf) http://www.stat.uiowa. edu/~luke/R/cluster/cluster.html. Now ** from the box

I tried ot build rpvm in my own makefile. But runs into some linker errors like e.g. undefined reference to `_R_alloc' My enviornment looks like this: CYGWIN pvm 3.4 compiled under cygwin myself R installed from the rw2001.exe setup file. I guess that the R under rw2001.exe was build with some other compiler? I then tried to compile R myself under CYGWIN but runs into the following

Hi all, I'm trying to get the snow package with mpi working on my linux ubuntu 10.04 machine. When I tried to install it (see below) it already had problems with the dependencies. R version 2.14.0 (2011-10-31) Copyright (C) 2011 The R Foundation for Statistical Computing ISBN 3-900051-07-0 Platform: x86_64-pc-linux-gnu (64-bit) R is free software and comes with ABSOLUTELY NO WARRANTY. You

Dear R-help, Has anyone tried running R on a Beowulf-type cluster? I can get R to run in batch (using R CMD BATCH) on a cluster, but am wondering if it is possible to get an interactive R session on a compute node. Right now, if I run: beorun --nolocal R I just get the R start-up message and back to the shell prompt. If I try bpsh 0 R I can get R started (but the R prompt does not

Hi, does anybody know how to use the dual processors in the machines of a cluster? I am using R with rpvm and snow packages. I usually start pvm daemon and add host machines first, and then run R to start my computing work. But I find that only one processor in each machine is used in this way and the other one always stays idle. Is there any simple way to tell pvm to use the two processors at

Hi, I installed the snow package on a unix box that has multiple cores. To be able to exploit the multiple cores (on one pc) do I still need to install the rmpi package (or rpvm). Another question, if i run a bayesian simulation on the multiple core after setting them up correctly (using snow), would you think there will be a noticeable speedup gain. Thanks, Saeed --- linux centos 4 dual core

Dear R Users, Is there a version of rpvm available for windows ? I have recently had some problems with snow using SOCKS and was considering PVM as an alternative. Thanks in advance, Tolga Generally, this communication is for informational purposes only and it is not intended as an offer or solicitation for the purchase or sale of any financial instrument or as an official confirmation of

Hi, Our environment is: 2.6.9-55.0.9.EL_lustre.1.6.3smp I am getting following errors from two OSS''s ... Nov 7 10:39:51 storage09.beowulf.cluster kernel: LustreError: 23045:0:(client.c:519:ptlrpc_import_delay_req()) @@@ IMP_INVALID req at 00000100b410be00 x4190687/t0 o101->MGS at MGC10.143.245.201@tcp_0:26 lens 232/240 ref 1 fl Rpc:/0/0 rc 0/0 Nov 7 10:39:51

On 04/20/2011 08:05 AM, Andreas Wilhelm wrote: > Am 19.04.2011 um 16:44 schrieb John Criswell: > >> On 4/19/11 5:57 AM, Andreas Wilhelm wrote: >>> Hello, >>> >>> I found some code within the pool allocation project to identify >>> parallelizable function calls. >>> Unfortunately the functionality isn't part of the current release of

Hello, I found some code within the pool allocation project to identify parallelizable function calls. Unfortunately the functionality isn't part of the current release of poolalloc (in release 14 it was). My intention is to estimate the parallelization-potential of sequential applications concerning coarse-grained parallelism. Can you tell me... 1. Why are classes of pollalloc, like

On 4/19/11 5:57 AM, Andreas Wilhelm wrote: > Hello, > > I found some code within the pool allocation project to identify > parallelizable function calls. > Unfortunately the functionality isn't part of the current release of > poolalloc (in release 14 it was). Can you tell me in what file(s) this is implemented? I wasn't aware that the poolalloc project had such an

Am 19.04.2011 um 16:44 schrieb John Criswell: > On 4/19/11 5:57 AM, Andreas Wilhelm wrote: >> >> Hello, >> >> I found some code within the pool allocation project to identify parallelizable function calls. >> Unfortunately the functionality isn't part of the current release of poolalloc (in release 14 it was). > > Can you tell me in what file(s) this

Hello R enthusiasts, I am working with a Fedora Core 6 OS and R 2.5. I have just finished loading PVM on my test cluster and this is working properly. Also, rpvm has been loaded in R. However, when I try to load my test program, I receive this error: Loading required package: rpvm Error in dyn.load(x, as.logical(local), as.logical(now)) ; unable to load shared library