similar to: Viable Approach to Parallel R?

Displaying 20 results from an estimated 700 matches similar to: "Viable Approach to Parallel R?"

2008 Sep 04
1
Erlang-style message-passing in R: Rmpi, Snow, NetWorkSpaces, etc.
I see about 7 different R packages for multi-process parallel programming. Which do you think is the best, most complete, and most robust to pick for general purpose Erlang-style message-passing programming in R, and why? First here's my use case, and then my analysis so far. I often have code whose basic organization looks something like this: 1. Fetch step: For each date, gather up or
2005 Sep 01
1
controlling where *.Rout gets printed. Possible?
OK, my journey to make lab machines automagically install & update all desirable R packages is nearing an end! The only question I have now is this: How can I control where the system prints the *.Rout file that is created automatically when the R batch program runs. In "man R" I don't find any information about it. When the cron job runs "R_installAll.sh" (see
2010 Oct 29
1
NetWorkSpace from REvolution; Distributed Computing setup questions
***Summary:*** I'm setting up a cluster using netWorkSpace, and I'm having issues with the sleigh initialization. My R function to initialize the sleigh succeeds and the sleigh appears to be ready, but I get apparently conflicting information from "status(s)", "rankCount(s)", and "s"; and basic sleigh functions cause the sleigh to hang indefinitely. Also,
2007 Apr 12
1
taskPR
Hello I tried to load the taskPR-package in R, but it doesn't work at all. Everytime I try /library("taskPR")/, I get the error-message: Error in dyn.load(x, as.logical(local), as.logical(now)) : unable to load shared library '/home/bw135690/R-2.4.1/library/taskPR/libs/taskPR.so': /home/bw135690/R-2.4.1/library/taskPR/libs/taskPR.so: cannot open shared object
2006 Mar 21
1
build R on windows
Hi, I'm not sure if this question has been answered before, but when I execute command "Rcmd INSTALL --build nws" to build an R package on Windows, the build process got stucked on the save image step. Here is the snapshot of the build process, --- Making package nws ---- adding build stamp to DESCRIPTION installing NAMESPACE file and metadata installing R files
2007 Dec 05
1
Help installing taskPR
Hello, I'd like to take a look at how the taskPR package performs on our computational cluster, and this morning I've spend some time trying to do a test install of this package on one of our linux machines. Unfortunately I've been unsuccessful in completing the install, and I wondered if someone could please advise me. As I've noted I working on a linux machine, and it's
2011 May 17
1
simprof test using jaccard distance
Dear All, I would like to use the simprof function (clustsig package) but the available distances do not include Jaccard distance, which is the most appropriate for pres/abs community data. Here is the core of the function: > simprof function (data, num.expected = 1000, num.simulated = 999, method.cluster = "average", method.distance = "euclidean", method.transform =
2005 Dec 14
3
package for factor analysis
I have Windows XP Professional Version 2002 and the R-Version 2.1.1. I want to do factor analysis with R. In Google Search I find the reference to the RScaLAPACK-Package, but my R-Version 2.1.1. told me that "RScaLAPACK is invalid package, bevor 2.0.0. installed" . Which package can I take for factor analysis? [[alternative HTML version deleted]]
2009 Jul 01
1
RScaLAPACK package with OpenMPI
Hi all, I'm using RScalapack library for parallelizing some heavy matrix operations required by MCMC methods for spatio-temporal models. The package reference manuals (dated 2005) states that the library needs LamMPI to work but we have a Linux Cluster with OpenMPI. We have found (http://cvs.fedoraproject.org/viewvc/devel/R-RScaLAPACK/) a patch for OpenMPI but we are wondering if in the
2008 Mar 10
1
caretNWS and training data set sizes
Hi, I am using the caretNWS package to train some supervised regression models (gbm, lasso, random forest and mars). The problem I have encountered started when my training data set increased in the number of predictors and the number of observations. The training data set has 347 numeric columns. The problem I have is when there are more then 2500 observations the 5 sleigh objects start but do
2005 Nov 07
3
R thread safe
Dear R-dev, I would like to accelerate my R computation by using parallel OpenMP compilers (e.g from Pathscale) on a 2-processor AMD server and I would like to know whether R is a tread safe library. The main kernel of the OpenMP parallelization is a C SEXP function that performs the computational routine in parallel with: ******************* SEXP example(SEXP list, SEXP expr, SEXP rho) {
2009 Jun 07
1
Inf in nnet final value for validation data
Hi, I use nnet for my classification problem and have a problem concerning the calculation of the final value for my validation data.(nnet only calculates the final value for the training data). I made my own final value formula (for the training data I get the same value as nnet): # prob-matrix pmatrix <- cat*fittedValues tmp <- rowSums(pmatrix) # -log likelihood
2001 Nov 05
1
Why doesn't outer work?
Hello I'm a population ecologist and use R for all my stats and modelling. Recently I have been using R to numerically solve integral projection models. This involves constructing several large matrices. The current code by Easterling (Size-specific sensitivity: Applying a new structured population model. Ecology, 2000, 81, 694-708) uses nested loops to construct the matrices. To speed up the
2008 Feb 15
2
help on using try() to catch an error
Dear R Users, I have the following glm, which I am running several times in a loop (I am not including the full code): reduced_model <- NULL; full_model <- NULL; reduced_model <- try(glm.fit(X4,n,family=poisson(link="log"))) full_model <- try(glm.fit(X5,n,family=poisson(link="log"))); On some occasions, an error is produced, which is why I have attempted to work
2008 Jan 25
1
increasing speed for permutations of glm
Dear R Programmers, I am trying to run a Poisson regression on all pairs of variables in a data set and obtain the permutation distribution. The number of pairs is around 100000. It seems my code will take weeks to run, unless I try something else. Could you give me any suggestions on how to improve the speed of the code below, or any general suggestions on how I may accomplish this task. Thanks
2010 Jun 15
2
Integration problem: error in invoking an outside function
Dear all, Currently I am trying to integrate a function which depends on four variables, two of which are given, one is given in the integrate function, so there is one variable to integrate on. The code is as follows: Pmatrix = function(th) { P = matrix(nrow=6, ncol=6, data=0) P[1,1] = P[2,1]=P[3,2]=P[4,3]=P[5,4]=P[6,5]= exp(-th) P[,6] = 1-exp(-th) return(P)} lim.verd =
2007 Mar 05
0
Help on installing RScaLAPACK on Ubuntu
I try to install RScaLAPACK on Ubuntu 6.10 and LAM 7.0.x Does anybody know a useful link top some how-to site about RScaLAPACK. Now I manage to get the package compiling, but the linker shows me lots of unsolved references: sudo R CMD INSTALL RScaLAPACK_0.5.1.tar.gz --configure-args="--with-mpi=/usr/lib/lam": * Installing *source* package 'RScaLAPACK' ... configure:
2009 Feb 07
3
New package test results available
We've added a column at http://cran.r-project.org/web/checks/check_summary.html of test results using the Sun Studio compiler: it is intended that these will be updated weekly. The Sun Studio compiler is that used on Solaris: these runs were on the Linux version. All the other platforms are using gcc 4, so this provides an opportunity for checking for use of gcc-specific features and
2008 Feb 25
1
Parallel R for dummies (on hpc)
Hi, I had access to an hpc cluster, and wanted to parallelize some of my R code. I looked at the snow,nws, rscalapack documentation but was unable to make out how I should submit my job to the hpc, and how I should code a simple program. For example, if I had 10 matrices, and 10 processor how should I write the R (and the hpc submit code) so that I run the calculations (e.g. rowsums) for each
2009 Aug 30
1
Combining: R + Condor in 2009 ? (+foreach maybe?)
Hello dear R-help group (and David Smith from REvolution), I would like to perform parallel computing using R with Condor (hopefully using foreach or other recommended solutions, if available) for some "Embarrassingly parallel" problem. I will start by listing what I found so far, and then go on asking for help. So far I found the a manual by Xianhong Xie from Rnews_2005-2 (see page