search for: makeclust

Displaying 20 results from an estimated 158 matches for "makeclust".

Did you mean: makecluster
2018 Feb 10
2
makeCluster hangs
Hi all, I can't get the functionality of the package parallel to work. Specifically, makeCluster() hangs when I run it. I first noticed the problem when trying to run Rstan with multiple cores and the traced it back to the core package parallel. The following results in R hanging after the call to makeCluster. library(parallel) # Calculate the number of cores no_cores <- detectCores(...
2018 Feb 11
1
makeCluster hangs
...previously replicated the problem after several restarts of both R and the MacOS). I will follow-up if I can again replicate the problem. Florian On 2/10/18 4:39 PM, Henrik Bengtsson wrote: > A few quick comments: > > * You mention R --vanilla, but make sure to try with > parallel::makeCluster(), so that you don't happen to pick up > snow::makeCluster() if 'snow' is attached and ahead of parallel on the > search() path. > > * Try creating a single background worker, i.e. parallel::makeCluster(1L). > > * Try with cl <- future::makeClusterPSOCK(1L, verbos...
2018 Jun 14
2
makeCluster Stall on 32-bit Windows
Good day, I'm trying the example cl <- makeCluster(2, type = "SOCK") from the makeCluster documentation and the R command prompt never returns. I am using a 32-bit Windows 10 computer. The problem doesn't happen on another 64-bit Windows 10 computer but does happen on another 32-bit Windows 7 computer. Can anyone reproduce it? Are t...
2018 Feb 10
0
makeCluster hangs
A few quick comments: * You mention R --vanilla, but make sure to try with parallel::makeCluster(), so that you don't happen to pick up snow::makeCluster() if 'snow' is attached and ahead of parallel on the search() path. * Try creating a single background worker, i.e. parallel::makeCluster(1L). * Try with cl <- future::makeClusterPSOCK(1L, verbose = TRUE), which gives the s...
2012 Oct 04
1
(minor) R syntax error in help page to the function makeCluster of library(snow)
Dear list, I just realized that one of the examples given in the help page to the function makeCluster of the library(snow) has a small syntax error : ## to get started library(snow) ?makeCluster .. will open a halp page containing the command towards the end of the examples : cl <- makeCluster(c(rep(list(macOptions), 2), rep(list(lnxOptions), 2), rep(list(winOptions), 2...
2009 Dec 23
1
Help with makeClusters for Snow
...king a cluster, the only type of cluster I'm able to make is the "SOCK" (that too because I disabled the firewalls). For the rest (i.e. MPI, NWS, and PVM), I get error every time I try making one. I get the following errors ================================================= > cl = makeCluster(c("localhost", "localhost"), Type="MPI") Error in make.socket(serverHost, port) : socket not established > cl = makeCluster(c("localhost", "localhost"), Type="PVM") Error in make.socket(serverHost, port) : socket not established >...
2010 May 12
1
snow makeCluster (makeSOCKcluster) not working in R-2.11
Hello, I was using snow to parallel-process some code in R-2.10 (32-bit windows. ). The code is as follows: require(foreach) require(doSNOW) cl <- makeCluster(6, type='SOCK') registerDoSNOW(cl) bl2 <- foreach(i=icount(length(unqmrno))) %dopar% { (some code here) } stopCluster(cl) When I run the same code in Windows R-2.11 (either 32-bit or 64-bit), R hangs at cl<-makeCluster(6, type='SOCK') and no R processes are spawned. I was...
2018 Jun 14
0
makeCluster Stall on 32-bit Windows
Hi Dario, On 2018-06-14 14:00, Dario Strbenac wrote: > Good day, > > I'm trying the example cl <- makeCluster(2, type = "SOCK") Why use the 'snow' package and not 'parallel'? > from the makeCluster documentation and the R command prompt never > returns. I am using a 32-bit Windows 10 computer. The problem doesn't > happen on another 64-bit Windows 10 computer but...
2013 Sep 27
1
snow::makeCluster on Windows hangs
The command which hangs: I'm hoping there is a simple explanation, but I searched on-line and nothing jumped out. > cl <- makeCluster(type="SOCK",c("localhost"),manual=TRUE) Manually start worker on localhost with C:/PROGRA~1/R/R-214~1.2/bin/Rscript.exe "C:/Program Files/R/R-2.14.2/library/snow/RSOCKnode.R" MASTER=localhost PORT=11944 OUT=/dev/null SNOWLIB=C:/Program Files/R/R-2.14.2/library [...
2019 Mar 18
2
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
(Bcc: CRAN) This is a proposal helping CRAN and alike as well as individual developers to avoid stray R processes being left behind that might be produced when an example or a package test fails to set up a parallel::makeCluster(). ISSUE If a package test sets up a PSOCK cluster and then the master process dies for one reason or the other, the PSOCK worker processes will remain running for 30 days ('timeout') until they timeout and terminate that way. When this happens on CRAN servers, where many packages are...
2019 Mar 27
0
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
...t Tomas On 3/18/19 2:23 AM, Henrik Bengtsson wrote: > (Bcc: CRAN) > > This is a proposal helping CRAN and alike as well as individual > developers to avoid stray R processes being left behind that might be > produced when an example or a package test fails to set up a > parallel::makeCluster(). > > > ISSUE > > If a package test sets up a PSOCK cluster and then the master process > dies for one reason or the other, the PSOCK worker processes will > remain running for 30 days ('timeout') until they timeout and > terminate that way. When this happens on...
2009 Mar 26
1
Snow Parallel R: makeCluster with more nodes than available
Hi all, I would like to know what would happen if using snow I create a cluster of size 50, for example using makeCluster(50,type='SOCK') on a machine with 2 Cores and run a function. Does snow run 25 and 25 functions on each of my 2 "real" processors or it just run 50 functions in one processor ? Thanks.
2012 Jun 09
0
suppress output of makeCluster()
I'm trying to suppress the output of: makeCluster(detectCores()) and haven't had luck. So far, I've tried invisible, sink, and capture.output. Any ideas are appreciated. Thanks. -- View this message in context: http://r.789695.n4.nabble.com/suppress-output-of-makeCluster-tp4632904.html Sent from the R help mailing list archive at Nab...
2012 May 08
1
revolution foreach oddity
...I have a foreach loop to generate random samples. If I run the exact code below in normal r (2.14.1) it works as expected, but if I run it from revolution 4.2.0 each loop returns the same numbers. The only way I can get revolution to give different numbers is using 1 instead of 8 in registerDoSNOW(makeCluster(8, type = "SOCK")) but that seems to defeat the point. library(foreach) library(doSNOW) registerDoSNOW(makeCluster(8, type = "SOCK")) getDoParWorkers() getDoParName() getDoParVersion() mySamples <- foreach (jj = 1:4, .combine=cbind) %dopar% { return(sample(1:10,10...
2011 Dec 06
1
Vignette using parallel's makeCluster function has trouble building on Windows 7
...imal vignette (call it buggyVignette.Rnw): \documentclass[a4paper]{article} \title{Sweave Example 1} \author{Rich Calaway} \begin{document} \maketitle In this example I try to run code using library parallel in a vignette: <<>>= library(parallel) cl <- makeCluster(3) @ and find that I get an error. \end{document} I get the following error when I try to build the package: C:\Users\richcalaway\RforgeDev\doparallel>C:\R\R-2.14.0\bin\R CMD build pkg * checking for file 'pkg/DESCRIPTION' ... OK * preparing 'doParallel':...
2012 Aug 08
1
random number generator with SNOW/ Parallel/ foreach
...############# library(foreach) library(snow) library(doSNOW) testfun=function(){ options(digits.secs=6) set.seed(slave.seed <- substring(Sys.time(), 21, 26)) a <- rnorm(5,0,1) return(a) } maxkk <- 5 cl <- makeCluster(5, type = "SOCK") registerDoSNOW(cl) results=foreach (i = 1:maxkk, .combine = 'rbind') %dopar% testfun() results stopCluster(cl) ################# 2. Suppose I want to use *snow*, according to some reference, I need to use *rsprng* as a generator. Does this generator relay on s...
2008 Dec 15
1
newbie question on snow/Rmpi
I have a network of four machines set up. I'm having trouble spawning my slaves on these machines. All the examples I have found so far use makeCluster with type="MPI", and I guess I'm missing some kind of cluster configuration in my environment variables because all my clusters are formed on the machine where my initial session is running. Can anyone refer me to a link that illustrates how to set up the environment for MPI (listi...
2012 Jan 18
0
makeCluster() function in doSNOW package hangs
Dear R help, I am trying to set up a cluster for parallel computing on a machine running 64-bit windows XP, using the doSNOW package on R 2.14.1. However, the command makeCluster() consistently makes the computer hang. No R processes are started, no CPU consumed, R just becomes unresponsive. ESC still terminates the command, but I cannot start the cluster. There seems to be quite a lot of posts on R-help with this or a similar problem, but none of them are resolved. I h...
2013 Apr 18
1
snow: cluster initialization
Dear all, I found a strange thing with the snow package. This will work: y = matrix(1:4, 2) cl = makeCluster(rep('localhost', 8), type='SOCK') parMM(cl, y, y) This will not: y = matrix(1:4, 2) ncore = system('nproc') parMM(cl, y, y) Error in cut.default(i, breaks) : invalid number of intervals I also tried: cl = makeCluster(rep('localhost', ncore), type='SOCK')...
2012 Sep 21
2
Parallel Programming
I am trying to do parallel programming and I tried this library(doSNOW) library(foreach) testfunc<-function(x){ x<-x+1 x } noc<-2 cl <- makeCluster(do.call(rbind,rep(list("localhost"),noc)), type = "SOCK") registerDoSNOW(cl) clusterExport(cl=cl,c("testfunc.r")) testl<-foreach(pp=1:2) %dopar% { testfunc(pp) } And this works but if I try to enclose my commands inside a text file to be sourced it doesn't...