Displaying 20 results from an estimated 1100 matches similar to: "makeCluster() function in doSNOW package hangs"
2010 Dec 17
1
[R-sig-hpc] Error in makeMPIcluster(spec, ...): how to get a minimal example for parallel computing with doSNOW to run?
Shouldn't -n be 4 in the bsub command?
One master+3 slaves. This was required for snowfall, but I think doSNOW
is similar.
Hope it helps
mario
On 16-Dec-10 23:09, Marius Hofert wrote:
> Dear expeRts,
>
> I try to get a minimal example for parallel computing via "foreach" + "doSNOW" to run on a computer cluster (Brutus from
2011 Feb 25
1
Question about foreach (with doSNOW), is that a bug?
Hi all,
Within a foreach loop with doSNOW, we cant call functions which come from
the non-default package. We need to load(require/library) the package once
more within the foreach loop. Anyone knows why would happen like this? Is it
caused by the snow package and something happened when "snow" parallelize
the job?
Other than load the package once more with in the foreach loop, is
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
2019 Mar 27
0
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
The problem causing the stray worker processes when the master fails to
open a server socket to listen to connections from workers is not
related to timeout in socketConnection(), because socketConnection()
will fail right away. It is caused by a bug in checking the setup
timeout (PR 17391).
Fixed in 76275.
Best
Tomas
On 3/18/19 2:23 AM, Henrik Bengtsson wrote:
> (Bcc: CRAN)
>
>
2015 Feb 10
0
R CMD check: Uses the superseded package: ‘doSNOW’
The CRAN package snow is superseded by the parallel package which is
distributed with R since version 2.14.0. Here are the release notes
\item There is a new package \pkg{parallel}.
It incorporates (slightly revised) copies of packages
\CRANpkg{multicore} and \CRANpkg{snow} (excluding MPI, PVM and NWS
clusters). Code written to use the higher-level API functions in
those packages should
2015 Feb 09
2
R CMD check: Uses the superseded package: ‘doSNOW’
Dear list,
When I run an R CMD check --as-cran on my package (pROC) I get the
following note:
> Uses the superseded package: ?doSNOW?
The fact that it uses the doSNOW package is correct as I have the
following example in an .Rd file:
> #ifdef windows
> if (require(doSNOW)) {
> registerDoSNOW(cl <- makeCluster(2, type = "SOCK"))
> ci(roc2,
2015 Feb 10
1
R CMD check: Uses the superseded package: ‘doSNOW’
Oh, I completely missed that one.
It's very neat as it seems to work both on Windows and Unix.
Thanks!
Xavier
On 10/02/15 10:52, Martyn Plummer wrote:
> The CRAN package snow is superseded by the parallel package which is
> distributed with R since version 2.14.0. Here are the release notes
>
> \item There is a new package \pkg{parallel}.
>
> It incorporates (slightly
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
2019 Mar 18
2
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
(Bcc: CRAN)
This is a proposal helping CRAN and alike as well as individual
developers to avoid stray R processes being left behind that might be
produced when an example or a package test fails to set up a
parallel::makeCluster().
ISSUE
If a package test sets up a PSOCK cluster and then the master process
dies for one reason or the other, the PSOCK worker processes will
remain running for 30
2010 May 12
1
snow makeCluster (makeSOCKcluster) not working in R-2.11
Hello,
I was using snow to parallel-process some code in R-2.10 (32-bit
windows. ). The code is as follows:
require(foreach)
require(doSNOW)
cl <- makeCluster(6, type='SOCK')
registerDoSNOW(cl)
bl2 <- foreach(i=icount(length(unqmrno))) %dopar% {
(some code here)
}
stopCluster(cl)
When I run the same code in Windows R-2.11 (either 32-bit or 64-bit), R
hangs at
2019 Jun 05
0
MacOS parallel::makeCluster fails
Hi Dominik,
from the output, the master process could not "listen" on the port where
it expects a connection from the worker. We need to find out why. I'd
recommend first to create a minimal reproducible example (and one that
does not use future, only parallel, and a minimal number of threads,
ideally just 2). Then I'd recommend to check if the problem still exists
with
2019 Jul 12
1
MacOS parallel::makeCluster fails
Hi Thomas,
thanks for your reply (and thanks for your patience...).
I am now using the following minimal reprex:
> library(parallel)
> cl <- makeCluster(2L)
I freshly started the machine and did not open any other app. Just R.app (3.6.1).
After executing the second line of code, R seems to hang infinitely and does not respond.
The R process itself uses almost no CPU.
Unfortunately,
2013 Nov 06
0
MPICH2 Rmpi and doSNOW
Hi
I have managed to install MPICH2 and Rmpi on my Windows 7 machine. I can
also run the following code
> library(Rmpi)
> mpi.spawn.Rslaves()
4 slaves are spawned successfully. 0 failed.
master (rank 0, comm 1) of size 5 is running on: MyMaster
slave1 (rank 1, comm 1) of size 5 is running on: MyMaster
slave2 (rank 2, comm 1) of size 5 is running on: MyMaster
slave3
2013 Nov 06
0
MPICH2 Rmpi and doSNOW
Hi
I have managed to install MPICH2 and Rmpi on my Windows 7 machine. I can
also run the following code
> library(Rmpi)
> mpi.spawn.Rslaves()
4 slaves are spawned successfully. 0 failed.
master (rank 0, comm 1) of size 5 is running on: MyMaster
slave1 (rank 1, comm 1) of size 5 is running on: MyMaster
slave2 (rank 2, comm 1) of size 5 is running on: MyMaster
slave3 (rank 3, comm
2019 Jun 04
2
MacOS parallel::makeCluster fails
Hi all,
The call parallel::makeCluster(1L) hangs infinitely on my MacOS machine which seems to be already reported by some people (e.g., https://stat.ethz.ch/pipermail/r-devel/2018-February/075565.html).
However, the solutions posted on SO, GH or R-devel do not work in my case.
So far, I unsuccessfully tested ?
1. Couple of reboots
2. Adding 192.0.0.1 to /etc/hosts
3. Using R.app
2012 May 08
1
revolution foreach oddity
I know this is not a revolution support forum, but as anyone noticed the
following?
I have a foreach loop to generate random samples. If I run the exact code
below in normal r (2.14.1) it works as expected, but if I run it from
revolution 4.2.0 each loop returns the same numbers.
The only way I can get revolution to give different numbers is using 1
instead of 8 in
registerDoSNOW(makeCluster(8,
2012 Jul 24
1
untaring files in parallel with foreach and doSNOW?
Hello,
I'm running some code that requires untaring many files in the first step.
This takes a lot of time and I'd like to do this in parallel, if possible.
If it's the disk reading speed that is the bottleneck I guess I should not
expect an improvement, but perhaps it's the processor. So I want to try this
out.
I'm working on windows 7 with R 2.15.1 and the latest foreach
2011 Jan 14
0
Fwd: Re: [R-sig-hpc] Working doSNOW foreach openMPI example
Whas missing the R in the command line:
"mpirun -n --hostfile /home/hostfile R --no-save -f rtest.R"
Hope this helps
mario
On 13-Jan-11 22:08, Justin Moriarty wrote:
> Hi,
> Just wanted to share a working example of doSNOW and foreach for an openMPI cluster. The function eddcmp() is just an example and returns some inocuous warnings. The
2012 Dec 19
1
problem with opening more than one SOCK cluster with package snow
Dear list,
i have some problems using the snow package to create a SOCK cluster.
The errors just occour irregularly but it seems to me that they occour
when I try to create more than one cluster on the same machine via
different R instances started via submitting LSF jobs to a cluster. Does
anyone have an idea how to solve this or where to start digging for
solutions?
The error messages
2012 Sep 21
2
Parallel Programming
I am trying to do parallel programming and I tried this
library(doSNOW)
library(foreach)
testfunc<-function(x){
x<-x+1
x
}
noc<-2
cl <- makeCluster(do.call(rbind,rep(list("localhost"),noc)), type = "SOCK")
registerDoSNOW(cl)
clusterExport(cl=cl,c("testfunc.r"))
testl<-foreach(pp=1:2) %dopar% {
testfunc(pp)
}
And this works but if I try to
2012 Aug 08
1
random number generator with SNOW/ Parallel/ foreach
Dear All,
I have three classes of questions about generating random numbers with
different packages (windows xp 32bit R).
.
1. Suppose I would like to use package *foreach*, can I use current
Sys.time as a seed?
Although I can get the time up to1e-6 second precesion, the code below dose
not work well on a local machine with two cores. #################
library(foreach)
library(snow)
2011 Mar 13
1
R hangs when connected via VPN [incl. minimal example]
Dear expeRts,
This is a similar post as on R-SIG-MAC [I didn't receive an answer there; not sure if it was the right place to post either].
I'm running R version 2.12.1 (Platform: x86_64-apple-darwin9.8.0/x86_64 (64-bit))
on a MacBook Pro under Mac OS X 10.6.6. The following minimal example runs fine
under this setup. However, if I am connected to a server via a VPN client
[Cisco