Displaying 20 results from an estimated 2000 matches similar to: "makeSOCKcluster"
2006 Sep 01
2
makeSOCKcluster
Hi,
I am a newbie to R and trying to implement parallelism in R. I am currently using R-2.3.1, and Cygwin to run R on Windows xp.
ssh and all are working fine,
When I try to create a socket connection as
makeSOCKcluster(c("localhost","localhost")),
it just waits for the other prcess on localhost to get created and respond. But this other process is
2012 Dec 19
1
problem with opening more than one SOCK cluster with package snow
Dear list,
i have some problems using the snow package to create a SOCK cluster.
The errors just occour irregularly but it seems to me that they occour
when I try to create more than one cluster on the same machine via
different R instances started via submitting LSF jobs to a cluster. Does
anyone have an idea how to solve this or where to start digging for
solutions?
The error messages
2009 Apr 09
0
Connecting to "heterogenous" cluster using makeSOCKcluster of SNOW-package
When trying to create (a very simple) cluster using makeSOCKcluster or
makeCluster I get the following error message:
> library(snow)
> cl <- makeSOCKcluster("localhost")
Fatal error: kann Datei
'~/R/i686-suse-linux-gnu-library/2.8/snow/RSOCKnode.R' nicht ?ffnen: Datei
oder Verzeichnis nicht gefunden
(translation: could not open file [...]: File or directory not
2006 Aug 25
2
increasing the # of socket connections
Dear "R-help"ers,
using snow on socket connections, I ran into the following error
> cl <- makeSOCKcluster(hosts)
Error in socketConnection(port = port, server = TRUE,
blocking = TRUE : all connections are in use
with "showConnections(all=T)" showing 50 open connections.
As - for administrative reasons - I would prefer to use snow's
SOCK capabilities (instead
2011 Nov 22
0
snow package, socketConnection error, SSH, in Windows 7 x64
Hi. I have some problems trying to make cluster via "snow" package and
haven't found a solution for my problem in archives and relative topics.
I installed ssh server using cygwin and set a password-less SSH Login.
In R session after starting ssh service:
> system("ssh 10.10.5.15 date")
Tue Nov 22 16:22:36 AST 2011
But when I make connection:
> con <-
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
2019 Mar 18
2
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
(Bcc: CRAN)
This is a proposal helping CRAN and alike as well as individual
developers to avoid stray R processes being left behind that might be
produced when an example or a package test fails to set up a
parallel::makeCluster().
ISSUE
If a package test sets up a PSOCK cluster and then the master process
dies for one reason or the other, the PSOCK worker processes will
remain running for 30
2010 Sep 07
1
Problems in snow: can't open connection with nodes
I'm working with snow and created a local cluster. So far, the same code has
always worked (please see below). However, now I receive a message that the
connection with the nodes cannot be opened. I restarted my workstation but
that didn't help. Is there a known solution for this problem? Thanks a lot
for any help.
bram foubert
library(snow)
cl =
2013 Aug 02
1
segfault and RunSnowWorker: not found
Hi,
While I suspect that this is an issue peculiar to my machine (Debian squeeze amd64, R version 3.0.1, up-to-date packages), I'm hoping that somebody on this list may be able to give me suggestions on how to troubleshoot and fix the following:
> library (snow)
> cl <- makeSOCKcluster(c("localhost","localhost"))
sh: 1: RunSnowWorker: not found
I presume/hope
2008 Oct 22
1
torque/psb & snow library
Hello all;
I'm trying to execute parallel jobs trough library snow on a cluster built
through torque/PSB. I'm succesfully obtaining the cluster with:
>system("cat $PBS_NODEFILE > cluster.txt")
>mycluster <- scan(file="cluster.txt",what="character")
>cl <- makeSOCKcluster(mycluster)
The only problem, at the moment, is that if I use
2009 Jan 09
1
snow and different R versions
Dear Luke and others,
I have many R versions on my machine and want to start a particular
one when snow builds its cluster. (The same version I start snow
from.) It seems that everything is set up correctly in
defaultClusterOptions:
> mget(ls(defaultClusterOptions), defaultClusterOptions)
$homogeneous
[1] TRUE
$manual
[1] FALSE
$master
nodename
"maya.unil.ch"
$outfile
[1]
2013 Sep 27
1
snow::makeCluster on Windows hangs
The command which hangs:
I'm hoping there is a simple explanation, but I searched on-line and
nothing jumped out.
> cl <- makeCluster(type="SOCK",c("localhost"),manual=TRUE)
Manually start worker on localhost with
C:/PROGRA~1/R/R-214~1.2/bin/Rscript.exe "C:/Program
Files/R/R-2.14.2/library/snow/RSOCKnode.R" MASTER=localhost PORT=11944
OUT=/dev/null
2018 Mar 09
2
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
BACKGROUND:
While troubleshooting random, occasionally occurring, errors from
parallel::makePSOCKcluster("localhost", port = 11000);
Error in socketConnection("localhost", port = port, server = TRUE,
blocking = TRUE, :
cannot open the connection
I had another look at parallel:::newPSOCKnode(), which is used
internally to set up each background worker. It is designed to,
2009 Jun 16
0
Connecting to "heterogenous" cluster using makeSOCKcluster of SNOW-package
Thanks to Luke Tiernay and some experimenting I found out some issues. I
don't claim this infomation is complete, but it may be helpful for anyone
experimenting with SNOW on Linux:
- environment variables PATH and R_SNOW_LIB need to be set on master and
slaves.
(manually or permanent in ~/.bashrc (adjust your pathnames accordingly).
Don't use ~ for home directory, instead specify
2020 Nov 07
2
Process to Incorporate Functions from {parallely} into base R's {parallel} package
FWIW, there are indeed a few low hanging bug fixes in 'parallelly'
that should be easy to incorporate into 'parallel' without adding
extra maintenance. For example, in parallel::makePSOCKcluster(), it
is not possible to disable SSH option '-l USER' so that it can be set
in ~/.ssh/config. The remote user name will be the user name of your
local machine and if you try to
2018 Mar 09
2
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
A solution is to have parallel:::.slaveRSOCK() attempt to connect
multiple times before failing, e.g.
makeSOCKmaster <- function(master, port, timeout, useXDR, maxTries
= 10L, interval = 1.0) {
port <- as.integer(port)
for (i in seq_len(maxTries)) {
con <- tryCatch({
socketConnection(master, port = port, blocking = TRUE,
2018 Mar 10
1
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
Great.
For the record of this thread, I've submitted patch PR17391
(https://bugs.r-project.org/bugzilla3/show_bug.cgi?id=17391). I've
patched it against the latest R-devel on the SVN, passes 'make
check-all', and I've verified it works with the above tests.
/Henrik
On Fri, Mar 9, 2018 at 4:37 AM, <luke-tierney at uiowa.edu> wrote:
> I'm happy to look at a
2008 Dec 31
1
Problem with package SNOW on MacOS X 10.5.5
Hello All,
I can run the "lower level" functions OK, but many of the higher level
(eg. parSApply) functions are generating errors.
When running the example (from the snow help docs) for parApply on
MacOSX 10.5.5, I get the
following error:
cl <- makeSOCKcluster(c("localhost","localhost"))
sum(parApply(cl, matrix(1:100,10), 1, sum))
Error in
2003 Feb 07
1
Bug in socketConnection (PR#2535)
Platform: Windows
Version: 1.6.2
When first called, socketConnection gives an error. On subsequent calls it
performs correctly. Thus the first call has the effect of "priming" the
connection. Eg
> socketConnection(port=50)
Error in socketConnection(port = 50) : unable to open connection In
addition: Warning message:
localhost:50 cannot be opened
> MIM <-
2011 Jun 12
1
snow package
Hi
I try parallelising some code using the snow package and the following lines:
cl <- makeSOCKcluster(8)
pfunc <- function (x) (if(x <= (-th)) 1 else 0) ###correlation coefficient
clusterExport(cl,c("pfunc","th"))
cor.c.f <- parApply(cl,tms,c(1,2),FUN=pfunc)
The parApply results in the error message:
> cor.c.f <- parApply(cl,tms,c(1,2),FUN=pfunc)
Error
2010 May 12
1
snow makeCluster (makeSOCKcluster) not working in R-2.11
Hello,
I was using snow to parallel-process some code in R-2.10 (32-bit
windows. ). The code is as follows:
require(foreach)
require(doSNOW)
cl <- makeCluster(6, type='SOCK')
registerDoSNOW(cl)
bl2 <- foreach(i=icount(length(unqmrno))) %dopar% {
(some code here)
}
stopCluster(cl)
When I run the same code in Windows R-2.11 (either 32-bit or 64-bit), R
hangs at