similar to: makeSOCKcluster

Displaying 20 results from an estimated 2000 matches similar to: "makeSOCKcluster"

2006 Sep 01
2
makeSOCKcluster
Hi, I am a newbie to R and trying to implement parallelism in R. I am currently using R-2.3.1, and Cygwin to run R on Windows xp. ssh and all are working fine, When I try to create a socket connection as makeSOCKcluster(c("localhost","localhost")), it just waits for the other prcess on localhost to get created and respond. But this other process is
2012 Dec 19
1
problem with opening more than one SOCK cluster with package snow
Dear list, i have some problems using the snow package to create a SOCK cluster. The errors just occour irregularly but it seems to me that they occour when I try to create more than one cluster on the same machine via different R instances started via submitting LSF jobs to a cluster. Does anyone have an idea how to solve this or where to start digging for solutions? The error messages
2009 Apr 09
0
Connecting to "heterogenous" cluster using makeSOCKcluster of SNOW-package
When trying to create (a very simple) cluster using makeSOCKcluster or makeCluster I get the following error message: > library(snow) > cl <- makeSOCKcluster("localhost") Fatal error: kann Datei '~/R/i686-suse-linux-gnu-library/2.8/snow/RSOCKnode.R' nicht ?ffnen: Datei oder Verzeichnis nicht gefunden (translation: could not open file [...]: File or directory not
2006 Aug 25
2
increasing the # of socket connections
Dear "R-help"ers, using snow on socket connections, I ran into the following error > cl <- makeSOCKcluster(hosts) Error in socketConnection(port = port, server = TRUE, blocking = TRUE : all connections are in use with "showConnections(all=T)" showing 50 open connections. As - for administrative reasons - I would prefer to use snow's SOCK capabilities (instead
2011 Nov 22
0
snow package, socketConnection error, SSH, in Windows 7 x64
Hi. I have some problems trying to make cluster via "snow" package and haven't found a solution for my problem in archives and relative topics. I installed ssh server using cygwin and set a password-less SSH Login. In R session after starting ssh service: > system("ssh 10.10.5.15 date") Tue Nov 22 16:22:36 AST 2011 But when I make connection: > con <-
2019 Mar 18
2
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
(Bcc: CRAN) This is a proposal helping CRAN and alike as well as individual developers to avoid stray R processes being left behind that might be produced when an example or a package test fails to set up a parallel::makeCluster(). ISSUE If a package test sets up a PSOCK cluster and then the master process dies for one reason or the other, the PSOCK worker processes will remain running for 30
2010 Sep 07
1
Problems in snow: can't open connection with nodes
I'm working with snow and created a local cluster. So far, the same code has always worked (please see below). However, now I receive a message that the connection with the nodes cannot be opened. I restarted my workstation but that didn't help. Is there a known solution for this problem? Thanks a lot for any help. bram foubert library(snow) cl =
2013 Aug 02
1
segfault and RunSnowWorker: not found
Hi, While I suspect that this is an issue peculiar to my machine (Debian squeeze amd64, R version 3.0.1, up-to-date packages), I'm hoping that somebody on this list may be able to give me suggestions on how to troubleshoot and fix the following: > library (snow) > cl <- makeSOCKcluster(c("localhost","localhost")) sh: 1: RunSnowWorker: not found I presume/hope
2008 Oct 22
1
torque/psb & snow library
Hello all; I'm trying to execute parallel jobs trough library snow on a cluster built through torque/PSB. I'm succesfully obtaining the cluster with: >system("cat $PBS_NODEFILE > cluster.txt") >mycluster <- scan(file="cluster.txt",what="character") >cl <- makeSOCKcluster(mycluster) The only problem, at the moment, is that if I use
2009 Jan 09
1
snow and different R versions
Dear Luke and others, I have many R versions on my machine and want to start a particular one when snow builds its cluster. (The same version I start snow from.) It seems that everything is set up correctly in defaultClusterOptions: > mget(ls(defaultClusterOptions), defaultClusterOptions) $homogeneous [1] TRUE $manual [1] FALSE $master nodename "maya.unil.ch" $outfile [1]
2013 Sep 27
1
snow::makeCluster on Windows hangs
The command which hangs: I'm hoping there is a simple explanation, but I searched on-line and nothing jumped out. > cl <- makeCluster(type="SOCK",c("localhost"),manual=TRUE) Manually start worker on localhost with C:/PROGRA~1/R/R-214~1.2/bin/Rscript.exe "C:/Program Files/R/R-2.14.2/library/snow/RSOCKnode.R" MASTER=localhost PORT=11944 OUT=/dev/null
2018 Mar 09
2
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
BACKGROUND: While troubleshooting random, occasionally occurring, errors from parallel::makePSOCKcluster("localhost", port = 11000); Error in socketConnection("localhost", port = port, server = TRUE, blocking = TRUE, : cannot open the connection I had another look at parallel:::newPSOCKnode(), which is used internally to set up each background worker. It is designed to,
2009 Jun 16
0
Connecting to "heterogenous" cluster using makeSOCKcluster of SNOW-package
Thanks to Luke Tiernay and some experimenting I found out some issues. I don't claim this infomation is complete, but it may be helpful for anyone experimenting with SNOW on Linux: - environment variables PATH and R_SNOW_LIB need to be set on master and slaves. (manually or permanent in ~/.bashrc (adjust your pathnames accordingly). Don't use ~ for home directory, instead specify
2020 Nov 07
2
Process to Incorporate Functions from {parallely} into base R's {parallel} package
FWIW, there are indeed a few low hanging bug fixes in 'parallelly' that should be easy to incorporate into 'parallel' without adding extra maintenance. For example, in parallel::makePSOCKcluster(), it is not possible to disable SSH option '-l USER' so that it can be set in ~/.ssh/config. The remote user name will be the user name of your local machine and if you try to
2018 Mar 09
2
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
A solution is to have parallel:::.slaveRSOCK() attempt to connect multiple times before failing, e.g. makeSOCKmaster <- function(master, port, timeout, useXDR, maxTries = 10L, interval = 1.0) { port <- as.integer(port) for (i in seq_len(maxTries)) { con <- tryCatch({ socketConnection(master, port = port, blocking = TRUE,
2018 Mar 10
1
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
Great. For the record of this thread, I've submitted patch PR17391 (https://bugs.r-project.org/bugzilla3/show_bug.cgi?id=17391). I've patched it against the latest R-devel on the SVN, passes 'make check-all', and I've verified it works with the above tests. /Henrik On Fri, Mar 9, 2018 at 4:37 AM, <luke-tierney at uiowa.edu> wrote: > I'm happy to look at a
2008 Dec 31
1
Problem with package SNOW on MacOS X 10.5.5
Hello All, I can run the "lower level" functions OK, but many of the higher level (eg. parSApply) functions are generating errors. When running the example (from the snow help docs) for parApply on MacOSX 10.5.5, I get the following error: cl <- makeSOCKcluster(c("localhost","localhost")) sum(parApply(cl, matrix(1:100,10), 1, sum)) Error in
2003 Feb 07
1
Bug in socketConnection (PR#2535)
Platform: Windows Version: 1.6.2 When first called, socketConnection gives an error. On subsequent calls it performs correctly. Thus the first call has the effect of "priming" the connection. Eg > socketConnection(port=50) Error in socketConnection(port = 50) : unable to open connection In addition: Warning message: localhost:50 cannot be opened > MIM <-
2011 Jun 12
1
snow package
Hi I try parallelising some code using the snow package and the following lines: cl <- makeSOCKcluster(8) pfunc <- function (x) (if(x <= (-th)) 1 else 0) ###correlation coefficient clusterExport(cl,c("pfunc","th")) cor.c.f <- parApply(cl,tms,c(1,2),FUN=pfunc) The parApply results in the error message: > cor.c.f <- parApply(cl,tms,c(1,2),FUN=pfunc) Error
2010 May 12
1
snow makeCluster (makeSOCKcluster) not working in R-2.11
Hello, I was using snow to parallel-process some code in R-2.10 (32-bit windows. ). The code is as follows: require(foreach) require(doSNOW) cl <- makeCluster(6, type='SOCK') registerDoSNOW(cl) bl2 <- foreach(i=icount(length(unqmrno))) %dopar% { (some code here) } stopCluster(cl) When I run the same code in Windows R-2.11 (either 32-bit or 64-bit), R hangs at