similar to: Connecting to "heterogenous" cluster using makeSOCKcluster of SNOW-package

Displaying 20 results from an estimated 100 matches similar to: "Connecting to "heterogenous" cluster using makeSOCKcluster of SNOW-package"

2009 Jun 16
0
Connecting to "heterogenous" cluster using makeSOCKcluster of SNOW-package
Thanks to Luke Tiernay and some experimenting I found out some issues. I don't claim this infomation is complete, but it may be helpful for anyone experimenting with SNOW on Linux: - environment variables PATH and R_SNOW_LIB need to be set on master and slaves. (manually or permanent in ~/.bashrc (adjust your pathnames accordingly). Don't use ~ for home directory, instead specify
2007 Aug 14
1
makeSOCKcluster
Hi, I am attempting to implement a mixed (windows/linux) snow sockets parallelism in R, but am running into difficulties similar to a post made Aug 31, 2006 under the same subject heading. I feel like I may be one or two non-obvious steps away from getting it all working, but I'm stuck. If anyone can shed some light on this (I believe Prof. Tierney stated that he has successfully run a
2006 Sep 01
2
makeSOCKcluster
Hi, I am a newbie to R and trying to implement parallelism in R. I am currently using R-2.3.1, and Cygwin to run R on Windows xp. ssh and all are working fine, When I try to create a socket connection as makeSOCKcluster(c("localhost","localhost")), it just waits for the other prcess on localhost to get created and respond. But this other process is
2010 May 12
1
snow makeCluster (makeSOCKcluster) not working in R-2.11
Hello, I was using snow to parallel-process some code in R-2.10 (32-bit windows. ). The code is as follows: require(foreach) require(doSNOW) cl <- makeCluster(6, type='SOCK') registerDoSNOW(cl) bl2 <- foreach(i=icount(length(unqmrno))) %dopar% { (some code here) } stopCluster(cl) When I run the same code in Windows R-2.11 (either 32-bit or 64-bit), R hangs at
2013 Sep 27
1
snow::makeCluster on Windows hangs
The command which hangs: I'm hoping there is a simple explanation, but I searched on-line and nothing jumped out. > cl <- makeCluster(type="SOCK",c("localhost"),manual=TRUE) Manually start worker on localhost with C:/PROGRA~1/R/R-214~1.2/bin/Rscript.exe "C:/Program Files/R/R-2.14.2/library/snow/RSOCKnode.R" MASTER=localhost PORT=11944 OUT=/dev/null
2010 Mar 03
0
parallel computing--help
Hi Sayan, Just stumbled upon this email, three months old, since I was having the same problem, and noticed you hadn't been answered. I was able to solve this problem by noting that the "snow" library was not installed on the nodes--it has to be installed everywhere. So, you need to ssh to the "ip to another computer on the network ", then be sure the same version of R
2003 Feb 04
1
test for two samples
Hi R-users, My question is more methodological one, rather than technical. I have to samples representing residuals based on two measurements techniques (resid1,resid2; n=69). I need to compare two samples, to reject one technique (the worse one), and to keep the one which gave lower residuals (better one). What to look for? What should I analyse? Means, variance, std. deviations? Based on
2013 Aug 02
1
segfault and RunSnowWorker: not found
Hi, While I suspect that this is an issue peculiar to my machine (Debian squeeze amd64, R version 3.0.1, up-to-date packages), I'm hoping that somebody on this list may be able to give me suggestions on how to troubleshoot and fix the following: > library (snow) > cl <- makeSOCKcluster(c("localhost","localhost")) sh: 1: RunSnowWorker: not found I presume/hope
2008 Dec 31
1
Problem with package SNOW on MacOS X 10.5.5
Hello All, I can run the "lower level" functions OK, but many of the higher level (eg. parSApply) functions are generating errors. When running the example (from the snow help docs) for parApply on MacOSX 10.5.5, I get the following error: cl <- makeSOCKcluster(c("localhost","localhost")) sum(parApply(cl, matrix(1:100,10), 1, sum)) Error in
2008 Oct 22
1
torque/psb & snow library
Hello all; I'm trying to execute parallel jobs trough library snow on a cluster built through torque/PSB. I'm succesfully obtaining the cluster with: >system("cat $PBS_NODEFILE > cluster.txt") >mycluster <- scan(file="cluster.txt",what="character") >cl <- makeSOCKcluster(mycluster) The only problem, at the moment, is that if I use
2010 Sep 07
1
Problems in snow: can't open connection with nodes
I'm working with snow and created a local cluster. So far, the same code has always worked (please see below). However, now I receive a message that the connection with the nodes cannot be opened. I restarted my workstation but that didn't help. Is there a known solution for this problem? Thanks a lot for any help. bram foubert library(snow) cl =
2006 Aug 25
2
increasing the # of socket connections
Dear "R-help"ers, using snow on socket connections, I ran into the following error > cl <- makeSOCKcluster(hosts) Error in socketConnection(port = port, server = TRUE, blocking = TRUE : all connections are in use with "showConnections(all=T)" showing 50 open connections. As - for administrative reasons - I would prefer to use snow's SOCK capabilities (instead
2011 Jun 12
1
snow package
Hi I try parallelising some code using the snow package and the following lines: cl <- makeSOCKcluster(8) pfunc <- function (x) (if(x <= (-th)) 1 else 0) ###correlation coefficient clusterExport(cl,c("pfunc","th")) cor.c.f <- parApply(cl,tms,c(1,2),FUN=pfunc) The parApply results in the error message: > cor.c.f <- parApply(cl,tms,c(1,2),FUN=pfunc) Error
2012 Dec 19
1
problem with opening more than one SOCK cluster with package snow
Dear list, i have some problems using the snow package to create a SOCK cluster. The errors just occour irregularly but it seems to me that they occour when I try to create more than one cluster on the same machine via different R instances started via submitting LSF jobs to a cluster. Does anyone have an idea how to solve this or where to start digging for solutions? The error messages
2002 Aug 30
2
postscript() problem
Hi R-users, I am using "postscript("xx.eps", horizontal=FALSE, onefile=FALSE, height=6, width=10, pointsize=10)" and "barplot(xx.dat)" in R to produce EPS graphics for LATeX document. When checking the graphics with "gv" I see that it was not produced with full details. The main graphic is there, but axes labels and titles are missing. While checking the
2002 Nov 26
4
how to identify the outliers
Hello R-users, Is there any more sophisticated way how to identify the dataset outliers other then seeing them in boxplot? I wanna exclude them from further analysis and I am interested in their position in my vector data. Rado -- Radoslav Bonk M.S. Dept. of Physical Geography and Geoecology Faculty of Sciences, Comenius University Mlynska Dolina 842 15, Bratislava, SLOVAKIA tel: +421 2 602
2003 Sep 04
2
documents for writing functions
Hi, Does anybody know suitable documents (manuals) on writing user functions (covering loops, conditions ...) in R? Other than the usually available manuals. Thanks, Rado -- Radoslav Bonk M.S. Dept. of Physical Geography and Geoecology Faculty of Sciences, Comenius University Mlynska Dolina 842 15, Bratislava, SLOVAKIA tel: +421 905 968 127 e-mail: rbonk at host.sk
2006 Feb 16
0
sums of absolute deviations about the median as split function in rpart
Dear R community, as stated in Breiman et.al. (1984) and De'Ath & Fabricius (2000) using sums of absolute deviations about the median as an impurity measure gives robust trees. I would like to use this method in rpart. Has somebody already tried this method in rpart? Is there maybe already a script available somewhere? I am aware of the possibility to define usersplits myself with
2002 Jul 08
2
matrix: rows to columns conversion
Hi, I'm new to "R". I have a matrix of 6x12. I need to produce matrix of 12x6, such that rows in new matrix are columns from original matrix, and columns in a new matrix are rows from the original one. I was playing with rbind(), and cbind() with no success. Regards, -Rado -- Radoslav Bonk M.S. Dept. of Physical Geography and Geoecology Faculty of Natural Sciences, Comenius
2003 Sep 23
3
number of distinct values in a dataframe
Hi R-users, How can I found the number of a distinct values in a data frame (occurrence of distinct values)? The dataframe consists of several thousands integer numbers. Thanks, Rado -- Radoslav Bonk M.S. Dept. of Physical Geography and Geoecology Faculty of Sciences, Comenius University Mlynska Dolina 842 15, Bratislava, SLOVAKIA tel: +421 905 968 127 e-mail: rbonk at host.sk