search for: sfclusterapplylb

Displaying 5 results from an estimated 5 matches for "sfclusterapplylb".

Did you mean: clusterapplylb
2016 Apr 28
0
Snowfall - Error in checkForRemoteErrors(val) with sfClusterApplyLB()
...llo, I'm trying to run a code that uses the snowfall package. Here is the structure of my code. sfInit(parallel=T, cpus = 5, slaveOutfile="ErrorMessage.txt") sfExportAll() sfLibrary(rgdal) sfLibrary(raster) sfLibrary(sp) sfLibrary(rgeos) sfLibrary(snowfall) system.time( sfClusterApplyLB(1:10, function(k) { sfCat(paste("Iteration ", k), sep="\n") if (......) { } else { if (class(ob1)=="SpatialCollections") { ob2 <- ob1 at lineobj } else if (class(ob1)=="SpatialLines") { ob2 <- ob1 } ob3 <- data....
2011 Jun 06
1
RPostgreSQL && snowfall
Dear expeRts, I'm currently trying to get data from a PostgreSQL database _in parallel_. I tried two methods: * passing the DBI Connection object to the cluster nodes * connecting the the DB on each node (1) The execution of the first method looks like this: > result = sfClusterApplyLB(input, fun, dbiCon) and produces an "expired PostgreSQLConnection" error. (Of course the passed Connection Object is usable at that moment and afterwards!) (2) For the creation of DB connections on every node a function handling the whole connection is sourced into every node. This funct...
2009 Sep 22
0
snowfall: sfExport apparently harmless error
...ta n <- 46000 x <- runif(n, 0.02, 0.54) logx <- log(x) sfExport("logx") # Compute fake function computeTakens <- function(r0idx) { if(r0idx == 1) return(NA) return(1/(logx[r0idx] - sum(logx[1:(r0idx-1)])/(r0idx-1))) } res <- sfClusterApplyLB(n:1, computeTakens) } sfStop() -- Ing. Mario Valle Data Analysis and Visualization Group | http://www.cscs.ch/~mvalle Swiss National Supercomputing Centre (CSCS) | Tel: +41 (91) 610.82.60 v. Cantonale Galleria 2, 6928 Manno, Switzerland | Fax: +41 (91) 610.82.82
2010 Jun 24
0
Snowfall: "cannont open connection " problem
...Jun 24 09:17:56 2010" > el.time <- system.time( + + for (i in 1:(n.sims/everyout)) { + loop.start <- i*everyout -(everyout-1) + loop.end <- i*everyout + print(paste("loop.start = ",loop.start)) + print(paste("loop.end = ",loop.end)) + + rr[[i]] <- sfClusterApplyLB(loop.start:loop.end,wrapper1,reps) + a<-rr[[i]] + save(a,file=paste("rr_",i,".RData",sep="")) + } + ) [1] "loop.start = 1" [1] "loop.end = 10" Error in checkForRemoteErrors(val) : 10 nodes produced errors; first error: cannot open the con...
2011 Mar 01
6
usar multiples procesadores en R
Hola a tod en s, estoy realizando unas operaciones con muchos datos con el paquete "vegan", concretamente la función "metaMDS" y me gustaría saber si puedo usar más de un procesador a la vez para acelerar los cálculos. He visto el paquete "multicore" pero no sé usarlo, ¿alguien lo ha usado para algo así? Gracias y saludos, Javier -- http://oikos.inf.um.es