search for: sfexport

...y seems to work (stanza 2 below), but using them indirectly does not (stanza 3 below). I get an "attempt to apply non-function" error. In addition to exporting the instance of the object I created to the Snowfall slaves, I also made several attempts to export the method itself (e.g. sfExport("instance$method") or some such), with no success. Very strangely, if I run Stanza 2 below, then stanza 3 will work. I tried emailing the Snowfall author, but have not heard back. Any help is greatly appreciated! Henry Bryant Texas A&M University library("snowfall"...

...iteration 7 (with the error below). This value of n is suspiciously close to 2^14 (16kb). So maybe it is a configuration problem of my MPI installation. Or it is an undocumented limitation of snowfall/snow/Rmpi. My real variable size is around 100000, so I prefer not to implement workarounds to sfExport variables whose size is < 16k. If you can point me in the right direction will be really helpful. Thanks! mario TERM: Undefined variable. TERM: Undefined variable. TERM: Undefined variable. TERM: Undefined variable. Loading required package: utils Loading required package: utils Loading re...

...variable. TERM: Undefined variable. Loading required package: utils Loading required package: utils Loading required package: utils Loading required package: utils Library Rmpi loaded. snowfall 1.70 initialized: parallel execution on 3 CPUs. Error in unserialize(obj) : unknown input format Calls: sfExport ... mpi.recv.Robj -> .mpi.unserialize -> unserialize -> .Call Execution halted MPI Application rank 0 exited before MPI_Finalize() with status 1 /users/mvalle/snow/snow/inst/RMPISNOW: line 40: 15028 Terminated R --no-save $* /users/mvalle/snow/snow/inst/RMPISNOW: line 40: 23...

...dows version packages (parallel, snow, snowfall,..) but could not solve my specific problem. As far as I understood, either I have to write a new function like sfRollapplyr or I have to change my code in a way that it utilizes lapply, or sapply instead of 'rollapplyr' first then use sfInit, sfExport, and sfLapply,.. for parallel computing. I could not perform either so please help me :)   ## nc<-313 rs<-500000 ema<-10 h<-4 gomin1sd<-function (x,rho) { getOutliers(as.vector(x),rho=c(1,1))$limit[1] } dim(dt_l1_inp) [1] 500000 312 dt_l1_min1<-matrix(nrow=rs, ncol=nc-1-(ema*h)) f...

...39;, cc = "catt")) f1 <- function(y1) { new('catt', aa = y1 + 1) } f3 <- function(y2, y3) { new('dogg', bb=c(y2, 'GA'), cc = f1(y3)) } dat <- 1:5 f1(dat) f3('NY', dat) sapply(c("state1", 'state2', 'state3'), f3, dat) sfExportAll() sfClusterEval(ls()) sfSapply(c("s1", 's2', 's3'), f3, dat) sfStop() # sfSapply generates the following error # Error in checkForRemoteErrors(val) : # 2 nodes produced errors; first error: "dogg" is not a defined class === end ============= -- Vi...

R-helpers: What would be the absolute fastest way to make a large "empty" file (e.g. filled with all zeroes) on disk, given a byte size and a given number number of empty values. I know I can use writeBin, but the "object" in this case may be far too large to store in main memory. I'm asking because I'm going to use this file in conjunction with mmap to do parallel

...erramos conexión RODBC rm(canal2) #Eliminamos conexión RODBC } ############################## # Preparación de los cluster ##### ############################## sfRemoveAll() #Eliminamos los objetos que pudieran contener los cluster sfExport("tab","asubir","entabla","frec","datos", "pb","subida") #Exportamos a los 2 cluster los objetos que necesitamos tarea <- list( t1 = function() pb(tab,asubir,entabla,frec),t2 = function() subida(datos,tab)) #Creamos lista...

I have data that looks like this: > df1 group id 1 red A 2 red B 3 red C 4 blue D 5 blue E 6 blue F I want a list of the groups containing vectors with the ids. I am avoiding subset(), as it is only recommended for interactive use. Here's what I have so far: df1 <- data.frame(group=c("red", "red", "red", "blue",