search for: ffsave

Hi, I have been using ffsave.image() to save mixture of ff and normal objects in my workspace. e.g. ffsave.image(file = "C:\output\saveobjects", rootpath = "D:\fftempdir", safe = TRUE) It works fine but once my workspace has large (~4GB) objects, I get the error: Error in ffsave.image(file = "C:\out...

Dear list, I am trying to understand and use the ff package. As I had some problems saving some ff objects, and as I did not fully manage to understand the whole concept of *.ff, *.ffData and *.RData with the help of the documentation, I tried to reproduce the examples from the help of ffsave. When I ran, however : (copied from the help) message("let's create some ff objects") n <- 8e3 a <- ff(sample(n, n, TRUE), vmode="integer", length=n, filename="d:/tmp/a.ff") b <- ff(sample(255, n, TRUE), vmode="ubyte", length=n, filename...

I use the ff-package for large data and have good success in session. To ensure my data is available for the next R session, I save my workspace and use the /ffsave/ command to archive my large data objects. Syntax is simple: > ffsave(file="~/path/archiveName", list="objectName") when I have multiple files to save, the list is expanded using c(). When I start a new R session, I load the ff-package again and use /ffload/ to retrieve m...

...tual" .. .. - attr(*, "class") = chr [1:2] "ff_vector" "ff" $ row.names: NULL - attributes: List of 2 .. $ names: chr [1:3] "virtual" "physical" "row.names" .. $ class: chr "ffdf" the function I used to do this was: *ffsave(DATA, file='//N7700PRO/Datos/Datos_Servidor_Lucas/DATA')* this gives me the next error: *Error in system(cmd, input = filelist, intern = TRUE) : 'zip' not found* I found that I needed to have some kind of Zip and UnZip tool, this comes in Rtools, so I installed the Rtools *Rtools...

...quot;) > z <- ff(sample(255, n, TRUE), vmode="ubyte", length=n, filename="d:/tmp/z.ff") > df <- ffdf(x=x, y=y, z=z) > rm(x,y,z) > cat("save some of them with shorter relative pathnames ...\n") save some of them with shorter relative pathnames ... > ffsave(a, b, file="d:/tmp/y", rootpath="d:/tmp") Error in system(cmd, input = list, intern = TRUE) : 'zip' not found > str(ffinfo("d:/tmp/y")) Error in system(cmd, intern = TRUE) : 'unzip' not found Does it mean I have to install some special softwares for...

Dear R community, Package bit version 1.1-3 and ff version 2.1.2 is available on CRAN and should be useful to handle large datasets. It adds convenient utilities for managing ff objects and files (see ?ffsave) and removes some performance bottlenecks. In case you experience unexpected performance problems with ff, here is a couple of recommendations based on FAQs: 1) Compare the size of data to be written at the same time to available RAM for your filesystem cache. If the data exceeds available R...

Dear R community, Package bit version 1.1-3 and ff version 2.1.2 is available on CRAN and should be useful to handle large datasets. It adds convenient utilities for managing ff objects and files (see ?ffsave) and removes some performance bottlenecks. In case you experience unexpected performance problems with ff, here is a couple of recommendations based on FAQs: 1) Compare the size of data to be written at the same time to available RAM for your filesystem cache. If the data exceeds available R...

Hi All, My script generates a mixture of normal and ff objects. I need to run the script for different parameter settings. Very often I would like to save the workspace for each parameter setting, so that I can get back to it later on. Is there an easy way to do this, instead of needing to save individual ff objects separately? I've tried the naive way of just saving the workspace, only to

I've noticed that ff uses the unzip utility available on it's host OS to load datasets via ffload. It seems to work fine in linux, but when I try to use the package in Windows (hence dling Windows unzip utils) I get 2 errors, one telling me that the options aren't being passed to unzip correctly and another indicating that my filename is incorrect. First, does anyone know of an unzip

Greetings useRs, Can anyone provide an example how to use ff to feed a very large data frame to glm? The data.frame cannot be loaded in R using conventional read.csv as it is too big. glm(...,data=ff.file) ?? Thank you Stephen B

Hi all, I am having trouble loading a ff object previously saved in a different computer. I have both files .ffData and .RData, and the first of them is 13Mb large from which I know the data is therein. But when I try to ffload it, checkdir error: cannot create /home/_myUser_ Permission denied unable to process home/_myUser_/Rtempdir/ff1a831d500b8d.ff. and