search for: fftempdir

Displaying 6 results from an estimated 6 matches for "fftempdir".

2010 Feb 12
1
ffsave.image() error with large objects
Hi, I have been using ffsave.image() to save mixture of ff and normal objects in my workspace. e.g. ffsave.image(file = "C:\output\saveobjects", rootpath = "D:\fftempdir", safe = TRUE) It works fine but once my workspace has large (~4GB) objects, I get the error: Error in ffsave.image(file = "C:\output\savedobjects", rootpath = "D:\fftempdir", safe = TRUE) : ff image could not be renamed and is left in C:\output\savedobjects Could this d...
2009 Nov 09
3
Hand-crafting an .RData file
Hello, I frequently have to export a large quantity of data from some source (for example, a database, or a hand-written perl script) and then read it into R. This occasionally takes a lot of time; I'm usually using read.table("filename",comment.char="",quote="") to read the data once it is written to disk. However, I *know* that the program that generates
2010 Feb 11
0
ff package: How to save and open ff(df) files.
...;save" a ffdf file(s) and open it in another session, via saving it in an permanet location. Let´s supose we´re reading from a text file to a ffdf object, with read.table.ffdf and we want to save the files and information in a permanent path and file. First of all I read about GetOption("fftempdir") but I don´t know how to change this parameter. I read also about the pattern option, and I asume that this option changes the prefix of the files created phisically under the ffdf object. Isn´t it? Can I use this parameter to create a permanent location (via putting the entire path) for the...
2010 Nov 10
1
ff objects saving problem
Hi, I am running the examples in page 70 of the ff package document, but it failed with the following error > cat("let's create some ff objects\n") let's create some ff objects > n <- 8e3 > a <- ff(sample(n, n, TRUE), vmode="integer", length=n, filename="d:/tmp/a.ff") > b <- ff(sample(255, n, TRUE), vmode="ubyte", length=n,
2012 Sep 14
1
Any way to get read.table.ffdf() (in the ff package) to pass colClasses or comment.char parameters through to read.fwf() ?
...documentation) x <- data.frame(log=rep(c(FALSE, TRUE), length.out=26), int=1:26, dbl=1:26 + 0.1, fac=factor(letters), ord=ordered(LETTERS), dct=Sys.time()+1:26, dat=seq(as.Date("1910/1/1"), length.out=26, by=1)) x <- x[c(13:1, 13:1),] csvfile <- tempPathFile(path=getOption("fftempdir"), extension="csv") write.csv(x, file=csvfile, row.names=FALSE) y <- read.csv(file=csvfile, header=TRUE, colClasses=c(dct="POSIXct", dat="Date")) # "ordered" gives an error ffx <- read.csv.ffdf(file=csvfile, header=TRUE, colClasses=c(dct="POS...
2010 Apr 13
2
how to work with big matrices and the ff-package?
...<- as.ffdf(discretize(as.data.frame(as.ffdf(cc)), disc="equalwidth", nbins=5)) This won't work. After this step it somehow loses the path to the working directory. As soon as I try to discretize the next data.frame I get the following message: Error in if (dfile == getOption("fftempdir")) finalizer <- "delete" else finalizer <- "close" : Argument has length 0 Error in setwd(cwd) : character as argument expected I would be really glad if anybody can help me understanding the functionality and show me how to convert between the different data type...