search for: filehash

Trying to install package 'filehash' I get the following error on FreeBSD 9.0-CURRENT (amd64) with R version 2.11.0 (2010-01-15 r50990): ----------------------------------- R CMD INSTALL filehash_2.0-1.tar.gz * installing to library '/usr/local/lib/R/library' * installing *source* package 'filehash' ... ** libs...

Hi (Roger), I saw the announcement of filehash v2.0 and the sentence "This development has lead to better file locking for concurrent access and faster reading and writing of data in general" caught my attention. What kind of file locking do you refer to here? I am looking for a mechanism that can be used to lock files for reading an...

Hi all, several packages print messages during loading. How do I avoid to see them when the packages are in the defaultPackages? Here is an example. With this in ~/.Rprofile ,----[ ~/.Rprofile ] | old <- getOption("defaultPackages") | options(defaultPackages = c(old, "filehash")) | rm(old) `---- I get as last line when starting R: ,---- | filehash: Simple key-value database (2.2-1 2012-03-12) `---- Another package with (even more) prints during startup is tikzDevice. How can I avoid to get these messages? Regards, Andreas

Hi all, I am trying to use the filehash library to analyze a 5M by 20 matrix with both double and string data types. After consulting a few tutorials online, it seems as though one needs to first read the data into R; then create an R object; and then assign that object a location in my computer via filehash. It seems like the ben...

...in R. So far, I have been using SAS for data cleaning because my data sets are relatively large (handling multiple files, each could be as large as 5-10 G). I am not a fan of SAS at all and am eager to move data cleaning tasks into R completely. Seems to me, there are 3 options. Using SQL, ff or filehash. I do not want to learn sql. so my question is more related to ff and filehash. In specifics, (1) for merging two large data frames, which one is better, ff vs. filehash? (2) for reshaping a large data frame (say from long to wide or the opposite) which one is better, ff vs. filehash? If you ca...

Hello, I'm using filehash on the windows XP and it has been working fine with the newest R version 2.6.2. However, on the windows vista, when I ran the same code, I got the following error: > dbCreate("simdb") #create simdb database [1] TRUE > db<-dbInit("simdb") #initiate an object of data...

I have just uploaded to CRAN version 2.0 of the 'filehash' package. This version contains a major rewriting of many of the internals (much rewritten in C) for the DB1 format, which is the default. This development has lead to better file locking for concurrent access and faster reading and writing of data in general. In addition to rewriting the int...

I have just uploaded to CRAN version 2.0 of the 'filehash' package. This version contains a major rewriting of many of the internals (much rewritten in C) for the DB1 format, which is the default. This development has lead to better file locking for concurrent access and faster reading and writing of data in general. In addition to rewriting the int...

Dear R'ers, I have trouble installing tikzDevice in Ubuntu.  When I use install.packages("tikzDevice"), it gives error message: ERROR: dependency ‘filehash’ is not available for package ‘tikzDevice’ * removing ‘/usr/local/lib/R/site-library/tikzDevice’ Then I tried filehash installation, I get the message: "package ‘filehash’ is not available (for R version 2.13.1)" Any help will be appreciated. Thanks AK [[alternative HTML version del...

...done my data management in SAS, and Stata, mostly identifying spells, counting events in intervals, and a like, but I would like to do the data management-and fitting my models-in R. Though R can't handle the data in a normal R-way, it's simply too big. So I thought of trying either filehash, bigmemory or some other similar package I haven't heard of (yet). In the documentation to 'bigmemory' is says that the package is capable of ``basic manipulation '' on ``manageable subsets of the data '', but what does that actually mean? Since learning this i...

Hi, I have been using filehash for a while. It has performed very well. However, recently I found filehash gives an error when I need to do something like db[c("a", "b")] when the db is in RDS format. Does any one know a way to get around that? The code below reproduces the error thanks Jeff filehashOptio...

Hi, I am working with a very large dataset, and am using the 'filehash' package to manage such a large file. While I have no problem accessing objects that I load into a database, I was hoping there is a better way to append to objects already in the database. The only way I know now to append to an object, basically requires rewriting the entire object. Sample...

Dear R users, I try to use a very large file (~3 Gib) with the filehash package. The length of the dataset is around 4,000,000 obs. I get this message from R while trying to "load" the dataset (named "cc084.csv"): > dumpDF(read.csv("cc084.csv", header=T), dbName="db01") Erreur : impossible d'allouer un vecteur de taille 1...

Hi everybody! I'm trying to install the tikzDevice package, and I keep on getting the > ERROR: dependency ‘filehash’ is not available for package ‘tikzDevice’ I tried install.packages('filehash') and I get > package ‘filehash’ is not available Does anybody have the same problem or any hint? thank youhelena [[alternative HTML version deleted]]

...e or directory' > local({pkg <- select.list(sort(.packages(all.available = TRUE))) + if(nchar(pkg)) library(pkg, character.only=TRUE)}) > local({pkg <- select.list(sort(.packages(all.available = TRUE))) + if(nchar(pkg)) library(pkg, character.only=TRUE)}) Loading required package: filehash Error: package 'filehash' could not be loaded In addition: Warning message: In library(pkg, character.only = TRUE, logical.return = TRUE, lib.loc = lib.loc) : there is no package called 'filehash'

...uot;tcltk"), class = "tclObj") : [tcl] invalid command name "option". Error : .onLoad failed in 'loadNamespace' for 'gWidgetstcltk' Error: package/namespace load failed for 'gWidgetstcltk' Loading required package: proto Loading required package: filehash Error: package 'filehash' could not be loaded In addition: Warning message: In library(pkg, character.only = TRUE, logical.return = TRUE, lib.loc = lib.loc) : there is no package called 'filehash' Loading required package: gWidgetsRGtk2 Error in dyn.load(file, DLLpath = DLLpath, ....

Dear Experienced R Practitioners, I have 4GB .txt data called "dataset.txt" and have attempted to use *ff, bigmemory, filehash and sqldf *packages to import it, but have had no success. The readLines output of this data is: readLines("dataset.txt",n=20) [1] " "...

...#39;, :session_files_key => :files), :in_front => true # rails action that sends the file def download # do whatever it is you do to find get the filename/content type @attachment = Attachment.find(params[:id]) # this doesn''t matter as long as it''s unique filehash = Digest::SHA1.hexdigest( Time.now.to_s.split(''//'').sort_by { rand }.join ) # initialize session. Use the :session_files_key option here session[:files] ||= {} # set the value for this file with a 5 minute expiration time session[:files][filehash] = [5.minutes.f...

...ondents on 5 lifestyle variables and am having difficulty constructing a dissimilarity matrix which I will use for PAM.  I always get an error:  “cannot allocate  vector of size 293.3 Mb” even if I have already increased my memory to its limit of 4000.  I did it on 2GB , 32-bit OS .  I tried ff and filehash and I still get the same error.  Can you please help me? [[alternative HTML version deleted]]

...sed in R packages? I guess I'm just not clear on the implications of this comment in 'Rinternals.h': /* The connection interface is not yet available to packages. To allow limited use of connection pointers this defines the opaque pointer type. */ I have a function in the 'filehash' package that unserializes a bunch of objects from a file and it seems to run much faster in C than in R. But I don't want to release something that uses a non-public function/interface. Thanks, -roger -- Roger D. Peng | http://www.biostat.jhsph.edu/~rpeng/