Displaying 20 results from an estimated 10000 matches similar to: "Can the file locking in filehash be reused? (Was: Re: [R] [R-pkgs] filehash 2.0)"
2008 Aug 28
0
filehash 2.0
I have just uploaded to CRAN version 2.0 of the 'filehash' package.
This version contains a major rewriting of many of the internals (much
rewritten in C) for the DB1 format, which is the default. This
development has lead to better file locking for concurrent access and
faster reading and writing of data in general.
In addition to rewriting the internals, I have added two modules for a
2008 Aug 28
0
filehash 2.0
I have just uploaded to CRAN version 2.0 of the 'filehash' package.
This version contains a major rewriting of many of the internals (much
rewritten in C) for the DB1 format, which is the default. This
development has lead to better file locking for concurrent access and
faster reading and writing of data in general.
In addition to rewriting the internals, I have added two modules for a
2008 Jul 31
2
C versions of serialize/unserialize in packages
Are the functions 'R_Unserialize' and 'R_InitFileInPStream' allowed to
be used in R packages? I guess I'm just not clear on the implications
of this comment in 'Rinternals.h':
/* The connection interface is not yet available to packages. To
allow limited use of connection pointers this defines the opaque
pointer type. */
I have a function in the
2010 Jan 02
0
filehash - multiple indices via '[' not allowed when using RDS format
Hi,
I have been using filehash for a while. It has performed very well.
However, recently I found filehash gives an error when I need to do
something like db[c("a", "b")] when the db is in RDS format. Does any one
know a way to get around that?
The code below reproduces the error
thanks
Jeff
filehashOption(defaultType = "DB1")
dbCreate("mydb3", type =
2008 Apr 04
0
cacher v0.1-2
The 'cacher' package contains a set of routines for caching statistical
analyses. The idea is that an analysis stored in a file (say, 'foo.R') is run
and the results of the evaluated expressions are cached in a database. These
cached results can subsequently be packaged up and distributed over the interweb.
I've just uploaded to CRAN version 0.1-2 of the 'cacher'
2008 Apr 04
0
cacher v0.1-2
The 'cacher' package contains a set of routines for caching statistical
analyses. The idea is that an analysis stored in a file (say, 'foo.R') is run
and the results of the evaluated expressions are cached in a database. These
cached results can subsequently be packaged up and distributed over the interweb.
I've just uploaded to CRAN version 0.1-2 of the 'cacher'
2008 Mar 15
1
filehash
Hello,
I'm using filehash on the windows XP and it has been working fine with the
newest R version 2.6.2. However, on the windows vista, when I ran the same
code, I got the following error:
> dbCreate("simdb") #create simdb database
[1] TRUE
> db<-dbInit("simdb") #initiate an object of database
Error in sprintf(gettext(fmt, domain = domain), ...) :
object
2005 Mar 22
1
make install fails with makeinfo < 4.7
When I build R-devel (or the alpha snapshots) on a system without
makeinfo >= 4.7, I get a warning about not being able to build
HTML/Info help pages after running 'configure' (but 'make' runs
smoothly and there are no errors). However, when I run 'make install'
I get an error, something like
make[2]: Entering directory
2010 Jan 21
0
filehash does not install on FreeBSD
Trying to install package 'filehash' I get the following error on
FreeBSD 9.0-CURRENT (amd64) with R version 2.11.0 (2010-01-15 r50990):
-----------------------------------
R CMD INSTALL filehash_2.0-1.tar.gz
* installing to library '/usr/local/lib/R/library'
* installing *source* package 'filehash' ...
** libs
gcc -std=gnu99 -I/usr/local/lib/R/include
2004 Jun 23
1
problem with tilde expansion in install.packages
In R 1.9.0 on Solaris/Sparc when I run, for example,
install.packages("gregmisc", "~/R-local/lib"), instead of installing
the `gregmisc' package in the directory
/users/student/rpeng/R-local/lib the package gets installed in
/users/student/rpeng/\~/R-local/lib, so the directory \~ is created in
my home directory. This doesn't happen to me on Linux or Windows so I
2007 May 04
1
Display list redraw incomplete
Since compiling R 2.5.0 from source on my Mac (PowerBook) I've noticed
some strange behavior when plotting. I'm not sure if it's a problem
with my setup/compilation because I feel like a problem as basic as
this one would have been reported already. I'm running R with X11 and
R was built with gcc 4.0.1.
Basically, I run
> plot(0, 0)
> dev.off()
X11
4
Warning message:
2007 Apr 04
1
tilde expansion with install.packages
I've noticed recently that 'update.packages' and 'install.packages' seem to not
do tilde expansion anymore, i.e. when I run
update.packages("~/R-local/lib")
on R-alpha (r41043) I get the message
/home/rpeng/install/R-alpha/lib64/R/bin/INSTALL: line 304: cd: ~/R-local/lib: No
such file or directory
and the package is subsequently installed in the current working
2011 Jan 02
1
filehash for big data
Hi all,
I am trying to use the filehash library to analyze a 5M by 20 matrix with both
double and string data types.
After consulting a few tutorials online, it seems as though one needs to first
read the data into R; then create an R object; and then assign that object a
location in my computer via filehash. It seems like the benefit of this is
minimizing memory allocation when running
2005 Nov 20
1
mapply() gives seg fault (PR#8332)
--KsGdsel6WgEHnImy
Content-Type: text/plain; charset=iso-8859-1; format=flowed
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
Hi, people. Wandering in R archives, and seeing the message attached
below, I noticed that:
mapply(rep,times=1:4, MoreArgs=42)
still segfaults on R 2.2.0, and thought I should be a good citizen and
report it, even if I do not have an actual problem
2007 Apr 13
1
directory/filename completion
I've noticed something recently in R-beta that has changed since R 2.4.1
and I'm not sure if it's a readline problem or an R problem. I am on a
Linux FC5 system and in R 2.4.1 I could do
load("my-directory/
and then hit TAB and it would list all of the files in 'my-directory',
after which I could start typing the beginning of the file, hit TAB
again, and it would
2009 May 19
0
File too big for filehash?
Dear R users,
I try to use a very large file (~3 Gib) with the filehash package. The
length of the dataset is around 4,000,000 obs. I get this message from R
while trying to "load" the dataset (named "cc084.csv"):
> dumpDF(read.csv("cc084.csv", header=T), dbName="db01")
Erreur : impossible d'allouer un vecteur de taille 15.6 Mo (French)
Error:
2009 Jan 23
0
Appending objects created using filehash package
Hi,
I am working with a very large dataset, and am using the 'filehash' package
to manage such a large file.
While I have no problem accessing objects that I load into a database, I was
hoping there is a better way to append to objects already in the database.
The only way I know now to append to an object, basically requires rewriting
the entire object.
Sample code:
2005 Dec 21
1
random output with sub(fixed = TRUE)
I've noticed what I think is curious behavior in using 'sub(fixed = TRUE)' and
was wondering if my expectation is incorrect. Here is one example:
v <- paste(0:10, "asdf", sep = ".")
sub(".asdf", "", v, fixed = TRUE)
The results I get are
> sub(".asdf", "", v, fixed = TRUE)
[1] "0"
2010 Feb 22
1
big panel: filehash, bigmemory or other
Dear R-list
I'm on my way to start a new project on a rather big panel, consisting
of approximately 8 million observations in 30 waves of data and about
15 variables. I have a similar data set that is approximately 7
gigabytes in size.
Until now I have done my data management in SAS, and Stata, mostly
identifying spells, counting events in intervals, and a like, but I
would like to
2007 Nov 14
1
isOpen on closed connections
As far as I can tell, 'isOpen' cannot return FALSE in the case when 'rw = ""'.
If the connection has already been closed by 'close' or some other function,
then isOpen will produce an error. The problem is that when isOpen calls
'getConnection', the connection cannot be found and 'getConnection' produces an
error. The check to see if it is