Displaying 20 results from an estimated 2000 matches similar to: "size limitations in R"
2009 Feb 20
2
importing data to SQLite database with sqldf
Hi all,
I am attempting to learn SQL through sqldf...
One task I am particularly interested in is merging separate
(presumably large) files into a single table without loading these
files into R as an intermediate step (by loading them into SQLite and
merging them there).
Taking a step back, I've considered these alternatives:
1) I know if I use straight SQLite commands I might use the
2007 Sep 13
2
beginner's questions ... sorry
I have 316 files. Each file represents a patient's breathing track
(respiratory signal recorded for a variable number of cycles). All files
have the same are made up of a header followed by a variable number of
records.
Each record contains 7 comma separated fields.
The patient ID is recorder in the header which is stripped off when reading
the file into a R data.frame.
Since I need to keep
2010 Jul 28
1
sqldf 0.3-5 package or tcltk problem
This is my first post. I am running Mac OS X version 10.6.3. I am running R 2.11.0 GUI 1.33 64 bit.
This may or may not be related to sqldf, but I experienced this problem while attempting to use an sqldf query. The same code runs with no problem on my Windows machine. Here is what happens:
> r=sqldf("select ... ")
Loading required package: tcltk
Loading Tcl/Tk interface ...
Then
2007 Sep 07
3
Delete query in sqldf?
Dear All,
Is sqldf equipped with delete queries? I have tried delete queries but
with no success.
Thanks in advance,
Paul
2007 Sep 07
2
Automatic detachment of dependent packages
Dear All,
When one loads certain packages, some other dependent packages are
loaded as well. Is there some way of detaching them automatically when
one detaches the first package loaded? For instance,
> library(sqldf)
Loading required package: RSQLite
Loading required package: DBI
Loading required package: gsubfn
Loading required package: proto
but
> detach(package:sqldf)
>
>
2007 Jul 19
1
package NULL not found
In performing Rcmd check I am getting this output regarding using
Argument '' and a NULL package not found and it stops with an error:
* using log directory 'C:/Rpkgs/sqldf.Rcheck'
* using ARGUMENT '
' __ignored__ R version 2.5.1 (2007-06-27)
* checking for file 'sqldf/DESCRIPTION' ... OK
* this is package 'sqldf' version '0.1-0'
* checking package
2009 Jan 16
5
Value Lookup from File without Slurping
Dear all,
I have a repository file (let's call it repo.txt)
that contain two columns like this:
# tag value
AAA 0.2
AAT 0.3
AAC 0.02
AAG 0.02
ATA 0.3
ATT 0.7
Given another query vector
> qr <- c("AAC", "ATT")
I would like to find the corresponding value for each query above,
yielding:
0.02
0.7
However, I want to avoid slurping whole repo.txt
2010 Nov 15
5
How to Read a Large CSV into a Database with R
Hi, I'm working in R 2.11.1 x64 on Windows x86_64-pc-mingw32. I'm trying to
insert a very large CSV file into a SQLite database. I'm pretty new to
working with databases in R, so I apologize if I'm overlooking something
obvious here.
I'm trying to work with the American Community Survey data, which is two
1.3GB csv files. I have enough RAM to read one of them into memory,
2007 Aug 01
1
New R package sqldf
sqldf is an R package for running SQL select
statements on one or more R data frames. It is
optimized for convenience making it useful
for ad hoc queries against R data frames.
Given an SQL select statement whose tables
are the names of R data frames it:
- sets up the database (by default it transparently
sets up an in memory SQLite database using RSQLite;
however, MySQL via RMySQL, can be
2007 Aug 01
1
New R package sqldf
sqldf is an R package for running SQL select
statements on one or more R data frames. It is
optimized for convenience making it useful
for ad hoc queries against R data frames.
Given an SQL select statement whose tables
are the names of R data frames it:
- sets up the database (by default it transparently
sets up an in memory SQLite database using RSQLite;
however, MySQL via RMySQL, can be
2007 Sep 07
5
SQL like function?
Hi RUsers,
I am wonder if I can search observations whose IDs matches any of the
values in another vector, such as in MySQL. While I am learing MySQL for
future database management, I appreciate if anyone could give me a hint.
Suppose I have one 5*1 vector containing observation IDs and
frequencies, and one 3*1 vector containing observation IDs.
observation<-c(1,2,3,4,5)
ID<-c(1,3,4)
2007 Nov 13
7
combine two dataframe
I have two data frame A and B adn want to cross them.
A has format as:
a1 a2 a3
1 2 3
2 3 1
1 3 2
...
B:
b1 b2
1 2
2 1
...
the combine result shall be something like
a1 a2 a3 b1 b2
1 2 3 1 2
1 2 3 2 1
2 3 1 1 2
2 3 1 2 1
1 3 2 1 2
1 3 2 2 1
....
is there a function able of doing this instead of loops?
Thanks,
Sun
2010 Nov 01
1
sqldf hanging on macintosh - works on windows
Have a long script that runs fine on windows (32 bit). When I try to run in
on two different macs (64 bit), however, it hangs with identical behavior.
I start with:
library(sqldf)
This results in messages:
Loading required package: DBI
Loading required package: RSQLite
Loading required package: RSQLite.extfuns
Loading required package: gsubfn
Loading required package: proto
Loading required
2010 Jan 25
3
question on sqldf syntax
trying to structure sql to merge two datasets. structure follows:
dbs.possible.combos (all possible combinations of dates and places)
Date Place
1/1/10 N-01
1/1/10 S-02
1/2/10 N-01
1/2/10 S-02
etc...
dbs.aggregate (the raw data aggregated by date and location)
Date Place Days
1/1/10 N-01 6
1/1/10 S-02 10
1/2/10 S-02 5
Trying to merge so I look-up the values for each possible combo
dbs.final
2008 Dec 14
1
error with sqldf v0-1.4
I'm getting an error message when using the new version of sqldf,
> library(sqldf)
> str(kdv)
'data.frame': 71 obs. of 3 variables:
$ dpss: num 0.117 0.144 0.164 0.166 0.165 ...
$ npdp: num 0.1264 0.0325 0.0109 0.0033 0.0055 ...
$ logk: num 1.12 1.29 1.41 1.41 1.42 ...
> test=sqldf("select * from kdv")
Error in get("fun", env = this, inherits =
2008 Jan 29
1
sqldf error
Hi,
sqldf sounds like a very useful package but I don't
even get the example to run:
> a1s <- sqldf("select * from warpbreaks limit
6")
Error in combine(FUN(...)) : argument "value" is
missing, with no default
>
I am using R 2.6.1 on Windows Vista Business and have
updated all packages.
Some help would be very much appreciated.
Many thanks,
Werner
2007 Nov 10
7
How to more efficently read in a big matrix
Dear list,
I need to read in a big table with 487 columns and 238,305 rows (row names
and column names are supplied). Is there a code to read in the table in
a fast way? I tried the read.table() but it seems that it takes forever :(
Thanks a lot!
Best,
Allen
2011 Apr 13
1
Decimals in R/SQL
Hello,
When I am writing in sqldf or RSQLite I lose the decimals in my matrix.
The only way I can get decimals is by multiplying by 1.00000, etc. I
have tried manipulating the options, but it is only effective once I
multiply by 1.0000.
I appreciate any suggestions!
Thanks!
Example:
z <- sqldf ("select ST,
SUM(AGEP*PWGTP)*1.000000000/SUM(PWGTP)*1.00000000000000 as wgtage from
ss09
2010 Jun 27
2
Ways to work with R and Postgres
Hi,
I post this message to the general r-help list hoping anyone within a wider range have suggestions:
There are three ways to integration R and postgres, especially on 64bit Microsoft windows Platform,
1. via RODBC package, which has 32 bit and 64 bit version for windows
2. via RPostgres interface, which only has 32bit version currently
3. via plr for Greenplum, which only supports a
2012 Feb 02
9
sqldf for Very Large Tab Delimited Files
Hi All,
I have a very (very) large tab-delimited text file without headers. There
are only 8 columns and millions of rows. I want to make numerous pieces of
this file by sub-setting it for individual stations. Station is given as in
the first column. I am trying to learn and use sqldf package for this but am
stuck in a couple of places.
To simulate my requirement, I have taken iris dataset as an