similar to: A good DBMS for R?

Hi R users, I am new to using DBMS with R for large datasets. Thanks to all who responded with useful suggestion to my earlier postings about using large datasets and DBMS with R. I am writing to get some help about how to design good tables in DBMS to take full advantage of the wonderful built-in facilities in R, like labels. I am using RMySQL client. Because R makes good use of variable

Dear R-users, I am faced with the problem of analyzing a huge dataset (+ 2 million records, +150 variables) which does not fit into memory. I would like to know if there are pre-packaged tools (in the spirit of Insigthful I-Miner, for instance) aimed at subsampling or splitting the dataset into data-frameable subdatasets, applying functions record-wise, etc. Thank you very much for your

I'm using Samba to allow my users to store their database on a Redhat 6.1 file server. I've got some who want to shift to using Linux instead of Windows but the DBMS they use is not supported (yet... I'm told) on Linux and I'm afraid that multi-user access on different OS's are going to screw things all to high heck anyways... But that being said... Are there existing

I'm currently trying to do analysis on a 565k record database of Philadelphia's property assessments. I read the Data Import/Export .pdf and am still conflicted about which DBMS I should use to maintain reliability and ensure I don't crash while trying to do my calculations. Should I go with PostgreSQL for the option of Proxy Data Frames or should I go with MySQL for the "lean

I am seeking to hire a hardware/software consultant to help me build a stem with a 64 bit OS, R, and a SQL-compatible DBMS. Please contact me if you know of anyone qualified. Details: I am in need of a robust system that will run R, and a SQL compatible database. I will be working with large datasets, and wish to take advantage of as much RAM as possible, and therefore think I should use a 64

Hello, I was reading your posts about RSYNC. We have a massive Oracle schema lots of datafiles about 750 GB size. We do rsync datafiles from source to target server but everytime we cleanup the datafiles on the target server and do rsync every 2 weeks. On the target side mostly the datafiles will be same but on source we might have added few datafiles or made some changes in data and as such the

All, I am having trouble with a "read.table()" function that is inside of another function. But if I call the function by itself, it works fine. Moreover, if I run the script on a Mac OS X (with the default Mac OS X version of R installed, rev 2.8), it works fine. But it does not work if I run it on windows vista (also default Windows version of R, rev. 2.8). Again, both

In a RoR application, is it possible to have individual userids associated with particular sessions employed to establish their related connections to the postgresql DBMS backend and, if so, is this design desireable? What are the implications for performance and future deployment limitations? The idea behind this question is that in our application certain tables require that the last

Hi - a question for all ye rsync guru's out there... I have a need to migrate some fairly large Oracle datafiles from a UFS filesystem to VxFS (VERITAS), however I am not being allowed nearly enough outage time to perform a standard file copy migration. The datafiles (of which there are about 4 are about 50GB each in size and on separate UFS filesystems. I am considering instigating a local

Hi, we have a 2 node / 3 node RAC installation with OCFS. We have the following observations. 1. TIME STAMP Issue We have noticed that the time stamp which is shown on the datafiles doesnt remain the same even after a shutdown normal /shutdown immediate i.e If I shutdown all RAC instances ( A , B , C) using shutdown normal / immediate, the timestamp on the datafiles are not the same. Even

AFAIK a script run through source() does not have any legit way to learn about it's own location. I need this to make sure that the script will find its datafiles after I move the whole directory. (The datafiles are in the same directory.) Here is a hack I invented to work around it: print(getwd()) source_pathname = get("ofile",envir = parent.frame()) source_dirname =

Hi, I agree that replacing data.frames for modeling functions would be too painful. Also I agree with Thomas that new class(es) for tabular data should not inherit from data.frame, and that data.frames should conceptually inherit from some other base tabular data class. At this point I'm not suggesting anything in concrete --- I haven't sorted it out in my own mind --- but I want

we are running OCFS on 2.4.21-15.0.4.ELsmp ocfs-2.4.21-EL-smp-1.0.12-1 ocfs-support-1.0.10-1 ocfs-tools-1.0.10-1 I have been deleting datafiles, more than 3 times successfully for rman duplication, from a mount point /data1 (total 191G). Last week when I tried to delete datafiles from the same directory, it did delete datafiles but did not release (reclaim) all space. It still showed that 20G of

Hi, is there a way to analyze subpopulations (e.g. women over 50, those who answered "yes" to a particular question) in a survey using Survey package? Other packages (e.g. Stata, SUDAAN) do this with a subpopulation option to identify the subpopulation for which the analysis shoud be done. I did not see this option in the Survey package. Is there another way to do this?

I need help. I'm trying to connect with an Oracle DBMS and MySQL DBMS, I'm using RJDBC package. My code is the next: library('rJava') library('DBI') library('RJDBC') //Mysql drv <- JDBC("com.mysql.jdbc.Driver","C:\\Temporal\\mysql-connector-java-3.0.9-stable-bin.jar","'") conn <- dbConnect(drv,

Hi, I wonder if anybody could help me in converting this easy SAS program into R. (I'm still trying to do that!) PROC IMPORT OUT= WORK.CHLA_italian DATAFILE= "C:\Documents and Settings\carleal\My Documents\REBECCA\stat\sas\All&nutrients.xls" DBMS=EXCEL2000 REPLACE; GETNAMES=YES; RUN; data chla_italian; set chla_italian;

Hi all, I've been trying to find a solution for the problem of reading multiple files and storing them in a variable that contains the names by which I want to call the datasets later on. For example (5 filenames): - The filenames are stored in one variable: filenames = paste(paste('name', '_', 1:5, sep = ''), '.csv', sep = '') - Subsequently I have

Hi, When attempting to restore to LINUX RHEL5 - OCFS2 filesystem received the following error during RMAN restore for nearly all of the datafiles attempted to restore with exception of a couple of smaller datafiles which were smaller < 2GB. ORA-19870: error reading backup piece /db/dumps/TR1_1/rmanbackup/TR1_88_1 ORA-19502: write error on file "/db/devices/db1/PR2/pr2_1/pr2.data1",

We had a situation over the weekend with our production database that we can't figure out, hoping someone can shed some light. Specifics: Oracle 9.2.0.4 OS is Redhat AS2.1 ocfs-2.4.9-e-summit-1.0.12-1 ocfs-tools-1.0.10-1 ocfs-support-1.0.10-1 ocfs-2.4.9-e-enterprise-1.0.12-1 All database, redo, undo, and control files are on ocfs, archived logs are on ext3. We shut down the database for san

We are in the process of upgrading to OCFS2. We have recently restored our Production Database to a Development platform configured with OCFS2 with RMAN. No problems. As for the Production migration, we understand that you cannot mount an OCFS volume (our current configuration) with OCFS2. We are interested in mounting an EXT3 file system, performing a cold RMAN backup, copying the datafiles