similar to: R for large data

I've seen several posts over the past 2-3 weeks about memory issues. I've tried to carefully follow the suggestions, but remain baffled as to why I can't load data into R. I hope that in revisiting this issue that I don't exasperate the list. The setting: 1 gig RAM , Linux machine 10 Stata files of approximately 14megs each File contents appear at the end of this boorishly long

I've seen several posts over the past 2-3 weeks about memory issues. I've tried to carefully follow the suggestions, but remain baffled as to why I can't load data into R. I hope that in revisiting this issue that I don't exasperate the list. The setting: 1 gig RAM , Linux machine 10 Stata files of approximately 14megs each File contents appear at the end of this boorishly long

Everyone, I am putting together a new mail server for our firm using a SuperMicro with Centos 7.0. When performed the install of the os, I put 16 gigs of memory in the wrong slots on the mother board which caused the SuperMicro to recognize 8 gigs instead of 16 gigs. When I installed Centos 7.0, this error made the swap file 8070 megs instead of what I would have expected to be a over 16000

I have a question about stacking datasets. I have 40 stata datasets that have exactly the same number of variables, with the same names (~420k rows, 8 columns). The datasets are relatively large ~ 15 megs. If they were text files a linux "cat file1 file2 >> combo" sort of strategy would work. I've considered using a merge command, but I don't want any records merged,

I'm trying to install centos 5 on an old machine, a Micron with a pentium III and 250 megs of ram. I'm using the DVD image. The media check said the DVD was OK. Everything starts fine (both in graphics and text modes), untl I get to the custom partition table. The new system will go on hda, with the boot and root partition reformatted (see below). I laid it out to preserve the data on

Dear all, my problem is following. I know Stata, but currently I have to use R. Could You please help in finding the analogy to R. (1) creating of City-Dummy. I know in Stata: g byte city=0 replace city=1 if city==12&year==2000 and (2) Create a Time-Dummy-Variable g byte T2000=0 replace T2000=1 if year==2000 (3) I need the City DUmmy for the following combination: I have the

Hi, I'm trying to rsync a fairly large chunk of data [around 350 gigs, mostly 1 gig files] between 2 hosts in separate colo facilities. Link is plenty fast, I can pull 10 megs easily. Everytime, it seems to die with something like this, whether I try rsync from the stable 2 branch or the beta 3 branch sent 453675 bytes received 956704928 bytes 404632.68 bytes/sec total size is

Dear folks ? I have a large (26 gig) ASCII flat file in fixed-width format with about 10 million observations of roughly 400 variables. (It is 51 years of Current Population Survey micro data from IPUMS, roughly half the fields for each record). The file was produced by automatic process in response to a data request of mine. The file is not accompanied by a human-readable file giving the

As you know, Stata support in 'foreign' was frozen a while back at Stata version 12. R-core has received a request from a grad student to 'give top priority' to supporting Stata 13. That is not going to happen, not least because none of us has access to Stata. However, according to Stata's documentation both Stata 12 and 13 use format 115, so foreign::read.dta should be

Rob J Hyndman gives great explanation here (https://robjhyndman.com/hyndsight/estimation/) for reasons why results from R's arima may differ from other softwares. @iacobus, to cite one, 'Major discrepancies between R and Stata for ARIMA' (https://stackoverflow.com/questions/22443395/major-discrepancies-between-r-and-stata-for-arima), assign the, sometimes, big diferences from R

Hi I am using Stata 10 and I need to import a data set in stata 10 to R, I have saved the dataset in lower versions of Stata as well by using saveold command in Stata. My RAM is 4gb and the stata file is 600MB, I am getting an error message which says : "Error: cannot allocate vector of size 3.4 Mb In addition: There were 50 or more warnings (use warnings() to see the first 50)" Thus

Hi, I am new to R, but a fairly `old' user of Stata. I read posts asking about survey methods and large datasets in the archive, so I will not ask those questions again. But some still remain: - R seems to consume more memory given the same set of data, say if I have only a data frame defined, than Stata. Am I right if I think that this is because the object oriented nature of R and can

Hi, I am new to R, but a fairly `old' user of Stata. I read posts asking about survey methods and large datasets in the archive, so I will not ask those questions again. But some still remain: - R seems to consume more memory given the same set of data, say if I have only a data frame defined, than Stata. Am I right if I think that this is because the object oriented nature of R and can

I'm developing a minimal embedded linux system that will be running on a powerpc chip. I can get everything to work but the size is quite large. The majority of my size requirements are in libcrypto.a which is around 1.52 Megs I tried to pare it down further by removing some crypto options [ Configure linux-ppc no-asm no-cast no-des no-dh no-md2 no-mdc2 no-rc2 no-rc4 no-rc5 shared ] This

I have a client who uses Stata 11. Can anyone advise me on ways of transferring data from this version of Stata to R? Reading the documentation for read.dta in package foreign it seems it only allows for versions up to Stata 10. I don't know Stata at all but a bit of poking around on their website led me to believe Stata 11 couldn't write in Stata 10 format. However Stata 11 can

On 2015-02-15, Gregory P. Ennis <PoMec at PoMec.Net> wrote: > > I am putting together a new mail server for our firm using a SuperMicro > with Centos 7.0. When performed the install of the os, I put 16 gigs of > memory in the wrong slots on the mother board which caused the > SuperMicro to recognize 8 gigs instead of 16 gigs. When I installed > Centos 7.0, this error made

On Sun, 2015-02-15 at 17:37 -0800, Keith Keller wrote: > On 2015-02-15, Gregory P. Ennis <PoMec at PoMec.Net> wrote: > > > > I am putting together a new mail server for our firm using a SuperMicro > > with Centos 7.0. When performed the install of the os, I put 16 gigs of > > memory in the wrong slots on the mother board which caused the > > SuperMicro to

Hi, I have a new job, and everyone here uses Stata. I won't give up on R, but I must learn better how to exchange data between the two softwares. I am now focusing on importing data from Stata to R, and I must confess that I am a bit disappointed with the read.dta function from the foreign package because IT typically happens that (i) I get a big R file (for example, a 15Mb Stata file

Hello, This might be a bit off-topic, and I apologize. But I think this might be a FS problem I'm having with ext3 (but I'm not sure). I finally got RH 7.2 to install on my new box. The box looks like: Epox 8KHA+ motherboard (KT 266A chipset) 512 Meg DDR DRAM WD 200BB HD S3 Savage 2000 64 Meg card (set at AGP 4x) NEC 5FGp monitor Intel NIC CD floppy I partitioned the HD to look

Hi. I want to use R with very large files, a couple hundred megabytes, but R crashes every time that I try. Reading help files seems to indicate that R ought to manage its memory itself. I know I have enough memory since stata handles these files perfectly well. I have a mac running OS 10.3 and am running RAqua 1.8.1. Is there anything I can do to make it deal with these files successfully?