I will be involved with an analysis based on a file that will be roughly 25 meg. Assuming I have enough memory, is their any limitations to using R on a file this large. Thank you, Gregory L. Blevins Vice President, Partner The Market Solutions Group, Inc. gblevins at marketsolutionsgroup.com Office phone: 612 392-3163 Cell phone: 612 251-0232
On Mon, 6 Jan 2003, Greg Blevins wrote:> I will be involved with an analysis based on a file that will be roughly 25 meg. Assuming I have enough memory, is their any limitations to using R on a file this large.That's a small file! Seriously, people work on datasets of 100Mb or so in 1Gb (or even 512Mb) machines. However, some care is needed to select a good way to read the data in (if read.table, do follow the advice on the help page), and it would probably be better to use a database interface (see the Data Import/Export manual). -- Brian D. Ripley, ripley at stats.ox.ac.uk Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/ University of Oxford, Tel: +44 1865 272861 (self) 1 South Parks Road, +44 1865 272866 (PA) Oxford OX1 3TG, UK Fax: +44 1865 272595
On Mon, 13-Jan-2003 at 01:13PM +1300, Patrick Connolly wrote: |> On Tue, 07-Jan-2003 at 10:52AM +0000, ripley at stats.ox.ac.uk wrote: |> |> |> On Mon, 6 Jan 2003, Greg Blevins wrote: |> |> |> |> Something simple, no doubt, but nothing I can see. Simple alright. For some unexplained reason, I had another version of read.table in with my local functions. (Evidently, the nrows parameter has been added in the last two years, from my limited investigations.) Sorry if I alarmed anyone. Now, if I could just imagine how that happened...... Thanks to James Holtman for a suggestion. -- Patrick Connolly HortResearch Mt Albert Auckland New Zealand Ph: +64-9 815 4200 x 7188 ~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~ I have the world`s largest collection of seashells. I keep it on all the beaches of the world ... Perhaps you`ve seen it. ---Steven Wright ~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~