R help - Aug 2008 - New to R. Question about very large files

.. I am new to R but experienced in SAS.  SAS has the capability to let me
develop a model from a sample and use the results to score the records of
another file which won't fit in memory.  Is this straightforward in R or
does it require coding to do the scoring in segments?  Can someone point me
to sample code that I can copy or modify to do this quickly?

-- 
Richard Palmer

Home 508 877-3862
Cell 508 982-7266

	[[alternative HTML version deleted]]

Richard Palmer <rhpalmer <at> gmail.com> writes:
> 
> .. I am new to R but experienced in SAS.  SAS has the capability to let me
> develop a model from a sample and use the results to score the records of
> another file which won't fit in memory.  Is this straightforward in R
or
> does it require coding to do the scoring in segments?  Can someone point me
> to sample code that I can copy or modify to do this quickly?
> 
I don't know what you mean by "score the records," but the package
biglm might
be able help.

Mark

Hi Richard,

It is if you use Rattle.  Rattle allows you to do that for quite a few types 
of models and has a really nice GUI interface.  It has been developed for 
the purposes of datamining, and given your use of the term "score" in
your
post, I assume in part that this is what you are looking for.  You can 
import a random sample of cases (a training percentage from the total 
dataset) and the package will use the remainder of your sample for testing 
and scoring.  Rattle is very sophisticated in terms of the algorithms it 
offers, and once you get going in R, SAS will become obselete (just 
kidding).

Sorry if I am wrong here about what you need.

Welcome ..... Paul

----- Original Message ----- 
From: "Richard Palmer" <rhpalmer at gmail.com>
To: <r-help at r-project.org>
Sent: Thursday, August 14, 2008 10:40 PM
Subject: [R] New to R. Question about very large files

> .. I am new to R but experienced in SAS.  SAS has the capability to let me
> develop a model from a sample and use the results to score the records of
> another file which won't fit in memory.  Is this straightforward in R
or
> does it require coding to do the scoring in segments?  Can someone point 
> me
> to sample code that I can copy or modify to do this quickly?
>
> -- 
> Richard Palmer
>
> Home 508 877-3862
> Cell 508 982-7266
>
> [[alternative HTML version deleted]]
>
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide 
> http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>