Displaying 6 results from an estimated 6 matches for "kmb56".
2016 Dec 15
1
Parallel compression support for saving to rds/rdata files?
...First question: Should the above work?
Second question: Is it possible to make this dummy friendly by allowing
"pigz" as an option for ``compress`` in saveRDS and save? And in such a way
that the decompressing is hidden from the user like normal?
Thanks!
Kenny
--
Kendon Bell
Email: kmb56 at berkeley.edu
Phone: (510) 612-3375
Ph.D. Candidate
Department of Agricultural & Resource Economics
University of California, Berkeley
[[alternative HTML version deleted]]
2016 Jul 27
2
Model object, when generated in a function, saves entire environment when saved
...ction (object) {
> tf <- tempfile(fileext = ".RData")
> on.exit(unlink(tf))
> save(object, file = tf)
> file.size(tf)
> }
>
>
>
> Bill Dunlap
> TIBCO Software
> wdunlap tibco.com
>
> On Wed, Jul 27, 2016 at 10:48 AM, Kenny Bell <kmb56 at berkeley.edu> wrote:
>
>> In the below, I generate a model from an environment that isn't
>> .GlobalEnv with a large object that is unrelated to the model
>> generation. It seems to save the irrelevant object unnecessarily. In
>> my actual use case, I am running...
2016 Jul 27
3
Model object, when generated in a function, saves entire environment when saved
In the below, I generate a model from an environment that isn't
.GlobalEnv with a large object that is unrelated to the model
generation. It seems to save the irrelevant object unnecessarily. In
my actual use case, I am running and saving many models in a loop that
each use a single large data.frame (that gets collapsed into a small
data.frame for estimation), so removing it isn't an
2016 Jul 27
0
Model object, when generated in a function, saves entire environment when saved
...he save file when using the naive method.
saveSize <- function (object) {
tf <- tempfile(fileext = ".RData")
on.exit(unlink(tf))
save(object, file = tf)
file.size(tf)
}
Bill Dunlap
TIBCO Software
wdunlap tibco.com
On Wed, Jul 27, 2016 at 10:48 AM, Kenny Bell <kmb56 at berkeley.edu> wrote:
> In the below, I generate a model from an environment that isn't
> .GlobalEnv with a large object that is unrelated to the model
> generation. It seems to save the irrelevant object unnecessarily. In
> my actual use case, I am running and saving many mod...
2016 Jul 27
0
Model object, when generated in a function, saves entire environment when saved
....RData")
> > on.exit(unlink(tf))
> > save(object, file = tf)
> > file.size(tf)
> > }
> >
> >
> >
> > Bill Dunlap
> > TIBCO Software
> > wdunlap tibco.com
> >
> > On Wed, Jul 27, 2016 at 10:48 AM, Kenny Bell <kmb56 at berkeley.edu> wrote:
> >
> >> In the below, I generate a model from an environment that isn't
> >> .GlobalEnv with a large object that is unrelated to the model
> >> generation. It seems to save the irrelevant object unnecessarily. In
> >> my actu...
2020 Jan 29
2
Model object, when generated in a function, saves entire environment when saved
...f))
>> > save(object, file = tf)
>> > file.size(tf)
>> > }
>> >
>> >
>> >
>> > Bill Dunlap
>> > TIBCO Software
>> > wdunlap tibco.com
>> >
>> > On Wed, Jul 27, 2016 at 10:48 AM, Kenny Bell <kmb56 at berkeley.edu>
>> wrote:
>> >
>> >> In the below, I generate a model from an environment that isn't
>> >> .GlobalEnv with a large object that is unrelated to the model
>> >> generation. It seems to save the irrelevant object unnecessarily....