similar to: Reduce memory peak when serializing to raw vectors

Presumably one could stream over the data twice, the first to get the size, without storing the data. Slower but more memory efficient, unless I'm missing something. Michael On Tue, Mar 17, 2015 at 2:03 PM, Simon Urbanek <simon.urbanek at r-project.org> wrote: > Jorge, > > what you propose is not possible because the size of the output is > unknown, that's why a

Jorge, what you propose is not possible because the size of the output is unknown, that's why a dynamically growing PStream buffer is used - it cannot be pre-allocated. Cheers, Simon > On Mar 17, 2015, at 1:37 PM, Martinez de Salinas, Jorge <jorge.martinez-de-salinas at hp.com> wrote: > > Hi, > > I've been doing some tests using serialize() to a raw vector: >

In principle, yes (that's what Rserve serialization does), but AFAIR we don't have the infrastructure in place for that. But then you may as well serialize to a connection instead. To be honest I don't see why you would serialize anything big to a vector - you can't really do anything useful with that ... (what you couldn't do with the streaming version). Sent from my iPhone

Hi, I've been doing some tests using serialize() to a raw vector: df <- data.frame(runif(50e6,1,10)) ser <- serialize(df,NULL) In this example the data frame and the serialized raw vector occupy ~400MB each, for a total of ~800M. However the memory peak during serialize() is ~1.2GB: $ cat /proc/15155/status |grep Vm ... VmHWM: 1207792 kB VmRSS: 817272 kB We work with very

Hi All, I am using RHEL 6.4 on a Dell Server with 32 cores. But in the Cpus_allowed_list only 30 cores are available. Why is that? See the snippet from cat /proc/self/status: Cpus_allowed: 7fff7fff Cpus_allowed_list: 0-14,16-30 The allowed list is same for the init process as well (see below). I didn't see this issue, in RHEL 6.2. Why is that? Is there a way to change it? -miraj

On Sat, 1 Jul 2017 16:30:25 +0100, Rowland Penny via samba wrote: > On Sat, 01 Jul 2017 11:48:21 -0300 > Guido Lorenzutti via samba wrote: > >> Hi there! I been using samba3 with ldap for years, and now im about to move to samba4 to leave the slapd. > > I take it you mean that you use Samba as an AD DC Exactly. >> I didnt try yet to migrate the directory from

Hi, sorry if this question is trivial or unclear, this is my first venture into mixed C/R programming (I am reasonably experienced in each separately). I am trying to write a serialization function for a format called typedbytes, which is used as an interchange format in Hadoop circles. Since I would need to serialize according to the internal R format many small R objects I looked at the c

Does backgroundrb support SSL like drb? I was unable to find any sample configurations including SSL. Any help would be appreciated, thanks. -jim salinas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://rubyforge.org/pipermail/backgroundrb-devel/attachments/20080521/9588825a/attachment.html>

Hi, I'm a recent R convert so I haven't quite figured out the details yet... How do I select one variable by another one? Ie if I want to draw the histogram of variable X only for those individuals that also have a value Y in a certain range? In STATA I would give something like: histogram X if ((Y>=A & Y<=B)) (The data is for individuals and each individual has a number of

Hi there, Here at my company we are willing to use the asterisk IVR system. The problem we are having rigth now is that all our GWs use G729. I've read that in order to asterisk be able to make transcoding from the GSM audio files to G.729, it is necesary to purchase a license from digium. Is this correct? I've seen that licenses are purchased on a per-channel basis. Could

Hi, we are setting a 120-channel conference server and would like to learn if someone already did this (hardware, problems, etc...) Best regards, PauloHM

I'm trying to efficiently allow conversion of R objects to PostgreSQL bytea (raw binary) datatype within PL/R for persistent storage in Postgres tables. I have found R_serialize() which looks like what I need, -- e.g. R_serialize(object, NULL, FALSE, NULL) -- except that it is marked attribute_hidden. Is there some other externally available interface that I can use? Thanks, Joe

Folks, i thought it should be straightforward but after a few hours poking around, I decided it's best to post my question on this list. I have a data frame consisting of a (large) number of date columns, which are read in from a csv file as character string. I want to convert them to Date type. Following is an example, where the first column is of integer type, while the rest are type

I'm using Wine 1.0 on Puppy Linux 3.01 I wrote an application with a http-server and a socket-server for windows and I like to use this on linux. (Delphi with Indy components) My application works fine on windows without any memory leak. But running with wine the VmRSS-value is permanently increased. I use following bash-script to check this: Code: while true; do cat

I'm using Wine 1.1.18 on Puppy Linux 3.01 I wrote an application with a http-server and a socket-server for windows and I like to use this on linux. (Delphi with Indy components) My application works fine on windows without any memory leak. But running with wine the VmRSS-value is continual increased. I use following bash-script to check this: Code: while true; do cat

Hi all, This is my first post, I hope you will help me. I've some data to present with histograms. I have few values with almost 99% of the frequencies (thousands) and some other values with low frequencies (below one hundred) that I want to emphasize. I think if I could present the logarithms of the frequencies, these could be presented in a more convenient way, but I don't know how

http://r.789695.n4.nabble.com/file/n3312061/x_and_y_values.txt x_and_y_values.txt I have the absorbance values form HPLC Chromatogram. I need to find the peaks in datapoints and area under each peak. I am not sure how how to find the peaks, I tried couple of libraries and peak function but they return me a list of values which when computed from area turns out to be huge nnumbers. In the

Hi, I've been trying to find a way to label the the peak or mean of a densityplot for a while but haven't been successful. Does anyone know how to accomplish this? Thank you for your help in advance. Joon [[alternative HTML version deleted]]

While reviewing Greg Woods' PATCH 28/36, I realized that our namespace use "peakcurrent". A more coherent name would be "current.peak", as used in Greg's patch (well, in the metasys driver to be precise). For the time being, only the upscode2 driver is using "peakcurrent". But as told, metasys is already using "current.peak". So I'm going to

I have two questions... When I disconnect from my Icecast mount (when broadcasting), I want the following to happen... 1. The "Peak Listeners" count to not be reset to 0 the next time I connect 2. For the mount to remain present (so that my listeners don't get a 404 error and remain listening to silence until I reconnect. Is this possible? Thanks in advance, -- Ben