similar to: Keeping memory usage low for a big script

Displaying 20 results from an estimated 40000 matches similar to: "Keeping memory usage low for a big script"

2005 May 25
3
Rounding fractional numbers to nearest fraction
Hi all, I've got a matrix of fractional data that is all positive and greater than zero that I would like to "loosely" classify, for lack of a better word. It looks something like this : 1.07 1.11 1.27 1.59 0.97 0.76 2.23 0.98 0.71 0.88 1.19 1.02 What I'm looking for is a way to round these numbers to the nearest 0.25, i.e. the above matrix would be
2005 Oct 03
3
Problem building/checking library that requires input from user
Hi all, I've got a package i've written that i am trying to check, build, and install. This is my 1st time doing this, so apologies in advance... ;) The package that I've written requires input from the user. It needs to know sample sizes and then runs some calcs, (sample sizes are just integers), and it gets this info from the user as num_reps <- readline("How many reps
2005 Oct 11
4
Any way to add to data frame saved as .rData file?
Hi all, I've got a script that generates a few moderate-size data frames, and then puts them together into one big data frame at the end in order to write that data frame to disk, so that it may be re-opened later on... I'm trying to trim down memory requirements in this script, so I was wondering if there was any way to append to a data frame already saved on disk (just like
2005 Jul 11
2
Isolating string containing only file name from complete path
Hi all, What I'd like to do is to is to be able to extract a string corresponding to only the file name from a string containing the complete path, i.e. from the following path string: "/Users/ken/Desktop/test/runs/file1" I would like to end up with: "file1" This would be most ideally done in a platform-independent way. Thanks in advance, -Ken
2006 Jan 23
3
ordering a data frame to same order as a chr vector
Hi all, I've got a data frame that has an identical column to a chr vector. I would like to use the chr vector to order the rows of the data frame to be identical to the order in the chr vector (the contents of the chr vector are completely identical to one col of the data frame), but this is proving trickier than it sounds.. Any help would be much obliged, -Ken
2005 Dec 14
2
memory tops out at 1.84gb on OS X 10.4 machine w/ 5GB ram
Hi all, Sorry if this is a dumb question, but I am on 10.4 with R2.2, and when loading a big text file (~500MB) with scan(file, what=character) I am throwing malloc errors that say I am out of memory...I have 5GB on this machine, and Activity Monitor tells me R is only up to ~1.84GB both times this has happened (running from terminal)... I am wondering why this is happening when I still have
2005 Jan 24
1
Deleted objects keep coming back
Having a very strange and frustrating problem with v2.0.1 under Mac OSX 10.3. I have several closely related workspaces in the same directory that I need to keep separate from one another (there are a few objects common to all workspaces, and then there are other objects that store the results of different analyses on the common objects, which is why I need separate workspaces). When I
2005 Apr 08
1
Princomp$Scores
Hi all, I was hoping that someone could verify this for me- when I run princomp() on a matrix, it is my understanding that the scores slot of the output is a measure of how well each row correlates (for lack of a better word) with each principal component. i.e. say I have a 300x6 log2 scaled matrix, and I run princomp(). I would get back a $scores slot that is also 300x6, where each value
2005 Feb 08
4
Renaming columns in data.frame, inserting/removing columns from data.frame
Hello, I'm hoping that there is an easier way to rename columns in a data frame other than by using the names() assignment, which requires you to type in all the column names at once for a data.frame, in the case that I simply want to rename a single column in a data frame. Also, is there an easy way to move columns in a data frame around relative to the other columns? Thanks in
2005 Oct 03
0
Problem building/checking library that requires input fro m user
What file are you putting these into? I believe this is the correct syntax for the \example{} section of an .Rd file. If you want to do this in a plain R file, (e.g. package/tests/somename.R), you can use if(interactive) { num_reps <- readline(""How many reps do you have... ") num_reps <- as.integer(num_reps) } else num_reps <- 10 instead. -G > -----Original
2005 May 05
2
Intersection of more than two groups in one function?
Hi all, As far as I can tell, the only canned way to do an intersect between two vectors of ints is the intersect(vec1, vec2) function -- is there another function I'm missing for intersecting more than two vectors?? TIA, Ken
2005 Mar 17
1
Binding one column of characters into a dataframe factors other numeric columns
Hi all, I searched through the archives, but couldn't find a fix... Basically, I've got a bunch of numeric vectors and one character vector that I want to bind into a data frame. When I include the character vector as a column in the data frame, all the numeric columns get factored in the data frame, which makes it tough to call those columns for calculations later on. I've tried
2011 Oct 13
1
[PATCH] Use SSL_MODE_RELEASE_BUFFERS if available to keep memory usage low
# HG changeset patch # User Cristian Rodr?guez <crrodriguez at opensuse.org> # Date 1318533592 10800 # Node ID c15d6befe20082009cb40926afa208ab4b684818 # Parent 962df5d9413a4a0fcc68aacc1df0dca7a44a0240 Use SSL_MODE_RELEASE_BUFFERS if available to keep memory usage low. diff -r 962df5d9413a -r c15d6befe200 src/login-common/ssl-proxy-openssl.c --- a/src/login-common/ssl-proxy-openssl.c Wed
2013 Apr 18
1
Memory usage reported by gc() differs from 'top'
In help(gc) I read, "...the primary purpose of calling 'gc' is for the report on memory usage". What memory usage does gc() report? And more importantly, which memory uses does it NOT report? Because I see one answer from gc(): used (Mb) gc trigger (Mb) max used (Mb) Ncells 14875922 794.5 21754962 1161.9 17854776 953.6 Vcells 59905567 457.1 84428913 644.2
2006 Jan 12
1
bug with mai , pdf, and heatmap ?
Hi all, When using heatmap() with a pdf driver, and specifying parameters for mai in heatmap, I get a printout of the mai parameters at the top of the pdf...see attachment. This is on win2k pro with R2.2.1 Thanks, Ken
2005 Apr 18
1
Storing vectors as vectors and iterating through them
Hi all, I have a bunch of int vectors. Each vector holds a bunch of ints that correspond to row numbers of an existing matrix. I use the int vectors to pull out rows of data from a matrix, i.e. data <- my_matrix[int_vector,] I would like to store these int vectors in some sort of data structure that will preserve them as-is and allow iteration. I guess what I'm looking for would be
2005 Mar 07
1
Faster way of binding multiple rows of data than rbind?
Hi all, I have a vector that contains the row numbers of data taken from several filtering operations performed on a large data frame (20,000rows x 500cols). In order to output this subset of data, I've been looping through the vector containing the row numbers (keepRows). output <- data.frame(row.names = rownames(bigMatrix)) for(i in keepRows) { output <- rbind(output,
2014 Jan 17
2
Very long delay for first write to big filesystem
I asked about this a while back. It seems that this problem is getting much worse. The problem/issue: there is a very long delay when my system does a write to the filesystem. The delay now is over 5 minutes (yes: minutes). This only happens on the first write after booting up the system, and only for large files - 1GB or more. This can be a serious problem since all access to any hard disk is
2008 Nov 13
2
Samba memory usage - how big is it?
Hi, I'd upgraded samba to v3.0.32 last Sunday before our samba server started to hang. Every day we have to restart our server 2-3 times (today I just restart it once). I can see via System Monitor that 33 of our users each (pid) consume 13.6Mb (average) of memory. Our server only have 1Gb of RAM but usually it runs very well (except that we've already moved solidworks engineer to work
2008 Nov 13
1
Fwd: Samba memory usage - how big is it?
Sorry forgot to include the list. > From: Mike Gallamore <mike@mpi-cbg.de> > Date: November 13, 2008 3:49:21 PM GMT+01:00 > To: Volker.Lendecke@SerNet.DE > Subject: Re: [Samba] Samba memory usage - how big is it? > > I didn't include the whole output which would be about a page. Yeah > it is just a total of the columns. There is commands for excluding > shared