Displaying 20 results from an estimated 32 matches for "1.4gb".
2009 Jul 16
0
Question on importing large dataset (1.4GB) into R-Bioconductor
To whom it may concern,
I am a student from Peking University, China. I am currently doing some microarray data analysis research with Bioconductor package of R.
Problem arises when I try to import into R my dataset which contains 109 samples (total size more than 1.4 GB). The memory limit of R makes importing all the samples into one AffyBatch object a "mission impossible" for me.
2005 Feb 04
3
Handling large data sets via scan()
I'm trying to read in datasets with roughly 150,000 rows and 600
features. I wrote a function using scan() to read it in (I have a 4GB
linux machine) and it works like a charm. Unfortunately, converting the
scanned list into a datafame using as.data.frame() causes the memory
usage to explode (it can go from 300MB for the scanned list to 1.4GB for
a data.frame of 30000 rows) and it fails
2004 Oct 22
2
direct access or local IMAP access?
Hello,
Thanks to much help from Timo Sirainen, I now have a running dovecot on
my Mac, that works great both with mutt and Mail.app.
I'm going to have a lot of mail stored there (about 40000 messages for
1.4GB in 30 folders), and I was wondering if it was better (in terms of
performance and stability) to directly access the mail using the maildir
hierarchy, or access it using local IMAP.
2006 Jun 05
2
Swap
I know this is more of a general unix question, but the thread about the
last kernel update, and memory usage got me to looking and thinking.
Given a system with 2 Gb of memory, and at peak usage, top reports
considerably less than the 2 gig amount in use, as well as system
monitoring that never shows all available memory used, what would happen
if you just turned swap off, and let memory
2016 Sep 17
2
(Thin)LTO llvm build
So, when I embark on the next ThinLTO try build, probably this Sunday,
should I append -Wl,-plugin-opt,jobs=NUM_PHYS_CORES to LDFLAGS
and run ninja without -j or -jNUM_PHYS_CORES?
2005 Nov 25
2
Where to look or command
List,
I've got a process(s) that have been exiting on a signal 11, but not
all the time. I suspect it's memory related, and I was wondering, is
there any way to tell exactly how much memory a particular process has
in use at the point it sigsev's ? I can't sit here and watch top or the
system monitor, but thought maybe something might be saved somewhere
after the fact.
2006 Mar 01
1
Load Average
Maybe somewhat of a vague question, but what would constitute a moderate
and a heavy load as depicted by "top" on any particular machine? I am
trying to justify running this machine with near 100% cpu utilization on
both, with load averages between 5 and 5 according to top. I don't
particularly see any significant slowdown in the running processes, but
there is a chance the disk
2016 Sep 17
5
(Thin)LTO llvm build
On Sun, Sep 18, 2016 at 12:32 AM, Mehdi Amini <mehdi.amini at apple.com> wrote:
>
>> On Sep 17, 2016, at 3:19 PM, Carsten Mattner <carstenmattner at gmail.com> wrote:
>>
>> So, when I embark on the next ThinLTO try build, probably this Sunday,
>> should I append -Wl,-plugin-opt,jobs=NUM_PHYS_CORES to LDFLAGS
>> and run ninja without -j or
2009 Jul 09
2
Improvement of [dpq]wilcox functions
Hi,
I believe I have significantly improved [dpq]wilcox
functions by implementing Harding's algorithm:
Harding, E.F. (1984): An Efficient, Minimal-storage Procedure
for Calculating the Mann-Whitney U, Generalized U and Similar
Distributions, App. Statist., 33, 1-6
Results on my computer show (against R-2.9.1):
> system.time( dwilcox( 800, 800, 80) )
user system elapsed
0.240
2004 Jul 02
0
1.0-test24 and some mbox benchmarking
http://dovecot.org/test/
Again only mbox fixes. I found some more bugs which could have also
caused some of the mbox problems that people reported.
They were found when I today thought I'd again do a bit of testing with
my favourite 1.4GB mbox. Then I thought I might as well see how it
compares against UW-IMAP. First a bit of explanations how they work
internally:
Dovecot 1.0-test24
2011 Jun 02
8
How to format a USB drive?
I have a usb drive, /media/disk and I want to reformat it. There
are several questions that come up:
How can I determine the current format?
Do I use the mkfs command?
Many thanks...
Todd
--
Ariste Software
Petaluma, CA 94952
http://www.aristesoftware.com
2015 Jan 18
2
default min-v/nsize parameters
On Thu, Jan 15, 2015 at 3:55 PM, Michael Lawrence
<lawrence.michael at gene.com> wrote:
> Just wanted to start a discussion on whether R could ship with more
> appropriate GC parameters.
I've been doing a number of similar measurements, and have come to the
same conclusion. R is currently very conservative about memory usage,
and this leads to unnecessarily poor performance on
2002 Nov 13
0
timeout on large file sets
I'm getting "unexpected EOF in read_timeout" when dealing with large
collections of files.
The root path is /files, which has 1.4GB of data in 483260 files in 5328
subdirectories.
I tried setting "--timeout=600" as a test, but it is still timing out after
about 30 seconds. Shouldn't this do it? Or am I possibly having network
connectivity issues that may be
2003 Dec 17
0
samba linking Linux and OSX -- weird permissions
Greetings!
Samba works great for mounting OSX shares on Linux, or vice versa.
However, when I mount an OSX share on Linux, I get weird switches in
ownership and permissions. Take these examples from two Linux machines
(one and two), running Debian sid and Samba 3.0.0final-1, mounting a
directory on an OSX 10.3.
First, what the OSX machine shows through an ssh session:
[osx:~/Desktop]
2009 Nov 06
2
Optimizing Samba to stream movies
I am sharing some of my personal videos on a local network via Ubuntu
9.10/Samba 3.42 on my wired PC to wireless Windows XP and Vista users
with a 802.11g router in between. Some of the movies can stream fast
enough to watch uninterrupted, while others seem to skip often.
I searched online to see any optimization techniques and found this is
a popular one for the /etc/samba/smb.conf file:
2006 Dec 22
1
recommneded tape drives
Hi there, I am pricing out a dell 840 (low end file server) that will
run latest centos.
Can anyone recommend a good tape drive/card combo with centos? The
drives (to be backed up) in it will be a raid 0 - 500gb.
Thanks in advance!
Dustin
2006 Nov 27
5
startx reboots my computer
Well, sometimes startx reboots my computer. Other times is does nothing
except slow it to a halt for a while. Sometimes is locks up.
I am using init level 3. At the command line, everything looks fine, and I
can do whatever commands I want.
When I type startx, then things go down the tubes.
What doesn't happen:
X never starts
No error messages get posted to dmesg
no log is generated in
2015 Jan 20
1
default min-v/nsize parameters
>>>>> Peter Haverty <haverty.peter at gene.com>
>>>>> on Mon, 19 Jan 2015 08:50:08 -0800 writes:
> Hi All, This is a very important issue. It would be very
> sad to leave most users unaware of a free speedup of this
> size. These options don't appear in the R --help
> output. They really should be added there.
Indeed,
2011 Sep 05
1
Quota calculation
Hi Junaid,
Sorry about the confusion, indeed I gave you the
wrong output. So let's start to the beginning. I disabled quota and I
reactivated it
My configuration :
Volume Name: venus
Type: Distributed-Replicate
Status: Started
Number of Bricks: 2 x 2 = 4
Transport-type: tcp
Bricks:
Brick1: ylal3020:/soft/venus
Brick2: ylal3030:/soft/venus
Brick3: yval1000:/soft/venus
Brick4:
2006 Jun 01
2
Kernel update = slower ?
This is really strange. Day before, I updated the machine here (x86_64)
and all went normal. I rebooted, and everything came back just as I
expected. Next morning, I noticed one of my jobs during the night had
finished, but finished late by about 8 or 9 minutes. I really didn't
think much of it, but after looking at jobs running today, I'm seeing
the same thing. Processes that