similar to: question about R on Linux Cluster

Hi, do any one have experience with loading dataset that is larger than 2GB into R. My organization is a SAS oriented shop and I'm in the process of switching it to R. One of the complain about R has always been it's inability to handle large dataset (>GB) efficiently. I would like some comments from someone with experience of working on >2GB dataset in R. Thanks. Apollo

I have a function that needs to be repeated many times with for loop. I have take measure to rm all the big arrays that was used in the function. The only array that cannot be rm was the return arrays. The loop needed to be repeat for over 2000 times and I am using v1.6.0 in Windows 2000 When I look at the task manager, I see that the memory used by R keep going up and reach more than 1G byte

Dear R users, I have access to a Sun cluster with multiple processors , a lot of RAM and with RedHat installed. I want to take advantage of its power for a R routine very time consuming. Whick package do I have to use? I know there are snow,snowFT and others package.Which is the best for my purpose? Do someone have experiences with this? Thanck in advance. Moreno

Hello, right now I'm thinking about running R 2.0.0 on box A (Debian SID) but at the same time having access to the ressources of box B (Ubuntu Linux) regarding disk capacity, RAM, idle CPU cycles . Is there anyone of you that has already installed and administred such a tiny (home based) cluster? Well, the term cluster seems quite a bit of an exaggeration related to what I am looking

Hi there, We're currently attempting to explain a slowdown of an LVQ-type parallel analysis we're working on. We are benchmarking our analysis running over openMosix against the same running via SNOW for R. Both perform similarly on small datasets, but on large datasets SNOW drastically outperforms openMosix. However, these results are achieve running SNOW on the default RedHat

Hello, I have a question about running R in a cluster environment. The shell script I am running looks like this: #!/bin/bash cd /nfs/apollo/2/c2b2/users/mb0001/Data /nfs/apollo/1/shares/software/core_facility/local/x86_64_rocks/R/current/bin/ R --save < calculate.R >& script.out I have used the "-save" command to save the R workspace (If, I understand it

Hello, I tried the v1.0 test of dovecot, because it should make the directories for me. I configured it and installed it. The old one is still there, but I shut it down to test the other version. When I start the new v1.0 test of dovecot i get the following message in my log: Jun 6 13:33:08 APOLLO dovecot: Dovecot v1.0-test72 starting up Jun 6 13:33:09 APOLLO dovecot: Auth process died too

Dear all, We have started using R for data analysis since a few months and find it useful. We are planning to acquire a high-end dedicated system for microarray data analysis and thinking of a distributed environment. I would appreciate if some one could send some pointers regarding how to choose a proper hardware configuration, software (R or other software, esp. MATLAB), issues on setting up

Hi all, I was hoping to get some advice about a problem that I realize will be difficult to reproduce for some people. I'm running R 1.7.1 on an openMosix (Linux) cluster and have been experiencing some odd slow-downs. If anyone has experience with such a setup (or a similar one) I'd appreciate any help. Here's a simplified version of the problem. I'm trying to run the

Hi, I've been struggling with this problem for the last couple of hours and am nowhere near solving the problem. I am trying to run a tftp server in a chroot jail. Now perhaps I am being paranoid, but I would like to have it launched from within its own jail even if it supposedly does a chroot itself and runs with a parameterizable user. I downloaded the atftp-server package and tried

As per request by Arnaud in the users list Device manufacturer: Apollo Device name: 1085VC (Retailer's product page: http://shop.esquire.co.za/ProductDescription.aspx?id=583072) upsc on mains power: > $ upsc apollo > battery.voltage: 13.50 > battery.voltage.nominal: 12.0 > beeper.status: enabled > device.mfr: > device.model: > device.type: ups > driver.name:

Hi, I'm trying to setup a Linux CD on mashine that will have nothing but a CDROM. Everything worked fine until I removed the HDD. From this moment on the CD doesn;t boot. I upgraded to Syslinux 2.0 but with no luck. The error message I got almost says it all: "Extremely broken BIOS", but can I ask for help if there some ideas how to fix this, cause if I put the HDD back the CD boots

Dear R People: I was wondering if there were any packages for parallel programming in R. According to the R-help, at one time there was a package called SNOW. It doesn't seem to exist anymore. Any help would be much appreciated! Sincerely, Erin Hodgess mailto: hodgess@gator.uhd.edu [[alternative(swapped) HTML version deleted]]

Dear FLAC User's Mailing List, I'm Miguel A. Mota Jr., Co-Founder and President of the Woodrow Wilson High School Science & Technology Club in Camden, New Jersey USA. With a few small grants from Lucent Technologies/Bell Labs, we have developed a parallel-processing Linux Cluster (6 nodes) based on Red Hat 7.3 (2.4.18 kernel ) and openMosix clustering technology. Its not much,

Hi Having followed this guide: http://blog.shadypixel.com/monitoring-a-ups-with-nut-on-debian-or-ubuntu-linux/and seeing support for Apollo UPSes mentioned on the compatibility list (genericups, type=4) I tried to set up Nut as follows. OS: Ubuntu Server 12.04 Nut: 2.6.3 (I believe - from Ubuntu repos) ups.conf: > [apollo] > driver = genericups > upstype = 4 > port = /dev/ttyUSB0

Hi folks, is it possible to read more things about R behavior in multiprocessor / multihost environment ? Is there any distributed computation project associated to it ? Laurent

Hi, I've got an odd situation here. Somehow, I find myself with two files that start with the - character. [eric at apollo mysql]$ ls -l total 93348 -rw-r--r-- 1 mysql mysql 9273344 Nov 13 19:03 -N=2007-11-08 -rw-r--r-- 1 mysql mysql 38879232 Nov 13 19:02 --newer=2007-11-08 Don't ask how they were created; something went wrong with a script at some point. My problem is that I am

Caveat: I've only played with this a couple of years ago... I believe you can just add each host _twice_ (or as many times as the number of CPUs at that host) to get both CPUs to work. Andy From: Paul Y. Peng > > Hi, > > does anybody know how to use the dual processors in the > machines of a cluster? I am using R with rpvm and snow > packages. I usually start pvm

Hello, When I run the 'smbclient -L apollo' command at the UNIX prompt a I get an error. I have gone as far as I can in this DIAGNOSIS.txt file. Does anyone have any thoughts on what may be causing my problem ? I have made my comments to the DIAGNOSIS.txt file via '---- davidw {comment}' so you can see what I've done to date. Also, I thought I'd pass on the output

Oops. Seems I only sent this to myself. T. -------------- next part -------------- An embedded message was scrubbed... From: "Timothy H. Keitt" <tklistaddr at keittlab.bio.sunysb.edu> Subject: Re: [R] Multithreading Date: 16 Apr 2002 12:34:52 -0400 Size: 2091 Url: https://stat.ethz.ch/pipermail/r-help/attachments/20020416/dd6c9385/attachment.mht