similar to: reading large data

Displaying 20 results from an estimated 3000 matches similar to: "reading large data"

2004 Aug 16
1
turning off automatic coersion from list to matrix
Hello, I am having trouble understanding how R is coercing between matrices and lists in the following example. I have an aggregate behavior I like: aggregate(a[,"num"],by=list(product=a[,"product"],region=a[,"region"]), sum) Now in reality I have more columns than just product and region, and need to pick different combinations. So I want to abstract this into a
2004 Jun 02
1
data filtering
I would like to know if there is a way to do the following command in one step, primarily for speed on large data (5 million elements), and secondarily for readablity. mean(delta[(intersect(which(x[['class']]==0),which(delta<1)))]) Do I really have to rely on an intersect operator? Isn't that O(nlg(n))? Can't I just filter in one step? As an R newbie, I would have guessed
2006 Mar 31
2
R garbage collection
r-help, The R manual lists two types of memory: transient and user-controlled. If I have transient blocks reachable from the globals only by traversal through user-controlled blocks, will they be correctly preserved? Secondly, what are the ways to mark user controlled blocks as "roots" for the garbage collector, so that transient blocks they reference stay uncollected? So far I
2006 Mar 31
2
R garbage collection
r-help, The R manual lists two types of memory: transient and user-controlled. If I have transient blocks reachable from the globals only by traversal through user-controlled blocks, will they be correctly preserved? Secondly, what are the ways to mark user controlled blocks as "roots" for the garbage collector, so that transient blocks they reference stay uncollected? So far I
2007 Oct 24
1
setuid question
I've got a problem I hope someone can help with. We have a directory on a redhat box where we want anyone who creates a file (usually done with samba access) to have that file be created as if by a special "user" and group.. Now in the smb.privateshares config file we specify force user and force group.. However when we create a file in this directory it shows it being owned by the
2007 Oct 11
1
problem installing MCMCpack
I'm completely new to R and am trying to install an add-on package for one of our faculty members. I've had no problems with most of them, but am completely stuck trying to figure out why MCMCpack won't install.. any help is VERY much appreciated!!! here's what I get when I try to install the package: * Installing *source* package 'MCMCpack' ... checking for C++ compiler
2007 Mar 08
2
Composite Primary Keys
Have been looking into using rails but am finding the "Composite Primary Keys are Bad" thing a tad disturbing (to put it mildly). I have been working with RDBMS systems for over fifteen years and this is the first time I have herd the idea questioned. I have cone across using surrogate keys which mirror the composite key for performance reasons in VERY big databases but I have never
2016 Mar 16
2
Index corruption in 2.2.18
We are using dbox with lz4 compression and dovecot-lda + sieve for delivery. Mail recieved: Mar 16 06:27:55 mail2 dovecot: lda(svs at example.com): sieve: msgid=<20160316032754.4C89D2C4 at rdbms.oldstable.office.example.com>: stored mail into mailbox 'INBOX' Around 08:14:00 user start his thunderbird with local filters. He found one mail without headers. Around that time user do
2006 Apr 17
7
Should Perl talk to Rails via LWP
Hi folks, I need your opinions on a basic design issue. I''ve seen the light of RoR and have replaced my Perl (DBI/CGI) based web server <-> RDBMS communication with RoR, but I still have a whole host of users (other servers/OS''s etc) out there wanting to talk to my RDBMS and they only talk Perl. Also they don''t want to talk Perl/DBI directly (they are not allowed
2008 Apr 08
4
Practical Data Limitations with R
We are new to R and evaluating if we can use it for a project we need to do. We have read that R is not well suited to handle very large data sets. Assuming we have the data prepped and stored in an RDBMS (Oracle, Teradata, SQL Server), what can R reasonably handle from a volume perspective? Are there some guidelines on memory/machine sizing based on data volume? We need to be able to handle
2006 Dec 14
1
Actually what is the SQL DB used for?
Is a RDBMS required for Dovecot to run in small (SOHO) environments? (Does it store indexes to the mail, etc.?) Or is it strictly leveraged for larger-scale environments? I'm asking, because the INSTALL says ./configure and make is enough for most...but as my previous post requested...there isn't anywhere that lists Required Packages/Software. We need to get that out there before 1.0RC
2009 Aug 20
3
Wind-data analysis with R?
Hello, are there people outside who use R for analysis of wind-measurement data (meteorological or for planning of wind power stations)? Are there already scripts/modules available for analysing and displaying/plotting wind data in the way it is done in projection/planning of wind power stations? If not, would it be of interest to use R for this, and therefore adapt data-logger output to R (by
2006 May 25
2
Best way to validate an integer field?
I am trying to validate an integer field called quantity. I don''t know how to chack if it has gone beyond or below the maximum or minimum value allowed by the Firebird RDBMS. I tired adding this code to the validate method in the model: if (quantity > -2147483648) and (quantity < 2147483648) errors.add("quantity", "is out of range (must be between
2005 Nov 18
1
Can Dovecot work with an RDBMS for mail/attachment storage?
This may seem off the wall, but can dovecot be configured to support a connection to a database server and use the database server to store the e-mail message and its attachments? While you can use Postgres and MySQL for storing and authenticating users, there is a possibility to use an RDBMs to control the mail itself. Thoughts? -- Michael Segel Principal MSCC
2004 Sep 28
8
OCFS and BCM5700
Hi... I have a strange problem with my Private NIC Channel, here is my environment details : 1. RHAS 2.1 with kernel 2.4.9-e.27 Enterprise 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes 4. Private NIC Channel: Broadcom BCM5700 My Private NIC channel is down intermittently, we just tracing the root of the problems by identify each product installed the
2004 Jun 01
5
OCFS 1.0.9-6 performance with EVA 6000 Storage
Dear All... I need some information regarding OCFS performance in my Linux Box, herewith is my environment details : 1. We are using RHAS 2.1 with kernel 2.4.9-e.27 Enterprise 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes 4. Storage = EVA 6000 with 8 TB SIZE 5. We have 1 DiskGroup and 51 LUNs configured in EVA6000. My Question is : 1. It takes arround 15
2004 Jun 01
5
OCFS 1.0.9-6 performance with EVA 6000 Storage
Dear All... I need some information regarding OCFS performance in my Linux Box, herewith is my environment details : 1. We are using RHAS 2.1 with kernel 2.4.9-e.27 Enterprise 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes 4. Storage = EVA 6000 with 8 TB SIZE 5. We have 1 DiskGroup and 51 LUNs configured in EVA6000. My Question is : 1. It takes arround 15
2006 May 18
1
rails & mysql
so for relational associations, do i need to actually be using an rdbms like innodb or bdb? or can i get away with myisam and assume that telling ruby how i want the tables related will be good enough (ie, has_one, has many, etc)?
2006 Apr 07
1
Off Topic: Boston area bootstrap startup looking for part-time rails help
Bootstrap startup - innovative Web 2.0 project management software. Prototype in development. Significant equity. This not a big, venture-backed thing; it''s a work at home, bust your ass, do work you like, make good money (eventually) ? and take down decent money when we sell (hopefully) thing. MS Project is a $1 billion/year product that frustrates most of its users. I believe we can
2005 Nov 09
1
How to install gds32.dll into wine
Hi All, I'm new in Linux... My Office will migrate from Windows to Linux. We're using Mandrake 10. Actually there's no problem migrating office application into Linux, but some of our application that is using firebird cannot instantly migrate to Linux. That's why wine is my hope solution for this. After I install wine-20050830-mdk.i586.rpm almost "exe file" can