similar to: dataframe selection using a multi-value key

Does anyone have any performance tuning tips when working with datasets that are extremely wide (e.g. 20,000 columns)? In particular, I am trying to perform a merge like below: merged_data <- merge(data1, data2, by.x="date",by.y="date",all=TRUE,sort=TRUE); This statement takes about 8 hours to execute on a pretty fast machine. The dataset data1 contains daily data going

I am designing a package to analyze fire department data. I created an S4 class called CAD (short for Computer Aided Dispatch data) as part of this package that essentially extends the data.frame class. When the user initializes a CAD object, a data.frame object is broken down into seperate incident data and unit response data that are stored in separate slots. This separation is intentional

I am using the following command to mirror a directory between two Sun systems using rsync 2.5.5: /usr/local/bin/rsync --verbose --archive --delete --ignore-errors --exclude-from=$HOME/ems.exclude $SOURCE $DEST It appears that deletes and even transfers are being affected by the number of files. Here is a look at the directories: /data/EMS/data : 1 /data/EMS/hist : 0 /data/EMS/parameters : 6089

Dear useRs, I've just encountered a serious problem involving the F-test being carried out in aov() and anova(). In the provided example, aov() is not making the correct F-test for an hypothesis involving the expected mean square (EMS) of a factor divided by the EMS of another factor (i.e., instead of the error EMS). Here is the example: Expected Mean Square

Hi, I'm really struggling with barplot I have a data.frame with 3 columns. The first column represents an "incident" type The second column represents a "month" The third column represents a "time" Code for a sample data.frame incidents <- rep(c('a','b','d','e'), each =25) months <- rep(c(1,2), each =10) times

Hello, I am fairly new to RoR and I have a question I hope can be solved elegantly (so many things are, so why not this one too?). I have a working solution, but I want to be sure I am doing things the "rails way" (having come from PHP). You could say I am looking for a little validation (no flames please). I have a table of units like so: CREATE TABLE `units` ( `id`

I am trying to plot the linear fit by id of the following data (test.l): id year incidents 100 1 0 101 1 1 102 1 21 103 1 27 104 1 3 105 1 12 100 2 5 101 2 5 102 2 19 103 2 10 104 2 2 105 2 12 100 3 0 101 3 0 102 3 22 103 3 14 104

Users report that an extent map''s list is still linked when it''s actually going to be freed from cache. The story is that a) when we''re going to drop an extent map and may split this large one into smaller ems, and if this large one is flagged as EXTENT_FLAG_LOGGING which means that it''s on the list to be logged, then the smaller ems split from it will also be

We''re running a Cyrus IMAP server on a T2000 under Solaris 10 with about 1 TB of mailboxes on ZFS filesystems. Recently, when under load, we''ve had incidents where IMAP operations became very slow. The general symptoms are that the number of imapd, pop3d, and lmtpd processes increases, the CPU load average increases, but the ZFS I/O bandwidth decreases. At the same time, ZFS

I am working on creating an R package for doing fire department analysis and am trying to create a function that can display emergency incident densities. The following code sort of does the trick, but I need a display that shows the number of incidents per square mile. I believe the code below shows incidents per square unit (in this case, degrees lat/long). To solve this problem, I believe

On 04/11/2017 09:11 AM, Jonathan Billings wrote: > On Tue, Apr 11, 2017 at 09:02:45AM -0700, Bruce Ferrell wrote: >> How about over 30 and it took me a week? No, I don't carry a CS >> degree or cert of any kind either, just some high school. >> >> For me, systemd has been an absolute nightmare of unexpected reboots >> and non-transparently broken processes

Dear Prof Gray and everyone, As our package developers discussed about incompatibility between Design and survival packages, I faced another problem with cmprsk- a survival dependent packacge. The problem is exactly similar to what happened to the Design package that when I just started running cuminc function, R was suddenly closed. These incidents suggest that maybe many other survival

Recently our Unix Administrator installed Samba v.2.07. It was configured to attach to our NT domain. When this occurred we started to experience problems with user authentication's to the domain and it appeared that the "Samba" server had become the master browser. Have you seen this problem occur at other sites? If so, what is the work around? We have been using Samba v2.06

Hi Everyone I am considering learning Java. There have been well publicized Java security incidents recently that make me not want to learn it. However it's in Centos and I trust Centos, are the concerns in the media blown out of proportion ? -Patrick

Hopefully this is a simple issue or just my ignorance on the results returned by "df -k" but can anyone explain why the available block is 0 if total 1k-blocks - Used is greater than 0? #df -k /ems/bigdisk/ Filesystem 1K-blocks Used Available Use% Mounted on /dev/mapper/vg0-bigdisk 397367512 383562960 0 100% /<name> Filesystem volume

Over the last two weeks, we have had at least two "incidents" where our asterisk server got flooded (a hundred or more per second) by SIP packets. Once from 114.31.50.10, second time from 173.212.200.146. We became aware of the problem when bandwidth started suffering because asterisk got very busy sending back replies or rejects (dunno which, I didn't investigate it any further).

--fupGvOGOQM Content-Type: text/plain; charset=us-ascii Content-Description: message body and .signature Content-Transfer-Encoding: 7bit There's a simple bug in the handling of the start and offset arguments in glm and glm.fit. The bug exists in the latest development version of R (version information below), but it appears that glm.R has not been touched much lately, so the bug affects at

Hi all, We've had a couple of incidents where Samba 2.2.5 on Solaris 8 has stopped accepting new connections...there are many smbd processes sitting there blocked doing a: fcntl(7, F_SETLKW64, 0xFFBED5E0) (sleeping...) We have around 400 users connecting on a daily basis. This message from Samba 2.2.3 days seems to suggest that there was a problem on Solaris with "fcntl locks with

All, I have a user who has a Dell Precision 7520 laptop, and we're running CentOS 7, latest kernel. This morning he had two lockup incidents. Nothing in /var/log/messages stands out so far, but did get this information when running 'abrt-cli list --since 1560891312': id c48278a875c27dd4369d971bcfc7db4267766c6d reason: WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:356

I have been trying to implement Mike's tutorial on backup with rsync, but my server has kept crashing in the middle of the rsync transfer. I am backing up /dev/hda1 to /dev/hdc1 on a SuSe v 7.3 i386 box Server crashed 8 times. 16 fsck and 8 reboots later I finally got an error message and a graceful exit from rsync. Somewhere in the middle of the crashes I compiled and installed the