Displaying 20 results from an estimated 5000 matches similar to: "speed up in R apply"
2008 May 01
4
efficient code - yet another question
Dear list members;
The code given below corresponds to the PCA-NIPALS (principal
component analysis) algorithm adapted from the nipals function in the
package chemometrics. The reason for using NIPALS instead of SVD is
the ability of this algorithm to handle missing values, but that's a
different story. I've been trying to find a way to improve (if
possible) the efficiency of the code,
2010 May 05
5
[Pv-ops][PATCH 0/4 v4] Netback multiple threads support
This is netback multithread support patchset version 4.
Main Changes from v3:
1. Patchset is against xen/next tree.
2. Merge group and idx into netif->mapping.
3. Use vmalloc to allocate netbk structures.
Main Changes from v2:
1. Merge "group" and "idx" into "netif->mapping", therefore
page_ext is not used now.
2. Put netbk_add_netif() and netbk_remove_netif()
2003 Dec 25
2
Fast logistic regression
Is there any faster implementation of logistic regression
than glm function in base package in R?
I am working on simulation study and discovered glm fitting part is the
bottle neck of my program.
-Masahiko
2005 May 04
2
[OT] Shaping and squid question
List
Out of interest, I use transparent squid proxies for caching websites,
and I shape the clients that browse the net, this all works perfectly
so no questions in this regard...
CLIENT <--- eth0 ----> SQUID <----- ppp0 -----> NET
What I just realised was that all egress traffic on eth0 gets shaped,
squid gets data from ppp0 and hence is not shaped. Does this mean that
squid
2016 May 20
0
[PATCH RFC kernel] balloon: speed up inflating/deflating process
On Fri, 20 May 2016 17:59:46 +0800
Liang Li <liang.z.li at intel.com> wrote:
> The implementation of the current virtio-balloon is not very efficient,
> Bellow is test result of time spends on inflating the balloon to 3GB of
> a 4GB idle guest:
>
> a. allocating pages (6.5%, 103ms)
> b. sending PFNs to host (68.3%, 787ms)
> c. address translation (6.1%, 96ms)
> d.
2012 Apr 13
4
Help with stemDocument
Hi, All:
I am new to R and tm package. I'm trying to do the stemming using tm_map()
and it doesn't seem to work:
*I used:*
> stemDocument(t_cmts[[100]])
*Where t_cmts is the corpus object, the results is:*
bottle loose box abt airpak sections top plastic bottle squashed nearly
flush neck previous shipments bottle wrapped securely bubble wrap wno
bottle damage packaging poor
2017 Nov 02
4
samba 4.x slow ...
Hi,
we are running samba 4.4 on two machines as file servers.
Both are running a GFS (stornext). The storage is attached using 8G HBA.
You can get up to 800MB/s local speed. We are exporting the shares using
2x1GB
and 2x10G. However the clients are only getting 40-50MB/s. With samba3 I
think we had up to 80-90MB/s.
Using a 100MB/s link for the client we see 12-13MB/s (wire speed).
Using
2005 May 10
1
Client has fallen too far behind
Michael Smith schrieb:
>On 5/10/05, Anatol <icecast@recordcaster.de> wrote:
>
>
>>[...]
>>
>>
>This usually means the client can't receive fast enough - possible
>because their connection is too slow. It's normal to get it
>occastionally with some songs.
>
>If it's dropping clients that are fast enough, maybe there's something
2009 Jun 26
1
parallel R?
Hi all,
Lots of big IT companies are renting out their computing facilities.
Amazon has one such service. In my understanding, this will
dramatically improve the speed of my R program -- currently the cross
validation and model selection part is the bottle neck. It take a few
days to just finish optimal parameter tuning via CV.
Could anybody shed some lights on this? Is it completely transparent
2003 Nov 25
3
Persistent state of R
Hi
I am using R as a back-end to some CGI scripts, written in Perl. My platform is Suse Linux 8.2, Apache 1.3.7. So the CGI script takes some form parameters, opens a pipe to an R process, loads up some Bioconductor libraries, executes some R commands and takes the ouput and creates a web page. It is all very neat and works well.
I am trying to make my cgi scripts quicker and it turns out
2009 Nov 04
2
Conditional read-in of data
Hello All,
I have a 40k rows long data set that is taking a lot of time to be read-in.
Is there a way to skip reading even/odd numbered rows or read-in only rows
that are multiples of, say, 10? This way I get the general trend of the data
w/o actually reading the entire thing. The option 'skip' in read.table
simply skips the first n rows and reads the rest. I do understand that once
the
2001 Dec 13
2
a very simple problem, but unknown solution
In our environemt, we use PCs (NT) running a JVM that produces unique file
names, and data content about 100K or less. We only write to these file. The
JVM (the application) does spawn many threads so the net effect can be many
simultaneous file creation requests from one PC.
All the files are written to a samba mounted directory, and the directory
*file* itself does get somewhat large. The
2017 Sep 01
2
ERROR during high volume MoH dialplan
Thanks for the feedback.
I do agree with having multiple smaller servers. When I was first approached with this task I mentioned as much. However, the current desire is to work with already existing hardware. That is out of my hands at the moment unless it just can't be done. I will explore Freeswitch a bit soon to compare it as well.
I am struggling to find what the bottle neck is in
2008 Dec 05
5
Adding RAM
I have a server running Centos 4.7 32bit. Will moving from 4Gig of
RAM to 8Gig do any good? Since its 32bit I assume it will only be
able to address the first 4Gig not? When I installed CentOS I did not
do anything special to enable using more then 4Gig if thats required.
Exim, spamassassin and Clamd seem to be the biggest load on this
machine. My biggest bottle neck is disk I/O anyway.
Wish
2024 Mar 20
1
Education - 1, 000s, 100, 000's, Millions of listeners. (What kind of infrastructure)
Good morning,
On Wed, 2024-03-20 at 13:16 -0400, Wayne Barron wrote:
> Hello everyone.
>
> This is something I am interested in learning more about.
> Let's say you have an audience of (what is in the subject line.)
> What kind of infrastructure do you need for Icecast?
>
> I asked a similar question about the liquidsoap group.
>
> In Windows and Linux web
2014 Mar 17
1
Slow RAID resync
OK todays problem.
I have a HP N54L Microserver running centos 6.5.
In this box I have a 3x2TB disk raid 5 array, which I am in the
process of extending to a 4x2TB raid 5 array.
I've added the new disk --> mdadm --add /dev/md0 /dev/sdb
And grown the array --> mdadm --grow /dev/md0 --raid-devices=4
Now the problem the resync speed is v slow, it refuses to rise above
5MB, in general
2017 Jun 05
2
Question about llvm::Value::print performance
Dear Thomas,
> Hi Christoph,
>
> maybe there is a way of caching the print outputs and output them at the
> end of the program execution?
> So, your real application do not have this kind of bottle neck.
this is a valid idea, thought the problem is: I output all things only "once" and I even
output it like:
1) load module
2) go over functions
3) output all blocks with
2009 Sep 25
6
SATA vs RAID5 vs VMware
Hello,
I have strange behaviour on a server that I can't get a handle on. I have a
reasonably powerful server running VMware server 1.0.4-56528. It has a RAID5
build with mdadm on 5 SATA drives. Masses of ram and 2 XEON CPUs. But it
stutters.
Example : fire up vi, press and keep finger on i. After filling 2-3 lines, the
display is stopped for 2-12 seconds. Then they continue. This
2013 Jan 31
3
/home on BTRFS on SSD, now highly fragmenting virtuoso database - use autodefrag?
Hi!
Today I converted my /home from Ext4 to BTRFS by reformatting and copying
all over again.
I created the filesystem with -l 16384 -n 16384 -d single -m single on an
logical volume Intel SSD 320 and mount with compress=lzo,spacecache. Current state:
merkaba:~> btrfs filesystem show
failed to read /dev/sr0
Label: ''home'' uuid: […]
Total devices 1 FS bytes used
2016 May 20
0
[PATCH RFC kernel] balloon: speed up inflating/deflating process
On Fri, May 20, 2016 at 05:59:46PM +0800, Liang Li wrote:
> The implementation of the current virtio-balloon is not very efficient,
> Bellow is test result of time spends on inflating the balloon to 3GB of
> a 4GB idle guest:
>
> a. allocating pages (6.5%, 103ms)
> b. sending PFNs to host (68.3%, 787ms)
> c. address translation (6.1%, 96ms)
> d. madvise (19%, 300ms)
>