similar to: Memory Fragmentation in R

Displaying 20 results from an estimated 3000 matches similar to: "Memory Fragmentation in R"

2007 Dec 08
1
FW: R memory management
Hi, I'm using R to collect data for a number of exchanges through a socket connection and constantly running into memory problems even though task I believe is not that memory consuming. I guess there is a miscommunication between R and WinXP about freeing up memory. So this is the code: for (x in 1:length(exchanges.to.get)) { tickers<-sqlQuery(channel,paste("SELECT Symbol
2005 Feb 04
3
Handling large data sets via scan()
I'm trying to read in datasets with roughly 150,000 rows and 600 features. I wrote a function using scan() to read it in (I have a 4GB linux machine) and it works like a charm. Unfortunately, converting the scanned list into a datafame using as.data.frame() causes the memory usage to explode (it can go from 300MB for the scanned list to 1.4GB for a data.frame of 30000 rows) and it fails
2003 Apr 17
2
HoltWinters() - p-values for alpha, beta and gamma
Need your expertise for the theoretical approach to deduce the p-values for the level, trend and seasonality parameters. I wonder if there's source code available. Thanks group. Kel
2008 Mar 25
2
Expected transfer rate of samba, SATA over gigabit to SATA
What is a good transfer rate to expect when writing from Windows XP/Vista to a samba network share in the following situation? * New client. Intel Core 2 Duo 6600 with 4GB memory, and Intel gigabit NIC. * New server. HP XW8400 with (currently) a single 5335 Xeon with 4GB memory, and integrated Intel gigabit. Running samba 3.0.25b, as included with CentOS (RHEL). * Netgear GS116 (gigabit)
2005 Feb 24
1
Do environments make copies?
I am using environments to avoid making copies (by keeping references). But it seems like there is a hidden copy going on somewhere - for example in the code fragment below, I am creating a reference to "y" (of size 500MB) and storing the reference in object "data". But when I save "data" and then restore it in another R session, gc() claims it is using twice the
2005 Feb 24
1
Do environments make copies?
I am using environments to avoid making copies (by keeping references). But it seems like there is a hidden copy going on somewhere - for example in the code fragment below, I am creating a reference to "y" (of size 500MB) and storing the reference in object "data". But when I save "data" and then restore it in another R session, gc() claims it is using twice the
2013 Apr 04
1
Freenas domU network performance issue
Hi guys, I''m running a freenas domU (FreeBSD 8.3 based, ZFS v28, 2 vcpus mapped to the same HT capable core) to serve storage for all purpose including other domUs running on the same host. I did some study to understand how well it works and the result is kind of confusing. In summary, the network performance between domains on the same host is worse than expected. And NFS service to
2009 Oct 03
1
Passing lists and R memory usage growth
Hello, I can't think of an explanation for this memory allocation behaviour and was hoping someone on the list could help out. Setup: ------ R version 2.8.1, 32-bit Ubuntu 9.04 Linux, Core 2 Duo with 3GB ram Description: ------------ Inside a for loop, I am passing a list to a function. The function accesses various members of the list. I understand that in this situation, the entire
2004 Jan 26
3
Samba and Window XP write performance
I did some testing using samba-3.0.0 as a server and two identical clients one Running W2K and other running Win XP pro. If I write a big file using the W2K client, I'm getting about 25 Mbytes/sec but if I run the same testing using the Win XP Pro, this client only is able to get 12.5 Mbytes/sec. There is a problem between XP and samba?
2013 Sep 06
1
Gluster native client very slow
Hello, I'm testing a two nodes glusterfs distributed cluster (version 3.3.1-1) on Debian 7. The two nodes write on the same iscsi volume on a SAN. When I try to write an 1G file with dd, I have the following results : NFS : 107 Mbytes/s Gluster client : 8 Mbytes/sec My /etc/fstab on the client : /etc/glusterfs/cms.vol /data/cms glusterfs defaults 0 0 I'd like to use the gluster
2007 Dec 18
1
btrfs timeline - fragmentation and delayed allocation
Hi! Is there plans for fragmentation analyzing/reporting and online defragmentation tools for btrfs? And what about delayed allocation? Thanks!
2020 Oct 12
1
samba AD problem after re-join domain
On 12/10/2020 16:11, Jason Keltz wrote: > >> Hi Rowland, >> >> I did not leave the domain, but I did delete the entry by either the >> Windows AD tool or "samba-tool computer delete" option.? I can't >> remember which one at this point.? I think that clears up all the >> bits.? Is that correct?? On the local host, I also deleted the >>
2012 Feb 08
2
slow creating files
We tried to migrate from old Windows fileserver (p4, single HDD) to Samba (FedoraCore15, Samba 3.5.12-72.fc15, ext4 volume, xeon, raid5). Our pipeline is so, that some special software generates files on that fileserver. The typical filesize ~50 mbytes. On the old hardware, software (win2k3 server) the time of single file creation was about 10 seconds. On the new configuration it takes 20-25
2016 Jun 14
3
horizontal fragmentation?
Hello, is it possible to apply a strategy of horizontal fragmentation into the Active Directory? I mean, to store some amount of data in another DC, for example when the first DC is "full" Any idea? Felipe.
2011 Jan 11
1
Bonding performance question
I have a Dell server with four bonded, gigabit interfaces. Bonding mode is 802.3ad, xmit_hash_policy=layer3+4. When testing this setup with iperf, I never get more than a total of about 3Gbps throughput. Is there anything to tweak to get better throughput? Or am I running into other limits (e.g. was reading about tcp retransmit limits for mode 0). The iperf test was run with iperf -s on the
2007 Aug 22
6
simple tbf rate clamping issues
Hello, I was attempting to throttle egress traffic to a specific rate using a tbf. As a starting point I used an example from the LARTC howto, which goes: tc qdisc add dev eth1 root tbf rate 220kbit latency 50ms burst 1540 I then attempt a large fetch from another machine via wget (~40 megs) and the rate was clamped down to about 12Kbytes/s. As this seemed too much, I gradually increased
2006 Sep 13
2
File fragmentation
Wayne.my vote is for a command-line option. I've noticed there is some penalty for very large files (35GB-50GB). The penalty is relatively small based on my 'intuitive' measurements.read me watching without running a real timer. The difference is very small compared to what happens after a few weeks without the fragmentation patch. Our SAN was becoming so fragmented that we were
2010 Nov 15
5
Poor performance on bandwidth, Xen 4.0.1 kernel pvops 2.6.32.24
Hello list, I have two differents installation Xen Hypervisor on two identical physical server, on the same switch : The problem is on my new server (Xen 4.0.1 with pvops kernel 2.6.32.24), I have bad performance on bandwidth I have test with a files copy and "iperf". Result iperf average: Transfert Bandwidth XEN-A -> Windows
2005 Jul 08
1
filesystem fragmentation stats?
Let me preface this by saying "Yes, I know *nix filesystems don't need to worry about fragmentation". That said, is there a way to check the overall level of fragmentation of a live ext3 filesystem? I know about filefrag, but that's for specific files. And I think e2fsck tells you, but only if you take the filesystem offline for the scan. Is there anything that will give
2016 Jun 15
2
horizontal fragmentation?
Hello Marc, I'm referring to divide/fragment de Database AD (if possible). Trying to store a set of Data in a DC and another set of data in other DC... something like this. I ask that, because I've been asked for a strategy or mechanism related to the scalability which based on the horizontal fragmentation of AD. Then, Does AD have some type of mechanism for supporting the horizontal