similar to: Rsync performance with very large files

I need to rsync 4 TB datafiles to remote server and clone to a new oracle database..I have about 40 drives that contains this 4 TB data. I would like to do rsync from a directory level by using --files-from=FILE option. But the problem is what will happen if the network connection fails the whole rsync will fail right. rsync -a srchost:/ / --files-from=dbf-list and dbf-list would contain this:

Hi list, and Wayne in particular, It was almost a year since we had the discussion (with http://lists.samba.org/archive/rsync/2005-March/011875.html as it's conclusion) regarding chances for hash collisions and large files. As now we have someone asking about synching 5TB files, I decided to actually submit a patch. Attached is a patch that uses a non-predetermined hash table size, so that

Hello, I have inherited a setup where there are 2 AIX 5.1 systems in 2 separate sites. There are large database files that are backed from each site to the other via rsync. Currently, it is using rsync version 2.5.4. It does it via ssh with the options -avz. This has all been merrily plodding along for some time. There is one file that is over 45 GB, and it started having trouble with that

Here is what I have configured: T2000 with OBP 4.28.6 2008/05/23 12:07 with 2 - 72 GB disks as the root disks OpenSolaris Nevada Build 91 Solaris Express Community Edition snv_91 SPARC Copyright 2008 Sun Microsystems, Inc. All Rights Reserved. Use is subject to license terms. Assembled 03 June 2008

I've been playing with rsync and very large files approaching and surpassing 100GB, and have found that rsync has excessively very poor performance on these very large files, and the performance appears to degrade the larger the file gets. The problem only appears to happen when the file is being "updated", that is, when it already exists on the receiving side. For instance,

This is my situation and I am running into dead ends. We have a server with about 400GB of data that we are trying to backup with rsync. On the content1 server we had rsyncd.conf as: [content1] path = / comment = Backup list = no read only = yes hosts allow = 192.168.22.181 hosts deny = * uid = root gid = root and on the backup server we had a crontab entry as follows:

I am trying to replicate the repeated measures example from Dr.Faraway's book (Extending the linear model with R) as follows: data(vision) vision$npower <- rep(1:4,14) mmod <-lmer(acuity~power+(1|subject)+(1|subject:eye),vision) When I look at the fixed effects p-value, it is missing. Am I missing something here? Thanks. Fixed effects: Estimate Std. Error t value

Dear list, I'm following the instructions provided here to compile R 64 bit on AIX 6.1. I did export OBJECT_MODE=64 export CC="gcc -maix64 -pthread" export CXX="g++ -maix64 -pthread" export FC="gfortran -maix64 -pthread" export F77="gfortran -maix64 -pthread" export CFLAGS="-O2 -g -mcpu=power6" export FFLAGS="-O2 -g -mcpu=power6"

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, is there anybody here who has access to such a machine and could test errrr... 'some software' there? Please mail me privately. Thanks & best, Timo -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (GNU/Linux) iD8DBQFNQYqAfg746kcGBOwRArE2AJ4+qtS3i0V6a0Y6WocbpGZfne7Q/wCgsphj 1JcOBKH2RuleIQ3X80XFfT4= =AEdz -----END PGP

Please note that if I don't specify those variables, then R 32 bit compiles fine. Thanks. -- Vinh On Thu, Oct 8, 2015 at 6:50 PM, Vinh Nguyen <vinhdizzo at gmail.com> wrote: > Dear list, > > I'm following the instructions provided here to compile R 64 bit on > AIX 6.1. I did > > export OBJECT_MODE=64 > export CC="gcc -maix64 -pthread" > export

Skipped content of type multipart/mixed-------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 252 bytes Desc: OpenPGP digital signature Url : http://lists.alioth.debian.org/pipermail/pkg-xen-devel/attachments/20060904/6ca2ff93/signature-0001.pgp

hie Im trying to calculate the power of the logrank test for different values of rho .I was just wandering whether the following programme would do it. any suggestions are welcome s=50 number=1 count1=0;count2=0;count3=0;count4=0;count5=0;count6=0;count7=0;count7=0; count8=0;count9=0 while(s!=0){ n=20 n1=n/2

Thank very much for this answer, so my last question will be: is it possible to use the LLVM JIT on a PS3 with Yellow Dog 6.2 distribution, instead of the LLVM interpreter, by using the PPE as it seems to be similar to 64-bit PowerPC processors? 2009/12/18 Scott Michel <scooter.phd at gmail.com> > Jerome: > > No, there are no plans to JIT to SPU. That's considerably more

Jerome: No, there are no plans to JIT to SPU. That's considerably more complicated -- you'd have to figure out when to JIT to the SPU and live with all of the constraints that the SPU imposes (data reformatting, r/w DMA, ensure your code lives in 256K unless you can manage to interface with the virtual I-cache work.) Basically, it's not trivial and it doesn't quite fit into the

Hi list, I have to build vpn server for 1500 clients. No encryption necessary. can anyone please recommend me vpn server. I do not have experience on vpn. I have tested openvpn on my test setup, & its working fine. I want to check if there any other vpn server available. I have not checked but can pptp vpn be usefull? My requirement is to connect 1500 clients on vpn server. Need

Hello everybody, I tried to measure the performance of the available drivers for windows as a HVM guest. I used the gplpv drivers 0.9.11-pre17, the PV drivers from Novell, and the drivers from Citrix XenSource with the XenServer 5. The Novell and gplpv drivers were more or less at the same speed, for both, network and disk performance. The disk performance was about 10MB/s reading and

I would be "pleased" if you would try packages - i.e., none of "Toolbox" or Perzl rpm's. The iconv I supply might not be working as is (I will need to install a new system to check). However, this is why I have been testing with R-3.2.3 - to side-step the system library dependencies. re: xz - I have "installp" version - and any of my packages should work

On Jan 4, 2016, at 1:34 AM, Michael Felt <aixtools at gmail.com> wrote: > I would be "pleased" if you would try packages - i.e., none of "Toolbox" or Perzl rpm's. > R requires iconv, so you have to get that somehow. I tried to bypass the check and build it anyway against the system one, but that fails as there is a iconv conversion further down the line that

i''m trying to send users a polite error message when they try to upload a file above a certain size (1.5MB). we''re using lightpd with rails, and lighttpd is configured to not allow requests larger than 1.5MB. that has two flaws: 1.5MB has to be uploaded before i fails. i''d like to read the file size before is uploaded, to not waste user''s time or our bandwidth.

Hello: I've recently started using R to process data in HDF5 format. My files come in 1.5MB chunks, but they can be as big as 50MB. The problem I am facing with R-1.2.2 is that when I try to load 50 of the 1.5MB HDF5 files (using the hdf5 library) in a loop, my Linux box gets close to its memory limit around the file #15 (256MB RAM and 256MB swap). This happens even if I load file ->