similar to: direct IO, IO throttling

I am using rsync to back up across a VPN. Unfortunately, every so often the home office miscreants drop a big block of data into the backup and that particular backup cycle takes many hours. These same people also complain when net pipe is filled during the day. What I need is an ability to change the bwlimit based on time of day. Any suggestions as to how to do this?

https://bugzilla.samba.org/show_bug.cgi?id=3491 Summary: throttle disk IO during filelist/directory parsing Product: rsync Version: 2.6.4 Platform: All URL: http://vilius.multiply.com/video/item/10 OS/Version: Linux Status: NEW Severity: enhancement Priority: P3 Component: core

We would like to use rsync to deploy large data files over an (all to often) faulty WAN connection. In the past, we've used scp and, when a transfer got interrupted, it would have to be restarted from scratch. This is why we've begun experimenting with rsync. The problem we're having with rsync stems from its use of checksums. The target systems we're deploying data to are highly

Wayne replied to my original note which said that in a special situation that I was using to probe rsync to build a behavioral model that bwlimit= resulted in bimodal behavior around a 4000 kbyte/sec value. He responded with a patch that I have tested in a limited way. I have a push scenario from a local site to a remote site. I use a file that is 6.3 Megabyte in size whose checksums (when

If you aleady are doing this - then thanks. But here's a feature I'd like to see. Rsync often puts a lot of load on the system because of high disk access. I'd like to see rsync become "load aware" and to slow itself down under high load levels. Seems to me that it could be something fairly easy to add to have it check the load levels and back down so as not to slow

https://bugzilla.samba.org/show_bug.cgi?id=7120 Summary: Variable bandwidth limit .. bwlimit Product: rsync Version: 3.1.0 Platform: Other OS/Version: Linux Status: NEW Severity: enhancement Priority: P3 Component: core AssignedTo: wayned at samba.org ReportedBy: pmdumuid at gmail.com

I am doing some benchmarking of rsync. I am using the --bwlimit= option to throttle down rsync to predict its operation over slow communications links. I am using rsync 2.6.2 from the release site without any patches. I downloaded the release rather than pull from the CVS tree. I have 2 servers "wilber" (the remote archive) and "judy" (the local archive) connected with a gig

mhh - interesting question...... what about combining the power of throttle ( http://linux.die.net/man/1/throttle ) or similar tools (there are some more like this) with rsync ? via this hint: http://lists.samba.org/archive/rsync/2006-February/014623.html i got a clue how to combine rsync and throttle and gave it a try : cat throttle-wrap #!/bin/bash throttle -k 1 -s 1| "$@" rsync

You're obviously not the first to need this. That's why the '--bwlimit=' option was added. Set it to however many Kbps you want rsync to use. I usually use 768 going over our wan, to spare some bandwidth on the T1, and maybe 10000 over the lan (in my case, all the dasd is nfs). I suspect that it may affect local-to-local transfers as well, but haven't tested it, but

https://bugzilla.samba.org/show_bug.cgi?id=3371 Summary: no way to limit disk IO bandwidth Product: rsync Version: 2.6.6 Platform: x86 URL: https://bugzilla.samba.org/show_bug.cgi?id=2800 OS/Version: Linux Status: NEW Severity: enhancement Priority: P3 Component: core AssignedTo:

I am running rsync 2.6.9 on SuSe Linux Enterprise Server 10. I got a 53.7 GB directory in one of my servers that I need to rsync over a gigabit link. But rsync runs for about 2-3 hours and fails with the following error - 2006/11/19 17:51:57 [9229] rsync: writefd_unbuffered failed to write 4 bytes [generator]: Connection reset by peer (104) 2006/11/19 17:51:57 [9229] rsync error: error in rsync

# Environment (both local and remote hosts): $ /usr/bin/rsync --version rsync version 2.5.7 protocol version 26 Copyright (C) 1996-2002 by Andrew Tridgell and others <http://rsync.samba.org/> Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, IPv6, 64-bit system inums, 64-bit internal inums $ uname -a Linux dbrac-01 2.4.9-e.27enterprise #1 SMP Tue

Hi zfs-discuss, I have some questions about throttling on ZFS 1) I know that throttling is activating while one sync is waiting for another. (http://blogs.sun.com/roller/page/roch?entry=the_dynamics_of_zfs) Is it possible to throttle only selected processes (e.g. nfsd) ? 2) How can I obtain some statistics about it? I want to know how often throttling is activating on my host etc. 3) Is it

Hi, we bought some machines with 2 x quad core Xeon E5405 processors and installed centos 5.3 on them. My problem is that I can't get the cpuspeed service to work. No driver seems to claim responsibility for the throttling and the fallback "modprobe acpi_cpufreq" in the cpuspeed init script just yields a "No such device" message. According to the acpi information the

I have a small, aircooled pc server, which is running fine, but the log gets filled with a series of messages saying the package, and each of 8 cpus is throttled because of thermal issues. Then, within the same second according to the timestamps, it reports everything is OK and throttling is off. This happens once every minute. In reality, when I try performance tests, I believe the processor

Hi, guys. I want to change block I/O throttle using 'virsh blkdeviotune' with vm not running, it reported an error: # virsh blkdeviotune instance-000000dc /dev/loop0 --total-bytes-sec 20000000 --total-iops-sec 20 --config error: Unable to change block I/O throttle error: unsupported configuration: block I/O throttling not supported with this QEMU binary I can do this when the vm is

Hi, i have a question about throttling a token bucket. As far as i understand, if there not enough tokens to dequeue a packet from the queue, a watchdog timer will be started and the TCQ_F_THROTTLED flag will be set. But what exactly are the consequences of setting this flag. As far as i can see, it neither prevents the enqeueing nor the deqeueing of packets in both functions of the token bucket

Hi, Just a quick check, was wondering if anyone is experiencing problems mass deleting/purging mails from a folder? I am on RC19 with the mail_log plugin enabled. Quite often, when a mass deletion/purge is attempted, we receive the following message in the dovecot logs: dovecot: Feb 01 11:36:27 Error: IMAP(userid): Sending log messages too fast, throttling.. Sometimes this is accompanied

master: Error: service(log): command startup failed, throttling for 2 secs i see that due restart on any machine acting as IMAP/POP3 proxy why? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL:

(Resent since I screwed up the first time) I'm getting a weird source throttling bug that I just don't know how to track down. Source is windows shoutcast 1.9.0 winamp plugin (XP up to date, and possibly others) Server is 2.3.0 It works fine for quite a while, then I get the following wierdness on tcpdump and it goes to hell: 21:03:54.601871 IP (tos 0x0, ttl 64, id 27852, offset 0,