search for: bup

...d0 ONLINE 0 0 0 c5t1d0 ONLINE 0 0 0 mirror ONLINE 0 0 0 c6t0d0 ONLINE 0 0 0 c6t1d0 ONLINE 0 0 0 errors: No known data errors to one of my external USB drives holding pool bup-wrack -bash-3.2$ zpool status bup-wrack pool: bup-wrack state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM bup-wrack ONLINE 0 0 0 c7t0d0 ONLINE 0 0 0 errors: No known data errors The line in the...

...as done. There are a moderate number of snapshots on the zp1 pool, and I''m intending to replicate the whole thing into the backup pool. After housekeeping, I take make a current snapshot on the data pool (zp1). Since this is a new full backup, I then destroy the data on the backup pool (bup-ruin). Then I create the appropriate backup filesystem (bup-ruin/fsfs/zp1), and do a full replication send and receive. (They''re piped together; Bash trace output shows the commands separately below.) + zfs snapshot -r zp1 at bup-20100303-130903GMT + zfs destroy -rf bup-ruin/fsfs/zp1 +...

First, it fails because the destination directory doesn''t exist. Then it fails because it DOES exist. I really expected one of those to work. So, what am I confused about now? (Running 2008.11) # zpool import -R /backups/bup-ruin bup-ruin # zfs send -R "zp1 at bup-20090222-054457UTC" | zfs receive -dv bup-ruin/fsfs/zp1" cannot receive: specified fs (bup-ruin/fsfs/zp1) does not exist # zfs create bup-ruin/fsfs/zp1 # zfs send -R "zp1 at bup-20090222-054457UTC" | zfs receive -dv "bup-ruin/fsf...

...-200 rho<-0.7 sigma<-0.2 mu<-0.1 Cov <- matrix(rho*sigma*sigma, ncol=n, nrow=n) diag(Cov) <- rep(sigma*sigma, n) S <- 1+matrix(mvrnorm(m, rep(mu, n), Sigma=Cov), ncol=n) #The problem is formulated as minimize t(b) Cov b #subject to cLo <= A <= cUp #and bLo=0 <= w <= 1=bUp Cov <- var(S) mu <- apply(S, 2, mean) mu.target <- 0.1 #subject to cLo <= A <= cUp and bLo=0 <= b <= 1=bUp A <- rbind(1,mu) cLo <- c(1, mu.target) cUp <- c(1, Inf) bLo <- rep(0, n) bUp <- rep(1, n) #I convert [cLo <= A <= cUp] to Amat >= bvec and [bLo=...

On 17/09/17 18:03, Niklas Hamb?chen wrote: > So far the only difference between `ls` and `bup index` I could observe > is that `bup index` chdir()s into the directory to index, ls doesn't. > > But when I `cd` into the dir and run `ls` without directory argument, it > is still much faster than bup index for each stat(). Hmm, bup uses the fchdir() syscall to go into the targ...

...no problem! But when I try to start upsmon, it's unable to talk to my upsd. Having try a few option I found that saying RUN_AS_USER=root makes my upsmon runs without any problem. Here is the message I receive from the Debug: rounoff:/var/run/nut# upsmon -D Network UPS Tools upsmon 2.0.2 UPS: bup@localhost (master) (power value 1) Using power down flag file /etc/killpower Trying to connect to UPS [bup@localhost] UPS [bup@localhost]: connect failed: No such host do_notify: ntype 0x0005 (COMMBAD) Communications with UPS bup@localhost lost I found that if I put the -p it work but i'm not...

On 15/09/17 02:45, Sam McLeod wrote: > Out of interest have you tried testing performance > with performance.stat-prefetch enabled? Not yet, because I'm still struggling to understand the current more basic setup's performance behaviour (with it being off), but it's definitely on my list and I'll report the outcome.

On 15/09/17 03:46, Niklas Hamb?chen wrote: >> Out of interest have you tried testing performance >> with performance.stat-prefetch enabled? I have now tested with `performance.stat-prefetch: on` but am not observing a difference. So far the only difference between `ls` and `bup index` I could observe is that `bup index` chdir()s into the directory to index, ls doesn't. But when I `cd` into the dir and run `ls` without directory argument, it is still much faster than bup index for each stat().

...ving something weird: When I list and stat them all using rsync, then the lstat() calls that rsync does are incredibly fast (23 microseconds per call on average, definitely faster than a network roundtrip between my 3-machine bricks connected via Ethernet). But when I try to back them up with the `bup` tool (https://github.com/bup/bup), which (at least according to strace) does the same syscalls as rsync to stat all files, it takes 1700 microseconds per lstat() call, and the total time to go over all files is 50x higher. These are my strace statistics: rsync strace: $ strace -f -w -c rsync...

Hi All, Today I got a couple of ZyXEL Prestige 2000W WiFi phones. I'm having a problem making SIP calls although I can receive calls just fine. When I try to make a call the phone makes some sound (like "bup bup bup bup bup bup beep beep") and then I just hear hissing background noise (not too loud - like comfort noise). I upgraded to the latest firmware on the phone - Wj.00.10 Has anyone else had this problem? Thanks, Derek -- Derek Conniffe Rivertower Limited Tel: (Lo-Call Ireland) 1890 4...

...t; When I list and stat them all using rsync, then the lstat() calls that > rsync does are incredibly fast (23 microseconds per call on average, > definitely faster than a network roundtrip between my 3-machine bricks > connected via Ethernet). > But when I try to back them up with the `bup` tool > (https://github.com/bup/bup), which (at least according to strace) does > the same syscalls as rsync to stat all files, it takes 1700 microseconds > per lstat() call, and the total time to go over all files is 50x higher. > > These are my strace statistics: > > rsync...

...= 8 total files = 76100 total IOPS = 0 95.12% of requested files processed, minimum is 90.00 elapsed time = 2.885 files/sec = 26373.893173 So here I get 26k files / sec. Based on 25k files / sec that works out to about 40 seconds, much more like what you are seeing. Are you sure that your BUP app isn't doing something like ls -l where as rsync is doing something like stat? Maybe you could try the smallfile benchmark and see what it gives you. Also, make sure you clear cache on both clients and servers(echo 3 > /proc/sys/vm/drop_caches) before running your tests to eliminate ser...

I found the reason now, at least for this set of lstat()s I was looking at. bup first does all getdents(), obtaining all file names in the directory, and then stat()s them. Apparently this destroys some of gluster's caching, making stat()s ~100x slower. What caching could this be, and how could I convince gluster to serve these stat()s as fast as if a getdents() had been...

...(even a shutdown could do this, and shutdowns could also take hours). I have tried a number of things and I use a combination of two things now: 1. a btrfs volume with force-compress enabled to store the intermediate data - it compresses my data to about 60% and that's enough for me 2. use of bup (https://bup.github.io/) to store long-term backups. bup is incredibly efficient for my use case (full VM backups). Over the course of a whole month, the dataset only increases by about 30% from the initial size (I create a new full backup each month) - and this is with FULL backups of all VMs eve...

...ecot error log I see: Sep 19 20:34:25 imap01 dovecot: imap(grain at rp-auth-test.com): Error: Cached message size smaller than expected (615 < 971) Sep 19 20:34:25 imap01 dovecot: imap(grain at rp-auth-test.com): Error: Corrupted index cache file /mail/index01/434/860/grain at rp-auth-test.com/.Bup/dovecot.index.cache: Broken physical size for mail UID 0 Sep 19 20:34:25 imap01 dovecot: imap(grain at rp-auth-test.com): Error: read() failed: Invalid argument (uid=0) (Note this happens from the copy operation, not a subsequent access. Also note the UID is always 0). The filename for the messa...

Dear list, I am syncing files with rsync .... surprise surprise ... Rsync claims files to be uptudate, but they are not ... >From the log: export/opt/bup/status/1 is uptodate export/opt/bup/status/2 is uptodate . . Source directory (locally on server): -rw-r--r-- 1 root root 28 2008-03-01 22:44 1 -rw-r--r-- 1 root root 28 2008-03-01 22:37 2 . . Destination directory (nfs share): -rw-r--r-- 1 root root 28 2008-02-29 22:45 1 -rw-r--r-- 1...

Folks I'm looking for a solution for backups because ZFS has failed on me too many times. In my environment, I have a large amount of data (around 2tb) that I periodically back up. I keep the last 5 "snapshots". I use rsync so that when I overwrite the oldest backup, most of the data is already there and the backup completes quickly, because only a small number of files have

WHY OH WHY does rsync SEND and CREATE a file called RepositoryPath ALTHOUGH the rsync is called like rsync "--exclude=*.bup RepositoryPath" ... can ANYBODY explain. ALSO when you specify an exclude list on the server in the rsyncd.conf file and you call rsync with the --delete option WHY DO THE FILES that SHOULD BE EXCLUDED get deleted ?? Jeeez, what a bummer W

...on 2.5.5). This setup/command had previously worked for a bit (cygwin at rsync version 2.4.6 AFAICR), but yesterday it hung, so, finding some mail-list entries about that, I upgraded cygwin, and now I get this: C:\>c:\cygwin\bin\rsync.exe -vvvvvv -essh -ac --delete ik@boat:/usr/local/cvs /cvs-bup/rsync cmd=ssh machine=boat user=ik path=/usr/local/cvs cmd=ssh -l ik boat rsync --server --sender -vvvvvvlogDtprc --delete . /usr/local/cvs opening connection using ssh -l ik boat rsync --server --sender -vvvvvvlogDtprc --delete . /usr/local/cvs read: Invalid argument rsync: connection unexpectedly...

I apologize if this has already been discussed before, but as of yet I have been unable to find any info on the topic. I have a very simple (and common) disk based backup system using rsync, hard links, and a little bit of perl to glue it together. Remote machines are backed up regularly using hardlinks across each snapshot to reduce disk usage. Recently I learned that rsync does a