search for: hblkhd

...tapps. building file list ... 1 file to consider ntapps.dsk 8388608512 100% 2.11MB/s 1:03:11 rsync[8049] (sender) heap statistics: arena: 147992 (bytes from sbrk) ordblks: 3 (chunks not in use) smblks: 0 hblks: 0 (chunks from mmap) hblkhd: 0 (bytes from mmap) usmblks: 0 fsmblks: 0 uordblks: 42648 (bytes used) fordblks: 105344 (bytes free) keepcost: 11168 (bytes in releasable chunk) Number of files: 1 Number of files transferred: 1 Total file size: 8388608512 bytes...

...generate_files phase=3 total: matches=0 hash_hits=0 false_alarms=0 data=0 recv_files finished rsync[32689] (receiver) heap statistics: arena: 204800 (bytes from sbrk) ordblks: 7 (chunks not in use) smblks: 2 hblks: 2 (chunks from mmap) hblkhd: 401408 (bytes from mmap) allmem: 606208 (bytes from sbrk + mmap) usmblks: 0 fsmblks: 192 uordblks: 58736 (bytes used) fordblks: 146064 (bytes free) keepcost: 133904 (bytes in releasable chunk) generate_files finished rsync[32...

...ded by Martin Nowack in the bug report but I have added a test case and an ifdef macro around the modified code in Process::GetMallocUsage() The issue seems to be that the ptmalloc2 allocator used in glibc (in my case 2.19) does not include mmap()'ed memory in mallinfo.uordblks and so mallinfo.hblkhd needs to be added to the value that Process::GetMallocUsage() will return. Another easy way to see this issue (other than running the unit test) is to build and run the attached "malloc-test.c" program on a system that uses glibc. You will see that after malloc'ing 256MiB of memory u...

...les phase=1 generate_files phase=2 recv_files phase=2 generate_files phase=3 recv_files finished rsync[2432] (receiver) heap statistics: arena: 135168 (bytes from sbrk) ordblks: 2 (chunks not in use) smblks: 2 hblks: 2 (chunks from mmap) hblkhd: 401408 (bytes from mmap) allmem: 536576 (bytes from sbrk + mmap) usmblks: 0 fsmblks: 192 uordblks: 57200 (bytes used) fordblks: 77968 (bytes free) keepcost: 64288 (bytes in releasable chunk) rsync[2430] (generator) heap sta...

...receiving file list ... done Public Event Server/ Public Event Server/Public Event Server.db rsync[6790] (receiver) heap statistics: arena: 118120 (bytes from sbrk) ordblks: 5 (chunks not in use) smblks: 2 hblks: 0 (chunks from mmap) hblkhd: 0 (bytes from mmap) usmblks: 0 fsmblks: 80 uordblks: 101704 (bytes used) fordblks: 16416 (bytes free) keepcost: 3352 (bytes in releasable chunk) Number of files: 2 Number of files transferred: 1 Total file size: 6883446 byt...

...hash_hits=0 >> false_alarms=0 data=0 recv_files finished >> >> rsync[32689] (receiver) heap statistics: arena: 204800 >> (bytes from sbrk) ordblks: 7 (chunks not in use) >> smblks: 2 hblks: 2 (chunks from mmap) >> hblkhd: 401408 (bytes from mmap) allmem: 606208 >> (bytes from sbrk + mmap) usmblks: 0 fsmblks: >> 192 uordblks: 58736 (bytes used) fordblks: 146064 >> (bytes free) keepcost: 133904 (bytes in releasable chunk) >> generate_files finishe...

...ll! I want to make a similar table as on the tech report at http://rsync.samba.org/tech_report/node6.html But with which command rsync shows me these stats? With --stats I get the heap statistics. I didn't find anything about the abbreviations. Could someone tell me please what e.g. ordblks, hblkhd, etc. mean? (I know that blk=block) :) Thanks very much. David _______________________________________________________________________ T?glich 1.000.000 Euro gewinnen! Jetzt kostenlos WEB.DE MillionenKlick spielen! https://millionenklick.web.de/?mc=mail@footer.mklick@home

Hello, I've had some problems using rsync to transfer directories with more than 3 million files. Here's the error message from rsync: <snip> ERROR: out of memory in receive_file_entry rsync error: error allocating core memory buffers (code 22) at util.c(116) rsync: connection unexpectedly closed (63453387 bytes read so far) rsync error: error in rsync protocol data stream (code

...jk/..viminfo.IcFUcX failed: Permission denied mkstemp jk/.rsync.sh.focqIP failed: Permission denied rsync[17002] (sender) heap statistics: arena: 1659224 (bytes from sbrk) ordblks: 51 (chunks not in use) smblks: 6 hblks: 1 (chunks from mmap) hblkhd: 266240 (bytes from mmap) usmblks: 0 fsmblks: 232 uordblks: 1509880 (bytes used) fordblks: 149344 (bytes free) keepcost: 132928 (bytes in releasable chunk) The script is being run from the root account. My understanding is that running as...

...========= rsync[5966] (server receiver) heap statistics: arena: 17016 (bytes from sbrk) rsync[5964] (sender) heap statistics: arena: 53880 (bytes from sbrk) ordblks: 3 (chunks not in use) smblks: 0 hblks: 0 (chunks from mmap) hblkhd: 0 (bytes from mmap) usmblks: 0 fsmblks: 0 uordblks: 42424 (bytes used) fordblks: 11456 (bytes free) keepcost: 4152 (bytes in releasable chunk) Number of files: 44 Number of files transferred: 0 Total file size: 20229310 bytes...

...ail.cheek.com::root/home/ericom Password: cd1_en_binary.iso 616431616 100% 190.94kB/s 0:52:32 rsync[8871] (sender) heap statistics: arena: 70552 (bytes from sbrk) ordblks: 3 (chunks not in use) smblks: 0 hblks: 1 (chunks from mmap) hblkhd: 266240 (bytes from mmap) usmblks: 0 fsmblks: 0 uordblks: 58120 (bytes used) fordblks: 12432 (bytes free) keepcost: 8112 (bytes in releasable chunk) Number of files: 1 Number of files transferred: 1 Total file size: 616431616 bytes...

...jk/..viminfo.IcFUcX failed: Permission denied mkstemp jk/.rsync.sh.focqIP failed: Permission denied rsync[17002] (sender) heap statistics: arena: 1659224 (bytes from sbrk) ordblks: 51 (chunks not in use) smblks: 6 hblks: 1 (chunks from mmap) hblkhd: 266240 (bytes from mmap) usmblks: 0 fsmblks: 232 uordblks: 1509880 (bytes used) fordblks: 149344 (bytes free) keepcost: 132928 (bytes in releasable chunk) The script is being run from the root account. My understanding is that running as...

Im running into an issue with exclude options not working correctly. Here are the details, if anybody can see what Im doing incorrectly, please let me know.. Thanks rsync version 2.5.7 protocol version 26 Command: "/usr/bin/rsync""--archive""--compress""--delete""--group""--perms""--st

...e is uptodate jp/.spamassassin/user_prefs is uptodate jp/Mailbox is uptodate jp/passwd is uptodate rsync[2509] (receiver) heap statistics: arena: 135168 (bytes from sbrk) ordblks: 6 (chunks not in use) smblks: 2 hblks: 0 (chunks from mmap) hblkhd: 0 (bytes from mmap) usmblks: 0 fsmblks: 40 uordblks: 6888 (bytes used) fordblks: 128280 (bytes free) keepcost: 90576 (bytes in releasable chunk) Number of files: 14 Number of files transferred: 0 Total file size: 8819 bytes Tota...

...12.70kB/s 0:00:00 (xfer#2, to-check=0/3) total: matches=0 hash_hits=0 false_alarms=0 data=25 rsync[26335] (sender) heap statistics: arena: 270336 (bytes from sbrk) ordblks: 1 (chunks not in use) smblks: 4 hblks: 2 (chunks from mmap) hblkhd: 532480 (bytes from mmap) allmem: 802816 (bytes from sbrk + mmap) usmblks: 0 fsmblks: 208 uordblks: 211632 (bytes used) fordblks: 58704 (bytes free) keepcost: 58496 (bytes in releasable chunk) deleting in . Number of files: 3...

...omething like this to my log file: ================================================================ rsync[23169] (sender) heap statistics: arena: 17339064 (bytes from sbrk) ordblks: 509 (chunks not in use) smblks: 2 hblks: 2 (chunks from mmap) hblkhd: 1294336 (bytes from mmap) usmblks: 0 fsmblks: 80 uordblks: 17180952 (bytes used) fordblks: 158112 (bytes free) keepcost: 132840 (bytes in releasable chunk) Number of files: 161530 Number of files transferred: 327 Total file size: 979368291...

...tistics: 2008/12/05 13:59:27 [940] arena: 327680 (bytes from sbrk) 2008/12/05 13:59:27 [940] ordblks: 4 (chunks not in use) 2008/12/05 13:59:27 [940] smblks: 0 2008/12/05 13:59:27 [940] hblks: 0 (chunks from mmap) 2008/12/05 13:59:27 [940] hblkhd: 327680 (bytes from mmap) 2008/12/05 13:59:27 [940] allmem: 655360 (bytes from sbrk + mmap) 2008/12/05 13:59:27 [940] usmblks: 2686976 2008/12/05 13:59:27 [940] fsmblks: 0 2008/12/05 13:59:27 [940] uordblks: 479936 (bytes used) 2008/12/05 13:59:27 [9...

Here is the structure of my servers : Source : /home/test1/link_dir sub_dir1 file1 file2 ... sub_dir2 ... Destination: /home/test2/real_dir sub_dir1 file1 file2 ... subdir2

...pguinane.tar.UvpoSJ failed: Permission denied mkstemp .rdgroot.tar.4XbXBG failed: Permission denied rsync[19081] (sender) heap statistics: arena: 348792 (bytes from sbrk) ordblks: 3 (chunks not in use) smblks: 0 hblks: 1 (chunks from mmap) hblkhd: 266240 (bytes from mmap) usmblks: 0 fsmblks: 0 uordblks: 341344 (bytes used) fordblks: 7448 (bytes free) keepcost: 3352 (bytes in releasable chunk) Number of files: 22 Number of files transferred: 22 Total file size: 2483555627 byt...

When I use the preallocate patch and create a 77GB file using the function I get a CPU spike on the server-side. The spike lasts about 20 minutes and uses about 20%-25% of the cpu associated with the rsync instance creating the file. The spike is directly linked to the time it takes to create the file. I compiled rsync using cygwin CVS. I initially suspected the implementation of