search for: sbrk

...his send_files phase=1 recv_files phase=1 generate_files phase=2 send_files phase=2 recv_files phase=2 send files finished generate_files phase=3 total: matches=0 hash_hits=0 false_alarms=0 data=0 recv_files finished rsync[32689] (receiver) heap statistics: arena: 204800 (bytes from sbrk) ordblks: 7 (chunks not in use) smblks: 2 hblks: 2 (chunks from mmap) hblkhd: 401408 (bytes from mmap) allmem: 606208 (bytes from sbrk + mmap) usmblks: 0 fsmblks: 192 uordblks: 58736 (bytes used)...

...ecv_generator(.,0) delete_in_dir(.) recv_files(1) starting recv_generator(.,1) generate_files phase=1 recv_files(.) recv_files phase=1 generate_files phase=2 recv_files phase=2 generate_files phase=3 recv_files finished rsync[2432] (receiver) heap statistics: arena: 135168 (bytes from sbrk) ordblks: 2 (chunks not in use) smblks: 2 hblks: 2 (chunks from mmap) hblkhd: 401408 (bytes from mmap) allmem: 536576 (bytes from sbrk + mmap) usmblks: 0 fsmblks: 192 uordblks: 57200 (bytes used)...

...ate_files phase=2 >> send_files phase=2 recv_files phase=2 send files finished >> generate_files phase=3 total: matches=0 hash_hits=0 >> false_alarms=0 data=0 recv_files finished >> >> rsync[32689] (receiver) heap statistics: arena: 204800 >> (bytes from sbrk) ordblks: 7 (chunks not in use) >> smblks: 2 hblks: 2 (chunks from mmap) >> hblkhd: 401408 (bytes from mmap) allmem: 606208 >> (bytes from sbrk + mmap) usmblks: 0 fsmblks: >> 192 uordblks: 58736 (byte...

...t: KLIBCLD usr/klibc/libc.so ppc-linux-ld: usr/klibc/globals.o:/root/packages/klibc-2.0.7/usr/klibc/../include/unistd.h:15: multiple definition of `environ'; usr/klibc/__shared_init.o:/root/ldb_base/ofl/packages/klibc-2.0.7/usr/klibc/libc_init.c:42: first defined here ppc-linux-ld: usr/klibc/sbrk.o:(.sbss+0x0): multiple definition of `__current_brk'; usr/klibc/brk.o:(.sbss+0x0): first defined here ppc-linux-ld: usr/klibc/getopt_long.o:(.sbss+0x8): multiple definition of `optind'; usr/klibc/getopt.o:(.sbss+0x8): first defined here ppc-linux-ld: usr/klibc/getopt_long.o:(.sbss+0xc): mu...

...= 0x15b30000 brk(0x15b30800) = 0x15b30000 --- SIGSEGV (Segmentation fault) @ 0 (0) --- +++ killed by SIGSEGV +++ and ltrace gives: __libc_start_main(0x405180, 1, 0x7fff89087298, 0x440b30, 0x440b20 <unfinished ...> setlocale(5, "" <unfinished ...> sbrk(0) = 0x141f1000 sbrk(2048) = 0xffffffffffffffff --- SIGSEGV (Segmentation fault) --- +++ killed by SIGSEGV +++ Does anyone have any ideas? -- Erkki '?rkki' Aalto &qu...

...ry once > > you are done using it. > > Sure. Is that the goal, though? If goal is to reduce fragmentation, possibly. You don't know if you have fragmentation or not, the JITed app may fragment memory for example. > Why isn't malloc doing it already? Because it can't. sbrk() can only increase/decrease memory usage at the end (like a stack), you can't release something in the middle. Thats one of the reasons why we wrote a pool-based memory allocator for ClamAV. > > > With malloc() no, it takes just 1 allocation at the end of the heap > > to keep...

...t --stats -- progress ntapps.dsk vmware2::home/ [root@VMWARE Storage]# rsync --verbose --recursive -t --stats -- progress ntapps. building file list ... 1 file to consider ntapps.dsk 8388608512 100% 2.11MB/s 1:03:11 rsync[8049] (sender) heap statistics: arena: 147992 (bytes from sbrk) ordblks: 3 (chunks not in use) smblks: 0 hblks: 0 (chunks from mmap) hblkhd: 0 (bytes from mmap) usmblks: 0 fsmblks: 0 uordblks: 42648 (bytes used) fordblks: 105344 (bytes free) keepcost:...

Does anyone know what exactly S_alloc() does? (Yes, it's porting time again ...) Thanks, -k =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- r-devel mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html Send "info", "help", or "[un]subscribe" (in the "body", not the subject !) To:

...the goal, though? Why isn't malloc doing it already? > With malloc() no, it takes just 1 allocation at the end of the heap to > keep all the rest allocated. That wouldn't be a problem if libc would > use mmap() as the low-level allocator for malloc but it doesn't. > It uses sbrk() mostly for small (<128k) allocations, and even with > mmaps it caches them for a while. Recommended reading: http://people.freebsd.org/~jasone/jemalloc/bsdcan2006/jemalloc.pdf > I think that is because mmap() is slow in multithreaded apps, since it > needs to take a process level lo...

...it is always possible to fully release the memory once you are done using it. With malloc() no, it takes just 1 allocation at the end of the heap to keep all the rest allocated. That wouldn't be a problem if libc would use mmap() as the low-level allocator for malloc but it doesn't. It uses sbrk() mostly for small (<128k) allocations, and even with mmaps it caches them for a while. I think that is because mmap() is slow in multithreaded apps, since it needs to take a process level lock, which also contends with the lock taken by pagefaults from other existing mmaps (in fact that lock i...

Hello, I've had some problems using rsync to transfer directories with more than 3 million files. Here's the error message from rsync: <snip> ERROR: out of memory in receive_file_entry rsync error: error allocating core memory buffers (code 22) at util.c(116) rsync: connection unexpectedly closed (63453387 bytes read so far) rsync error: error in rsync protocol data stream (code

...ect: Cron <root@cornerstone> run-parts /etc/cron.daily /etc/cron.daily/backup_ribs: -= Beginning backups for calendar receiving file list ... done Public Event Server/ Public Event Server/Public Event Server.db rsync[6790] (receiver) heap statistics: arena: 118120 (bytes from sbrk) ordblks: 5 (chunks not in use) smblks: 2 hblks: 0 (chunks from mmap) hblkhd: 0 (bytes from mmap) usmblks: 0 fsmblks: 80 uordblks: 101704 (bytes used) fordblks: 16416 (bytes free) ke...

...If goal is to reduce fragmentation, possibly. You > don't know if you have fragmentation or not, the JITed app may fragment > memory for example. Yes, the goal is to fully release the memory back to the OS. >> Why isn't malloc doing it already? > > Because it can't. sbrk() can only increase/decrease memory usage at the > end (like a stack), you can't release something in the middle. > Thats one of the reasons why we wrote a pool-based memory allocator for > ClamAV. Another thing malloc could do is to use madvise with MADV_DONTNEED to free the pages in...

...seems like incremental rsync is used.. can any1 tell me why ? while "back2rsyncerr.log" is empty, following is the content of the file "back2rsync.log" - ====================================== rsync[5966] (server receiver) heap statistics: arena: 17016 (bytes from sbrk) rsync[5964] (sender) heap statistics: arena: 53880 (bytes from sbrk) ordblks: 3 (chunks not in use) smblks: 0 hblks: 0 (chunks from mmap) hblkhd: 0 (bytes from mmap) usmblks: 0 fsmblks: 0 uordblk...

...n _nl_find_domain () from /lib64/libc.so.6 #5 0x00007f4c9008d6e0 in __dcigettext () from /lib64/libc.so.6 #6 0x00007f4c6fabcfe3 in Rf_onsigusr1 () from /usr/local/lib64/R/lib/libR.so #7 <signal handler called> #8 0x00007f4c9014079a in brk () from /lib64/libc.so.6 #9 0x00007f4c90140845 in sbrk () from /lib64/libc.so.6 #10 0x00007f4c900dd769 in __default_morecore () from /lib64/libc.so.6 #11 0x00007f4c900d87a2 in _int_free () from /lib64/libc.so.6 #12 0x0000000000b3ff24 in gp_free2 () #13 0x0000000000b356fc in AllocSetDelete () #14 0x0000000000b38391 in MemoryContextDeleteImpl () #15 0x00...

...* files didn't help. Neither did 'cp -rp .INBOX.Triaged .INBOX._Triaged' and then subscribing to the new folder. In fact, the problem seems to be with the files in cur/. There are 51 in total, and 39 of them have an 'i' flag: 1155084961.P27685Q5.redback.sydney.atlassian.com:2,Sbrk 1155084979.P27685Q6.redback.sydney.atlassian.com:2,Sbtk 1155085103.P27685Q10.redback.sydney.atlassian.com:2,Sbwk 1155085175.P28321Q1.redback.sydney.atlassian.com:2,Sbcki 1155085221.P27685Q12.redback.sydney.atlassian.com:2,Sbwk 1155085228.P28321Q4.redback.sydney.atlassian.com:2,Sbki 1155085231.P2832...

...ace that lisp uses. I then hacked a linker script so that GNU ld will put these .o files in the executable and add the proper program headers. It all worked, and I can actually run the resulting executable. Unfortunately it doesn't get far. The first time it calls malloc, malloc tries to call sbrk (I think it's sbrk) twice and those calls return invalid argument errors. Malloc then returns 0. I used ktrace and the "U" malloc_option to determine this --- the calls show up as follows: 89021 testit CALL readlink(0x680bbf14,0xbfbff3b0,0x3f) 89021 testit NAMI "/etc/m...

...nsmission enabled ./ testfile 12 100% 0.00kB/s 0:00:00 (xfer#1, to-check=1/3) testfile2 13 100% 12.70kB/s 0:00:00 (xfer#2, to-check=0/3) total: matches=0 hash_hits=0 false_alarms=0 data=25 rsync[26335] (sender) heap statistics: arena: 270336 (bytes from sbrk) ordblks: 1 (chunks not in use) smblks: 4 hblks: 2 (chunks from mmap) hblkhd: 532480 (bytes from mmap) allmem: 802816 (bytes from sbrk + mmap) usmblks: 0 fsmblks: 208 uordblks: 211632 (bytes used)...

...rt at gmail.com> Subject: Re: [LLVMdev] Getting started with LLVM Passes On Fri, 8 Jul 2005, Sean Peisert wrote: > Hi Chris, > >>> I'm now off on to addressing my own code transformations. The ones >>> that I may begin with are the '=' operator, as well as sbrk and mmap >>> syscalls. It isn't completely obvious to me which pass class to use >>> for these. Would you recommend the FunctionPass classes for both of >>> these? >> >> I don't understand what you would like your transform to do, can you >> e...

...ee(), which ends in Free(my_tree); All well, BUT: problem is that memory just builds up and is not freed at all. >From a (more private) E-mail of Prof Brian Ripley, I read (maybe wrongly?) that this seems to be ``common'': BDR> and the way that most mallocs work is to use sbrk to raise or lower BDR> the brk, that is the size of the data space. BDR> They only reduce it when the data space is sufficiently unfragmented. -------------------------------------------------------------------- which may be my case : "Free(my_tree)" doesn't really f...