search for: posix_fallocate

Displaying 20 results from an estimated 159 matches for "posix_fallocate".

2009 Jul 30
3
AIX and posix_fallocate
Hi, AIX's implementation of posix_fallocate is a little bit, let me say, peculiar. Attached is a patch to "fix" (=work around) this. Without you'll see this in the logs: Jul 28 01:17:41 trevi mail:err|error dovecot: IMAP(beckerr): posix_fallocate() failed: File exists Jul 28 01:17:41 trevi mail:err|error dovecot: IMAP(bec...
2013 Aug 05
1
Corrupted mboxes with v2.2.4, posix_fallocate and GFS2
...uld be appended directly after a block of NUL bytes, and be scanned by dovecot as being glued to the preceding message. I traced this to the file extension operation performed in mbox_sync_handle_eof_updates, where the 'file_set_size' call is used. If available, file_set_size will use the posix_fallocate call. In GFS2 posix_fallocate increases the file size in 4 kB chunks (there seems to be no guarantee anyway that posix_allocate will extend a file by the exact size requested). After a successful posix_fallocate call, mbox_sync_handle_eof_updates currently proceeds in rewriting the mailbox startin...
2010 Apr 06
1
[PATCH] Check error returns from posix_fallocate (RHBZ#579664).
...can.org/getting_started_with_ocaml_on_red_hat_and_fedora -------------- next part -------------- >From 557f413e0bd1ad7bd0180ca28a5bfec854f23790 Mon Sep 17 00:00:00 2001 From: Richard Jones <rjones at redhat.com> Date: Tue, 6 Apr 2010 11:03:03 +0100 Subject: [PATCH] Check error returns from posix_fallocate (RHBZ#579664). posix_fallocate has a non-standard way to return error indications. Thus all our calls to posix_fallocate were effectively unchecked. For example: $ guestfish alloc test.img 1P $ echo $? 0 $ ll test.img -rw-rw-r--. 1 rjones rjones 0 2010-04-06 11:02 test.img $ rm test....
2007 Nov 05
13
preallocate CPU usage - pre4
...spike on the server-side. The spike lasts about 20 minutes and uses about 20%-25% of the cpu associated with the rsync instance creating the file. The spike is directly linked to the time it takes to create the file. I compiled rsync using cygwin CVS. I initially suspected the implementation of posix_fallocate in cygwin. I posted the same question to their board and Corinna indicated she can create a 40GB file in a few milliseconds. I'm wondering if there is something else going on at this point. Does anyone else get this issue too? I want to confirm it isn't just a problem with my environm...
2008 Sep 22
2
Test environment question
...rned off the cehck for mail when starting and check for new mail every N minutes functions, and then check the ps table to make sure there are no imap connections) However, I'm seeing two errmsgs in the maillog on the test machine: > Sep 22 11:54:13 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() faile > d: Protocol not available > Sep 22 11:54:13 egg mail:err|error dovecot: IMAP(sdean): file_set_size() failed > with mbox file /var/spool/mail/sdean: Protocol not available which appear to happen AFTER mail arrives at the production server....it seems to happen on my test server...
2017 Oct 31
2
lld: sigbus error handling
Does FreeBSD have fallocate(2) or equivalent? On Mon, Oct 30, 2017 at 4:32 PM, Ed Maste <emaste at freebsd.org> wrote: > On 23 October 2017 at 18:49, Rui Ueyama via llvm-dev > <llvm-dev at lists.llvm.org> wrote: > >> > >> BTW, posix_fallocate() might provide better portability and decrease the > >> likelihood of falling back on ftruncate(). > > > > Yes, but we want to avoid that function because when it falls back, it is > > very slow. What it does when fallocate(2) is not available is to actually > > wr...
2009 Nov 25
0
[PATCH] daemon: Alternate implementation of posix_fallocate.
...inGW http://www.annexia.org/fedora_mingw -------------- next part -------------- >From f6df273d53ba46042856ebe6b2c640c9b715a51b Mon Sep 17 00:00:00 2001 From: Richard Jones <rjones at redhat.com> Date: Tue, 24 Nov 2009 16:16:08 +0000 Subject: [PATCH 3/4] daemon: Alternate implementation of posix_fallocate. If the posix_fallocate function is not available [ie. Windows] use an alternate implementation that just loops and writes. --- daemon/configure.ac | 1 + daemon/fallocate.c | 23 ++++++++++++++++++++++- 2 files changed, 23 insertions(+), 1 deletions(-) diff --git a/daemon/configure.ac b/d...
2017 Oct 23
2
lld: sigbus error handling
...back the file's size with stat() before mapping? > .st_blocks should give the "real" size. > Creating a sparse file is not an error, and a sparse file works fine as long as your disk has enough space (which is almost always true.) So I don't know how stat helps. > BTW, posix_fallocate() might provide better portability and decrease the > likelihood of falling back on ftruncate(). > Yes, but we want to avoid that function because when it falls back, it is very slow. What it does when fallocate(2) is not available is to actually write 0 to every block to make sure that all...
2010 Dec 08
2
Improving Samba write performance on Linux
...system (ext4 or XFS) in a very efficient way which causes the actual writes to be much faster than having to allocate them dynamically. How does a Linux application (Samba) get access to this new extent-based allocation call ? Simple, it's built into glibc on modern Linux distributions via the posix_fallocate() call. In the new patch that has gone into Samba 3.5.7 (and also all future versions of Samba), when the smb.conf parameter: "strict allocate = yes" is set on a share, whenever a file is extended by an SMBwriteX/SMB2_WRITE call, call Samba calls posix_fallocate() to ensure the file ext...
2008 Apr 03
1
combining --preallocate and --fuzzy
...ke to accomplish is the merging of the .preallocate patch and the .fuzzy option. When these 2 switches are used together (at least on Windows platforms), I want rsync to determine which fuzzy file to use (from the fuzzy_distance() function), but then go ahead and preallocate the new file, not with posix_fallocate(), but with the contents of the file matched from fuzzy_distance(). This would keep the destination file from being severely fragmented. What I see happening is rsync doing a local file copy first, but not block by block. When you copy a file on Windows, with the copy command, the entire file (s...
2006 Sep 13
2
File fragmentation
Wayne.my vote is for a command-line option. I've noticed there is some penalty for very large files (35GB-50GB). The penalty is relatively small based on my 'intuitive' measurements.read me watching without running a real timer. The difference is very small compared to what happens after a few weeks without the fragmentation patch. Our SAN was becoming so fragmented that we were
2018 Mar 29
1
Re: [PATCH v7 6/6] v2v: Add -o rhv-upload output mode (RHBZ#1557273).
...66170890192c1fd7d1f3#diff-5ca47c29ae13efa3959b8b28cf4dbd31R112 > line 112 > > The disk size in this case is 40 GB and we currently wait 5 minutes. > > On the ovirt-node there's an ‘fallocate’ process (still) running. > It's taken 23 minutes so far. > This code is using posix_fallocate and it can be very slow on NFS < 4.2, writing one byte to every 4k block. > Because we didn't reach a satisfactory conclusion of the whole > sparse/format business, I am currently setting sparse = False > (format is always raw in my testing): > > > https://github.com/libg...
2017 Oct 24
3
lld: sigbus error handling
On Mon, Oct 23, 2017 at 6:40 PM, Andrew Kelley <superjoe30 at gmail.com> wrote: > > > On Mon, Oct 23, 2017 at 9:30 PM, Rui Ueyama <ruiu at google.com> wrote: > >> On Mon, Oct 23, 2017 at 5:28 PM, Andrew Kelley <superjoe30 at gmail.com> >> wrote: >> >>> For Zig we use LLD as a library. So for us it would be better to avoid >>>
2006 Aug 06
2
File fragmentation
I've been running some tests on files created by rsync and noticing fragmentation issues. I started the testing because our 5TB array started performing very slowly and it appears fragmentation was the culprit. The test I conducted was straighforward: 1. Copy over a 49GB file. Analyzed with contig (from sysinternals), no fragments. 2. Ran rsync and the file was recreated normally (rsync
2020 Mar 27
2
[Bug 14328] New: usleep() is obsolete, use nanosleep()
...01 declares this function obsolete; use nanosleep(2) instead. POSIX.1-2008 removes the specification of usleep(). recent rsync 3.1.3 is still using usleep: # grep -r usleep * config.h.in:/* Define to 1 if you have the `usleep' function. */ configure.ac: initgroups utimensat posix_fallocate attropen setvbuf usleep) configure.sh: initgroups utimensat posix_fallocate attropen setvbuf usleep OLDNEWS: - Use usleep() for our msleep() function if it is available. util2.c: usleep(t*1000); for my curiosity, that went into rsync @2014, which is not too long ago: https://git.samba....
2007 Oct 18
2
more problems with dovecot-1.1 beta3
Hi, Thank you for pointing me about -xc99 flag, I have compiled and installed dovecot inplace of version 1.0.5 without any special actions on the upgrade. And after starting it immediately got in it's log file messages like: --- dovecot: Oct 16 23:10:18 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.git-altlinux-ru/dovecot.index.cache: Invalid
2015 Jun 02
2
preallocation=full Vs preallocation=metadata
Hi All I was reading through this: http://kashyapc.com/2011/12/02/little-more-disk-io-perf-improvement-with-fallocateing-a-qcow2-disk/ I was basically searching for pointers on improving disk I/O. I wanted to know the purpose of preallocation=full & preallocation=metadata , What is the difference between them ? and which one would yield a better disk I/O speed ? Appreciate your
2018 May 14
1
Unable to build 'lld' on Mac OS 10.9
...ing for getrusage -- Looking for getrusage - found -- Looking for setrlimit -- Looking for setrlimit - found -- Looking for isatty -- Looking for isatty - found -- Looking for futimens -- Looking for futimens - not found -- Looking for futimes -- Looking for futimes - found -- Looking for posix_fallocate -- Looking for posix_fallocate -not found -- Looking for lseek64 -- Looking for lseek64 - not found -- Looking for mallctl -- Looking for mallctl - not found -- Looking for mallinfo -- Looking for mallinfo - not found -- Looking formalloc_zone_statistics -- Looking formalloc_zone_statistic...
2015 Jun 03
0
Re: preallocation=full Vs preallocation=metadata
...39;test2-full.qcow2', fmt=qcow2 size=1073741824 encryption=off cluster_size=65536 preallocation='full' lazy_refcounts=off refcount_bits=16 $ ls -lash test2-full.qcow2 1.1G -rw-r--r--. 1 root root 1.1G Jun 3 03:31 test2-full.qcow2 (3) 'preallocation=falloc': which uses posix_fallocate() to "allocate blocks and marking them as uninitialized", and is relatively faster than writing out zeroes to a file: $ qemu-img create -f qcow2 -o preallocation=falloc test3-falloc.qcow2 1G Formatting 'test3-falloc.qcow2', fmt=qcow2 size=1073741824 encryption=off...
2009 Mar 10
1
Error crosscompiling
Hi, I was trying to crosscompile dovecot, but I got some error: --with-notify=inotify don't work, as it try to run a test program to verify if inotify is supported in the building platform. Solved with --with-notify=dnotify. Ihmo, is more a hack than a solution. | checking whether posix_fallocate() works... configure: error: cannot run test program while cross compiling I can't find an a suitable option for this error. Again the problem is that configure can't run an executable for a different platform. It's possible to set a safe default? Thanks in advance. -- Saluti / Re...