search for: fsync

Displaying 20 results from an estimated 400 matches for "fsync".

Did you mean: sync
2013 Nov 15
7
[PATCH 1/2] xfstests: add generic/321 to test fsync() on directories V2
Btrfs had some issues with fsync()''ing directories and fsync()''ing after renames. These three new tests cover the 3 different issues we were seeing. This breaks out the dmflakey stuff into a common helper to be shared between generic/311 and generic/321. Thanks, Signed-off-by: Josef Bacik <jbacik@fus...
2004 Sep 16
1
[PATCH] BUG on fsync/fdatasync with Ext3 data=journal
Hello, We found that fsync and fdatasync syscalls sometimes don't sync data in an ext3 file system under the following conditions. 1. Kernel version is 2.6.6 or later (including 2.6.8.1 and 2.6.9-rc2). 2. Ext3's journalling mode is "data=journal". 3. Create a file (whose size is 1Mbytes) and execute umount...
2006 Feb 25
1
Linux performance bug: fsync() for files with zero links
Linux kernel (as of 2.6.15.4) has the following performance bug: Syncing (fsync() or fdatasync()) files with zero links (deleted files) in not no-op, as it should be. See details, a test C program, and the rationale in the URL below: http://b2e.ex-code.com/index.php/soft/2006/02/24/linux_performance_bug_zero_links_fsync In the article with th...
2007 Mar 21
1
Ext3 behavior on power failure
Hi all, We are building a new system which is going to use ext3 FS. We would like to know more about the behavior of ext3 in the case of failure. But before I procede, I would like to share more information about our future system. * Our application always does an fsync on files * When symbolic links (more specifically fast symlink) are created, the host directory is also fsync'ed. * Our application is also going to front an EMC disk array configured using RAID5 or RAID6. * We will be using multipathing so that we can assume that no disk errors will be repor...
2004 Feb 13
1
fsync in ext3: A question
Hi, I have a question on fsync() and ext3's journaling modes. Assume that I call fsync(fd) on a file. If that file is in 'data=journal' mode, would the fsync() return once the data gets safely into the journal ? On the other hand, if that file is in 'data=writeback' mode, would the fsync() return only when...
2009 Mar 18
24
rename(2), atomicity, crashes and fsync()
...is means after a crash, "foo" is zero-length, and both the new and the old data has been lost, which is undesirable. This doesn''t happen when using ext3''s default settings because ext3 writes data to disk before metadata (which has performance problems, see Firefox 3 and fsync[2]) Ted T''so''s (the main author of ext3 and ext4) response is that applications which perform open(),write(),close(),rename() in the expectation that they will either get the old data or the new data, but not no data at all, are broken, and instead should call open(),write(),fsyn...
2008 Jun 24
10
1.0.14 -> 1.1.1: dovecot-uidlist errors
I''ve just updated from 1.0.14 to 1.1.1 (Maildirs). According to <URL:http://wiki.dovecot.org/Upgrading/1.1>, "dovecot-uidlist file is in a new format. The old format is automatically converted to new one." When I try to delete a message (which moves it to the IMAP Trash folder), I get the following looping sequence of errors until I cancel the delete
2018 Mar 05
1
SQLite3 on 3 node cluster FS?
On Mon, Mar 5, 2018 at 8:21 PM, Paul Anderson <pha at umich.edu> wrote: > Hi, > > tl;dr summary of below: flock() works, but what does it take to make > sync()/fsync() work in a 3 node GFS cluster? > > I am under the impression that POSIX flock, POSIX > fcntl(F_SETLK/F_GETLK,...), and POSIX read/write/sync/fsync are all > supported in cluster operations, such that in theory, SQLite3 should > be able to atomically lock the file (or...
2018 Mar 06
2
SQLite3 on 3 node cluster FS?
...<rgowdapp at redhat.com> wrote: > > > > > > On Mon, Mar 5, 2018 at 8:21 PM, Paul Anderson <pha at umich.edu> wrote: > >> > >> Hi, > >> > >> tl;dr summary of below: flock() works, but what does it take to make > >> sync()/fsync() work in a 3 node GFS cluster? > >> > >> I am under the impression that POSIX flock, POSIX > >> fcntl(F_SETLK/F_GETLK,...), and POSIX read/write/sync/fsync are all > >> supported in cluster operations, such that in theory, SQLite3 should > &gt...
2005 Nov 25
28
ZFS and memcntl(..., MC_SYNC, ...)
It wouldn''t be proper to start my first post here without congratulations and thanks to the ZFS team for such an impressive piece of work. Anyway, on to my query. I''ve been trying out ZFS, with a particular focus in reducing latency in a specific application. This application has a fair amount of random writing going on in the background (which, of course, ZFS will make
2018 Mar 05
2
SQLite3 on 3 node cluster FS?
...2018 at 11:26 AM, Raghavendra Gowdappa <rgowdapp at redhat.com> wrote: > > > On Mon, Mar 5, 2018 at 8:21 PM, Paul Anderson <pha at umich.edu> wrote: >> >> Hi, >> >> tl;dr summary of below: flock() works, but what does it take to make >> sync()/fsync() work in a 3 node GFS cluster? >> >> I am under the impression that POSIX flock, POSIX >> fcntl(F_SETLK/F_GETLK,...), and POSIX read/write/sync/fsync are all >> supported in cluster operations, such that in theory, SQLite3 should >> be able to atomical...
2018 Mar 05
1
SQLite3 on 3 node cluster FS?
Hi, tl;dr summary of below: flock() works, but what does it take to make sync()/fsync() work in a 3 node GFS cluster? I am under the impression that POSIX flock, POSIX fcntl(F_SETLK/F_GETLK,...), and POSIX read/write/sync/fsync are all supported in cluster operations, such that in theory, SQLite3 should be able to atomically lock the file (or a subset of page), modi...
2010 Apr 11
1
Re: Poor interactive performance with I/O loads with fsync()ing
...ari.foss@gmail.com> writes: > >> ext4/XFS/JFS/btrfs should be better in this regard > >> > >> > > I am using btrfs, so yes, I was expecting things to be better. Unfortunately, > > the improvement seems to be non-existent under high IO/fsync load. > > > > btrfs is known to perform poorly under fsync. > Has the reason for this been identified? Judging from the nature of metadata loads, it would seem that it should be substantially easier to implement fsync() efficiently. - Ben -- To unsubscribe from this list: send th...
2001 Jul 30
1
ext3-2.4-0.9.5
...te it if the MTA guys could poke some useful holes in the modelling. The simulator launches a (large) number of sub-processes. Each subprocess does the following: for 100 different filenames create a file write some data to the file (5k to 250k, exponential distribution) optionally fsync() the file close the file optionally fsync() the file's parent dir rename the file optionally fsync() the file's parent dir rename the file optionally fsync() the file's parent dir rename the file optionally fsync() the file's parent dir unlink th...
2013 Dec 06
5
How reliable is XFS under Gluster?
...he default FS in the upcoming RedHat7. On the other hand, XFS is being known as a file system that can be easily corrupted (zeroing files) in case of a power failure. Supporters of the file system claim that this should never happen if an application has been properly coded (properly committing/fsync-ing data to storage) and the storage itself has been properly configured (disk cash disabled on individual disks and battery backed cache used on the controllers). My question is, should I be worried about losing data in a power failure or similar scenarios (or any) using GlusterFS and XFS? Are the...
2013 Jul 17
5
syncer causing latency spikes
...cal modifications and backports, r231160 in particular). The system has an LSI 9261-8i RAID controller (backed by mfi(4)) and the database and WALs are on separate volumes, a RAID 6 and a RAID 1 respectively. It has about 96GB of RAM installed. What''s happening is that the syncer tries to fsync a large database file and goes to sleep in getpbuf() with the corresponding vnode lock held and the following stack: #3 0xffffffff805fceb5 in _sleep (ident=0xffffffff80ca8e20, lock=0xffffffff80d6bc20, priority=-2134554464, wmesg=0xffffffff80a4fe43 "wswbuf0", timo=0) at /d2/usr...
2007 Feb 06
22
1.0.rc22 released
...my imaptest catched the bug only in CVS HEAD but not in branch_1_0 even though both had it. Anyway, now the imaptest runs nicely for both, and I'm again optimistic that the bug count is low enough for v1.0 to be released soon :) BTW. My previous benchmarks which showed how mmap_disable=yes and fsync_disable=yes give huge performance benefits are pretty XFS-specific. I did some quick tests with ext3 and the differences were quite small with it. I'll probably do another proper run of tests later. + pop3: Commit the transaction even if client didn't QUIT so cached data gets saved. -...
2007 Feb 06
22
1.0.rc22 released
...my imaptest catched the bug only in CVS HEAD but not in branch_1_0 even though both had it. Anyway, now the imaptest runs nicely for both, and I'm again optimistic that the bug count is low enough for v1.0 to be released soon :) BTW. My previous benchmarks which showed how mmap_disable=yes and fsync_disable=yes give huge performance benefits are pretty XFS-specific. I did some quick tests with ext3 and the differences were quite small with it. I'll probably do another proper run of tests later. + pop3: Commit the transaction even if client didn't QUIT so cached data gets saved. -...
2003 Feb 04
1
Quick fsync question
If I want to make sure a file has really been deleted do I have to: 1. fsync the file 2. fsync the directory the file is in 3. both? Much thanks. -- Ben Escoto
2003 Feb 24
0
fsync() and data=journal behaviour
I'm currently looking at the behaviour of various Linux filesystems as backends for the Cyrus IMAP server. Like many mail applications, Cyrus makes heavy use of the fsync() system call to ensure that data has hit stable storage before it acknowledges receipt of messages. At the moment fsync() appears to introduce lots of synchronous I/O as data is flushed all the way through to the filesystem proper. My (probably naive) hope was that when using the data=journa...