I am trying to use dovecot. I've got a GFS2 shared volume on two servers with dovecot running on both. On one server at a time, it works. The test I am trying is to attach two mail programs (MUA) via IMAPS (Thunderbird and Evolution as it happens). I've attached one mail program to each IMAPS server. I am trying to move emails around in one program (from folder to folder), and then checking it on the other program. I'm testing in effect how it would work if my users log on twice and end up on different servers. I seem to suffer from never ending index file corruption: Apr 4 16:55:49 mailstore-b dovecot: IMAP(david at everybody-loves.craigon.co.uk): Corrupted transaction log file /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex.log: end_offset (284) > current sync_offset (104) Apr 4 16:55:49 mailstore-b dovecot: IMAP(david at everybody-loves.craigon.co.uk): broken sync positions in index file /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex Apr 4 16:55:49 mailstore-b dovecot: IMAP(david at everybody-loves.craigon.co.uk): fscking index file /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex Apr 4 16:55:49 mailstore-b dovecot: IMAP(david at everybody-loves.craigon.co.uk): Fixed index file /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex: log file sync pos 1,284 -> 1, 104 Apr 4 16:55:50 mailstore-b dovecot: IMAP(david at everybody-loves.craigon.co.uk): Unexpected transaction log desync with index /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex Apr 4 16:56:18 mailstore-b dovecot: IMAP(david at everybody-loves.craigon.co.uk): Transaction log file /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex.log: marked corrupted This happens pretty quickly. I can also get message duplication- if I move a message from one server to another, I can get a message in the original folder and the destination folder. I am using RC28. I have tried using fcntl locking and dotlocking with equal lack of success. Can anyone offer any advice? David Griffin Information Systems Ltd 20 St Christopher's Way, Pride Park, Derby DE24 8JY www.griffin.com <http://www.griffin.com/> Registered in England and Wales. Company Registration Number: 3676297. VAT Number: 716604053
On 095, 04 05, 2007 at 09:58:44AM +0100, David Craigon wrote:> I am trying to use dovecot. I've got a GFS2 shared volume on two servers > with dovecot running on both. On one server at a time, it works. > > The test I am trying is to attach two mail programs (MUA) via IMAPS > (Thunderbird and Evolution as it happens). I've attached one mail > program to each IMAPS server. I am trying to move emails around in one > program (from folder to folder), and then checking it on the other > program. I'm testing in effect how it would work if my users log on > twice and end up on different servers. > > I seem to suffer from never ending index file corruption:Where are index files located ?> Apr 4 16:55:49 mailstore-b dovecot: > IMAP(david at everybody-loves.craigon.co.uk): Corrupted transaction log > file > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex.log: > end_offset (284) > current sync_offset (104) Apr 4 16:55:49 mailstore-b > dovecot: > IMAP(david at everybody-loves.craigon.co.uk): broken sync positions in > index file > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex > Apr 4 16:55:49 mailstore-b dovecot: > IMAP(david at everybody-loves.craigon.co.uk): fscking index file > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex > Apr 4 16:55:49 mailstore-b dovecot: > IMAP(david at everybody-loves.craigon.co.uk): Fixed index file > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex: > log file sync pos 1,284 -> 1, 104 > Apr 4 16:55:50 mailstore-b dovecot: > IMAP(david at everybody-loves.craigon.co.uk): Unexpected transaction log > desync with index > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex > Apr 4 16:56:18 mailstore-b dovecot: > IMAP(david at everybody-loves.craigon.co.uk): Transaction log file > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex.log: > marked corrupted > > This happens pretty quickly. I can also get message duplication- if I > move a message from one server to another, I can get a message in the > original folder and the destination folder. > > I am using RC28. I have tried using fcntl locking and dotlocking with > equal lack of success. > > Can anyone offer any advice? > > David > > > Griffin Information Systems Ltd > 20 St Christopher's Way, > Pride Park, > Derby > DE24 8JY > www.griffin.com <http://www.griffin.com/> > > Registered in England and Wales. Company Registration Number: 3676297. > VAT Number: 716604053 > > >-- Andrey Panin | Linux and UNIX system administrator pazke at donpac.ru | PGP key: wwwkeys.pgp.net -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: Digital signature URL: <http://dovecot.org/pipermail/dovecot/attachments/20070405/a52ad2bc/attachment.bin>
On Thu, 2007-04-05 at 09:58 +0100, David Craigon wrote:> I am trying to use dovecot. I've got a GFS2 shared volume on two servers > with dovecot running on both. On one server at a time, it works.Do you have mmap disabled? Tomi
Yes> -----Original Message----- > From: Tomi Hakala [mailto:tomi.hakala at pobox.fi] > Sent: 05 April 2007 11:30 > To: David Craigon > Cc: dovecot at dovecot.org > Subject: Re: [Dovecot] Problems using GFS2 and clustered dovecot > > On Thu, 2007-04-05 at 09:58 +0100, David Craigon wrote: > > I am trying to use dovecot. I've got a GFS2 shared volume on two > > servers with dovecot running on both. On one server at a > time, it works. > > Do you have mmap disabled? > > Tomi > >
Sorry, it's just struck me that I've missed out the most important information- I am using maildir++. Sorry :-(. The index files are kept on the shared volume. And to answer the other question again, mmap is off. David> -----Original Message----- > From: Andrey Panin [mailto:pazke at donpac.ru] > Sent: 05 April 2007 10:25 > To: David Craigon > Cc: dovecot at dovecot.org > Subject: Re: [Dovecot] Problems using GFS2 and clustered dovecot > > On 095, 04 05, 2007 at 09:58:44AM +0100, David Craigon wrote: > > I am trying to use dovecot. I've got a GFS2 shared volume on two > > servers with dovecot running on both. On one server at a > time, it works. > > > > The test I am trying is to attach two mail programs (MUA) via IMAPS > > (Thunderbird and Evolution as it happens). I've attached one mail > > program to each IMAPS server. I am trying to move emails > around in one > > program (from folder to folder), and then checking it on the other > > program. I'm testing in effect how it would work if my users log on > > twice and end up on different servers. > > > > I seem to suffer from never ending index file corruption: > > Where are index files located ? > > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): Corrupted > transaction log > > file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex.log: > > end_offset (284) > current sync_offset (104) Apr 4 16:55:49 > > mailstore-b > > dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): broken sync positions in > > index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): fscking index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): Fixed index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex: > > log file sync pos 1,284 -> 1, 104 > > Apr 4 16:55:50 mailstore-b dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): Unexpected > transaction log > > desync with index > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:56:18 mailstore-b dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): Transaction log file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex.log: > > marked corrupted > > > > This happens pretty quickly. I can also get message > duplication- if I > > move a message from one server to another, I can get a > message in the > > original folder and the destination folder. > > > > I am using RC28. I have tried using fcntl locking and > dotlocking with > > equal lack of success. > > > > Can anyone offer any advice? > > > > David > > > > > > Griffin Information Systems Ltd > > 20 St Christopher's Way, > > Pride Park, > > Derby > > DE24 8JY > > www.griffin.com <http://www.griffin.com/> > > > > Registered in England and Wales. Company Registration > Number: 3676297. > > VAT Number: 716604053 > > > > > > > > -- > Andrey Panin | Linux and UNIX system administrator > pazke at donpac.ru | PGP key: wwwkeys.pgp.net >
David Craigon wrote:> I am trying to use dovecot. I've got a GFS2 shared volume on two servers > with dovecot running on both. On one server at a time, it works. > >Sorry to not answer your question directly, but do you have a good reason to be using GFS instead of NFS? We experimented with GFS last year (granted, not GFS2), and found its performance pretty horrible and its stability comically bad... had we been paying for it, however, it wouldn't have been funny. OCFS2 was better, but still unreliable. Lustre was the best we found (it worked, at least), but it required a lot of hardware/admin overhead. We tried other clustering filesystems as well, and none of them was worth the trouble.> The test I am trying is to attach two mail programs (MUA) via IMAPS > (Thunderbird and Evolution as it happens). I've attached one mail > program to each IMAPS server. I am trying to move emails around in one > program (from folder to folder), and then checking it on the other > program. I'm testing in effect how it would work if my users log on > twice and end up on different servers. > > I seem to suffer from never ending index file corruption: > > Apr 4 16:55:49 mailstore-b dovecot: > IMAP(david at everybody-loves.craigon.co.uk): Corrupted transaction log > file > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex.log: > end_offset (284) > current sync_offset (104) Apr 4 16:55:49 mailstore-b > dovecot: > IMAP(david at everybody-loves.craigon.co.uk): broken sync positions in > index file > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex > Apr 4 16:55:49 mailstore-b dovecot: > IMAP(david at everybody-loves.craigon.co.uk): fscking index file > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex > Apr 4 16:55:49 mailstore-b dovecot: > IMAP(david at everybody-loves.craigon.co.uk): Fixed index file > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex: > log file sync pos 1,284 -> 1, 104 > Apr 4 16:55:50 mailstore-b dovecot: > IMAP(david at everybody-loves.craigon.co.uk): Unexpected transaction log > desync with index > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex > Apr 4 16:56:18 mailstore-b dovecot: > IMAP(david at everybody-loves.craigon.co.uk): Transaction log file > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind > ex.log: > marked corrupted > > This happens pretty quickly. I can also get message duplication- if I > move a message from one server to another, I can get a message in the > original folder and the destination folder. > > I am using RC28. I have tried using fcntl locking and dotlocking with > equal lack of success. > > Can anyone offer any advice? > > David > > > Griffin Information Systems Ltd > 20 St Christopher's Way, > Pride Park, > Derby > DE24 8JY > www.griffin.com <http://www.griffin.com/> > > Registered in England and Wales. Company Registration Number: 3676297. > VAT Number: 716604053 > > > >
Well, I'm not paying for it. And I've managed to fix the comedy stability I've come across so far, but you're right- I haven't really loaded the system up yet. My rationale is that I want a filesystem I can share between several servers, reducing the points of failure as far as I can down. We've got a large iSCSI SAN we've already bought for other projects, and I'd like to use that for our storage. So using NFS, I'd have to have another server in front of my SAN that act as an NFS server (presuambly as a single point of failuire), and the mail servers as NFS clients. I'd rather have the servers talk to the SAN directly. Besides, NFS never really works for me, but I'm sure I could overcome that. Anyway, I don't think it's a GFS problem so far. David> -----Original Message----- > From: dovecot-bounces at dovecot.org > [mailto:dovecot-bounces at dovecot.org] On Behalf Of Justin McAleer > Sent: 05 April 2007 13:37 > To: dovecot at dovecot.org > Subject: Re: [Dovecot] Problems using GFS2 and clustered dovecot > > David Craigon wrote: > > I am trying to use dovecot. I've got a GFS2 shared volume on two > > servers with dovecot running on both. On one server at a > time, it works. > > > > > > Sorry to not answer your question directly, but do you have a > good reason to be using GFS instead of NFS? We experimented > with GFS last year (granted, not GFS2), and found its > performance pretty horrible and its stability comically > bad... had we been paying for it, however, it wouldn't have > been funny. OCFS2 was better, but still unreliable. Lustre > was the best we found (it worked, at least), but it required > a lot of hardware/admin overhead. We tried other clustering > filesystems as well, and none of them was worth the trouble. > > > The test I am trying is to attach two mail programs (MUA) via IMAPS > > (Thunderbird and Evolution as it happens). I've attached one mail > > program to each IMAPS server. I am trying to move emails > around in one > > program (from folder to folder), and then checking it on the other > > program. I'm testing in effect how it would work if my users log on > > twice and end up on different servers. > > > > I seem to suffer from never ending index file corruption: > > > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): Corrupted > transaction log > > file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex.log: > > end_offset (284) > current sync_offset (104) Apr 4 16:55:49 > > mailstore-b > > dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): broken sync positions in > > index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): fscking index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): Fixed index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex: > > log file sync pos 1,284 -> 1, 104 > > Apr 4 16:55:50 mailstore-b dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): Unexpected > transaction log > > desync with index > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:56:18 mailstore-b dovecot: > > IMAP(david at everybody-loves.craigon.co.uk): Transaction log file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex.log: > > marked corrupted > > > > This happens pretty quickly. I can also get message > duplication- if I > > move a message from one server to another, I can get a > message in the > > original folder and the destination folder. > > > > I am using RC28. I have tried using fcntl locking and > dotlocking with > > equal lack of success. > > > > Can anyone offer any advice? > > > > David > > > > > > Griffin Information Systems Ltd > > 20 St Christopher's Way, > > Pride Park, > > Derby > > DE24 8JY > > www.griffin.com <http://www.griffin.com/> > > > > Registered in England and Wales. Company Registration > Number: 3676297. > > VAT Number: 716604053 > > > > > > > > >
On 5.4.2007, at 11.58, David Craigon wrote:> I am trying to use dovecot. I've got a GFS2 shared volume on two > servers > with dovecot running on both. On one server at a time, it works.I guess GFS2 has some caching problems then..> end_offset (284) > current sync_offset (104) Apr 4 16:55:49 > mailstore-b > dovecot:This means that dovecot.index file said that transaction log is synced up to offset 284, but when Dovecot was trying read the dovecot.index.log file, it found data only up to offset 104. So either GFS2 said that the file ended at offset 104, or it decided to return old data from cache. I guess it's the latter, because the log file reads are done without locking. Probably the easiest way is to just put the index files into local disk. -------------- next part -------------- A non-text attachment was scrubbed... Name: PGP.sig Type: application/pgp-signature Size: 186 bytes Desc: This is a digitally signed message part URL: <http://dovecot.org/pipermail/dovecot/attachments/20070406/1c3629c8/attachment.bin>
Seemingly Similar Threads
- Stopping certain users from using IMAP, or POP3, etc.
- Driving quota out of a database.
- Maildir + NFS + multiple machines = spectacular failure
- Crash in service imap with version 2.2.13
- Realtime asterisk queues only reload queue members when a new call joins the queue