thr3ads.net - dovecot - [Dovecot] dovecot & OCFS2 Cluster [Apr 2011]

If this information is useful, please help other people find it:
Share via:

Osvaldo Alvarez Pozo

2011-Apr-25 17:02 UTC

[Dovecot] dovecot & OCFS2 Cluster

hi all

We have an ocfs2 cluster compose of 4 Debian lenny serveurs wich have
access to an ISCSI LUN we have create a partition on this Lun and
formated this partition as OCFS2.
2 serveurs does mail delivery (SMTP) and the two other are pop/imap
servers. The smtp servers use dovecot LDA to deliver to mailboxes. La
version de dovecot is 1.2.13, ldirectord balance conexion to the
servers(pop/pops/imap/imaps to the two imap/pop serveurs) (smtp to the
two smtp servers).


this is a part of my  dovecot.conf

mail_location = maildir:/var/vmail/%d/%u/Maildir
mail_access_groups = mail
first_valid_uid = 5000
last_valid_uid = 5000
mail_max_userip_connections = 100
maildir_copy_with_hardlinks = yes
disable_plaintext_auth = no
dotlock_use_excl=yes
mmap_disable = yes
protocols = imap imaps pop3 pop3s managesieve
protocol imap {
  mail_plugins = quota imap_quota
  imap_client_workarounds = outlook-idle delay-newmail
}
protocol pop3 {
  mail_plugins = quota
  pop3_client_workarounds = outlook-no-nuls oe-ns-eoh
  pop3_uidl_format = %08Xu%08Xv
}
protocol lda {
  mail_plugins = quota sieve
  log_path = /var/log/dovecot-deliver.log
  info_log_path = /var/log/dovecot-deliver.log
}
protocol managesieve {
  managesieve_implementation_string = dovecot
 }
auth default {
mechanisms = plain login
  passdb sql {
    args = /etc/dovecot/sql.conf
  }
 userdb prefetch {
  }
  userdb sql {
    args = /etc/dovecot/sql.conf
  }
    user = nobody
  socket listen {
    master {
      path = /var/run/dovecot/auth-master
      mode = 0660
      user = vmail
      group = mail
    }
    client {
      path = /var/spool/postfix/private/auth
      mode = 0660
      user = postfix   	
      group = mail
}

We are having severals  problems from "cpu stuck for 61 seconds"   to
"too many connexion".

I wonder if there is a configuation type of dovecot when using ocfs2.
In tje dovecot site they give advices about how to configure dovecot
when using NFS, but not about OCFS2.
Somme people say that lda shuld not be used.
Any help please?

Thanks
nebano

Robert Schetterer

2011-Apr-25 18:53 UTC

head link

[Dovecot] dovecot & OCFS2 Cluster

Am 25.04.2011 19:02, schrieb Osvaldo Alvarez Pozo:> hi all
> 
> We have an ocfs2 cluster compose of 4 Debian lenny serveurs wich have
> access to an ISCSI LUN we have create a partition on this Lun and
> formated this partition as OCFS2.
> 2 serveurs does mail delivery (SMTP) and the two other are pop/imap
> servers. The smtp servers use dovecot LDA to deliver to mailboxes. La
> version de dovecot is 1.2.13, ldirectord balance conexion to the
> servers(pop/pops/imap/imaps to the two imap/pop serveurs) (smtp to the
> two smtp servers).
> 
> 
> this is a part of my  dovecot.conf
> 
> mail_location = maildir:/var/vmail/%d/%u/Maildir
> mail_access_groups = mail
> first_valid_uid = 5000
> last_valid_uid = 5000
> mail_max_userip_connections = 100
> maildir_copy_with_hardlinks = yes
> disable_plaintext_auth = no
> dotlock_use_excl=yes
> mmap_disable = yes
> protocols = imap imaps pop3 pop3s managesieve
> protocol imap {
>   mail_plugins = quota imap_quota
>   imap_client_workarounds = outlook-idle delay-newmail
> }
> protocol pop3 {
>   mail_plugins = quota
>   pop3_client_workarounds = outlook-no-nuls oe-ns-eoh
>   pop3_uidl_format = %08Xu%08Xv
> }
> protocol lda {
>   mail_plugins = quota sieve
>   log_path = /var/log/dovecot-deliver.log
>   info_log_path = /var/log/dovecot-deliver.log
> }
> protocol managesieve {
>   managesieve_implementation_string = dovecot
>  }
> auth default {
> mechanisms = plain login
>   passdb sql {
>     args = /etc/dovecot/sql.conf
>   }
>  userdb prefetch {
>   }
>   userdb sql {
>     args = /etc/dovecot/sql.conf
>   }
>     user = nobody
>   socket listen {
>     master {
>       path = /var/run/dovecot/auth-master
>       mode = 0660
>       user = vmail
>       group = mail
>     }
>     client {
>       path = /var/spool/postfix/private/auth
>       mode = 0660
>       user = postfix   	
>       group = mail
> }
> 
> We are having severals  problems from "cpu stuck for 61 seconds" 
to
> "too many connexion".
> 
> I wonder if there is a configuation type of dovecot when using ocfs2.
> In tje dovecot site they give advices about how to configure dovecot
> when using NFS, but not about OCFS2.
> Somme people say that lda shuld not be used.
> Any help please?
> 
> Thanks
> nebano
first upgrade your dovecot and i.e postfix to latest versions
use lmtp instead of lda
read
http://wiki1.dovecot.org/MailLocation/SharedDisk
look archives here
i use 5000 mailboxes on maildir  with drbd ocfs2 ,no problem so far
there is an option mail if you format with ocfs2
look bottlenecks with your ISCSI
as the nature of the beast there may be several reasons for your problem
but there is no known reason or bug to me why you shouldnt use ocfs2
you need to make more analysis
-- 
Best Regards

MfG Robert Schetterer

Germany/Munich/Bavaria

Henrique Fernandes

2011-Apr-25 22:54 UTC

head link

[Dovecot] dovecot & OCFS2 Cluster

There is a bug in ocfs2 1.4 if you are using it you should be looking for
upgrading to ocfs2 1.6

I have several performance problens with ocfs2 but now i guess the problem
is the webmail client that we are using.

I have several post here about it.

I will write a new one as soon as i found the solution.

Anyway, why use lmtp over lda ?

My setup have about 5000 active acounts all in maildir.

And i have never had you cpu problem.


[]'sf.rique


On Mon, Apr 25, 2011 at 3:53 PM, Robert Schetterer <robert at
schetterer.org>wrote:
> Am 25.04.2011 19:02, schrieb Osvaldo Alvarez Pozo:
> > hi all
> >
> > We have an ocfs2 cluster compose of 4 Debian lenny serveurs wich have
> > access to an ISCSI LUN we have create a partition on this Lun and
> > formated this partition as OCFS2.
> > 2 serveurs does mail delivery (SMTP) and the two other are pop/imap
> > servers. The smtp servers use dovecot LDA to deliver to mailboxes. La
> > version de dovecot is 1.2.13, ldirectord balance conexion to the
> > servers(pop/pops/imap/imaps to the two imap/pop serveurs) (smtp to the
> > two smtp servers).
> >
> >
> > this is a part of my  dovecot.conf
> >
> > mail_location = maildir:/var/vmail/%d/%u/Maildir
> > mail_access_groups = mail
> > first_valid_uid = 5000
> > last_valid_uid = 5000
> > mail_max_userip_connections = 100
> > maildir_copy_with_hardlinks = yes
> > disable_plaintext_auth = no
> > dotlock_use_excl=yes
> > mmap_disable = yes
> > protocols = imap imaps pop3 pop3s managesieve
> > protocol imap {
> >   mail_plugins = quota imap_quota
> >   imap_client_workarounds = outlook-idle delay-newmail
> > }
> > protocol pop3 {
> >   mail_plugins = quota
> >   pop3_client_workarounds = outlook-no-nuls oe-ns-eoh
> >   pop3_uidl_format = %08Xu%08Xv
> > }
> > protocol lda {
> >   mail_plugins = quota sieve
> >   log_path = /var/log/dovecot-deliver.log
> >   info_log_path = /var/log/dovecot-deliver.log
> > }
> > protocol managesieve {
> >   managesieve_implementation_string = dovecot
> >  }
> > auth default {
> > mechanisms = plain login
> >   passdb sql {
> >     args = /etc/dovecot/sql.conf
> >   }
> >  userdb prefetch {
> >   }
> >   userdb sql {
> >     args = /etc/dovecot/sql.conf
> >   }
> >     user = nobody
> >   socket listen {
> >     master {
> >       path = /var/run/dovecot/auth-master
> >       mode = 0660
> >       user = vmail
> >       group = mail
> >     }
> >     client {
> >       path = /var/spool/postfix/private/auth
> >       mode = 0660
> >       user = postfix
> >       group = mail
> > }
> >
> > We are having severals  problems from "cpu stuck for 61
seconds"   to
> > "too many connexion".
> >
> > I wonder if there is a configuation type of dovecot when using ocfs2.
> > In tje dovecot site they give advices about how to configure dovecot
> > when using NFS, but not about OCFS2.
> > Somme people say that lda shuld not be used.
> > Any help please?
> >
> > Thanks
> > nebano
>
> first upgrade your dovecot and i.e postfix to latest versions
> use lmtp instead of lda
> read
> http://wiki1.dovecot.org/MailLocation/SharedDisk
> look archives here
> i use 5000 mailboxes on maildir  with drbd ocfs2 ,no problem so far
> there is an option mail if you format with ocfs2
> look bottlenecks with your ISCSI
> as the nature of the beast there may be several reasons for your problem
> but there is no known reason or bug to me why you shouldnt use ocfs2
> you need to make more analysis
> --
> Best Regards
>
> MfG Robert Schetterer
>
> Germany/Munich/Bavaria
>

Timo Sirainen

2011-May-09 15:18 UTC

head link

[Dovecot] dovecot & OCFS2 Cluster

On Mon, 2011-04-25 at 19:02 +0200, Osvaldo Alvarez Pozo
wrote:> hi all
> 
> We have an ocfs2 cluster compose of 4 Debian lenny serveurs wich have
> access to an ISCSI LUN we have create a partition on this Lun and
> formated this partition as OCFS2.
> 2 serveurs does mail delivery (SMTP) and the two other are pop/imap
> servers. The smtp servers use dovecot LDA to deliver to mailboxes. La
> version de dovecot is 1.2.13, ldirectord balance conexion to the
> servers(pop/pops/imap/imaps to the two imap/pop serveurs) (smtp to the
> two smtp servers).
With v2.0 I'd suggest using http://wiki2.dovecot.org/Director
> mail_location = maildir:/var/vmail/%d/%u/Maildir
Cluster filesystems don't seem to like Maildir much. With v2.0 you could
use mdbox.
> We are having severals  problems from "cpu stuck for 61 seconds" 
to
> "too many connexion".
I don't know what either of those errors mean. In any case you should
switch to high-performance login processes:
http://wiki.dovecot.org/LoginProcess

http://wiki.dovecot.org/PerformanceTuning has more stuff

Osvaldo Alvarez Pozo

2011-May-12 23:00 UTC

head link

[Dovecot] dovecot & OCFS2 Cluster

Hi all

I migrated from dovecot 1.2 to dovecot 2.0

Next step" migrate from maildir to mdbox"

I have being reading about migrating to mdbox as Timo pointed me out.
But I have douths with namespace. I tried to use dsync  and I got a
error:

dsync(root): Fatal: Mail locations must use the same virtual mailbox
hierarchy separator (specify separator for the default namespace)

I think It could be solved adding:

namespace {
  inbox = yes
  separator = /
  subscriptions = yes
}

Actually I have no namespace definition. If i add namespace definition
for start migrating,  waht about my clients? will they be able to find
there mail & mailboxes while I am migrating from maildir to mdbox?

Thanks.

2011/5/9 Timo Sirainen <tss at iki.fi>:> On Mon, 2011-04-25 at 19:02 +0200, Osvaldo Alvarez Pozo wrote:
>> hi all
>>
>> We have an ocfs2 cluster compose of 4 Debian lenny serveurs wich have
>> access to an ISCSI LUN we have create a partition on this Lun and
>> formated this partition as OCFS2.
>> 2 serveurs does mail delivery (SMTP) and the two other are pop/imap
>> servers. The smtp servers use dovecot LDA to deliver to mailboxes. La
>> version de dovecot is 1.2.13, ldirectord balance conexion to the
>> servers(pop/pops/imap/imaps to the two imap/pop serveurs) (smtp to the
>> two smtp servers).
>
> With v2.0 I'd suggest using http://wiki2.dovecot.org/Director
>
>> mail_location = maildir:/var/vmail/%d/%u/Maildir
>
> Cluster filesystems don't seem to like Maildir much. With v2.0 you
could
> use mdbox.
>
>> We are having severals ?problems from "cpu stuck for 61
seconds" ? to
>> "too many connexion".
>
> I don't know what either of those errors mean. In any case you should
> switch to high-performance login processes:
> http://wiki.dovecot.org/LoginProcess
>
> http://wiki.dovecot.org/PerformanceTuning has more stuff
>
>
>

Maybe Matching Threads

Search for more reasonably related threads

dovecot - Apr 2011 - dovecot & OCFS2 Cluster

[Dovecot] dovecot & OCFS2 Cluster

[Dovecot] dovecot & OCFS2 Cluster

[Dovecot] dovecot & OCFS2 Cluster

[Dovecot] dovecot & OCFS2 Cluster

[Dovecot] dovecot & OCFS2 Cluster

Maybe Matching Threads