dovecot - Oct 2011 - How can we horizontally scale Dovecot across multiple servers?

Hi,

 

How can we horizontally scale Dovecot across multiple servers? Do we require
to install independent instances of Dovecot on each server?

We are planning to use a NAS/SAN device using ZFS or EFS for email storage.
Each logical unit will be of 10TB and similarly as the no: of user increases
we are planning to add multiple 10TB units.

In this case how we can manage the email storage on multiple volumes from
Dovecot.

 

The configuration of our existing system is:-

 

Dovecot 1.0.15 / Maildirs

Postfix 2.5.5

Debian 5.0.9 (Lenny)

MySQL 5.0.15

 

Please advise.

 

Thanks in advance.

 

Creative Regards,

Arlin

Could anyone please respond to this query. Thank you!

 

From: Arlin [mailto:arlin at mvs.us] 
Sent: 28 October 2011 17:06
To: 'dovecot at dovecot.org'
Subject: How can we horizontally scale Dovecot across multiple servers? 

 

Hi,

 

How can we horizontally scale Dovecot across multiple servers? Do we require
to install independent instances of Dovecot on each server?

 

We are planning to use a NAS/SAN device using ZFS or EFS for email storage.
Each logical unit will be of 10TB and similarly as the no: of user increases
we are planning to add multiple 10TB units.

In this case how we can manage the email storage on multiple volumes from
Dovecot.

 

The configuration of our existing system is:-

 

Dovecot 1.0.15 / Maildirs

Postfix 2.5.5

Debian 5.0.9 (Lenny)

MySQL 5.0.15

 

Please advise.

 

Thanks in advance.

 

Creative Regards,

Arlin

On 10/28/2011 6:35 AM, Arlin wrote:
> How can we horizontally scale Dovecot across multiple servers? Do we
require
> to install independent instances of Dovecot on each server?
The performance limiting factors for IMAP servers are disk IO, memory
size, network bandwidth/latency, and processor power, usually in that
order.  To scale Dovecot horizontally would imply multiple servers each
with independent storage handling a subset of the total concurrent user
load.
> We are planning to use a NAS/SAN device using ZFS or EFS for email storage.
> Each logical unit will be of 10TB and similarly as the no: of user
increases
> we are planning to add multiple 10TB units.
This does not describe horizontal maildir performance scaling.  This
simply describes vertical scaling of the IO, to a point, as the nodes
are all attached to one controller with finite IOPS performance, which
is dictated by the speed of the IO ASIC and cache memory bandwidth WRT
writes, and aggregate spindle IOPS WRT reads.

With this setup, you simply gain multi-node redundancy of the front end
servers.  However, you will *lose* performance compared to a single
equivalent large host due to NFS/cluster filesystem overhead, latency,
locking, etc, and your management/troubleshooting burden will be increased.

If your goal is simply increased performance and storage expandability,
go with a single large host system.  I'd only go the cluster route if
you believe you need the redundancy.

-- 
Stan