similar to: RFC: Storing indexes in a (remote) database to increase dovecot scalability

Displaying 20 results from an estimated 10000 matches similar to: "RFC: Storing indexes in a (remote) database to increase dovecot scalability"

2008 Sep 10
4
Panic: IMAP: Trying to allocate 2273345672 bytes
Hi, we're running dovecot 1.1.2 (centos5 32-bit rpm from atrpms) havn't had any real issues with it, but today it looks like an index has become badly corrupted. We're seeing this in the logs every time we log in to a particular account: 2008-09-10T11:56:07+01:00 mail8 dovecot: Panic: IMAP(xxx): Trying to allocate 2273345672 bytes 2008-09-10T11:56:07+01:00 mail8 dovecot: IMAP(xxx):
2008 Nov 10
1
nfs_flush_fcntl failed: No locks available
Hi there, I've been seeing this error in our logs quite frequently on our nfs storage (v3): 2008-11-10T13:24:26+00:00 mail8 dovecot: IMAP(XXX at YYY.com): nfs_flush_fcntl: fcntl(/var/spool/mail/XXX/Maildir/dovecot.index.cache, F_RDLCK) failed: No locks available Which is because we don't run lockd on our servers. Why is dovecot trying to use fcntl() ? I explicitly set it to use dotlocks
2008 Nov 20
1
%d in deliver
Hi there, I run a system that has a lot of virtual users. We invoke deliver from exim and pass the directory to deliver into using the HOME environment variable, so deliver doesn't do any database lookups during the delivery process. The exim pipe environment is described at http://exim.org/exim-html-current/doc/html/spec_html/index.html#toc0239, but basically I'd like to know the domain
2009 Aug 06
1
Dovecot deliver uidlist issues
Hi all, Lets say I have a maildir which doesn't contain any dovecot files but has some emails lying around in it. If I add a message to this mailbox using deliver, dovecot creates the uidlist file with a single entry (the message that was just delivered). When I then log in to the mailbox, all the other messages are added into the uidlist file in the normal order (directory list order I
2008 Dec 23
2
1.1.6 -> 1.1.7 regression: dovecot: pipe() failed: Too many open files
Hi all, We updated to 1.1.7 a week or two back from 1.1.6 (both standard atrpms builds). Since doing so, twice now I've seen the imap services accept connections but they hang before the banner is printed (pop seems to be unaffected). I see this in the logs: Dec 23 14:02:15 mail9 dovecot: pipe() failed: Too many open files Dec 23 14:02:15 mail9 dovecot: Temporary failure in creating login
2008 Jul 03
2
assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq)
Hi guys, Anyone know what this error with deliver is (v1.1.1)? 2008-07-03T09:45:19+01:00 mail4 deliver(alexander): Panic: file mail-index-transaction.c: line 642 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) Seen a few of these this morning. Mark -- Mark Zealey -- Shared Hosting Team Leader Product Development *
2008 Oct 09
0
Maildir size report for imap?
Hi guys, It would be really nice if there were an easy way to see how much space an individual imap account used when a user logged out; something like pop3_logout_format = size=%s. I appreciate that this isn't so easy in imap though - I was thinking of using the quota plugin with no limit or something like that. Mark -- Mark Zealey -- Shared Hosting Team Leader Product Development *
2009 Feb 19
2
Effects of going read-only on dovecot & pop/imap clients
Hi all, We need to set our filestore to read-only for quite a while, and I want to mitigate the effects for our clients. First issue; dovecot. If we just change the nfs mounts to read-only, dovecot complains: 2009-02-19T14:03:19+00:00 mail2 dovecot: pop3-login: Login: user=<test2 at markandruth.co.uk>, method=PLAIN, rip=10.15.10.95, lip=10.15.10.102:11002 2009-02-19T14:03:19+00:00 mail2
2011 Dec 07
2
sql dict: commit failed: MySQL server has gone away
Following on from this thread: http://www.dovecot.org/list/dovecot/2010-September/052704.html <https://owa2010.webfusion.com/owa/redir.aspx?C=a447887e3d204944a8c766142df41453&URL=http%3a%2f%2fwww.dovecot.org%2flist%2fdovecot%2f2010-September%2f052704.html> in 2.0.16 I am seeing the same issues. I believe this would be related to some timeouts set on our mysql servers which are pretty
2006 Jan 26
1
Question on scalability
Hi all, I''ve had a lot of fun over the last couple of days integrating Ferret with my Rails app. Many thanks to Dave Balmain for writing this. Everything seems to work well and my site now has full search capabilities. But I''m wondering how I can scale my site now? What would be the recommended approach in terms of sharing indexes across multiple servers? Is the
2008 Nov 11
2
Unbreakable NFS locking issues...
Hello All, We are struggling to find a solution to a problem we are encountering with a load-balanced email setup. Currently, we have a Coyote loadbalancer, and 3 Postfix/Dovecot nodes that then get their information from a mysql database. The problem is that after a couple weeks, we start seeing NFS locking issues occur, which then takes email completely down, requiring a site visit to
2009 Jan 20
3
Re : problem with running mysql on glusterfs
Hello. I would like to ask about having mysql data hosted on glusterfs. Please see my issue below. I have posted DEBUG log information on pastebin. I am using GlusterFS version: glusterfs 1.4.0rc7 FUSE Version :fuse-2.7.3glfs10 my ISSUE is: When hosting mysql data on glusterfs I have an issue: The first time I start the glusterfsd server using [root at mohan ~]#
2009 Feb 06
1
help: "dovecot: pipe() failed: Too many open files"
Dear All, I'm having an intermittent problem, with dovecot slowing to a crawl. Restarting dovecot fixes the problem. Looking at the maillog, I see loads of these errors.... dovecot: pipe() failed: Too many open files dovecot: Temporary failure in creating login processes, slowing down for now dovecot: Created login processes successfully, unstalling looking at the processes, I can see
2008 Sep 01
1
usernames with/without domain - my solution
My existing pop3/imap environment is courier imap + vpopmail + qmail with MySQL backend. I'm looking at migrating this to Dovecot. Currently I have multiple instances of Courier bound to different loopback IPs (the IPs correspond with the virtual IPs on a server load balancer). When a user authenticates they don't have to specify a domain - if they don't, Courier will use a
2005 May 24
8
mysql & xen - is anyone using this combination successfully?
Hi, I''ve tried running the mysql daemon on a few different servers running Xen, and seen two different sorts of problems. In one case, on two identically configured systems, the mysql daemon segv''s but restarts immediately. This happened with Xen 2.0.5, I haven''t yet seen it with 2.0.6. It seems to be the same problem as this one:
2008 Jun 30
5
Poor pop3 over nfs performance
Hi, About a week ago I upgraded our reasonably heavily loaded mail servers from a pretty recent courier version to dovecot-1.1rc10. IMAP performance on dovecot is amazing, however POP3 performance is worse than courier :-( I have uploaded some munin graphs taken today to http://linweb.atlas.pipex.net/dovecot/; the dovecot server is handling about 2000 pop logins/sec and 300 imap sessions (but
2005 Feb 04
1
New rails user database question
I''m currently using Perl, Class::DBI, Template Toolkit on top of Mysql and I''m about to try my hand at a first Rails app. The power of Rails and Ruby has me very intrigued... The O-R mapping in Class::DBI seems to be covered by AR, so I''m hoping it is a workable proposition. I plan to build a simple test case to get up to speed before converting a large production
2009 Nov 12
1
kernel error
Hi, yesterday there was obviously a problem in one virtual server. Host centos uname -rm: 2.6.18-128.1.6.el5 x86_64 Guest: centos uname -rm: 2.6.18-128.4.1.el5 x86_64 Vmware server : VMware-server-2.0.1-156745.x86_64.rpm Logwatch in guest: --------------------- Kernel Begin ------------------------ WARNING: Kernel Errors Present [<ffffffff8005dde9>]
2006 Jun 18
0
Out of Memory xenU
Hi, i''ve a big problem in a xenU (256M RAM, 2.6.11.12-xenU, in 3 LVM partition (/, swap and /home) This xenU freeze and crash with this messages in syslog. This xenU work very fine since 2005 september. Is it serious ? What could be the solution ? Regards Franck ############ SYSLOG ...................... Jun 18 08:45:21 lemodev kernel: oom-killer: gfp_mask=0x1d2 Jun 18 08:45:21
2009 Aug 10
5
Scalability plans: Abstract out filesystem and make it someone else's problem
This is something I figured out a few months ago, mainly because this one guy at work (hi, Stu) kept telling me my multi-master replication plan sucked and we should use some existing scalable database. (I guess it didn't go exactly like that, but that's the result anyway.) So, my current plan is based on a couple of observations: * Index files are really more like memory dumps.