search for: cache_fields

...pvt_modseq changes_during_sync Nname existence mailbox_guid uid_validity uid_next last_renamed_or_created subscribed last_subscription_change Dhierarchy_sep mailboxes dirs unsubscribes Bmailbox_guid uid_validity uid_next messages_count first_recent_uid highest_modseq highest_pvt_modseq mailbox_lost cache_fields have_guids have_save_guids have_only_guid128 Atype key value stream deleted last_change modseq Ctype uid guid hdr_hash modseq pvt_modseq save_timestamp add_flags remove_flags final_flags keywords_reset keyword_changes Rguid uid Mguid uid pop3_uidl pop3_order received_date stream cname decision last...

...problem. Below is a horrible workaround that just allocates a lot more memory for the message part array, so that it remains contiguous. *** mail-index-update.c.orig Wed Mar 26 10:41:55 2003 --- mail-index-update.c Sun Apr 20 16:53:45 2003 *************** *** 498,504 **** if (cache_fields & DATA_FIELD_MESSAGEPART) { t_push(); ! buf = buffer_create_dynamic(data_stack_pool, 2048, (size_t)-1); message_part_serialize(part, buf); --- 498,504 ----...

Steffen Kaiser writes: > e.g. put message-id into mail_always_cache_fields > > - From http://dovecot.org/pipermail/dovecot-cvs/2013-May/023261.html > > lib-storage: Allow mail_*cache_fields settings to specify any hdr.* fields ... but I belatedly wrote ... > Maybe you can even add these items into the cache upon delivery, > but someone more knowlegable...

...(ctx=0xdebcdb0, bbox=0xdcb8e38) at virtual-sync.c:725 sync_flags = <value optimized out> status = {messages = 121, recent = 0, unseen = 111, uidvalidity = 1225530594, uidnext = 182153, first_unseen_seq = 0, first_recent_uid = 182152, highest_modseq = 0, virtual_size = 0, keywords = 0x0, cache_fields = 0x0, nonpermanent_modseqs = 0} ret = <value optimized out> __FUNCTION__ = "virtual_sync_backend_box" #7 0x00002ba91276b661 in virtual_storage_sync_init (box=0xcf524c0, flags=MAILBOX_SYNC_FLAG_FIX_INCONSISTENT) at virtual-sync.c:1400 sync_ctx = <value optimized out> ret...

...0x7fffffffdaf0) at lucene-wrapper.cc:831 box = 0x7ffff76fd0ad <mailbox_list_iter_next+285> metadata = {guid = "\230\332\377\377\377\177\000\000\200?UUU\000", virtual_size = 140737340823160, physical_size = 140737488345756, first_save_date = 140737488345840, cache_fields = 0x555500000000, precache_fields = (MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_NUL_STATE | MAIL_FETCH_STREAM_BINARY | MAIL_FETCH_IMAP_BODY | MAIL_FETCH_IMAP_BODYSTRUCTURE | MAIL_FETCH_IMAP_ENVELOPE | MAIL_FETCH_FROM_ENVELOPE | MAIL_FETCH_REFCOUNT | MAIL_FETCH_BODY_SNIPP...

...id uid_validity uid_next last_renamed_or_created subscribed last_subscription_change Dhierarchy_sep mailboxes dirs unsubscribes Bmailbox_guid uid_validity uid_next messages_count first_recent_uid highest_modseq highest_pvt_modseq mailbox_lost cache_fields have_guids have_save_guids have_only_guid128 Atype key value stream deleted last_change modseq Ctype uid guid hdr_hash modseq pvt_modseq save_timestamp add_flags remove_flags final_flags keywords_reset keyword_changes Rguid uid Mguid...

...ctx = 0x7fff68b7f35c t = 0x7fff68b7f35c mail = 0x0 search_args = 0x0 #6 index_storage_mailbox_delete (box=0x1294060) at index-storage.c:701 metadata = {guid = "\000\000\000\000\000\000\000\000\030\377\347\242\000\000\000", virtual_size = 19480672, cache_fields = 0x0, precache_fields = (MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_IMAP_ENVELOPE | MAIL_FETCH_UIDL_FILE_NAME | MAIL_FETCH_GUID | unknown: 16777216), backend_ns_prefix = 0x7f6ba2ee64b0 <mailbox_open+16> "\211\302\061\300...

...ESSAGE----- Hash: SHA1 On Thu, 19 Mar 2015, Vu Ngoc VU wrote: > My goal is to be able to find mails quickly with "doveadm search". What information you are search for? Message-ID, subject, body text? If your data is in the headers, check out: doveconf -a|grep -i cache mail_always_cache_fields = mail_cache_fields = flags mail_cache_min_mail_count = 0 mail_never_cache_fields = imap.envelope e.g. put message-id into mail_always_cache_fields - From http://dovecot.org/pipermail/dovecot-cvs/2013-May/023261.html lib-storage: Allow mail_*cache_fields settings to specify any hdr.* fields - -...

> Date: Fri, 20 Mar 2015 02:05:48 > From: Joseph Tam <jtam.home at gmail.com> > To: dovecot at dovecot.org > Subject: Re: fast doveadm search results > > Steffen Kaiser writes: > >> e.g. put message-id into mail_always_cache_fields >> >> - From http://dovecot.org/pipermail/dovecot-cvs/2013-May/023261.html >> >> lib-storage: Allow mail_*cache_fields settings to specify any hdr.* fields > > ... but I belatedly wrote ... ahah, in France, we says "that happens" >> Maybe you can eve...

...really new and exposing this issue. The problem goes away with: diff --git a/src/lib-index/test-mail-cache.c b/src/lib-index/test-mail-cache.c index e4e5503f6..4734904e8 100644 --- a/src/lib-index/test-mail-cache.c +++ b/src/lib-index/test-mail-cache.c @@ -130,11 +130,13 @@ static void test_mail_cache_fields(void) struct test_header_data header_data1 = { .line1 = 15, .line2 = 30, + .end_of_lines = 0, .headers = "foo\nbar\n", }; struct test_header_data header_data2 = { .line1 = 10,...

...hest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 1}, metadata = {guid = "PY\r\001", '\000' <repeats 11 times>, virtual_size = 17651520, cache_fields = 0x7fad73836e40, precache_fields = 1934521552, backend_ns_prefix = 0x7fad74012000 "", backend_ns_type = 1080}, error = 4294967295, errstr = 0xffffffffffffffa8 <Address 0xffffffffffffffa8 out of bounds>} ns = <value optimized out> mail...

...tup is 2.2.9 on Ubuntu 14.04 running on OpenVZ containers with 2 Director and 2 imap/pop3 backends. The storage is shared via NFS. Is this the performance problem? If dovecot has metadata I want in its cache, I cannot see how this is a problem. Can these settings be useful for my case? mail_always_cache_fields = mail_cache_fields = flags mail_cache_min_mail_count = 0 mail_never_cache_fields = imap.envelope Thanks.

...= 0 box_vname = 0x55c7b938f280 "INBOX.lfd.SSH login alerts" errstr = <optimized out> search_args = 0x0 mail = 0x55c7b93dcff8 metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0, physical_size = 0, first_save_date = 0, cache_fields = 0x0, precache_fields = (MAIL_FETCH_STREAM_HEADER | MAIL_FETCH_STREAM_BODY | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE | MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER), backend_ns_prefix = 0x0, backend_ns_typ...

Getting this when attempting to build 2.3.11.3 on CentOS 6: test-mail-cache.c:176: Assert failed: strcmp(str_c(str),"123\nfoo\n456\nbar\n") "" != "123 foo 456 bar " test-mail-cache.c:176: Assert failed: strcmp(str_c(str),"123\nfoo\n456\nbar\n") "" != "123 foo 456 bar " mail cache uncommitted lookups

...ges_during_sync Nname existence mailbox_guid uid_validity uid_next last_renamed_or_created subscribed last_subscription_change Dhierarchy_sep mailboxes dirs unsubscribes Bmailbox_guid uid_validity uid_next messages_count first_recent_uid highest_modseq highest_pvt_modseq mailbox_lost mailbox_ignore cache_fields have_guids have_save_guids have_only_guid128 Atype key value stream deleted last_change modseq Ctype uid guid hdr_hash modseq pvt_modseq add_flags remove_flags final_flags keywords_reset keyword_changes received_timestamp virtual_size Rguid uid Mguid uid pop3_uidl pop3_order received_date saved_dat...

...pvt_modseq changes_during_sync Nname existence mailbox_guid uid_validity uid_next last_renamed_or_created subscribed last_subscription_change Dhierarchy_sep mailboxes dirs unsubscribes Bmailbox_guid uid_validity uid_next messages_count first_recent_uid highest_modseq highest_pvt_modseq mailbox_lost cache_fields have_guids have_save_guids Atype key value stream deleted last_change modseq Ctype uid guid hdr_hash modseq pvt_modseq save_timestamp add_flags remove_flags final_flags keywords_reset keyword_changes Rguid uid Mguid uid pop3_uidl pop3_order received_date stream cname decision last_used . Hsyd2 The...

using latest auto build didn't help. this happens only with a specific account. # doveadm -o imapc_user=----- at domain.com -o imapc_password=---- backup -u =----- at domain.com -R imapc: dsync(---- at domain.com): Panic: pool_data_stack_realloc(): stack frame changed dsync(---- at domain.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4209a) [0xb762b09a] ->

...rue, have_save_guids = true, > have_only_guid128 = false} > ??????? trans = 0x0 > ??????? search_args = 0x0 > ??????? ctx = 0x0 > ??????? mail = 0x0 > ??????? metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0, > physical_size = 0, first_save_date = 0, cache_fields = 0x0, > precache_fields = (MAIL_FETCH_STREAM_HEADER | MAIL_FETCH_STREAM_BODY | > MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | > MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE | > MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER), > backend_ns_prefix = 0x0,...

...status = { messages = 3, recent = 0, unseen = 3, uidvalidity = 1311811715, uidnext = 4, first_unseen_seq = 0, first_recent_uid = 4, highest_modseq = 0, virtual_size = 0, keywords = 0x0, cache_fields = 0x0, nonpermanent_modseqs = 0 } #5 0x00000000004166e5 in imap_search_start (ctx=0x926008, sargs=0x932710, sort_program=0x0) at imap-search.c:540 cmd = 0x925f00 wanted_fields = 0 wanted_headers = 0x0 #6 0x000000000040d726 in cmd_search (cmd=0x925f00)...

...permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, have_save_guids = 0, have_only_guid128 = 0}, metadata = { guid = "\000\000\000\000\001\000\000\000\r\000\000\000\033\000\000", virtual_size = 2199023255593, cache_fields = 0xfe7a67f2, precache_fields = 134861792, backend_ns_prefix = 0x80921a8 "0(\t\b\030", backend_ns_type = 134511236}, error = 134654712, errstr = 0x80b2038 "STATUS"} ns = (struct mail_namespace *) 0x80ab1b0 mailbox = 0x8093318 "pro/triad" orig_mailbox = 0x80ab2f...