search for: highest_modseq

Hi again, after replacing CRLF in 4 mboxes dsync was able to sync all of the 30+GB mailstore to mdbox. Now the (repeated) calling of dsync yields info messages of the kind dsync(athimm): Info: old/speicher: highest_modseq changed: 1 != 10 dsync(athimm): Info: root/root-heretic: highest_modseq changed: 1 != 10 dsync(athimm): Info: lists/ccrma.stanford.edu/planetccrma: highest_modseq changed: 11 != 14 I actually have 987 such messages for a total of 1115 mboxes. I checked a couple of them to see whether this is a CRL...

...= 0, create_stamp = 1359082912, initial_modseq = 0, compat_flags = 1 '\001', unused = "\000\000", unused2 = 0}, mmap_buffer = {data = 0x0, used = 0, priv = {0x0, 0x0, 0x0, 0x0, 0x0}}, buffer = 0x0, buffer_offset = 0, mmap_base = 0x0, mmap_size = 0, sync_offset = 40, sync_highest_modseq = 0, saved_tail_offset = 0, max_tail_offset = 0, saved_tail_sync_offset = 0, index_deleted_offset = 0, index_undeleted_offset = 0, modseq_cache = {{offset = 0, highest_modseq = 0}, {offset = 0, highest_modseq = 0}, { offset = 0, highest_modseq = 0}, {offset = 0, highest_modseq = 0}, {offset...

...last_common_uid last_common_modseq last_common_pvt_modseq changes_during_sync Nname existence mailbox_guid uid_validity uid_next last_renamed_or_created subscribed last_subscription_change Dhierarchy_sep mailboxes dirs unsubscribes Bmailbox_guid uid_validity uid_next messages_count first_recent_uid highest_modseq highest_pvt_modseq mailbox_lost cache_fields have_guids have_save_guids have_only_guid128 Atype key value stream deleted last_change modseq Ctype uid guid hdr_hash modseq pvt_modseq save_timestamp add_flags remove_flags final_flags keywords_reset keyword_changes Rguid uid Mguid uid pop3_uidl pop3_o...

...understand it, so I've elided it: dsync(chris): Error: open() failed with mbox file /home/chris/mail/admin: Permission denied dsync(chris): Error: Failed to sync mailbox admin: Internal error occurred. Refer to server log for more information. [2011-03-09 15:50:10] dsync(chris): Info: spam: highest_modseq changed: 2 != 3 I don't understand the following errors from dsync (2.0.9): chris at one-mail(~)$ sudo dsync -v -u chris backup mdbox:/home/chris/mdbox dsync(chris): Error: Next message unexpectedly corrupted in mbox file /home/chris/mail/spam at 404513741 dsync(chris): Warning: Transaction...

...st recent uid ......... = 25848 -log file tail offset ..... = 16468 -log file head offset ..... = 16468 +log file tail offset ..... = 16828 +log file head offset ..... = 16828 - - sync_mtime . = 2012-08-30 19:38:05 + - sync_mtime . = 2012-08-30 20:09:23 - - dirty_flag . = 1 + - dirty_flag . = 0 - - highest_modseq = 11162 + - highest_modseq = 11163 - - log_offset ... = 16468 + - log_offset ... = 16828 CACHE: -used_file_size ....... = 6385696 +used_file_size ....... = 6392132 RECORD: seq=25663, uid=25835, flags=0x00 - - ext 0 keywords : (0000) - - ext 1 modseq : 11156 (942b000000000000)...

...40 list_view = <value optimized out> list_trans = <value optimized out> changes = {status = {messages = 718675880, recent = 32767, unseen = 4294967295, uidvalidity = 0, uidnext = 68, first_unseen_seq = 0, first_recent_uid = 1, last_cached_seq = 0, highest_modseq = 3176264, highest_pvt_modseq = 17854784, keywords = 0x10f40a0, permanent_flags = 17778368, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 0}, guid = "p ?*?\177\000\000D\000\000\000\000\000\000", seq = 17750944,...

...:102 counter = 0 max = 21569 percentage_sent = 0 storage = <optimized out> status = {messages = 21569, recent = 0, unseen = 0, uidvalidity = 1462447525, uidnext = 6027769, first_unseen_seq = 0, first_recent_uid = 6027758, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, flags = 0, permanent_keywords = false, allow_new_keywords = false, nonpermanent_modseqs = false, no_modseq_tracking = false, have_guids = true, have_save_guids = true, have_only_guid128 = false} uids = <optimize...

...E\344H\203\304([]\351\320f\377\377UH\211\345H\203\354\060H\211}\330dH\213\004%(" > ??????? error = MAIL_ERROR_TEMP > ??????? status = {messages = 10, recent = 0, unseen = 0, uidvalidity = > 1545140227, uidnext = 11, first_unseen_seq = 0, first_recent_uid = 3, > last_cached_seq = 1, highest_modseq = 0, highest_pvt_modseq = 0, > keywords = 0x0, permanent_flags = 0, flags = 0, permanent_keywords = > false, allow_new_keywords = false, nonpermanent_modseqs = false, > no_modseq_tracking = false, have_guids = true, have_save_guids = true, > have_only_guid128 = false} > ??????? trans...

...ot; #6 0x00002ba91276ac92 in virtual_sync_backend_box (ctx=0xdebcdb0, bbox=0xdcb8e38) at virtual-sync.c:725 sync_flags = <value optimized out> status = {messages = 121, recent = 0, unseen = 111, uidvalidity = 1225530594, uidnext = 182153, first_unseen_seq = 0, first_recent_uid = 182152, highest_modseq = 0, virtual_size = 0, keywords = 0x0, cache_fields = 0x0, nonpermanent_modseqs = 0} ret = <value optimized out> __FUNCTION__ = "virtual_sync_backend_box" #7 0x00002ba91276b661 in virtual_storage_sync_init (box=0xcf524c0, flags=MAILBOX_SYNC_FLAG_FIX_INCONSISTENT) at virtual-sync....

...77UH\211\345H\203\354\060H\211}\330dH\213\004%(" >>> ??????? error = MAIL_ERROR_TEMP >>> ??????? status = {messages = 10, recent = 0, unseen = 0, uidvalidity = >>> 1545140227, uidnext = 11, first_unseen_seq = 0, first_recent_uid = 3, >>> last_cached_seq = 1, highest_modseq = 0, highest_pvt_modseq = 0, >>> keywords = 0x0, permanent_flags = 0, flags = 0, permanent_keywords = >>> false, allow_new_keywords = false, nonpermanent_modseqs = false, >>> no_modseq_tracking = false, have_guids = true, have_save_guids = true, >>> have_only_gui...

...x16cba20 username = 0x16c79e8 "reuben" box_vname = 0x16d0888 "Sent" status = {messages = 453, recent = 0, unseen = 0, uidvalidity = 1267935879, uidnext = 8558, first_unseen_seq = 0, first_recent_uid = 8557, last_cached_seq = 448, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, have_save_guids = 1, have_only_guid128 = 0} trans = 0x16e4b80...

...t+164> "\213E\344H\203\304([]\351\320f\377\377UH\211\345H\203\354\060H\211}\330dH\213\004%(" ??????? error = MAIL_ERROR_TEMP ??????? status = {messages = 10, recent = 0, unseen = 0, uidvalidity = 1545140227, uidnext = 11, first_unseen_seq = 0, first_recent_uid = 3, last_cached_seq = 1, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, flags = 0, permanent_keywords = false, allow_new_keywords = false, nonpermanent_modseqs = false, no_modseq_tracking = false, have_guids = true, have_save_guids = true, have_only_guid128 = false} ??????? trans = 0x0 ??????? search_arg...

...AIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER), backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)} counter = 0 max = 15 status = {messages = 15, recent = 0, unseen = 0, uidvalidity = 1048765368, uidnext = 151, first_unseen_seq = 0, first_recent_uid = 151, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, have_save_guids = 1, have_only_guid128 = 0} mail = 0x555555838190 ret = 0 t...

...1 dsync(michael at domain.com): Info: INBOX: only in dest (guid=3c68c835800a07547d45000029cbe4c2)= 1 dsync(michael at domain.com): Info: Deleted Messages: uidnext changed: 109 != 1 dsync(michael at domain.com): Info: MBA Mails: uidnext changed: 444 != 1 dsync(michael at domain.com): Info: Archive: highest_modseq changed: 0 != 1 dsync(michael at domain.com): Info: Spam: uidnext changed: 3 != 1 dsync(michael at domain.com): Info: Apple Mail To Do: highest_modseq changed: 0 != 1 dsync(michael at domain.com): Info: Jobsuche: uidnext changed: 22436 != 1 dsync(michael at domain.com): Info: Trash (Messages): uidn...

...changes_during_sync Nname existence mailbox_guid uid_validity uid_next last_renamed_or_created subscribed last_subscription_change Dhierarchy_sep mailboxes dirs unsubscribes Bmailbox_guid uid_validity uid_next messages_count first_recent_uid highest_modseq highest_pvt_modseq mailbox_lost cache_fields have_guids have_save_guids have_only_guid128 Atype key value stream deleted last_change modseq Ctype uid guid hdr_hash modseq pvt_modseq save_timestamp add_flags remove_flags final_flags...

On 10 May 2015, at 06:19, Reuben Farrelly <reuben-dovecot at reub.net> wrote: > > I'm now seeing these crashes in the indexing code: > > May 10 12:22:32 tornado.reub.net dovecot: master: Dovecot v2.2.17.rc1 (3903badc4ee0+) starting up for imap, lmtp, sieve > ... > May 10 13:07:50 tornado.reub.net dovecot: indexer: Error: Indexer worker disconnected, discarding 1

...<mailbox_open+16> "\211\302\061\300\205\322x\bH\203\304\030[]?\366\203\230\002", backend_ns_type = (unknown: 0)} status = {messages = 0, recent = 0, unseen = 19029536, uidvalidity = 0, uidnext = 1, first_unseen_seq = 0, first_recent_uid = 2730247353, last_cached_seq = 32619, highest_modseq = 19480672, highest_pvt_modseq = 140100271760191, keywords = 0x1, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 0, have_save_guids = 0, have_only_guid128 = 0} ret_guid = <optimized...

...]\351\320f\377\377UH\211\345H\203\354\060H\211}\330dH\213\004%(" >> ??????? error = MAIL_ERROR_TEMP >> ??????? status = {messages = 10, recent = 0, unseen = 0, uidvalidity = >> 1545140227, uidnext = 11, first_unseen_seq = 0, first_recent_uid = 3, >> last_cached_seq = 1, highest_modseq = 0, highest_pvt_modseq = 0, >> keywords = 0x0, permanent_flags = 0, flags = 0, permanent_keywords = >> false, allow_new_keywords = false, nonpermanent_modseqs = false, >> no_modseq_tracking = false, have_guids = true, have_save_guids = true, >> have_only_guid128 = false} &g...

...3\354\060H\211}\330dH\213\004%(" >>>> ??????? error = MAIL_ERROR_TEMP >>>> ??????? status = {messages = 10, recent = 0, unseen = 0, uidvalidity = >>>> 1545140227, uidnext = 11, first_unseen_seq = 0, first_recent_uid = 3, >>>> last_cached_seq = 1, highest_modseq = 0, highest_pvt_modseq = 0, >>>> keywords = 0x0, permanent_flags = 0, flags = 0, permanent_keywords = >>>> false, allow_new_keywords = false, nonpermanent_modseqs = false, >>>> no_modseq_tracking = false, have_guids = true, have_save_guids = true, >>>&g...

...d1cf0de0) at virtual-storage.c:498 i = <optimized out> count = <optimized out> status = {messages = 3519949744, recent = 82, unseen = 2, uidvalidity = 0, uidnext = 1856604872, first_unseen_seq = 964, first_recent_uid = 3519949992, last_cached_seq = 82, highest_modseq = 355707281680, highest_pvt_modseq = 2999686621158, keywords = 0x52d1cf0de0, permanent_flags = 3520008512, permanent_keywords = 0, allow_new_keywords = 1, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, have_save_guids = 0, have_only_guid128 = 1} bboxes = 0x0...