dovecot - Oct 2015 - Indexing fails with .. FIELDS_INDEX_EXTENSION).c_str() )' failed

Hi,

Mailing list archives suggest that this problem has been fixed in the
older versions itself but I am getting the error still while trying to
doveadm index a large folder of emails. Sometimes it throws error
after 30000, something 40000, the latest it gave up after 111000. But
it just never completes.

111000/322080doveadm:
/home/stephan/packages/wheezy/i386/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:210:
std::string lucene::index::DocumentsWriter::closeDocStore(): Assertion
`numDocsInStore*8 == directory->fileLength( (docStoreSegment + "."
+
IndexFileNames::FIELDS_INDEX_EXTENSION).c_str() )' failed.
Aborted

I am using dovecot 2:2.2.19-1~auto+7& libclucene-core1:i386 2.3.3.4-4
from debian wheezy backports. Please advice.

-Akash

On 13 Oct 2015, at 23:25, Akash <akbwiz+dovecot at gmail.com>
wrote:
> 
> Hi,
> 
> Mailing list archives suggest that this problem has been fixed in the
> older versions itself but I am getting the error still while trying to
> doveadm index a large folder of emails. Sometimes it throws error
> after 30000, something 40000, the latest it gave up after 111000. But
> it just never completes.
> 
> 111000/322080doveadm:
>
/home/stephan/packages/wheezy/i386/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:210:
> std::string lucene::index::DocumentsWriter::closeDocStore(): Assertion
> `numDocsInStore*8 == directory->fileLength( (docStoreSegment +
"." +
> IndexFileNames::FIELDS_INDEX_EXTENSION).c_str() )' failed.
> Aborted
> 
> I am using dovecot 2:2.2.19-1~auto+7& libclucene-core1:i386 2.3.3.4-4
> from debian wheezy backports. Please advice.
Looks like a bug in clucene library. I don't know if there's anything
that can be done about it on Dovecot side. I recommend switching to fts-solr.

---- On Wed, 14 Oct 2015 07:28:42 +1100 Timo Sirainen <tss at iki.fi>
wrote ----
 > Looks like a bug in clucene library. I don't know if there's
anything that can be done about it on Dovecot side. I recommend switching to
fts-solr.
 
Either that or fts-elasticsearch[1]

Regards,
Tim

[1] https://github.com/ascendantcom/fts-elasticsearch/