thr3ads.net - dovecot - [Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post

If this information is useful, please help other people find it:
Share via:

Marc Schiffbauer

2012-Dec-31 03:23 UTC

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

Hi all,

I am having a problem indexing one of my mailboxes using the solr fts backend in
dovecot 2.1.12
For many mailboxes it works just fine, but on one mailbox I currently always get
a panic.

solr setup:
Java: icedtea 6.1.11.5
Solr: 3.6.2 running in tomcat 7.0.32

Command to reproduce error: doveadm index -u my at user badmailbox

I already noticed that there have been some solr backend fixes just before
2.1.21 release...
Is this another bug in the backend? Any idea?

IMO relevant logs line parts:
java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at char #483989,
byte #532382)


complete dovecot log:
doveadm(my at user): Error: fts_solr: Invalid XML input at 85:198: mismatched
tag (near: <html><head><title>Apache Tomcat/7.0.32-gentoo -
Error report</title><style><!--H1
{font-family:Tahoma,Arial,sans-serif;color:wh)
doveadm(my at user): Panic: file solr-connection.c: line 547
(solr_connection_post_more): assertion failed: (maxfd >= 0)
doveadm(my at user): Error: Raw backtrace:
/usr/lib64/dovecot/libdovecot.so.0(+0x4bcdb) [0x34fbd53ecdb] ->
/usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x3a) [0x34fbd53edb8]
-> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x34fbd50eeac] ->
/usr/lib64/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x2a4)
[0x34fbba81072] -> /usr/lib64/dovecot/lib21_fts_solr_plugin.so(+0x40a5)
[0x34fbba7d0a5] ->
/usr/lib64/dovecot/lib20_fts_plugin.so(fts_build_mail+0x462) [0x34fbbc8d6dc]
-> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xd8c2) [0x34fbbc928c2] ->
doveadm(+0x17a30) [0x264ecb7a30] -> doveadm(+0x13a45) [0x264ecb3a45] ->
doveadm(+0x14762) [0x264ecb4762] -> doveadm(doveadm_mail_try_run+0x173)
[0x264ecb4cfd] -> doveadm(main+0x3e9) [0x264ecbd0d5] ->
/lib64/libc.so.6(__libc_start_main+0xfd) [0x34fbd16a48d] -> doveadm(+0x13809)
[0x264ecb3809]
Aborted


complete java exception:
Dec 31, 2012 4:12:58 AM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr-web path=/update params={} status=500 QTime=118 
Dec 31, 2012 4:12:58 AM org.apache.solr.common.SolrException log
SEVERE: java.lang.RuntimeException: [was class java.io.CharConversionException]
Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382)
        at
com.ctc.wstx.util.ExceptionUtil.throwRuntimeException(ExceptionUtil.java:18)
        at com.ctc.wstx.sr.StreamScanner.throwLazyError(StreamScanner.java:731)
        at
com.ctc.wstx.sr.BasicStreamReader.safeFinishToken(BasicStreamReader.java:3657)
        at com.ctc.wstx.sr.BasicStreamReader.getText(BasicStreamReader.java:809)
        at org.apache.solr.handler.XMLLoader.readDoc(XMLLoader.java:315)
        at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:156)
        at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79)
        at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
        at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
        at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
        at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
        at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Unknown Source)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(Unknown
Source)
        at org.apache.catalina.core.StandardWrapperValve.invoke(Unknown Source)
        at org.apache.catalina.core.StandardContextValve.invoke(Unknown Source)
        at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Unknown
Source)
        at org.apache.catalina.core.StandardHostValve.invoke(Unknown Source)
        at org.apache.catalina.valves.ErrorReportValve.invoke(Unknown Source)
        at org.apache.catalina.valves.AccessLogValve.invoke(Unknown Source)
        at org.apache.catalina.core.StandardEngineValve.invoke(Unknown Source)
        at org.apache.catalina.connector.CoyoteAdapter.service(Unknown Source)
        at org.apache.coyote.http11.AbstractHttp11Processor.process(Unknown
Source)
        at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Unknown
Source)
        at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(Unknown
Source)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:679)
Caused by: java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at
char #483989, byte #532382)
        at com.ctc.wstx.io.UTF8Reader.reportInvalidInitial(UTF8Reader.java:302)
        at com.ctc.wstx.io.UTF8Reader.read(UTF8Reader.java:188)
        at com.ctc.wstx.io.ReaderSource.readInto(ReaderSource.java:84)
        at
com.ctc.wstx.io.BranchingReaderSource.readInto(BranchingReaderSource.java:57)
        at com.ctc.wstx.sr.StreamScanner.loadMore(StreamScanner.java:992)
        at
com.ctc.wstx.sr.BasicStreamReader.readTextSecondary(BasicStreamReader.java:4628)
        at
com.ctc.wstx.sr.BasicStreamReader.readCoalescedText(BasicStreamReader.java:4126)
        at
com.ctc.wstx.sr.BasicStreamReader.finishToken(BasicStreamReader.java:3701)
        at
com.ctc.wstx.sr.BasicStreamReader.safeFinishToken(BasicStreamReader.java:3649)
        ... 25 more


TIA
-Marc
-- 
[*] sys4 AG

http://sys4.de, +49 (89) 30 90 46 64
Franziskanerstra?e 15, 81669 M?nchen

Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263
Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer
Aufsichtsratsvorsitzender: Joerg Heidrich
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 190 bytes
Desc: This is a digitally signed message part.
URL:
<http://dovecot.org/pipermail/dovecot/attachments/20121231/996c10c2/attachment-0004.bin>

Christian Rößner

2013-Jan-02 14:16 UTC

head link

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

> solr setup:
> Java: icedtea 6.1.11.5
> Solr: 3.6.2 running in tomcat 7.0.32
I am running solr on Tomcat 6.
> complete dovecot log:
> doveadm(my at user): Error: fts_solr: Invalid XML input at 85:198:
mismatched tag (near: <html><head><title>Apache
Tomcat/7.0.32-gentoo - Error report</title><style><!--H1
{font-family:Tahoma,Arial,sans-serif;color:wh)
Looks strange :) Did you investigate this XML thing?
> complete java exception:
> Dec 31, 2012 4:12:58 AM org.apache.solr.core.SolrCore execute
> INFO: [] webapp=/solr-web path=/update params={} status=500 QTime=118 
status 500. Internal server error? Do you have entries in Apache error.log?

-- 
-Christian R??ner

--
[*] sys4 AG
Franziskanerstra?e 15       Telefon +49 89 3090 4664
81669 M?nchen           Telefax +49 89 3090 4666

Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263
Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer
Aufsichtsratsvorsitzender: Joerg Heidrich

Timo Sirainen

2013-Jan-04 03:21 UTC

head link

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

On 31.12.2012, at 5.23, Marc Schiffbauer <m at sys4.de> wrote:
> I am having a problem indexing one of my mailboxes using the solr fts
backend in dovecot 2.1.12
> For many mailboxes it works just fine, but on one mailbox I currently
always get a panic.
..> SEVERE: java.lang.RuntimeException: [was class
java.io.CharConversionException] Invalid UTF-8 start byte 0xf8 (at char #483989,
byte #532382)
Looks like the same issue I was trying to debug with the other guy also, but I
couldn't figure out how that happens. Dovecot shouldn't be sending such
data to Solr. Can you record the TCP traffic between Dovecot and Solr when this
happens, and send it to me?

Timo Sirainen

2013-Jan-04 21:26 UTC

head link

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

On Mon, 2012-12-31 at 04:23 +0100, Marc Schiffbauer wrote:
> IMO relevant logs line parts:
> java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at char
#483989, byte #532382)
Fixed: http://hg.dovecot.org/dovecot-2.1/rev/7be4709aab5e

Hiromi Kimura

2013-Jan-07 08:25 UTC

head link

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

Quote: Timo Sirainen <tss at iki.fi>?> On Mon, 2012-12-31 at 04:23 +0100, Marc Schiffbauer wrote:
>
>> IMO relevant logs line parts:
>> java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at  
>> char #483989, byte #532382)
>
> Fixed: http://hg.dovecot.org/dovecot-2.1/rev/7be4709aab5e
I have another problem with same error.
dovecot-2.1.12 + patch (01550514f189,172295f5a78b,339e654f371e,7be4709aab5e)
Solr-3.6.0 + Jetty-6.1

# doveadm index -u hiromi badmbox
doveadm(hiromi): Error: fts_solr: Indexing failed: 400 Invalid UTF-8  
start byte 0xf8 (at char #1681, byte #-1)

SEVERE: org.apache.solr.common.SolrException: Invalid UTF-8 start byte  
0xf8 (at char #1681, byte #-1)
         at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:81)
         at  
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
         ...
Caused by: java.io.CharConversionException: Invalid UTF-8 start byte  
0xf8 (at char #1681, byte #-1)
         at  
com.ctc.wstx.io.UTF8Reader.reportInvalidInitial(UTF8Reader.java:302)
         at com.ctc.wstx.io.UTF8Reader.read(UTF8Reader.java:188)
         ...

Timo, I will send captured data by personal mail.
-=-=-=-=-
Hiromi KIMURA http://www.tac.tsukuba.ac.jp/~hiromi/
PGP Fingerprint16 = 2A 27 2E 46 9E 75 4E 3D  E3 FD 5A DC 2A AA 3A 2E

Hiromi Kimura

2013-Feb-26 01:10 UTC

head link

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

This bug was fixed !
  http://hg.dovecot.org/dovecot-2.1/rev/fa9387588430

Thanks Timo.

Quote: Hiromi Kimura <hiromi at tac.tsukuba.ac.jp>?
> Quote: Timo Sirainen <tss at iki.fi>?
>> On Mon, 2012-12-31 at 04:23 +0100, Marc Schiffbauer wrote:
>>
>>> IMO relevant logs line parts:
>>> java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at
>>> char #483989, byte #532382)
>>
>> Fixed: http://hg.dovecot.org/dovecot-2.1/rev/7be4709aab5e
>
> I have another problem with same error.
> dovecot-2.1.12 + patch
(01550514f189,172295f5a78b,339e654f371e,7be4709aab5e)
> Solr-3.6.0 + Jetty-6.1
>
> # doveadm index -u hiromi badmbox
> doveadm(hiromi): Error: fts_solr: Indexing failed: 400 Invalid UTF-8  
> start byte 0xf8 (at char #1681, byte #-1)
>
> SEVERE: org.apache.solr.common.SolrException: Invalid UTF-8 start  
> byte 0xf8 (at char #1681, byte #-1)
>         at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:81)
>         at  
>
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
>         ...
> Caused by: java.io.CharConversionException: Invalid UTF-8 start byte  
> 0xf8 (at char #1681, byte #-1)
>         at  
> com.ctc.wstx.io.UTF8Reader.reportInvalidInitial(UTF8Reader.java:302)
>         at com.ctc.wstx.io.UTF8Reader.read(UTF8Reader.java:188)
>         ...
>
> Timo, I will send captured data by personal mail.
> -=-=-=-=-
> Hiromi KIMURA http://www.tac.tsukuba.ac.jp/~hiromi/
> PGP Fingerprint16 = 2A 27 2E 46 9E 75 4E 3D  E3 FD 5A DC 2A AA 3A 2E
>
-=-=-=-=-
Hiromi KIMURA http://www.tac.tsukuba.ac.jp/~hiromi/
PGP Fingerprint16 = 2A 27 2E 46 9E 75 4E 3D  E3 FD 5A DC 2A AA 3A 2E

Reasonably Related Threads

Search for more reasonably related threads

dovecot - Dec 2012 - 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

Reasonably Related Threads