search for: request_timeout_msec

Hi, What's the recommended way to handling timeouts on large mailboxes given the hardwired request timeout of 60s in solr-connection.c: http_set.request_timeout_msecs = 60*1000; /Peter

...fts-parser-tika.c index a4b8b5c3034f57e22e77caa759c090da6b62f8ba..b8b57a350b9a710d101ac7ccbcc14560d415d905 100644 --- a/src/plugins/fts/fts-parser-tika.c +++ b/src/plugins/fts/fts-parser-tika.c @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) http_set.request_timeout_msecs = 60*1000; http_set.ssl = &ssl_set; http_set.debug = user->mail_debug; -tika_http_client = http_client_init(&http_set); +tika_http_client = http_client_init_private(&http_set); } *http_url_r = tuser->http_url; return 0; -------------- next part -------------- An HTML attachment w...

https://www.lerctr.org/~ler/dovecot/doveadm-index-fts-debug.txt https://www.lerctr.org/~ler/dovecot/doveadm-index-fts-bt.txt I wish there was a way to set plugins {fts_solr = <blah>} from the command line :( but I turned it on globally for that run. On Wed, Jan 2, 2019 at 3:40 PM Stephan Bosch <stephan at rename-it.nl> wrote: > Oh, d'oh. I was looking for some solr debug

...-git a/src/plugins/fts-solr/solr-connection.c b/src/plugins/fts-solr/solr-connection.c index 947ea76af..3389729d1 100644 --- a/src/plugins/fts-solr/solr-connection.c +++ b/src/plugins/fts-solr/solr-connection.c @@ -156,7 +156,7 @@ int solr_connection_init(const char *url, ??????????????? http_set.request_timeout_msecs = 60*1000; ??????????????? http_set.ssl = ssl_client_set; ??????????????? http_set.debug = debug; -?????????????? solr_http_client = http_client_init(&http_set); +?????????????? solr_http_client = http_client_init_private(&http_set); ??????? } ??????? conn->xml_parser = XML_ParserC...

...a4b8b5c3034f57e22e77caa759c090da6b62f8ba..b8b57a350b9a710d101ac7ccbcc14560d415d905 100644 > --- a/src/plugins/fts/fts-parser-tika.c > +++ b/src/plugins/fts/fts-parser-tika.c > @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) > http_set.request_timeout_msecs = 60*1000; > http_set.ssl = &ssl_set; > http_set.debug = user->mail_debug; > - tika_http_client = http_client_init(&http_set); > + tika_http_client = http_client_init_private(&http_set); > } > *http_url_r = tuser->http_url; > return 0; >

...c3034f57e22e77caa759c090da6b62f8ba..b8b57a350b9a710d101ac7ccbcc14560d415d905 > 100644 > --- a/src/plugins/fts/fts-parser-tika.c > +++ b/src/plugins/fts/fts-parser-tika.c > @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, > struct http_url **http_url_r) > http_set.request_timeout_msecs = 60*1000; > http_set.ssl = &ssl_set; > http_set.debug = user->mail_debug; > -tika_http_client = http_client_init(&http_set); > +tika_http_client = http_client_init_private(&http_set); > } > *http_url_r = tuser->http_url; > return 0; -- Hegh QaQ law' qu...

Hi, after the upgrade to Dovecot 2.3.11.3, from 2.3.10.1, I see frequently these errors from different users: Aug 18 11:02:35 Panic: indexer-worker(info at domain.com) session=<g71KISOttvS5LNVj:O3ahCyuZO18cYAAAEPCW+w>: file http-client-request.c: line 1232 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) Aug 18 11:02:35 Error: indexer-worker(info at

...a4b8b5c3034f57e22e77caa759c090da6b62f8ba..b8b57a350b9a710d101ac7ccbcc14560d415d905 100644 > --- a/src/plugins/fts/fts-parser-tika.c > +++ b/src/plugins/fts/fts-parser-tika.c > @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) > http_set.request_timeout_msecs = 60*1000; > http_set.ssl = &ssl_set; > http_set.debug = user->mail_debug; > - tika_http_client = http_client_init(&http_set); > + tika_http_client = http_client_init_private(&http_set); > } > *http_url_r = tuser->http_url; > return 0; >...

...6b62f8ba..b8b57a350b9a710d101ac7ccbcc14560d415d905 100644 >> --- a/src/plugins/fts/fts-parser-tika.c >> +++ b/src/plugins/fts/fts-parser-tika.c >> @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) >> http_set.request_timeout_msecs = 60*1000; >> http_set.ssl = &ssl_set; >> http_set.debug = user->mail_debug; >> - tika_http_client = http_client_init(&http_set); >> + tika_http_client = http_client_init_private(&http_set); >> } >> *http_ur...

...rror: Mailbox INBOX: Transaction commit failed: FTS transaction commit failed: backend I could not find for a long time what the problem was and set the nginx as a proxy, and see that dovecot breaks the connect after 60 seconds. After examining the code, I found the fixed connection time: http_set.request_timeout_msecs = 60 * 1000; which is clearly not enough for large data. After searching, he also found this post https://dovecot.org/pipermail/dovecot-cvs/2015-March/025551.html 1. I think it would be a good idea to remove these settings in the configuration file dovecot.conf A bit of statistics from nginx, so...

On 4/4/2019 2:21 AM, Peter Mogensen via dovecot wrote: > What's the recommended way to handling timeouts on large mailboxes given > the hardwired request timeout of 60s in solr-connection.c: > > http_set.request_timeout_msecs = 60*1000; I'm a denizen of the solr-user at lucene.apache.org mailing list. For a typical Solr index, 60 seconds is an eternity. Most people aim for query times of 100 milliseconds or less, and they often achieve that goal. If you have an index where queries really are taking longer tha...

...-parser-tika.c index a4b8b5c3034f57e22e77caa759c090da6b62f8ba..b8b57a350b9a710d101ac7ccbcc14560d415d905 100644 --- a/src/plugins/fts/fts-parser-tika.c +++ b/src/plugins/fts/fts-parser-tika.c @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) http_set.request_timeout_msecs = 60*1000; http_set.ssl = &ssl_set; http_set.debug = user->mail_debug; - tika_http_client = http_client_init(&http_set); + tika_http_client = http_client_init_private(&http_set); } *http_url_r = tuser->http_url; return 0;

...c3034f57e22e77caa759c090da6b62f8ba..b8b57a350b9a710d101ac7ccbcc14560d415d905 > 100644 > --- a/src/plugins/fts/fts-parser-tika.c > +++ b/src/plugins/fts/fts-parser-tika.c > @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, > struct http_url **http_url_r) > http_set.request_timeout_msecs = 60*1000; > http_set.ssl = &ssl_set; > http_set.debug = user->mail_debug; > -tika_http_client = http_client_init(&http_set); > +tika_http_client = http_client_init_private(&http_set); > } > *http_url_r = tuser->http_url; > return 0; -- Hegh QaQ law' qu...

...7ccbcc14560d415d905 100644 >>>> --- a/src/plugins/fts/fts-parser-tika.c >>>> +++ b/src/plugins/fts/fts-parser-tika.c >>>> @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) >>>> http_set.request_timeout_msecs = 60*1000; >>>> http_set.ssl = &ssl_set; >>>> http_set.debug = user->mail_debug; >>>> - tika_http_client = http_client_init(&http_set); >>>> + tika_http_client = http_client_init_private(&http_set); >>>...

...fts-parser-tika.c index a4b8b5c3034f57e22e77caa759c090da6b62f8ba..b8b57a350b9a710d101ac7ccbcc14560d415d905 100644 --- a/src/plugins/fts/fts-parser-tika.c +++ b/src/plugins/fts/fts-parser-tika.c @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) http_set.request_timeout_msecs = 60*1000; http_set.ssl = &ssl_set; http_set.debug = user->mail_debug; -tika_http_client = http_client_init(&http_set); +tika_http_client = http_client_init_private(&http_set); } *http_url_r = tuser->http_url; return 0; Greetings I'm also experiencing these issues whi...

...gt;>>>> --- a/src/plugins/fts/fts-parser-tika.c >>>>>> +++ b/src/plugins/fts/fts-parser-tika.c >>>>>> @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) >>>>>> http_set.request_timeout_msecs = 60*1000; >>>>>> http_set.ssl = &ssl_set; >>>>>> http_set.debug = user->mail_debug; >>>>>> - tika_http_client = http_client_init(&http_set); >>>>>> + tika_http_client = http_client_init_priv...

...-parser-tika.c index a4b8b5c3034f57e22e77caa759c090da6b62f8ba..b8b57a350b9a710d101ac7ccbcc14560d415d905 100644 --- a/src/plugins/fts/fts-parser-tika.c +++ b/src/plugins/fts/fts-parser-tika.c @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) http_set.request_timeout_msecs = 60*1000; http_set.ssl = &ssl_set; http_set.debug = user->mail_debug; - tika_http_client = http_client_init(&http_set); + tika_http_client = http_client_init_private(&http_set); } *http_url_r = tuser->http_url; return 0;

...350b9a710d101ac7ccbcc14560d415d905 100644 >>> --- a/src/plugins/fts/fts-parser-tika.c >>> +++ b/src/plugins/fts/fts-parser-tika.c >>> @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) >>> http_set.request_timeout_msecs = 60*1000; >>> http_set.ssl = &ssl_set; >>> http_set.debug = user->mail_debug; >>> - tika_http_client = http_client_init(&http_set); >>> + tika_http_client = http_client_init_private(&http_set); >>> } >...

...fmt = "ods" -o $fmt = "odp" ]; then ? ?xmlunzip "content.xml" --- src/plugins/fts/fts-parser-tika.c.orig? ? ? 2019-01-02 22:11:26 UTC +++ src/plugins/fts/fts-parser-tika.c @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struc ? ? ? ? ? ? ? ? http_set.request_timeout_msecs = 60*1000; ? ? ? ? ? ? ? ? http_set.ssl = &ssl_set; ? ? ? ? ? ? ? ? http_set.debug = user->mail_debug; -? ? ? ? ? ? ? ?tika_http_client = http_client_init(&http_set); +? ? ? ? ? ? ? ?tika_http_client = http_client_init_private(&http_set); ? ? ? ? } ? ? ? ? *http_url_r = tuser->ht...

...905 100644 >>>>> --- a/src/plugins/fts/fts-parser-tika.c >>>>> +++ b/src/plugins/fts/fts-parser-tika.c >>>>> @@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, struct http_url **http_url_r) >>>>> http_set.request_timeout_msecs = 60*1000; >>>>> http_set.ssl = &ssl_set; >>>>> http_set.debug = user->mail_debug; >>>>> - tika_http_client = http_client_init(&http_set); >>>>> + tika_http_client = http_client_init_private(&http_se...