dovecot - Aug 2021 - [OT] Re: What kind of search response time are you setting with solr full text search?

> Try this in on the commandline of the Solr server:
> 
> time curl
>
"http://localhost:YYY/solr/dovecot/select?q=maynez&defType=edismax&qf=body+to+subject+cc+from"
OK I had to modify the query path slightly to get it to work with my 
core to:

time curl 
http://localhost:8983/solr/dondley/select?q=maynez&defType=edismax&qf=body+to+subjec:t+ccfrom

But it didn't return any results:

Results:


   "responseHeader":{
     "status":0,
     "QTime":7,
     "params":{
       "q":"maynez"}},
  
"response":{"numFound":0,"start":0,"numFoundExact":true,"docs":[]
   }}

real    0m0.018s
user    0m0.004s
sys     0m0.006s

I only have emails for this person in a subfolder of my main Inbox 
folder so maybe it's only searching the top level folder?

> You could do the query remotely by changing "localhost" to the
> hostname or IP address of the Solr server.

 From remote host, I got similar numbers (no results):

real    0m0.017s
user    0m0.009s
sys     0m0.002s

On 8/25/2021 12:05 PM, Steve Dondley wrote:
>
> OK I had to modify the query path slightly to get it to work with my 
> core to:
>
> time curl 
>
http://localhost:8983/solr/dondley/select?q=maynez&defType=edismax&qf=body+to+subjec:t+ccfrom
>
> But it didn't return any results:
>
<snip>
> I only have emails for this person in a subfolder of my main Inbox 
> folder so maybe it's only searching the top level folder? 
That query should search ALL emails that dovecot has indexed to Solr.? 
There is no restriction for mailbox or folder.

Try replacing "maynez" with something else that you know will be in
the
index.

Note that you can ask dovecot to completely reindex everybody's email 
with this command run as root, and then you can try searching again a 
few minutes later:

doveadm index -A -q '*'

It took me forever to work out the right options for that command.? I 
think it should probably get added to the wiki page about fts_solr.

Question for experts on the dovecot side of this:? What does it take for 
dovecot to index new messages delivered with dovecot's LDA by postfix?? 
Is it a matter of waiting a certain amount of time?? I saw in Solr that 
the last update to the index was 3 hours earlier, but I had received 
email only a few minutes before looking at Solr's stats.

Thanks,
Shawn

On 2021-08-25 02:05 PM, Steve Dondley wrote:
>> Try this in on the commandline of the Solr server:
>> 
>> time curl
>>
"http://localhost:YYY/solr/dovecot/select?q=maynez&defType=edismax&qf=body+to+subject+cc+from"
> 
> OK I had to modify the query path slightly to get it to work with my 
> core to:
> 
> time curl
>
http://localhost:8983/solr/dondley/select?q=maynez&defType=edismax&qf=body+to+subjec:t+ccfrom
> 
OK! found the issue. My command line mangled the URL when I edited the 
url. There is a stray ":" in the query string.

So I am now seeing a ton of results and the following query time:

real    0m0.118s
user    0m0.003s
sys     0m0.011s

So this looks really good and fast. So I think we can say with 
confidence solr is doing its job. So why is roundcube/dovecot taking so 
long to show the results?