The one on the Wiki is mine...which I'm using now.? So it certainly does work - but perhaps there's a setting you have differently from me. Performing a "create -c dovecot" creates a Solr instance *named* dovecot - that does *not* initialize it with the necessary schema.? You need to specify "-d dovecot", with a dovecot configset already setup, to do that. The other choice is to create the instance as you show, ensure Solr is stopped, delete the "<prefix>/solr/dovecot/data" folder, and copy the managed-schema file to "<prefix>/solr/dovecot/conf".? Again, the filename saved in the /conf folder needs to be "managed-schema" - no ".xml" suffix. If that doesn't work for you - please share the errors. Daniel On 12/10/2018 11:40 AM, Joan Moreau wrote:> > Hi Daniel, > > THere is no need of all this, just the command (on Solr 7.5) "create > -c dovecot " is enough > > The chema.xml provided on the wiki basically does not work on 7.5 > > > Here the latest one I am working on , but nothing works properly (bad > search results, errors in ftp_solr, etc..) > > > <?xml version="1.0" encoding="UTF-8"?> > <schema name="dovecot" version="2.0"> > <uniqueKey>id</uniqueKey> > <types> > <fieldType name="string" class="solr.StrField" /> > <fieldType name="long" class="solr.LongPointField" > positionIncrementGap="0" /> > <fieldType name="text" class="solr.TextField" > autoGeneratePhraseQueries="true" positionIncrementGap="100"> > <analyzer type="index"> > <tokenizer class="solr.StandardTokenizerFactory"/> > <filter class="solr.StopFilterFactory" words="stopwords.txt" > ignoreCase="true"/> > <filter class="solr.WordDelimiterGraphFilterFactory" > generateWordParts="1" generateNumberParts="1" splitOnCaseChange="1" > splitOnNumerics="1" catenateWords="1" catenateNumbers="1" > catenateAll="1"/> > <filter class="solr.FlattenGraphFilterFactory"/> <!-- required on > index analyzers after graph filters --> > <filter class="solr.LowerCaseFilterFactory"/> > <filter class="solr.NGramFilterFactory" minGramSize="3" > maxGramSize="15" /> > <filter class="solr.KeywordMarkerFilterFactory" > protected="protwords.txt"/> > <filter class="solr.PorterStemFilterFactory"/> > </analyzer> > <analyzer type="query"> > <tokenizer class="solr.StandardTokenizerFactory"/> > <filter class="solr.SynonymGraphFilterFactory" expand="true" > ignoreCase="true" synonyms="synonyms.txt"/> > <filter class="solr.FlattenGraphFilterFactory"/> <!-- required on > index analyzers after graph filters --> > <filter class="solr.StopFilterFactory" words="stopwords.txt" > ignoreCase="true"/> > <filter class="solr.WordDelimiterGraphFilterFactory" > generateWordParts="1" generateNumberParts="1" splitOnCaseChange="1" > splitOnNumerics="1" catenateWords="1" catenateNumbers="1" > catenateAll="1"/> > <filter class="solr.LowerCaseFilterFactory"/> > <filter class="solr.NGramFilterFactory" minGramSize="3" > maxGramSize="15" /> > <filter class="solr.KeywordMarkerFilterFactory" > protected="protwords.txt"/> > <filter class="solr.PorterStemFilterFactory"/> > </analyzer> > </fieldType> > </types> > <fields> > <field name="_version_" type="long" indexed="true" stored="true"/> > <field name="bcc" type="text" indexed="true" stored="false"/> > <field name="body" type="text" indexed="true" stored="false"/> > <field name="box" type="string" indexed="false" required="true" > stored="true"/> > <field name="hdr" type="text" indexed="true" stored="false"/> > <field name="cc" type="text" indexed="true" stored="false"/> > <field name="from" type="text" indexed="true" stored="false"/> > <field name="id" type="string" indexed="true" required="true" > stored="true"/> > <field name="subject" type="text" indexed="true" stored="false"/> > <field name="to" type="text" indexed="true" stored="false"/> > <field name="uid" type="long" indexed="true" required="true" > stored="true"/> > <field name="user" type="string" indexed="true" required="true" > stored="true"/> > </fields> > </schema> > > > > On 2018-12-10 21:17, Daniel Miller via dovecot wrote: > >> On 12/4/2018 10:40 AM, Joan Moreau via dovecot wrote: >>> >>> In the Wiki, ( https://wiki.dovecot.org/Plugins/FTS/Solr ), it would >>> nice to stipulate to the reader? to type the command : >>> >>> sudo -u solr /opt/solr/bin/solr create -c dovecot # to create the >>> dovecot instance >>> >>> before updating the schema.xml . >>> >>> Also,? schema.xml is in /opt/solr/server/solr/dovecot/conf for >>> archlinux users >>> >>> Additionaly, the url is http://(solr_ >>> <http://(solr>server):8983/solr/dovecot/ (error in wiki) >>> >> After installing Solr, wherever the installation sets up there should >> a folder similar to: >> >> <your prefix>/solr/server/solr/configsets >> >> If you look there, you'll probably see folders like '_default' and >> 'sample_techproducts_configs'.? I haven't played with the >> 'techproducts' sample.? Copy the '_default' folder, with all its >> contents, to a 'dovecot' folder.? In the new dovecot folder, replace >> the 'managed-schema' file with the file from the Dovecot Wiki >> >> https://wiki.dovecot.org/Plugins/FTS/Solr?action=AttachFile&do=view&target=solr-7.x-schema.xml >> >> after that, you should be able to run 'solr /opt/solr/bin/solr create >> -c dovecot' to create the instance. If things still don't work let us >> know. >> >> The schema is one I've tweaked and updated during my own migrations >> since Solr 3.3.? It's possible there's something else in my config >> that needs documenting - but having experienced Solr search against >> my mailstore I never want to be without it. >> >> Daniel >>-------------- next part -------------- An HTML attachment was scrubbed... URL: <https://dovecot.org/pipermail/dovecot/attachments/20181210/3781d999/attachment.html>
I shared the errors already so many times (check this mailinling for "solr" in teh title) Contrary to what you say, with SOlr 7.5 and Dovecot git, I had to remove the "managed-schema" to make solr respond a bit properly. It relies on schema.xml In order to create the instance, no, it copies the default config in the dovecot instance. Bottom line, the end results is that the results are either "error : invalid response" (mostly on Android email client) or no results or innacurate results (using Roundcube) On 2018-12-10 23:30, Daniel Miller via dovecot wrote:> The one on the Wiki is mine...which I'm using now. So it certainly does work - but perhaps there's a setting you have differently from me. > > Performing a "create -c dovecot" creates a Solr instance *named* dovecot - that does *not* initialize it with the necessary schema. You need to specify "-d dovecot", with a dovecot configset already setup, to do that. > > The other choice is to create the instance as you show, ensure Solr is stopped, delete the "<prefix>/solr/dovecot/data" folder, and copy the managed-schema file to "<prefix>/solr/dovecot/conf". Again, the filename saved in the /conf folder needs to be "managed-schema" - no ".xml" suffix. > > If that doesn't work for you - please share the errors. > > Daniel > > On 12/10/2018 11:40 AM, Joan Moreau wrote: > > Hi Daniel, > > THere is no need of all this, just the command (on Solr 7.5) "create -c dovecot " is enough > > The chema.xml provided on the wiki basically does not work on 7.5 > > Here the latest one I am working on , but nothing works properly (bad search results, errors in ftp_solr, etc..) > > <?xml version="1.0" encoding="UTF-8"?> > <schema name="dovecot" version="2.0"> > <uniqueKey>id</uniqueKey> > <types> > <fieldType name="string" class="solr.StrField" /> > <fieldType name="long" class="solr.LongPointField" positionIncrementGap="0" /> > <fieldType name="text" class="solr.TextField" autoGeneratePhraseQueries="true" positionIncrementGap="100"> > <analyzer type="index"> > <tokenizer class="solr.StandardTokenizerFactory"/> > <filter class="solr.StopFilterFactory" words="stopwords.txt" ignoreCase="true"/> > <filter class="solr.WordDelimiterGraphFilterFactory" generateWordParts="1" generateNumberParts="1" splitOnCaseChange="1" splitOnNumerics="1" catenateWords="1" catenateNumbers="1" catenateAll="1"/> > <filter class="solr.FlattenGraphFilterFactory"/> <!-- required on index analyzers after graph filters --> > <filter class="solr.LowerCaseFilterFactory"/> > <filter class="solr.NGramFilterFactory" minGramSize="3" maxGramSize="15" /> > <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/> > <filter class="solr.PorterStemFilterFactory"/> > </analyzer> > <analyzer type="query"> > <tokenizer class="solr.StandardTokenizerFactory"/> > <filter class="solr.SynonymGraphFilterFactory" expand="true" ignoreCase="true" synonyms="synonyms.txt"/> > <filter class="solr.FlattenGraphFilterFactory"/> <!-- required on index analyzers after graph filters --> > <filter class="solr.StopFilterFactory" words="stopwords.txt" ignoreCase="true"/> > <filter class="solr.WordDelimiterGraphFilterFactory" generateWordParts="1" generateNumberParts="1" splitOnCaseChange="1" splitOnNumerics="1" catenateWords="1" catenateNumbers="1" catenateAll="1"/> > <filter class="solr.LowerCaseFilterFactory"/> > <filter class="solr.NGramFilterFactory" minGramSize="3" maxGramSize="15" /> > <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/> > <filter class="solr.PorterStemFilterFactory"/> > </analyzer> > </fieldType> > </types> > <fields> > <field name="_version_" type="long" indexed="true" stored="true"/> > <field name="bcc" type="text" indexed="true" stored="false"/> > <field name="body" type="text" indexed="true" stored="false"/> > <field name="box" type="string" indexed="false" required="true" stored="true"/> > <field name="hdr" type="text" indexed="true" stored="false"/> > <field name="cc" type="text" indexed="true" stored="false"/> > <field name="from" type="text" indexed="true" stored="false"/> > <field name="id" type="string" indexed="true" required="true" stored="true"/> > <field name="subject" type="text" indexed="true" stored="false"/> > <field name="to" type="text" indexed="true" stored="false"/> > <field name="uid" type="long" indexed="true" required="true" stored="true"/> > <field name="user" type="string" indexed="true" required="true" stored="true"/> > </fields> > </schema> > > On 2018-12-10 21:17, Daniel Miller via dovecot wrote: On 12/4/2018 10:40 AM, Joan Moreau via dovecot wrote: > > In the Wiki, ( https://wiki.dovecot.org/Plugins/FTS/Solr ), it would nice to stipulate to the reader to type the command : > > sudo -u solr /opt/solr/bin/solr create -c dovecot # to create the dovecot instance > > before updating the schema.xml . > > Also, schema.xml is in /opt/solr/server/solr/dovecot/conf for archlinux users > > Additionaly, the url is http://(solr_ [1]server):8983/solr/dovecot/ (error in wiki) > > After installing Solr, wherever the installation sets up there should a folder similar to: > > <your prefix>/solr/server/solr/configsets > > If you look there, you'll probably see folders like '_default' and 'sample_techproducts_configs'. I haven't played with the 'techproducts' sample. Copy the '_default' folder, with all its contents, to a 'dovecot' folder. In the new dovecot folder, replace the 'managed-schema' file with the file from the Dovecot Wiki > > https://wiki.dovecot.org/Plugins/FTS/Solr?action=AttachFile&do=view&target=solr-7.x-schema.xml > > after that, you should be able to run 'solr /opt/solr/bin/solr create -c dovecot' to create the instance. If things still don't work let us know. > > The schema is one I've tweaked and updated during my own migrations since Solr 3.3. It's possible there's something else in my config that needs documenting - but having experienced Solr search against my mailstore I never want to be without it. > > DanielLinks: ------ [1] http://(solr -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://dovecot.org/pipermail/dovecot/attachments/20181211/67591715/attachment.html>
On 12/11/2018 4:46 AM, Joan Moreau via dovecot wrote:> > I shared the errors already so many times (check this mailinling for > "solr" in teh title) > > Contrary to what you say, with SOlr 7.5 and Dovecot git,? I had to > remove the "managed-schema" to make solr respond a bit properly. It > relies on schema.xml > > In order to create the instance, no, it copies? the default config in > the dovecot instance. >I'm not a Solr expert by any means but I believe you are incorrect. As of Solr 5.x the managed-schema file is the primary method for configuration.? The method I detailed previously for setting up a config helps automate creating new Solr instances - but as I stated you can either setup a Solr template and then create the instance from that or create an instance using the default template and then adjust it. The part that you *must* do after creating from the default template is stop the server, delete the entire "<prefix>/solr/dovecot/data" folder, then install the correct managed-schema file, then restart the server.? The server will not function with mismatched schema/data. If you'll try that - explicitly "rm -rf <prefix>/solr/dovecot/data", copy the managed-schema file into the conf folder, and restart - things will either work or there's something else that needs correction. -- Daniel>>>-------------- next part -------------- An HTML attachment was scrubbed... URL: <https://dovecot.org/pipermail/dovecot/attachments/20181212/d00cb0e6/attachment.html>