search for: batch_siz

...PE=basic > ??????? SOLR_AUTHENTICATION_OPTS="-Dbasicauth=myuser:my at pass" > > and > > ????dovecot/conf.d/10-master.cf > > ??????? fts_solr = > url=https://"myuser":"my%40pass"@solr.example.com:8984/solr/dovecot/ > use_libfts soft_commit=yes batch_size=250 > > changing all > > -??? my at pass > +??? my_pass > > so that > > ??????? fts_solr = > url=https://"myuser":"my_pass"@solr.example.com:8984/solr/dovecot/ > use_libfts soft_commit=yes batch_size=250 > > does the trick.? fts/solr is in...

...e with multiple levels (the hash syntax) This worked in 1.2.6: *************** joins = " inner join AZ_LETTER_GROUP_VER3 as lg on AZ_TITLE_VER3.AZ_TITLE_VER3_ID = lg.AZ_TITLE_VER3_ID" conditions = [''lg.AZ_LETTER_GROUP_VER3_NAME = ?'', ''A''] batch_size = 10 page = 1 az_titles = SfxDb::AzTitle.find(:all, :joins => joins, :conditions => conditions, :limit => batch_size, :offset=>batch_size*(page -1), :order=>''TITLE_SORT'', :include=>[{:sfx_object => [:p...

...ched) ticketlocks. Here we form a batch of eligible lock holders and we serve the eligible (to hold the lock) batches in FIFO, but the lock-waiters within eligible batch are served in an unfair manner. This increases probability of any eligible lock-holder being in running state (to an average of (batch_size/2)-1) and also it provides needed bounded starvation since any lock requester can not acquire more than batch_size times repeatedly during contention. On the negetive side we would need an extra cmpxchg. The patch has the batch size of 8. (As we know increasing batch size means we are closer to...

...ched) ticketlocks. Here we form a batch of eligible lock holders and we serve the eligible (to hold the lock) batches in FIFO, but the lock-waiters within eligible batch are served in an unfair manner. This increases probability of any eligible lock-holder being in running state (to an average of (batch_size/2)-1) and also it provides needed bounded starvation since any lock requester can not acquire more than batch_size times repeatedly during contention. On the negetive side we would need an extra cmpxchg. The patch has the batch size of 8. (As we know increasing batch size means we are closer to...

...earing in search results, periodic indexing could be set up by cron. I've attached a patch, any comments are welcome (especially about getting settings from the backend context). Example config plugin { ? fts = solr ? fts_solr = url=https://user:password at solr.example.com:443/solr/dovecot/ batch_size=500 no_soft_commit } John -------------- next part -------------- --- src/plugins/fts-solr/fts-solr-plugin.h.orig 2019-04-14 15:12:07.694289402 +0200 +++ src/plugins/fts-solr/fts-solr-plugin.h 2019-04-14 14:04:17.213939414 +0200 @@ -12,8 +12,10 @@ struct fts_solr_settings { const char *url,...

On 13/11/2020 19:55, PGNet Dev wrote: > On 11/13/20 9:56 AM, PGNet Dev wrote: >>> (2) see here: https://wiki.dovecot.org/Plugins/FTS/Solr >>> >>> two useful settings are debug and rawlog_dir=whatever to be added in >>> the same line as fts_solr > > with > > ????fts_solr = ... debug > > line #35 @ https://pastebin.com/9ecLQspD _looks_ like

I have an issue where I am getting a large number of records from the database and I cant afford to keep it in the memory due to performance issues. Therefore using the following would be ideal, User.find_each(:batch_size => 5000, :start => 2000) do |user| NewsLetter.weekly_deliver(user) end however, I would like to use find_by_sql since my query is user defined. Question is, is it possible to use find_by_sql with batch_size and iterate through all the record-sets? Thanks Bhavesh -- Posted via http://w...

hi! after wondering why i can''t find alot of records i eventually found the problem in the sqlserver_adapters implementation of "add_limit_offset!". the problem is when using MSSQL with the sqlserver_adapter paging will only work when at least one column is defined in ":order". for example i was indexing a table with 2912 records, the generated sql for the batches

Is there any scalable alternative to iterating all the records of a certain model? #find_all seems to load everything into memory. With 500.000 records it will be a swap storm. Pedro.

On 13/11/2020 22:04, PGNet Dev wrote: >> I guess you didn't need to enclose username and password in quotes, i.e. >> >> fts_solr = >> url=https://myuser:my%40pass at solr.example.com:8984/solr/dovecot/ >> use_libfts soft_commit=yes batch_size=250 > > On 11/13/20 12:56 PM, John Fawcett wrote: > >> I guess you didn't need to enclose username and password in quotes, i.e. > >> > >> fts_solr = > >> url=https://myuser:my%40pass at solr.example.com:8984/solr/dovecot/ > >> use_libfts soft_...

On 4/13/2019 4:29 AM, John Fawcett via dovecot wrote: > If this value was made configurable people could set it to what they > want. However the underlying problem is likely on solr configuration. The Jetty that is included in Solr has its idle timeout set to 50 seconds. But in practice, I have not seen this timeout trigger ... and if the OP is seeing a 60 second timeout, then the 50

...:28 PM, Aki Tuomi wrote: > Dovecot FTS tokenization is not done, unless you have `use_libfts` in fts_solr setting, in your case > > fts_solr = url=https://solr.example.com:8984/solr/dovecot/ use_libfts changing - fts_solr = url=https://solr.example.com:8984/solr/dovecot/ soft_commit=yes batch_size=250 + fts_solr = url=https://solr.example.com:8984/solr/dovecot/ use_libfts soft_commit=yes batch_size=250 exec of doveadm fts rescan -u testuser at example.com returns doveadm(testuser at example.com): Error: fts-solr: fts_filter_normalizer_icu: libicu support not built in doveadm(testuser...

...s => { ''body'' => {}, ''title'' => { :boost => 2 } } end --- INDEX CODE index = Ferret::Index::Index.new(MyModel.aaf_configuration[:ferret].dup.update(:auto_flush => false, :field_infos => MyModel.aaf_index.field_infos, :create => true)) n = 0 BATCH_SIZE = 1000 while true # new index from scratch records = MyModel.find(:all, :limit => BATCH_SIZE, :offset => n, :select => "id,#{MyModel.aaf_configuration[:ferret_fields].keys.join('','')}") break if (!records || records.length == 0) records.each do |record...

...:index => :yes, :term_vector => :with_positions_offsets, :boost => 5.0) field_infos.add_field(:id, :store => :yes, :index => :untokenized, :term_vector => :no) field_infos.create_index(FerretConfig::INDEXPATH) index = Ferret::Index::Index.new(FerretConfig::INDEXOPTIONS) batch_size = 1000 Entry.transaction do 0.step(Entry.count, batch_size) do |i| Entry.find(:all, :limit => batch_size, :offset => i).each do |rec| index << rec.make_entry_ferret_doc end end end index.flush index.optimize index.close end def make_entry_ferret_doc doc = Ferre...

...to tika and suddenly, midway a document dovecot (or the server) sends a RST. Sometimes after thousands of documents, sometimes after a few. Usually after a few hundred. It appears there are less errors using http than https. Relevant config: OS: CentOS6, fully updated plugin { ? fts = solr ? batch_size = 1 ? fts_solr = url=https://username:password at solr-01.vevida.net:443/solr/dovecot/ ? #fts_tika = https://solr-01.vevida.net:443/tika/ ? batch_size = 1000 ? fts_autoindex=yes ? soft_commit=no } # dovecot --version 2.3.9.3 (9f41b88fa) # Configure options: ??? --docdir=%{_docdir}/dovecot? \ ??...

...gt; hits=3 status=0 QTime=3 > > But if no hits are found, then dovecot cannot be expected to display > results. It still may be an indexing problem though. my current config has soft_commit enabled, fts_solr = url=https://solr.example.com:8984/solr/dovecot/ use_libfts soft_commit=yes batch_size=250 i'll see abt getting some clearer test results ...

> On 02/11/2020 15:11 PGNet Dev <pgnet.dev at gmail.com> wrote: > > > On 11/2/20 12:44 AM, Aki Tuomi wrote: > > you should try removing use_libfts from your config line and let solr do that part. > > sry, i'm a bit confused. > > you'd suggested I _add_ it, > > https://dovecot.org/pipermail/dovecot/2020-October/120258.html > > > I

...> stopping you indexing excluded words like tambien). On my setup without > lib-fts everything goes to solr which does the work of indexing without > all the features of lib-fts. withOUT libfts - fts_solr = url=https://solr.presence-group.net:8984/solr/dovecot/ use_libfts soft_commit=yes batch_size=250 + fts_solr = url=https://solr.presence-group.net:8984/solr/dovecot/ soft_commit=yes batch_size=250 and unmodified dovecot-provided schema/config, /bin/cp -af /usr/share/doc/dovecot/solr-config-7.7.0.xml /path/to/solr/data/dovecot/conf/solrconfig.xml /bin/cp -af /usr/share/doc/dovecot/solr-...

Hi, I''m trying to figure out how to compile ferret with large file support, but none of the topics that discuss this actually say How this is done. Can someone please provide the info? thanks. -m my exact problem: http://www.ruby-forum.com/topic/94143#191630 this topic also discusses the issue: http://www.ruby-forum.com/topic/84237#151791 this topic says that the FAQ should have the

- refactor memoization code - pass pod as stdin rather than files Pino Toscano (3): generator: isolate memoized cache in own module generator: adjust variable names generator: improve pod2text invocation generator/Makefile.am | 3 ++ generator/memoized_cache.ml | 62 +++++++++++++++++++++ generator/memoized_cache.mli | 29 ++++++++++ generator/utils.ml | 101