search for: threadingrecol

...vement factor of almost 3 (on my quad-core CPU), for the total indexing time for "easy" files like HTML pages. This is nice (!) and I wanted to share my admiration for the "compact()" method. If someone is interested in a bit more detail: https://www.recoll.org/pages/idxthreads/threadingRecoll.html#_the_xapian_bottleneck_and_how_it_was_resolved_thanks_to_xapian Cheers, jf

Hi everybody, I'm the author of a small C++11 program called XDGSearch. The source code is hosted on Github, for a quick overview you can visit this link https://github.com/frank67/XDGSearch/blob/master/README.md I'm writing to the mailing list because I'd like to make the database build process splitted in more thread. Is it possible? If you are a C++ programmer you can take a look at

On 14/09/2018 at 09:30, Jean-Francois Dockes wrote: > Hi, > > You may be interested by how Recoll does it: > > https://www.lesbonscomptes.com/recoll/idxthreads/threadingRecoll.html > > A few things in the document are slightly obsolete (esp. the last > paragraph: recollindex now does use vfork()), but it's overall quite close > to how the current indexer works. > > jfd > Thank for your answer, briefly it's No: > The Xapian library ind...

...(on my quad-core CPU), for the total > indexing time for "easy" files like HTML pages. This is nice (!) and I wanted to share my > admiration for the "compact()" method. > > If someone is interested in a bit more detail: > https://www.recoll.org/pages/idxthreads/threadingRecoll.html#_the_xapian_bottleneck_and_how_it_was_resolved_thanks_to_xapian Nice write-up! It'd be helpful to note the Xapian version you're using for such benchmarking as the results are likely to evolve over time. Also are you using Xapian::DBCOMPACT_MULTIPASS? The linked page doesn't s...

...t; I'd be also happy if I find somebody that want to be involved in the > XDGSearch development :) > Thanks in advance for any answer, best regards > > -- > Franco Martelli Hi, You may be interested by how Recoll does it: https://www.lesbonscomptes.com/recoll/idxthreads/threadingRecoll.html A few things in the document are slightly obsolete (esp. the last paragraph: recollindex now does use vfork()), but it's overall quite close to how the current indexer works. jfd