Displaying 2 results from an estimated 2 matches for "dbcompact_multipass".
2024 Mar 15
1
Using multiple temporary indexes during updates
...ps://www.recoll.org/pages/idxthreads/threadingRecoll.html#_the_xapian_bottleneck_and_how_it_was_resolved_thanks_to_xapian
Nice write-up!
It'd be helpful to note the Xapian version you're using for such
benchmarking as the results are likely to evolve over time.
Also are you using Xapian::DBCOMPACT_MULTIPASS? The linked page doesn't
seem to say.
In theory it should be faster when merging many databases, but Tom
Mortimer reported he found it slower. That was a long time ago, but
I've never managed to get around to profiling to see what was going
on or if it was even still the case (probably m...
2024 Mar 15
1
Using multiple temporary indexes during updates
Hi,
I have been playing at converting the index update stage of the Recoll indexer to use
multiple temporary indexes and a final merge.
This yields an improvement factor of almost 3 (on my quad-core CPU), for the total
indexing time for "easy" files like HTML pages. This is nice (!) and I wanted to share my
admiration for the "compact()" method.
If someone is interested in a