Displaying 4 results from an estimated 4 matches for "idxflushmb".
2019 Jan 31
4
Amount of writes during index creation
...indexes, 1.5 is not so good
but probably somewhat expected.
The other good news is that the patch above decreases the amount of writing
by a significant factor, around 4.5 for the biggest index I tried.
The amount of writes is estimated with iostat before/after. The disk has
nothing else to do.
idxflushmb is the number of megabytes of input text between Xapian commits.
xapiandb,kb writes,kb K*1000 sz/w
xapian 1.4.5 idxflushmb 200
1544724 6941286 3.62 4.49
3080540 16312960 3.02 5.30
4606060 21054756 2.13 4.57
6123140 33914344 2.24 5.54
7631788 50452348 2.39 6.61
xapian git master l...
2019 Feb 03
0
Amount of writes during index creation
....tmp
sync tmp.db/postlist.DB
read 1 from tmp.db/postlist.DB
sync tmp.db/position.tmp
sync tmp.db/position.DB
read 1 from tmp.db/position.DB
sync tmp.db/termlist.tmp
sync tmp.db/termlist.DB
read 1 from tmp.db/termlist.DB
sync tmp.db/record.tmp
sync tmp.db/record.DB
read 1 from tmp.db/record.DB
> idxflushmb is the number of megabytes of input text between Xapian commits.
>
> xapiandb,kb writes,kb K*1000 sz/w
>
> xapian 1.4.5 idxflushmb 200
If you're going to the trouble of profiling, probably best to use the
latest release (1.4.5 was released in 2017).
> 1544724 6941286 3.62 4...
2019 Feb 02
0
Amount of writes during index creation
...y somewhat expected.
>
> The other good news is that the patch above decreases the amount of writing
> by a significant factor, around 4.5 for the biggest index I tried.
>
> The amount of writes is estimated with iostat before/after. The disk has
> nothing else to do.
>
> idxflushmb is the number of megabytes of input text between Xapian commits.
>
> xapiandb,kb writes,kb K*1000 sz/w
>
> xapian 1.4.5 idxflushmb 200
>
> 1544724 6941286 3.62 4.49
> 3080540 16312960 3.02 5.30
> 4606060 21054756 2.13 4.57
> 6123140 33914344 2.24 5.54
> 7631788 5045...
2019 Jan 21
2
Amount of writes during index creation
Hi,
I have had a problem report from a Recoll user about the amount of writes
during index creation.
https://opensourceprojects.eu/p/recoll1/tickets/67/
The issue is that the index is on SSD and that the amount of writes is
significant compared to the SSD life expectancy (index size > 250 GB).
>From the numbers he supplied, it seems to me that the total amount of block
writes is roughly