Displaying 4 results from an estimated 4 matches for "totalwrites".
Did you mean:
total_write
2019 Jan 31
4
Amount of writes during index creation
...tests, with data mostly from a project gutenberg dvd
and other books, with relatively modest index sizes, from 1 to 24 GB.
Quite curiously, in this zone, with all Xapian versions I tried, the ratio
from index size to the amount of writes is roughly proportional to the index
size to the power 1.5
TotalWrites / (IndexSize**1.5) ~= K
So, not quadratic, which is good news. For big indexes, 1.5 is not so good
but probably somewhat expected.
The other good news is that the patch above decreases the amount of writing
by a significant factor, around 4.5 for the biggest index I tried.
The amount of writes i...
2019 Feb 03
0
Amount of writes during index creation
...ject gutenberg dvd
> and other books, with relatively modest index sizes, from 1 to 24 GB.
>
> Quite curiously, in this zone, with all Xapian versions I tried, the ratio
> from index size to the amount of writes is roughly proportional to the index
> size to the power 1.5
>
> TotalWrites / (IndexSize**1.5) ~= K
I could perhaps believe it would tend to O(n*log(n)) eventually due to
the number of levels in the B-tree being log(n) (though the number of
levels is bounded above by a fairly small constant so one could
argue that's O(n)).
But probably the merging on commit will actu...
2019 Feb 02
0
Amount of writes during index creation
...ject gutenberg dvd
> and other books, with relatively modest index sizes, from 1 to 24 GB.
>
> Quite curiously, in this zone, with all Xapian versions I tried, the ratio
> from index size to the amount of writes is roughly proportional to the index
> size to the power 1.5
>
> TotalWrites / (IndexSize**1.5) ~= K
>
> So, not quadratic, which is good news. For big indexes, 1.5 is not so good
> but probably somewhat expected.
>
> The other good news is that the patch above decreases the amount of writing
> by a significant factor, around 4.5 for the biggest index I...
2019 Jan 21
2
Amount of writes during index creation
Hi,
I have had a problem report from a Recoll user about the amount of writes
during index creation.
https://opensourceprojects.eu/p/recoll1/tickets/67/
The issue is that the index is on SSD and that the amount of writes is
significant compared to the SSD life expectancy (index size > 250 GB).
>From the numbers he supplied, it seems to me that the total amount of block
writes is roughly