Xapian discuss - Jun 2009 - Indexing more than 15 billion documents

Hi,

Sorry to follow up on an old thread, but I am wondering if there has
been any work done on, or interest in, increasing the maximum document
id beyond a 32bit limit?

Daniel

On Mon, Jun 18, 2007 at 04:11:54AM +0100, Olly Betts wrote:
> > In particular, there is currently a limit of 4 billion documents in a
> > database, due to using a 32 bit type for document IDs, but I don't
think
> > it would be particularly hard to change to using a 64 bit type here
(the
> > database format might require an incompatible change, but this could
be
> > managed).

On Tue, Jun 23, 2009 at 01:34:52PM -0400, Daniel Enright
wrote:
> Sorry to follow up on an old thread, but I am wondering if there has
> been any work done on, or interest in, increasing the maximum document
> id beyond a 32bit limit?
Neither.

If you change types like Xapian::doccount to be 64 bit, it might just
work - if not, it shouldn't be much work to patch up the places which
make 32 bit assumptions.  The low level encodings are templated so will
handle any size type.

Cheers,
    Olly