Luca Barbieri
2011-Jan-11 15:44 UTC
[Xapian-discuss] chert-update creates a db with some errors
I've some problems converting a xapian db, created with core 1.1.3 (using chert), to the new chert format. I'm using xapian-chert-update, compiled from the core-1.2.4. The conversion seems to run without errors: #./xapian-core-1.2.4/bin/xapian-chert-update old new postlist: Reduced by 33.3333% 16K (48K -> 32K) record: Size unchanged (8K) termlist: doesn't exist position: Size unchanged (0K) spelling: Size unchanged (0K) synonym: Size unchanged (0K) But if I run xapian-check on the new database there're many errors reported: #./xapian-core-1.2.4/bin/xapian-check new postlist: baseB blocksize=8K items=67 lastblock=3 revision=1 levels=1 root=2 B-tree checked okay ....... document id 744 in value chunk is larger than get_last_docid() 490 document id 745 in value chunk is larger than get_last_docid() 490 document id 746 in value chunk is larger than get_last_docid() 490 postlist table errors found: 255 I've re-created the 1.1.3 database WITHOUT the values that I add to documents during the indexing (with the document.add_value) and in this case the conversion creates a database without errors. Can someone help me? -- --------------------- Luca Barbieri
Olly Betts
2011-Jan-12 01:26 UTC
[Xapian-discuss] chert-update creates a db with some errors
On Tue, Jan 11, 2011 at 04:44:01PM +0100, Luca Barbieri wrote:> document id 746 in value chunk is larger than get_last_docid() 490 > postlist table errors found: 255 > > I've re-created the 1.1.3 database WITHOUT the values that I add to > documents during the indexing (with the document.add_value) > and in this case the conversion creates a database without errors.It looks like it isn't translating the keys for the value chunks properly. Shouldn't be hard to fix. Do you have a small 1.1.3 database with values in handy, to save me having to build 1.1.3 myself? Cheers, Olly