Olly writes:>> xapian-check: DatabaseError: inflate failed (invalid distance too far back)> That's saying the zlib-compressed content is invalid.I was thinking that xapian-compact would write an index with valid content, but maybe the corruption in the original index tricked it.> Before investing a lot more effort into this, you could rename[...] I decided to give regenerating the index from scratch a go - I started it during the weekend, and it looks like it is "only" going to take around a week in total. So rather than wasting more of your time trying to decorrupt-at-a- distance, I will switch over to a new, freshly created glass index, hopefully later this week. Thanks for all the guidance and suggestions! Best regards, Adam -- "Yeah, in all those cloudy hours Adam Sj?gren When the demons seize my brain" asjo at koldfront.dk
On Wed, Nov 24, 2021 at 03:15:08PM +0100, Adam Sj?gren wrote:> I was thinking that xapian-compact would write an index with valid > content, but maybe the corruption in the original index tricked it.Compaction just copies a lot of the table entries as-is - it doesn't need to unpack and repack every entry to work, and it's much faster to just copy them. Sometimes keys need adjusting, and some "tags" (as they're called in the code) do too, but termlist table tags don't.> I decided to give regenerating the index from scratch a go - I started > it during the weekend, and it looks like it is "only" going to take > around a week in total. > > So rather than wasting more of your time trying to decorrupt-at-a- > distance, I will switch over to a new, freshly created glass index, > hopefully later this week.Sounds like a good plan. It should be significantly smaller and faster rebuilt for glass too. Cheers, Olly
Olly writes:> Compaction just copies a lot of the table entries as-is - it doesn't > need to unpack and repack every entry to work, and it's much faster > to just copy them.Ah, ok, makes sense!>> So rather than wasting more of your time trying to decorrupt-at-a- >> distance, I will switch over to a new, freshly created glass index, >> hopefully later this week. > > Sounds like a good plan. It should be significantly smaller and faster > rebuilt for glass too.It took a little longer than I predicted, but I've got the index rebuilt from scratch now. The new (glass) index is 1.2 TB on disk, while the old (chert) is 1.1 TB. Best regards, Adam -- "F?rst kom ingenting Adam Sj?gren Sen kom ingenting" asjo at koldfront.dk