Grzegorz Bogdanowicz
2007-Jan-30 09:41 UTC
[Xapian-devel] Re: [Xapian-commits] 7603: trunk/xapian-core/trunk/xapian-core/backends/flint/ trunk/xapian-core/backends/quartz/
hi, I'm using Xapian on Windows with large files. My index directory is about 65 607 466 693 bytes: 2007-01-30 09:28 17 position_baseA 2007-01-30 10:06 17 position_baseB 2007-01-23 14:18 0 position_DB 2007-01-30 10:06 360 496 postlist_baseB 2007-01-30 10:06 23 623 852 032 postlist_DB 2007-01-30 10:06 88 432 record_baseB 2007-01-30 10:10 5 825 560 576 record_DB 2007-01-30 10:06 550 103 termlist_baseB 2007-01-30 10:10 36 157 054 976 termlist_DB 2007-01-30 09:28 17 value_baseA 2007-01-30 10:06 17 value_baseB 2007-01-23 14:18 0 value_DB 14 file(s) 65 607 466 693 bytes Everything works fine. Regards, Grzegorz Dnia 29-01-2007 o godz. 18:31 Charlie Hull napisa?(a):> Olly Betts wrote: > > On Tue, Jan 02, 2007 at 03:55:59PM +0000, richard wrote: > >> * backends/quartz/btree.cc,backends/flint/flint_io.h: Patches from > >> Charlie Hull to allow 2GB+ index files work when compiled using > >> Visual C++. > > > > I suspect that xapian-compact.cc (and quartzcompact.cc if you can be > > bothered) will also need fixing since they use off_t. You need to make > > sure that the stat() function called works for 2GB+ files. Without this > > compression statistics don't get reported for such files. > > > > Cheers, > > Olly > > > > I've produced patches for xapian-compact.cc, quartzcompact.cc and > quartzcheck.cc (enclosed). Unfortunately I don't have any way of quickly > testing them here but we should soon have some kind of Xapian test > framework on Windows, complete with huge files, so I'll do it then. > > Charlie >---------------------------------------------------- Im wcze?niej tym taniej! LATO 2007 ju? w sprzeda?y - Kliknij: http://klik.wp.pl/?adr=http%3A%2F%2Fadv.reklama.wp.pl%2Fas%2Fd56.html&sid=1007
Charlie Hull
2007-Jan-30 09:54 UTC
[Xapian-devel] Re: [Xapian-commits] 7603: trunk/xapian-core/trunk/xapian-core/backends/flint/ trunk/xapian-core/backends/quartz/
Grzegorz Bogdanowicz wrote:> hi, > > I'm using Xapian on Windows with large files. My index directory is about 65 607 466 693 bytes: > > 2007-01-30 09:28 17 position_baseA > 2007-01-30 10:06 17 position_baseB > 2007-01-23 14:18 0 position_DB > 2007-01-30 10:06 360 496 postlist_baseB > 2007-01-30 10:06 23 623 852 032 postlist_DB > 2007-01-30 10:06 88 432 record_baseB > 2007-01-30 10:10 5 825 560 576 record_DB > 2007-01-30 10:06 550 103 termlist_baseB > 2007-01-30 10:10 36 157 054 976 termlist_DB > 2007-01-30 09:28 17 value_baseA > 2007-01-30 10:06 17 value_baseB > 2007-01-23 14:18 0 value_DB > 14 file(s) 65 607 466 693 bytes > > Everything works fine. > > Regards, > Grzegorz >Hi Grzegorz, Are you able to test quartzcheck, quartzcompact or xapian-compact with your large datasets? This will depend on which database type you're using, but any results would be great. Charlie