Hurricane Tong
2014-Feb-16 14:19 UTC
[Xapian-devel] how to index with different type of database
Hi, I'm trying to build a benchmark database indexing some documents from wikipedia. I want to index these documents with flint, chert and brass, to learn the difference of their performance in searching, as you did in #326. But I don't find some parameters of omindex to change the type of database, or some useful API. To realize this, must I modify the source code of Omega, or indexing with old version Xapian ? Cheers. ------------------ HurricaneTong,Second Year Undergraduate, School of Computer Science, Fudan University, China. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.xapian.org/pipermail/xapian-devel/attachments/20140216/2894a493/attachment-0002.html>
Olly Betts
2014-Feb-16 20:16 UTC
[Xapian-devel] how to index with different type of database
On Sun, Feb 16, 2014 at 10:19:05PM +0800, Hurricane Tong wrote:> I'm trying to build a benchmark database indexing some documents from > wikipedia. I want to index these documents with flint, chert and > brass, to learn the difference of their performance in searching, as > you did in #326.I wouldn't bother looking at flint (and flint is gone on trunk, which is the branch where you should be doing new development, such as GSoC projects). Also, brass on trunk has some changes over brass in 1.2 - the biggest is that positional data is now stored with a different key order, which speeds up phrase searching significantly.> But I don't find some parameters of omindex to change > the type of database, or some useful API. To realize this, must I > modify the source code of Omega, or indexing with old version Xapian ?You can set environmental variable XAPIAN_PREFER_BRASS to a non-empty value (and ensure it's exported so it's passed to the process) to get brass used by default. You can do this just for one run like so: XAPIAN_PREFER_BRASS=1 omindex [...] Or set it as a default (for the current shell): export XAPIAN_PREFER_BRASS=1 And then just run omindex as before: omindex [...] Note that this only affects creating a new database - if the database already exists, it won't try to change its type. Cheers, Olly