search for: termgenerator_internal

...lude/xapian/ base.h:154 #1 0xb7becf47 in Xapian::TermGenerator::Internal::index_text (this=0xa553970, itor= {p = 0xab2d69f " North Face Windwall 1 Jacket boys", end = 0xab2d6c1 "", seqlen = 1}, weight=3, prefix=@0xbff977ac, with_positions=true) at queryparser/termgenerator_internal.cc:207 #2 0xb7bebf0c in Xapian::TermGenerator::index_text (this=0x9b12d68, itor=@0xbff9779c, weight=3, prefix=@0xbff977ac) at queryparser/ termgenerator.cc:90 #3 0xb7c6b6d6 in XS_Search__Xapian__TermGenerator_index_text () from /usr/local/lib/perl5/site_perl/5.8.8/i686-linux/auto/Search/ Xa...

...ling (this=0x9d77de0, word=@0xbf846fa0, freqinc=1) at ./include/xapian/ base.h:154 #1 0x0032608a in Xapian::TermGenerator::Internal::index_text (this=0x9d77dc8, itor={p = 0x0, end = 0x9cb5db8 "", seqlen = 0}, weight=1, prefix=@0xbf84703c, with_positions=true) at queryparser/ termgenerator_internal.cc:207 #2 0x0032506c in Xapian::TermGenerator::index_text (this=0x9c94cd0, itor=@0xbf84702c, weight=1, prefix=@0xbf84703c) at queryparser/ termgenerator.cc:90 #3 0x0017100e in XS_Search__Xapian__TermGenerator_index_text (my_perl=0x9c78008, cv=0x9d7f7e8) at /usr/local/include/xapian/ termgen...

Hi, I'm using SimpleStopper with TermGenerator in a Python indexing script, in an attempt to keep my index size down (currently 30K per doc, and I have 200 million docs to index, which I think implies 6TB.) However, unprefixed (positional?) terms are not affected by the stopper, though Z-prefixed terms are. I assume this is intentional for phrase queries, but I need to reduce my

...rver.o net/.libs/replicatetcpclient.o net/.libs/replicatetcpserver.o net/.libs/serialise-error.o net/.libs/tcpclient.o net/.libs/tcpserver.o queryparser/.libs/cjk-tokenizer.o queryparser/.libs/queryparser.o queryparser/.libs/queryparser_internal.o queryparser/.libs/termgenerator.o queryparser/.libs/termgenerator_internal.o unicode/.libs/description_append.o unicode/.libs/unicode-data.o unicode/.libs/utf8itor.o weight/.libs/bb2weight.o weight/.libs/bm25plusweight.o weight/.libs/bm25weight.o weight/.libs/boolweight.o weight/.libs/coordweight.o weight/.libs/dlhweight.o weight/.libs/dphweight.o weight/.libs/ifb2weight....