scriptindex is using well over 200MB of RAM to build our search index. Is this normal? If it is normal, is there anything I can do to reduce the memory usage? This is quickly going to become a problem from a resources standpoint. FYI, we are indexing around 20k items, 18k of which are active. The resulting data file that we build for scriptindex to process ends up at about 12MB. The sizes of the Xapian database files are: position: 147MB postlist: 88MB record: 7MB termlist: 65MB value: 1.5MB I can provide the indexer_script configuration file if that would help as well. Thanks! - Jim
On Fri, Nov 16, 2007 at 05:13:45PM -0500, Jim Spath wrote:> scriptindex is using well over 200MB of RAM to build our search index. > > Is this normal?I've not studied scriptindex's memory usage much, but that does sounds rather high given the reported size of the data. How are you measuring that memory usage? And what platform is this? And which Xapian version?> I can provide the indexer_script configuration file if that would help > as well.Please. Cheers, Olly