Xapian discuss - Apr 2010 - what about the efficiency of building indexes

hi,all
     l am a newer to xapian,and l builds indexes for three million pages
recently,but lt takes about seven days ,l am a bit of confusing
about the efficiency of building indexes with xapian,so please give me some
information about xapian efficiency of building indexes,thanks a lot.

Hi clnju,

It's impossible to say where the problem is without more information.
Are you using omindex or an application you have written yourself?
What types of files are you indexing? What OS and hardware are you
using, and are there other resource-hungry systems running on the same
host? Have you tried profiling the indexer to find out where it's
spending most of its time?

One thing that has a big impact on indexing performance is how often
you are flushing/committing changes. You should generally do this as
infrequently as possible. Flushing after every document will make
things run very slow.

cheers,
Tom

On 26 April 2010 03:50, clnju <clnju at 126.com>
wrote:
>
> hi,all
> ? ? l am a newer to xapian,and l builds indexes for three million pages
recently,but lt takes about seven days ,l am a bit of confusing
> about the efficiency of building indexes with xapian,so please give me some
information about xapian efficiency of building indexes,thanks a lot.
>
>
> _______________________________________________
> Xapian-discuss mailing list
> Xapian-discuss at lists.xapian.org
> http://lists.xapian.org/mailman/listinfo/xapian-discuss
>