Xapian discuss - Nov 2006 - Performance of remote database

While I'm trying the remote database I found one problem: performance
While with local database I can insert "infinites" document per
second, with
remote database the average is 5, and I'm using my own ip to test it, the
same machine, then I think:
1 - The problem is with my network
2 - The problem is with the serializator of xapian
3 - The problem is with the xapian-tcpsrv in some place
4 - There are no problems, it's right

What could it be?

-- 
SDM Underlinux
Garimpar.com
--
PEP-8
S? existem 3 tipos de pessoas no mundo, as que sabem contar, e as que n?o
sabem.
CPFL - Compania Piratininga de FALTA de Luz (6 vezes em 5 dias!!)

On Tue, Nov 07, 2006 at 06:27:28PM +0000, Rafael SDM Sierra
wrote:
> While I'm trying the remote database I found one problem: performance
> While with local database I can insert "infinites" document per
second, with
> remote database the average is 5, and I'm using my own ip to test it,
the
> same machine, then I think:
>
> 1 - The problem is with my network
Try using "127.0.0.1" as the IP address to ensure you're using the
loopback interface.  That eliminates any effect from the network
itself (though the TCP stack is still involved).
> 2 - The problem is with the serializator of xapian
> 3 - The problem is with the xapian-tcpsrv in some place
It's quite possible that either of these are at fault - I've not
done any profiling work in remote writing yet.

Another thing to try is using xapian-progsrv instead of xapian-tcpsrv.
That will still be serialising documents and using the same remote
protocol, but across a pipe instead of a TCP socket.

If we can work out where the overhead is coming from, it'll be much
easier to address it.
> 4 - There are no problems, it's right
It's inevitably going to be slower to add documents to a remote
database, but 5 per second sounds much too slow to me, especially
as it's nowhere near as slow for a local database.

Cheers,
    Olly