On Fri, Jan 15, 2010 at 10:20:33PM -0800, Moazam Raja
wrote:> Hi all, has anyone used Xapian/Omega to index and search large amounts
> of (Unix) server logs?
I'm not aware of anyone doing it, but then a lot of people quietly use
Xapian without telling us what for so that doesn't mean much.
> I'm looking to create a search application which will allow me to
> index and search logs from roughly 20-100 servers but I'm not sure
> which engine to use that will provide near real time indexing and good
> search performance. Is this something that can be accomplished with
> Xapian/Omega?
I can't see why not. You probably want to make the "document" a
single logical
log entry (i.e. probably a single line in the log, but it might consist of
several lines logged at once in some log formats).
Cheers,
Olly