similar to: Robust "online" xapian backup?

Hi. Is xapian-check aware of the uncommitted data that could be sitting in an xapian index if the indexer has crashed during indexing. Could errors be falsely reported by xapian-chek in this situation? -- Jesper

I'm one of the developers of Notmuch, an email client that makes extensive use of Xapian. For some time, full multi-version concurrency control (MVCC) has been on our wish list. Olly mentioned that brass now uses free lists---a key step toward full MVCC---and I offered to pitch in on putting the other pieces into place. Before I wade too deep into this, I wanted to propose my plan. Full

Hi. I want to back up a Xapian database. If I copy the database directory and its contents using (for instance) rsync, and I know that throughout the duration of the rsync process another process has had the database open for writing, but has not actually made any modifications, can I be sure that, on completion of the rsync process, I have a copy of the database which is consistent and fully

Hi list. I have a specific document that does not handle updates sitting in the index. What can I do about that? 2010-01-30T13:58:07 Eval failure: Exception: No termlist for document 287376 at /usr/lib/perl5/Search/Xapian/Enquire.pm line 56. 2010-01-30T13:58:07 job failed. considering retry. is max_retries of 1000 >= failures of 1? 2010-01-30T13:58:07 job failed: Exception: No

Hi, I have read the concurrency webpage from the Xapian documentation: http://getting-started-with-xapian.readthedocs.io/en/latest/concepts/concurrency.html But it is still not clear to me how to ensure thread-safety when using libxapian (C++ API). Usually when doing multi-threading many threads can read the same variable concurrently without locking provided none of the threads modifies the

Hi! Suppose you have a huge notmuch/Xapian database, built on a 32-bit system (well, actually on x86_64-pc-linux-gnu, but using a years old 32-bit notmuch binary; notmuch 0.9, Xapian 1.2.21 -- don't laugh), and suppose you're finally going to update that years old notmuch installation (release by release, forward-porting a bunch of patches). Naturally, I'd now do a native 64-bit

On 8 Feb 2018, at 15:18, Kim Walisch <kim.walisch at gmail.com> wrote: > I have read the concurrency webpage from the Xapian documentation: > > http://getting-started-with-xapian.readthedocs.io/en/latest/concepts/concurrency.html > > But it is still not clear to me how to ensure thread-safety when using > libxapian (C++ API). > > 1) Can many thread search the >

Hi, We're looking to deploy Xapian as a search solution for a website that's run across a number of load-balanced web servers. However, I've not seen any clear indication in the documentation as to how it's recommended to operate Xapian in a load balanced / high availability configuration, or how to distribute the content-changes into the indexer. Has anyone got any particular

Hi all, I've been a Lucene user for the past year, but lately, with most of my project moving to Python, I really love Xapian's clean python binding. I can't seem to see how to boost a query term using Xapian's query syntax. In Lucene, there is "hello^4 world^.2" to boost "hello" and suppress "world". However, digging through Xapian's

Hi, The Perl module Search::Xapian's README file ends with these lines: ===================================================================== This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself. ===================================================================== (http://cpansearch.perl.org/src/OLLY/Search-Xapian-1.2.4.0/README) But

Hello everyone, I'm using Xapian at work (PHP bindings) and I have to make it accept '##' as a term to index. We have a layer on top of xapian, but as far as I can tell, Xapian's QueryParser is removing them from the query. So, if I search for just '##' I get an empty query, after Xapian parsed it. I've seen the flags this class accepts, but I can't do what I want

Hello all, Well, my local mirror now has CentOS 5.6! Yay! But, I cannot get it to install. A "yum update" and a "yum --skip-broken" yields me this: --> Processing Conflict: firefox conflicts xulrunner >= 1.9.2.14 --> Finished Dependency Resolution firefox-3.6.13-2.el5.centos.i386 from installed has depsolving problems --> firefox conflicts with xulrunner

I've uploaded Xapian 1.0.18 (including Search::Xapian 1.0.18.0), which as usual you can download from: http://xapian.org/download The most notable changes in this release are: QueryParser: * Improve support for languages such as Burmese which use Unicode enclosing mark and combining spacing mark characters. Flint backend: * When updating documents, don't update posting entries

In other words, is it possible to avoid duplicates if new documents are inserted into the DB by another process in-between ->get_mset calls when reusing Xapian::Enquire objects? I do some expensive processing on each mset window, so I always limit the results to limit heap usage even if I'm planning on going through a big chunk of the DB: $mset = $enq->get_mset(0, 1000);

Ok, but suppose I have a complex query, something like "(a OR b) AND NOT c OR ##". Do I have to parse the query by myself? > Date: Mon, 4 May 2015 03:03:24 +0100 > From: olly at survex.com > To: lautaromedrano at hotmail.com > CC: xapian-discuss at lists.xapian.org > Subject: Re: [Xapian-discuss] Make Xapian accept all characters > > On Sun, May 03, 2015 at

Olly Betts <olly at survex.com> wrote: > On Fri, Aug 18, 2023 at 10:41:52AM +0000, Eric Wong wrote: > > Olly Betts <olly at survex.com> wrote: > > > While the match is running, get_mset(2000, 1000) needs to track > > > 3000 entries so this won't reduce your heap usage (at least not > > > peak usage). > > > > > > Is the heap

On Thu, Aug 17, 2023 at 09:28:26PM +0000, Eric Wong wrote: > In other words, is it possible to avoid duplicates if new > documents are inserted into the DB by another process in-between > ->get_mset calls when reusing Xapian::Enquire objects? The Database object itself effectively does (it works in a snapshot of the state of the database when you open it, or last called reopen() which

Hello, I am student from University of Science and Technology in Cracow. I would like to ask you some questions about Xapian, because it is one of few search engines I am testing. 1. What type of stemmer is used in Xapian? Are You able to write some important features applied to Xapian? 2. We must use stemming for polish language. I read on Your webpage what languages include Xapian. There is no

Hi all, Today I just cloned Xapian and Xapian-Docsprint from your GitHub repos and was working through the practical example in Python in your Getting Started with Xapian 1.2 guide. However after the index was generated, I wasn't able to inspect it with delve because the command was not found. My system set-up is a fresh install of Debian 7.8.0 as a virtual machine under Virtual Box, and I

Greetings, I've been wondering about the index format and backwards compatibility. We're using the dev version (for chert) and each svn up means that any indexes created prior to this revision cannot be read. Is this purely a cautious move to prevent errors, and, barring any obvious index format changes, can I safely force the current revision to read existing indexes? eg, by