similar to: A xapian problem

Hello, I am trying to rebuild an index of 2+ million documents and have not been successful. I am running Python 2.7 Django 1.7 Haystack 2.1.1 Xapian 1.2.21 The index rebuild command I’m using is: django-admin.py rebuild_index --noinput --batch-size=100000 The rebuild completes but an immediate xapian-check returns this error: xapian-check ./archive_index record: baseB blocksize=8K

Hi Olly, Thanks for the detailed response. I hadn’t realized there was a new xapian haystack backend. I’m going to try that but I have some upgrades to do first. Django 1.8, etc. Thanks, Ryan > On Feb 28, 2017, at 3:40 PM, Olly Betts <olly at survex.com> wrote: > > On Mon, Feb 27, 2017 at 10:29:46AM -0800, Ryan Cross wrote: >> I am trying to rebuild an index of 2+

Hi there, My web app uses Xapian via the PHP bindings. I'm getting this error thrown occasionally when atempting to instantiate a XapianDatabase object for searching. DatabaseCorruptError: Expected block 107 to be level 1, not 0 Here's the line that invokes it: $database = new XapianDatabase(PROJROOT.'/data/xapian/posts'); And my version is xapian-core 1.2.3 with matchspy.

Ocassionally when I'm searching using Omega I get: "DatabaseCorruptError: Cannot open tables at consistent revisions" If I click reload it's all ok, is this the database being updated?, is there a way to avoid the message? Frank

Hello, I'm having a litle issue with Xapian-1.0.6 with php bindings under php5 when trying to add a new document it throws: Fatal error: Uncaught exception 'Exception' with message 'DatabaseCorruptError: Failed to unlink /var/lib/xapian/trade.ar/termlist.baseA: No such file or directory' in /usr/share/php5/xapian.php:1140 Stack trace: #0 /usr/share/php5/xapian.php(1140):

Matt <mattator at gmail.com> writes: > thanks didn't know about xapian-check ! > the output > === > docdata: > blocksize=8K items=70 firstunused=3 revision=421 levels=0 root=2 > B-tree checked okay > docdata table structure checked OK > > termlist: > blocksize=8K items=186136 firstunused=62058 revision=421 levels=2 root=12260 > B-tree checked okay >

Hello, I noticed a problem with DatabaseCorruptError exceptions with public-inbox and I guess it's user error... The problem is public-inbox was calling replace_document to modify the DB while iterating through a PostingIterator. At first I thought it was a glass problem, but I've hit it with chert on my dataset, too. I have a standalone Perl script to reproduce the problem at

I am getting this error when trying to remove a document from my Xapian database via writabledatabase_delete_document: "DatabaseCorruptError: Db block overwritten - are there multiple writers?" There might have been two processes trying to write to it earlier today, but currently only one process can touch it at a time, and I still receive the error. Is there a fast way to fix this

Hello, Since the migration to xapian 1.4.X and the migration to Glass, i've recurrent database corruption errors. I've to reindex my database to make it works again. > DatabaseCorruptError: Expected block 200713 to be level 2, not 1 Theses problems always occur after this error: > xapian.DatabaseCorruptError: Db block overwritten - are there multiple writers? I've

Greets, When merging lots of subindexes in batches like so: xapian-compact -m idx1 idx2... dstidx Errors such as: xapian-compact: DatabaseError: Error reading block 0: got end of file present a problem since it does not provide the offending path name (of the broken index) for easy identification/removal in automated/batch scenarios (the way DatabaseOpeningError:.... does, eg). The only way

Please keep conversations on-list so that everyone can help and benefit :-) On Sun, Jul 29, 2007 at 09:15:01PM +0800, Hightman(???) wrote: > James Aylett,??? > > Even if I split the two operator into different transaction one > after another, It cause DatabaseModifiedError Also ... It seems > that if I update one document by unique term frequently (within >

On Tue, Apr 07, 2020 at 05:21:47PM -0300, David Bremner wrote: > Matt <mattator at gmail.com> writes: [...] > > termlist: > > blocksize=8K items=186136 firstunused=62058 revision=421 levels=2 root=12260 > > B-tree checked okay > > termlist table structure checked OK > > > > postlist: > > blocksize=8K items=2598971 firstunused=61412 revision=421

On Mon, Feb 27, 2017 at 10:29:46AM -0800, Ryan Cross wrote: > I am trying to rebuild an index of 2+ million documents and have not been successful. I am running > > Python 2.7 > Django 1.7 > Haystack 2.1.1 > Xapian 1.2.21 > > The index rebuild command I’m using is: django-admin.py rebuild_index --noinput --batch-size=100000 > The rebuild completes but an immediate

Hi Olly, After upgrades my stack is now: Python 2.7 Django 1.8 Haystack 2.6.0 Xapian 1.4.3. (latest xapian haystack backend with some modifications) Using the same rebuild command as below but with —batch-size=50000 The issue has now become one of performance. I am indexing 2.2 million documents. Using delve I can see that performance starts off at about 100,000 records an hour. This is

Sorry if this is a repost .. I have edited my query a little bit and my previous post was too long and so was waiting approval(I cancelled it) Ok. Another question.. I have installed the Search ::Xapian on my local machine. Now I'm trying to install it on a machine where i dont have root access. So while running configure of the Xapian library I gave the -prefix option and everything installed

I have tested compiling vmkit using gcc3.4 and gcc4.4 Some vmkit files required that I added some explicit typecasts and #includes in order to compile. I have attached my changes against the vmkit svn trunk rev 69439 Using this patch both versions of gcc managed to compiled vmkit on my machine. Cheers Xerxes -------------- next part -------------- An embedded and charset-unspecified text was

On Sat, Mar 25, 2017 at 06:36:25PM -0500, Ryan Cross wrote: > After upgrades my stack is now: > > Python 2.7 > Django 1.8 > Haystack 2.6.0 > Xapian 1.4.3. (latest xapian haystack backend with some modifications) > > Using the same rebuild command as below but with —batch-size=50000 > > The issue has now become one of performance. I am indexing 2.2 million >

Hi All, I was looking for a function to find a small matrix inside a larger matrix in R similar to the one described in the following link: https://www.mathworks.com/matlabcentral/answers/194708-index-a-small-matrix-in-a-larger-matrix I couldn't find anything. The above function can be seen as a "generalisation" of the "which" function as well as the function described

We have a bad bug in udev if compiled with klibc. I seems that the needle string can't have a strlen of 1. This test case illustrates it: #include <stdio.h> #include <string.h> int main(int argc, char *argv[], char *envp[]) { char *hay = "a/b"; char *needle = "/"; if (memmem(hay, strlen(hay), needle, strlen(needle)) == NULL) printf("This uses the

Applied thanks! http://lists.cs.uiuc.edu/pipermail/vmkit-commits/2009-April/000815.html Btw, what are the error messages for these? > - char * res = strstr(haystack, needle); > + char * res = (char *)strstr(haystack, needle); > - char* ptr = strrchr(name, '/'); > + char* ptr = (char*)strrchr(name, '/'); Nicolas Xerxes Rånby wrote: > I have tested compiling