Displaying 20 results from an estimated 2000 matches similar to: "Searching without flush?"
2004 Jul 13
2
Multithread problem: Writing to a db disables reading from another one
Hi to all,
I have Xapian 0.8.1 installed on a single processor RH9 machine with a custom 2.4.20 kernel.
(I used ./configure without parameters.)
I have followed the recent "threaded test" discussion here, and I have tested the examples:
- Richard Boulton's example with one database, one writer, and three readers (1)
works fine, I only see the expected DatabaseModifiedError.
- Eric
2009 Jun 02
3
search without flush.
Hi,
Is it possible to perform a search without flushing the index? I've got
an application that updates the index every 4 hours but I need to be
able to search the new data fairly quickly after the index is updated.
The problem revolves around the fact that the update is often much less
than 10 000 documents so it isn't being flushed until quite a bit
latter. I realise I can do a flush
2009 Dec 23
1
flush() definitely required before close()
Greets,
WRT this discussion:
http://lists.xapian.org/pipermail/xapian-discuss/2009-November/007300.html
Richard recommends calling flush() before closing a index database
segment, etc. Well, I can confirm that calling flush() is *required*
before calling close() since close() on it's own does not commit/flush any
pending writes/whatever unless the Perl script terminates, etc.
So, for a
2004 Jul 19
2
large Xapian index files
Hello Arjen van der Meijden,
on xapian-discuss you mentioned that your Xapian installation has got up to
15 GB database size. Can you tell me about the largest index filesize you got?
According to <http://xapian.org/docs/scalability.html>, it seems that the
quartz database filesize is limited only by the OS and file system. Can you
confirm from your experience that there is no 2GB limit?
2007 Feb 07
2
My new record: Indexing 20 millions docs = 79m9.378s
Gentoo Linux 2.6
8 AMD Opteron 64-bit Processors
32GB Memory
--------------------------------------------------------------------------------
Environment:
------------------
XAPIAN_FLUSH_THRESHOLD=21000000
XAPIAN_FLUSH_THRESHOLD_LENGTH=16000000
XAPIAN_PREFER_FLINT=True
Indexing 20 million documents:
--stemmer=none
-------------------------------------------
real 79m9.378s
user 77m28.696s
2014 Feb 13
2
A beginner in "Posting list encoding improvements"
I uninstall xapian1.3 and install xapian-1.2.17
but i still failed
hurricanetong at hurricanetong-VirtualBox:~/workspace$ g++ `xapian-config --cxxflags --libs` demo2.cc
/tmp/cc2wsfDJ.o: In function `main':
demo2.cc:(.text+0x4a): undefined reference to `Xapian::WritableDatabase::WritableDatabase(std::basic_string<char, std::char_traits<char>, std::allocator<char> >
2004 Jun 15
1
QueryParser memory leak?
Hi Olly,
valgrind showed me what seems to be a memory leak:
QueryParser owns the Stopper and Stem instances it points to (since it
deletes them e.g. in set_stemming_options), but it does not delete them
at destruction.
(Btw., I don't test before deleting, but maybe "delete 0;" does not work
on all platforms?)
--
Robert Pollak
GPG Key ID: 748646AD
-------------- next part
2004 May 11
2
"Error reading block xxx: got end of file"
Xapian (0.7.5) is spitting out this error on a regular basis:
org.xapian.errors.DatabaseError: Error reading block 136618: got end of=20=
file
=A0=A0=A0=A0=A0=A0=A0 at=20
org.xapian.XapianJNI.writabledatabase_repalce_document(Native Method)
=A0=A0=A0=A0=A0=A0=A0 at=20
org.xapian.WritableDatabase.replaceDocument(WritableDatabase.java:67)
I don't have a gdb backtrace, only the Java
2007 Jun 19
2
Deleted documents not deleted
I seem to be seeing cases where I call db.delete_document(somedocid) with
no error, then flush() and delete the database object, but the document is
still there after process exit. The write lock is normally deleted, so it
appears that the database close finished normally.
If I then then call delete_document(somedocid) from another
command/process, this time it goes away.
I've been seeing
2005 Mar 16
2
How to concatenate time series?
Hello,
I have just completed first experiments in using R, especially creating and
using ARIMA models, e.g.
# create a model as in example(arima)
fit <- arima(USAccDeaths, order = c(1,1,1),seasonal = list(order=c(1,1,1)))
# use the model to generate a prediction
dp<-predict(fit, n.ahead = 24)
plot(dp$pred) # view the prediction
Now I created a combined chart of the original and
2014 Feb 13
2
回复: A beginner in "Posting list encoding improvements"
I think what i did is the same with you except i use make rather than make -sj8, and I did as root.
And I do as you wrote again:
root at hurricanetong-VirtualBox:/home/hurricanetong/xapian-1.2.17/xapian-core-1.2.17# ./configure
[...]
root at hurricanetong-VirtualBox:/home/hurricanetong/xapian-1.2.17/xapian-core-1.2.17# make -sj8
Making all in .
Making all in docs
Making all in tests
root at
2017 May 17
2
Xapian 1.4.3 "Db block overwritten - are there multiple writers?"
Hi,
I have a user reporting the following error during recoll indexing:
flush() failed: Db block overwritten - are there multiple writers?
"flush() failed" is from recoll, the rest is, I think the text of the Xapian
exception.
This is with Xapian 1.4.3 on Linux (I asked for more details, should be
coming).
I don't think that I've ever seen this error, and I also
2014 Jun 19
2
About memory index/search in multithread program
hi,
Why xapian don't support memory index/search ?
I know there is a method can create memory datebase, like this:
Xapian::WritableDatabase db(Xapian::InMemory::open());
*But, if i use these in multithread program, i need create many
datebases!!*
Xapian::WritableDatabase db1(Xapian::InMemory::open()); //used in thread1
Xapian::WritableDatabase db2(Xapian::InMemory::open()); //used in
2007 Dec 13
1
Omega datevalue search fails during scriptindex flush
Hi,
I'm experiencing weird behaviour in Xapian/Omega.
Here's my situation:
* I'm indexing data through scriptindex, the output is as follows:
*****************
Replace: 6706476
Replace: 6706477
Replace: 6706478
*****************
Since there is no output after entering several enters, I assume scriptindex is indexing data.
* The search I perform on omega is as follows:
2016 Feb 22
3
Database left unlocked by Tcl bindings
On Sun, 21 Feb 2016 22:33:22 +0000, Olly Betts <olly at survex.com> wrote:
> On Sun, Feb 21, 2016 at 02:15:25PM +0100, Eric J wrote:
> > I discovered, while trying to set up Tcl bindings for Notmuch
> > (https://notmuchmail.org/), which uses Xapian, that flintlock was not
> > being locked (I had lost updates).
>
> It seems to work for me, testing with this:
>
2015 Oct 28
2
Trying to get Search::Xapian perl module to compile on win32
Resurrecting an old thread from 2012! Finally got back to working on this. I have been stuck in JavaScript land for too long.
Come to find out, on windows, perl does indeed define open to be win32_open and close to be win32_close. This is done in perl/lib/CORE/win3iop.h. So, to get past this problem, I had to modify Xapian.xs to do an #undef of open and close if WIN32 is defined.
Also, I had
2007 Aug 09
2
Closing a DB
Hi,
As part of my whole indexing thing, I want to move the databases
around, from within the code. So, I figured that the safest bet
would be to close the DB before attempting to move it.
But there's no Xapian::Database::close() or even
Xapian::WritableDatabase::close().
I have a global variable that holds the database, and I open it
in the main():
// globals
Xapian::WritableDatabase
2001 Aug 11
1
2.4.8
Any idea of a timeframe for a 2.4.8 ext3 patch release? I tried patching
the 2.4.8 tree from ext3 CVS, but the kernel source files didn't end up
nice enough to successfully compile.
--
___ ___
/ _ | / _ \ Ari Pollak - ari@aripollak.com - www.aripollak.com
/ __ |/ ___/
/_/ |_/_/ NAVY: Never Again Volunteer Yourself
2002 Sep 23
2
Trouble with Windows 2000 sp3
Hello,
I work in a development shop where we write code for both Linux and Windows,
and develop on both OS's on a codebase stored on a Linux drive with Samba
shares. Ever since I 'upgraded' my Windows 2000 system to service pack 3, I
have been having trouble compiling my code with Visual Studio over this Samba
connection.
Basically what happens is that Visual Studio reports
2005 Apr 08
3
Database Locking
Locking of Quartz databases is currently done with a lockfile. This
works well from the actual locking side, but the downside is that
the lock isn't released if a process doesn't destroy the
Xapian::WritableDatabase object. This is made worse because some
of the bindings don't call destructors (or don't do it reliably).
The obvious alternative is to use actual locking APIs. On