Displaying 20 results from an estimated 10000 matches similar to: "Closing a DB"
2013 Jun 19
2
Compact databases and removing stale records at the same time
On Wed, Jun 19, 2013, at 03:49 PM, Olly Betts wrote:
> On Wed, Jun 19, 2013 at 01:29:16PM +1000, Bron Gondwana wrote:
> > The advantage of compact - it runs approximately 8 times as fast (we
> > are CPU limited in each case - writing to tmpfs first, then rsyncing
> > to the destination) and it takes approximately 75% of the space of a
> > fresh database with maximum
2014 Feb 13
2
回复: A beginner in "Posting list encoding improvements"
I think what i did is the same with you except i use make rather than make -sj8, and I did as root.
And I do as you wrote again:
root at hurricanetong-VirtualBox:/home/hurricanetong/xapian-1.2.17/xapian-core-1.2.17# ./configure
[...]
root at hurricanetong-VirtualBox:/home/hurricanetong/xapian-1.2.17/xapian-core-1.2.17# make -sj8
Making all in .
Making all in docs
Making all in tests
root at
2013 Jun 19
2
Compact databases and removing stale records at the same time
I'm trying to compact (or at least merge) multiple databases, while stripping search records which are no longer required.
Backstory:
I've inherited the Cyrus IMAPd xapian-based search code from Greg Banks when he left Opera.
One of the unfinished parts was removing expunged emails from the search database.
We moved from having a single search database to supporting multiple
2014 Feb 13
2
A beginner in "Posting list encoding improvements"
I uninstall xapian1.3 and install xapian-1.2.17
but i still failed
hurricanetong at hurricanetong-VirtualBox:~/workspace$ g++ `xapian-config --cxxflags --libs` demo2.cc
/tmp/cc2wsfDJ.o: In function `main':
demo2.cc:(.text+0x4a): undefined reference to `Xapian::WritableDatabase::WritableDatabase(std::basic_string<char, std::char_traits<char>, std::allocator<char> >
2014 Jun 19
2
About memory index/search in multithread program
hi,
Why xapian don't support memory index/search ?
I know there is a method can create memory datebase, like this:
Xapian::WritableDatabase db(Xapian::InMemory::open());
*But, if i use these in multithread program, i need create many
datebases!!*
Xapian::WritableDatabase db1(Xapian::InMemory::open()); //used in thread1
Xapian::WritableDatabase db2(Xapian::InMemory::open()); //used in
2016 Feb 22
3
Database left unlocked by Tcl bindings
On Sun, 21 Feb 2016 22:33:22 +0000, Olly Betts <olly at survex.com> wrote:
> On Sun, Feb 21, 2016 at 02:15:25PM +0100, Eric J wrote:
> > I discovered, while trying to set up Tcl bindings for Notmuch
> > (https://notmuchmail.org/), which uses Xapian, that flintlock was not
> > being locked (I had lost updates).
>
> It seems to work for me, testing with this:
>
2015 Oct 28
2
Trying to get Search::Xapian perl module to compile on win32
Resurrecting an old thread from 2012! Finally got back to working on this. I have been stuck in JavaScript land for too long.
Come to find out, on windows, perl does indeed define open to be win32_open and close to be win32_close. This is done in perl/lib/CORE/win3iop.h. So, to get past this problem, I had to modify Xapian.xs to do an #undef of open and close if WIN32 is defined.
Also, I had
2020 Aug 21
2
MultiDatabase shard count limitations
Going back to the "prioritizing aggregated DBs" thread from
February 2020, I've got 390 Xapian shards for 130 public inboxes
I want to search against(*). There's more on the horizon (we're
expecting tens of thousands of public inboxes).
After bumping RLIMIT_NOFILE and running ->add_database a bunch,
the actual queries seem to be taking ~30s (not good :x).
Now I'm
2018 Feb 27
1
modifying the DB while iterating is user error, right?
Hello, I noticed a problem with DatabaseCorruptError exceptions
with public-inbox and I guess it's user error...
The problem is public-inbox was calling replace_document to
modify the DB while iterating through a PostingIterator. At
first I thought it was a glass problem, but I've hit it with
chert on my dataset, too.
I have a standalone Perl script to reproduce the problem at
2016 Feb 24
4
Database left unlocked by Tcl bindings
On Wed, 24 Feb 2016 03:17:35 +0000, Olly Betts <olly at survex.com> wrote:
>On Mon, Feb 22, 2016 at 12:26:27PM +0100, Eric wrote:
>> On Sun, 21 Feb 2016 22:33:22 +0000, Olly Betts <olly at survex.com> wrote:
>>> On Sun, Feb 21, 2016 at 02:15:25PM +0100, Eric J wrote:
>>>> I discovered, while trying to set up Tcl bindings for Notmuch
>>>>
2005 Jul 15
2
Problem with Perl bindings (enquire)
Hello list,
looks like one can open a Xapian database in read-only mode and do the
following:
$db = Search::Xapian::Database->new("/foo/bar/");
$enq = $db->enquire("XIDblub");
the same doesn't seem to be possible with a database opened in read-write
mode:
$db = Search::Xapian::WritableDatabase->new("/foo/bar/",
2005 Apr 08
3
Database Locking
Locking of Quartz databases is currently done with a lockfile. This
works well from the actual locking side, but the downside is that
the lock isn't released if a process doesn't destroy the
Xapian::WritableDatabase object. This is made worse because some
of the bindings don't call destructors (or don't do it reliably).
The obvious alternative is to use actual locking APIs. On
2012 Jul 26
2
ruby bindings, ruby 1.9.3 and xapian
Hello,
I've problem with xapian or sth.
Ubuntu 8.04, ruby 1.9.3 with rvm, when Im trying to initialize
database, Im getting this error:
irb > require 'xapian'
==> true
irb > database = Xapian::WritableDatabase.new('/full_path/db/xapian_db/development', Xapian::DB_CREATE_OR_OPEN)
ArgumentError: Wrong arguments for overloaded method
2008 Nov 19
1
ruby xapian bindings and windows
Hi,
I've compiled xapian 1.0.9 (core and buildings) on Windows Xp, using
Lemur's nmake files[1].
I'm trying to use acts_as_xapian [2] on RubyOnRails, but I'm facing a
problem with the rebuild index process.
in acts_as_xapian, to rebuild the index, a new
Xapian::WritableDatabase is created with a different path, then
flush() is invoked; lastly, the new path is renamed to the old
2004 May 11
2
"Error reading block xxx: got end of file"
Xapian (0.7.5) is spitting out this error on a regular basis:
org.xapian.errors.DatabaseError: Error reading block 136618: got end of=20=
file
=A0=A0=A0=A0=A0=A0=A0 at=20
org.xapian.XapianJNI.writabledatabase_repalce_document(Native Method)
=A0=A0=A0=A0=A0=A0=A0 at=20
org.xapian.WritableDatabase.replaceDocument(WritableDatabase.java:67)
I don't have a gdb backtrace, only the Java
2012 Oct 02
1
Exception in thread "main" java.lang.UnsatisfiedLinkError: no xapian_jni in java.library.path
Hello
I am trying to use the java binding for xapian .
I am using ubuntu i have compiled the java binding and i got .so and .jar
file in build directory.
i tried to compiled the sample program from eclipse i get this exception
Exception in thread "main" java.lang.UnsatisfiedLinkError: no xapian_jni in
java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1681)
at
2007 Feb 04
1
Java Bindings on a Mac
I had to make some changes (sorry no diff available) to "configure" in
0.9.9 of the bindings so that I could compile them for OS X 10.4.8.
Essentially I replaced the the paths to jni.h with
/System/Library/Frameworks/JavaVM.framework/Headers. It compiled
without error and created both libxapian_jni.so and xapian_jni.jar in
the "built" subdirectory when I ran "make
2007 Dec 17
1
Crashes with spelling enabled and perl.
Hi Guys,
Here's a simple test case that causes a segfault with the perl
bindings patched to enable spelling correction:
use strict;
use warnings;
use Search::Xapian;
my $db = Search::Xapian::WritableDatabase->new("test.db",
Search::Xapian::DB_CREATE_OR_OPEN);
if (!defined($db)) {
die("Failed to open xapian_database: $!");
}
my $indexer =
2014 Jan 27
4
Perl Search::Xapian
Hi,
Trying to learn Search::Xapian and be better at perl at the same time,
I'm stuck, at the DB_CREATE_OR_OPEN error. Perl says this:
~/dev/sandbox/Xapian-perl$ ./Index1-Xap.pl 100-objects-v1.csv db
"db" is not exported by the Search::Xapian module
Can't continue after import errors at ./Index1-Xap.pl line 7.
BEGIN failed--compilation aborted at ./Index1-Xap.pl line 7.
What I
2015 Oct 29
4
Trying to get Search::Xapian perl module to compile on win32
The disclaimer automatically added and is not intended to limit legitimate discourse, and any code I write for this is expected to be licensed under whatever license the original work is using.
I haven't tried compiling latest code under visual studio yet (is this possible?). I wonder if there is a way to tell gcc to not mangle the names during cross compile. I was able to successfully