Displaying 6 results from an estimated 6 matches for "set_stopper".
2010 Sep 01
8
FIXMEs in Search::Xapian
Carrying on this conversation:
http://lists.tartarus.org/pipermail/xapian-discuss/2007-March/003513.html
void
TermGenerator::set_stopper(stopper)
Stopper * stopper
CODE:
// FIXME: no corresponding SvREFCNT_dec(), but a leak seems better
than
// a SEGV!
SvREFCNT_inc(ST(1));
THIS->set_stopper(stopper);
It would be good to fix these FIXMEs.
A class-level HASH could be maintained of contained objects.
Any o...
2008 Mar 12
1
how can i use stopwords?
...Search::Xapian::Stem(german2);
$self->{'Stopper'} = new Search::Xapian::SimpleStopper();
$self->{'TermGenerator'} = new Search::Xapian::TermGenerator;
$self->{'TermGenerator'}->set_stemmer( $self->{'Stemmer'} );
$self->{'TermGenerator'}->set_stopper( $self->{'Stopper'} );
I've thought that xapian now exclude the stopwords automatic by the stemming-language.
Could someone explain the stopword function?
Thanks.
Greetings
Sascha
2010 Apr 05
1
Problem with stop words by indexing
...e but it does not work at all.
I have my writableDatabase and my termGenerator (indexer) and they work
well both together: I can index texts and search trough the database
correctly.
But if I add (before indexing my texts):
Xapian::SimpleStopper stopper;
stopper.add("testword");
indexer.set_stopper(&stopper);
... the result is exactly the same as before. I have checked with delve
and "testword" is indexed.
Do I use the SimpleStopper in a right way?
Regards
Emmanuel
2010 May 27
1
Problem with stop words by indexing
...Generator
> (indexer) and they work
> well both together: I can index texts and search
> trough the database
> correctly.
> >
> > But if I add (before indexing my texts):
> > Xapian::SimpleStopper stopper;
> > stopper.add("testword");
> > indexer.set_stopper(&stopper);
> >
> > ... the result is exactly the same as before. I have
> checked with delve
> and "testword" is indexed.
>
> http://article.gmane.org/gmane.comp.search.xapian.general/7571
> Looks like I failed to add that note to the API docs - now done....
2012 Jun 04
1
Search not finding queries with stop words.
...= Search::Xapian::Document->new();
my $indexer = Search::Xapian::TermGenerator->new();
my $stemmer = Search::Xapian::Stem->new('english');
$doc->set_data($jsonText);
$indexer->set_stemmer($stemmer);
$indexer->set_stopper($stopper);
$indexer->set_document($doc);
$indexer->index_text($docBody);
$indexer->increase_termpos();
$indexer->index_text($subject);
... (other index_text and add_value calls)
$xdb->add_document($doc);
If I look for...
2008 Mar 27
2
Proper noun stemming
Hi All
I was wondering if anyone had a solution for the following problem.
I user QueryParser to stem my documents before adding them to a
database. During the stemming process I would like to find a way of
keeping proper nouns that span two or more words together as a phrase.
For example "New York" or "Gordon Brown" or "Prime Minister" get spilt
up. I see