search for: stemmer

hi, i am newbie to xapian and am trying to get started with it in python. there is no stemmer.stem_word method in the latest python library. how do i stem words before doing doc.add_posting? is there any sample hello world code in python that i can use? thanks a lot! >>> stemmer = xapian.Stem('english') >>> stemmer. stemmer.__call__ stemmer.__redu...

Hi, I configured XAPIAN 1.0.1 and OMEGA 1.0.1. on my development machine (first removed the old ones). I recreated my databases (both quartz and flint) and tried to run original queries against the databases created by the new versions. I'm getting empty result sets from OMEGA. If I use the delve tool I actually see that the records are created fine. No log files are written as far as I

Hello Xapian devs, -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.xapian.org/pipermail/xapian-devel/attachments/20150210/c848e9b7/attachment-0002.html>

Hi, In the documentation of FTS lucene, I need little more clarification about this section: -------------------------------------------------- --with-lucene --with-stemmer The second switch is only required if you have compiled libstemmer yourself or if it's included in the CLucene you are using. -------------------------------------------------- I am totally unsure but as I understand, on Debian testing, the stemmer support for libclucene comes as part of libc...

...... Running test: topercent2...FAIL: apitest Running test './internaltest' under eatmydata and valgrind PASS: internaltest Running test './stemtest' under eatmydata and valgrind The random seed is 42 Please report the seed when reporting a test failure. Running tests with armenian stemmer... Running test: stemdict... SKIPPED Running tests with basque stemmer... Running tests with catalan stemmer... Running test: stemdict... SKIPPED Running tests with danish stemmer... Running tests with dutch stemmer... Running tests with earlyenglish stemmer... Running test: stemdict... SKIPPE...

I'm using Xapian as a search back-end on a website. My client has certain search terms that the stemmer does not stem in a way they would like. For example "continuity" stems to "continu", which produces undesirable results in their application. Is there a way to override the stemming of certain words in a way that is compatible with the indexing stemmer and the query parser stemm...

...pped. ./apitest total: 702 tests passed, 6 failed, 20 skipped. FAIL: apitest Running test: serialisedouble1... FAILED 1 -> 0, difference = -1 FLT_RADIX = 2 DBL_MAX_EXP = 1024 FAIL: internaltest The random seed is 42 Please report the seed when reporting a test failure. Running tests with danish stemmer... Running test: stemdict... SKIPPED Running tests with dutch stemmer... Running test: stemdict... SKIPPED Running tests with english stemmer... Running test: stemdict... SKIPPED Running tests with finnish stemmer... Running test: stemdict... SKIPPED Running tests with french stemmer... Running tes...

...pped. ./apitest total: 702 tests passed, 6 failed, 20 skipped. FAIL: apitest Running test: serialisedouble1... FAILED 1 -> 0, difference = -1 FLT_RADIX = 2 DBL_MAX_EXP = 1024 FAIL: internaltest The random seed is 42 Please report the seed when reporting a test failure. Running tests with danish stemmer... Running test: stemdict... SKIPPED Running tests with dutch stemmer... Running test: stemdict... SKIPPED Running tests with english stemmer... Running test: stemdict... SKIPPED Running tests with finnish stemmer... Running test: stemdict... SKIPPED Running tests with french stemmer... Running tes...

Hi, is there a xapian stemmer suitable for polish or czech languages? Thanks, Torsten

Hi! I am going to use non-snowball russian stemmer with Xapian. There is a good one at http://www.aot.ru. I've found that current implementation of Xapian::Stem does not allow it (there is no public interface for Xapian::Stem::Internal). Do you apply patches? Are there any recommendations for writing patches? Regards, Oleg Obolenskiy high...

Hello, As mentioned on the project ideas page, Adding more support for stemmer algorithm, i found an implementation of Krovetz Stemmer Algo in C++ but before working on it to merge it into xapian, i needed help in recognizing the license information associated with the source code. To avoid further licensing issues kindly someone check the link http://sourceforge.net/p/le...

Hello xapian devs, I had shown interest in writing a krovetz stemmer for xapian and spoke to James Aylett about it. Since it was hard to code the stemmer in snowball, I came up with a C++ implementation of the stemmer. But since it is a dictionary based stemmer, im having problems on deciding how to create the dictionary. I did check out some of the implementations...

Hello, I am student from University of Science and Technology in Cracow. I would like to ask you some questions about Xapian, because it is one of few search engines I am testing. 1. What type of stemmer is used in Xapian? Are You able to write some important features applied to Xapian? 2. We must use stemming for polish language. I read on Your webpage what languages include Xapian. There is no polish. I would like You to tell how can I include polish language to Xapian's stemmer or create a n...

...o licenses both being the implementation of porter > > but our xapian use implementation in snowball which i assume is > > under GPL. The only cases I can think you might be referring to are two different submissions of patches based on Andy Stark's implementation of the Paice/Husk stemmer (not the Porter stemmer). The problem there is that this implementation has no explicit licence, which means we simply can't use it: http://www.gnu.org/licenses/license-list.html#NoLicense Cheers, Olly

Hey guys Hi :) I've implemented a PaiceHusk stemmer externally So what I am doing right now is passing a pointer to my StemPaiceHusk class(which in turn has been subclassed from Stemimplementation) to the Stem::Stem(StemImplementation *p) constructor .So basically,I have to include "paicehusk.h" in my indexer .However,I now want to make...

...ing errors : - First time: Error in .jnew(name) : java.lang.InternalError: Can't start the AWT because Java was started on the first thread. Make sure StartOnFirstThread is not specified in your application's Info.plist or on the command line Refreshing GOE props... - Second time: Stemmer 'porter' unknown! Stemmer 'english' unknown! Stemmer 'porter' unknown! Stemmer 'english' unknown! Stemmer 'porter' unknown! Stemmer 'english' unknown! Stemmer 'porter' unknown! Stemmer 'english' unknown! Stemmer 'porter' unknow...

Hi, I'm using Xapian bindings for Python in my project. How could I use a custom stemmer instead of the included one (Snowball)? The one I'm looking at right now is Hunspell (http://hunspell.sourceforge.net/) which has Python bindings (http://code.google.com/p/pyhunspell/). Thanks in advance, Eugene

Hi everyone, I was working on the Paice-Husk Stemmer, which is a Bite Size Project for Xapian, and I have created a C++ as well as Snowball version of it. I read the algorithm, and picked the rules from here: http://www.comp.lancs.ac.uk/computing/research/stemming/paice/descript.htm The C++ code takes rules as input from a file and generates the st...

...Running test: positfromtermit1... SKIPPED ./apitest backend remotetcp_flint: All 207 tests passed, 2 skipped. ./apitest total: All 2785 tests passed, 43 skipped. PASS: apitest PASS: internaltest The random seed is 42 Please report the seed when reporting a test failure. Running tests with danish stemmer... Running test: stemdict... SKIPPED Running tests with dutch stemmer... Running test: stemdict... SKIPPED Running tests with english stemmer... Running test: stemdict... SKIPPED Running tests with finnish stemmer... Running test: stemdict... SKIPPED Running tests with french stemmer... Running...

I've noticed some strange results from the stemmer in the Ruby port: irb(main):003:0> @stem.stem_word("anybody") => "anybodi" irb(main):004:0> @stem.stem_word("swimmingly") => "swim" irb(main):005:0> @stem.stem_word("fiercely") => "fierc" irb(main):006:0> @stem.stem_w...