search for: tokenfilt

In the O''reilly Ferret short cuts, I found very useful example for me. It explains how to make custom Tokenizer. But that book doesn''t explain how to make custom Filter. (especially, how to implement the #text=() method) I''m a newbee and I don''t understand how do I create my own custom Filter. Are there some good source code examples?? -- Posted via

Hi all, I''d like to write my own TokenStream Filter (in lucene this would be a subclass of a TokenFilter, which ferret seems to lack) but I''m not sure how to go about it. Specifically, it''s not clear how I''d create a non-trivial TokenStream to pass out to any filters that wrapped mine. Can anyone point me towards a code example? Thanks. -- Richard Jones dickjr at gmai...

After migrating to 0.9.1, I got: usr/local/lib/ruby/gems/1.8/gems/activesupport-1.3.1/lib/active_support/dependencies.rb:123:in `const_missing'': uninitialized constant TokenFilter (NameError) Here is a snapshot of my code: ... require ''ferret'' class MyFilter < Analysis::TokenFilter ... I works fine on my dev machine, but not a production server (shared host). Any idea? -- Posted via http://www.ruby-forum.com/.

...EuropeanAnalyzer (http://olivier.liquid-concept.com/fr/pages/2006_acts_as_ferret_accentuated_chars). By example, if the user search by "gonzalez" you can find documents taht contents the term "gonz?lez" (gonz&aacute;lez) The EuropeanAnalyzer is based on Ferret::Analysis::TokenFilter, but seems that in 0.10.x this is not available. What is the way to do this ? -- Posted via http://www.ruby-forum.com/.

...English words. This seems to cause the IndexWriter to slow to a crawl. Is this a known issue, or am I doing something wrong? If this is a known issue I don''t have any problem just not indexing tokens longer than a certain length, but what''s the best way to eliminate them? Using a TokenFilter on my own Analyzer? Sorry for the newbish questions, I''m new to ferret having never used lucene. Thanks in advance, Justin -------------- next part -------------- An HTML attachment was scrubbed... URL: http://rubyforge.org/pipermail/ferret-talk/attachments/20060616/7c7f8ae0/attachment-...

...the two boxes. I''ve tried all the suggestions I could find, setting the LANG on env.rb, tried both the examples for setting the utf on http://projects.jkraemer.net/acts_as_ferret/, which I couldn''t even get to work due to "`const_missing'': uninitialized constant TokenFilter (NameError)", and I even installed mysql 5.0.22 and setting the default charset on the table structure to utf thinking that would have something to do, but didn''t. So here I''m, stuck, hoping you guys could help me out with this issue. Just FYI, the locale for "en_...

Forgive me if this topic has already been discussed on the list. I googled but couldn''t find much. I''d like to search through text for US state abbreviations that are written in capitals. What is the best way to do this? I read somewhere that tokenized fields are stored in the index in lowercase, so I am concerned that I will lose precision. What is the best way to store a

...''w'', [''?'',''?'',''?''] => ''y'', [''?'',''?'',''?''] => ''z'' } class TokenFilter < TokenStream # Construct a token stream filtering the given input. def initialize(input) @input = input end end # replace accentuated chars with ASCII one class ToASCIIFilter < TokenFilter def next() token = @input.next() unless token.nil?...

...try] = country_filter # run the query with the filter index.search(query, :filter => mf) # filters can be changed and deleted mf[:category] = new_category_filter mf.delete(:country) index.search(query, :filter => mf) The other major addition is a MappingFilter (< TokenFilter). This can be used to transform your code from UTF-8 to ascii for example. I posted an example of how to do this earlier today. However, using the mapping filter you can apply a list of mappings string mappings rather than just character mappings. Obviously you could acheive this with a list of &...

Hi there, What''s the current status of the Windows port? I may be in a position to lend a hand over the next couple of weeks - where should I start looking? And what''s the best way to get SVN HEAD? This happens: $ svn checkout svn://www.davebalmain.com/ferret/trunk ferret svn: Can''t connect to host ''www.davebalmain.com'': Connection refused --

Hi all This week I have worked with Rails and Ferret to test Ferrets (and Lucenes) capabilities. I decided to make a mixin for ActiveRecord as it seemed the simplest possible solution and I ended up making this into a plugin. For more info on Ferret see: http://ferret.davebalmain.com/trac/ The plugin is functional but could easily be refined. Anyway I want to share it with you. Regard it as a

Hi all This week I have worked with Rails and Ferret to test Ferrets (and Lucenes) capabilities. I decided to make a mixin for ActiveRecord as it seemed the simplest possible solution and I ended up making this into a plugin. For more info on Ferret see: http://ferret.davebalmain.com/trac/ The plugin is functional but could easily be refined. Anyway I want to share it with you. Regard it as a