similar to: Ferret with IMAP dirs

I am indexing over 10,000 rows of data, it is very slow when it is indexing the 100,1000,10000 row, and now it is over 1 hour passed on the row 10,000. how to make it faster? here is my code: ================== doc = Document.new doc << Field.new("id", t.id, Field::Store::YES, Field::Index::UNTOKENIZED) doc << Field.new("title", t.title,

Hi, David and everyone, I''ve had Ferret running fine in a production Rails application for a while now. I haven''t updated Ferret or really looked at the Ferret-related code since probably January, but I recently started thinking about trying out the latest version (we were using 0.3.2, I think). I got the latest (0.9.4) and have noticed things break. In particular, I used to

I''m building a new index from scratch based on a number of documents stored in a database loaded using my Rails env (using Ruby Ferret 0.9x (installed today with Gem) on Windows). At first everything goes nice but after a number of documents it starts to go slower and slower until it grinds to a halt (at least feels like it). Am I doing something wrong? Is there some way to work

I''m running Ferret 0.9.5 on a MacBook Pro (OS X 10.4.7) under Locomotive 2.0.7. I have a problem where Ferret is hanging when I try to add items to the index. It doesn''t happen with every object that''s being indexed, and I''m not sure what the objects in question have in common (they are not all instances of the same ActiveRecord object). The process

Hey folks, Some good news. I''ve finished cFerret and it''s ruby bindings to the point where I can run all of the unit tests. I still have to work out how I''m going to package and release it but it shouldn''t be long now. If you can''t wait you might like to try it from the subversion repository. It''ll probably only work on linux at the moment and

Hey all, After dabbling with ActiveSearch, we''re coming back around to take another look at Ferret. ActiveSearch slowed to a crawl after indexing about 20k documents, each 20 lines each. This time we may attempt to create multiple Ferret indexes (isolating each organization''s data individually), since we eventually could have upwards of 20k documents for some

Hello list, I know this is a little OT but I wonder how I would go about using cFerret directly through C/C++ for indexing. Right now I do index = Index::Index.new(:path => ''/path/to/index'') index << {:title => "Programming Ruby", :content => "blah blah blah"} How would I do this in C/C++ against cFerret? Thanks! //Henrik

Hi Dave, I''ve been reading this post below back in December 2005. Is it possible to set :key to :id in cFerret like suggested below? Thanks, Mac On 12/3/05, Carl Youngblood <carl at youngbloods.org <http://rubyforge.org/mailman/listinfo/ferret-talk>> wrote: >* I seem to be getting the same document multiple times in my search *>* results. I''m wondering if

I''m noticing some long delays when optimizing my index. I know this is terribly inefficient, but in order to make sure that my ActiveRecord model is in sync with my index, I''m optimizing after every new record that I store, like so: class Resume < ActiveRecord::Base include Ferret has_and_belongs_to_many :users SEARCH_INDEX = File.dirname(__FILE__) +

Hi, the last couple of days I''m trying to index some txt files. Once indexed I have the habit of checking the contents of the Ferret index with Luke. But everytime I tried to open the index I got a ''read past EOF'' error. I managed to get it down to the way Ferret handles non-ascii characters. I have one txt file with the following content ''a o b c''

Hi, I am experiencing very poor performance when updating my index. For example, to update the index for 10 documents, it is taking 3 to 4 seconds. My index is currently very small... with probably less than 100 docs in it. I have created my index as follows: GIFT_INDEX = Index::Index.new(:path => "#{index_dir}/gift", :key => ''id'', :auto_flush => true)

The current full-text search will return the AND collection results,for example,if we use Article.search("aa bb"),then the articles that include "aa" and "bb" in the fields will be returned,how to return the articles that include "aa" OR "bb" effectly? A stumb method is to setup two queries respectly and collect them together with remove the

I''m not sure whether this is a bug or whether I''m simply expecting Ferret queries to work in a way other than they''re intended. I notice that if use a query like: (other_text:"Collaborative tools") AND NOT other_text:podcasts I''ll get correct search results. However, if I put parentheses around the second part, like:

FYI, I tried installing ferret on my freebsd virtual server and got this: retango# gem install ferret --include-dependencies Attempting local installation of ''ferret'' Local gem file not found: ferret*.gem Attempting remote installation of ''ferret'' Updating Gem source index for: http://gems.rubyforge.org Building native extensions. This could take a while...

I''m trying to use Ferret to do fuzzy searches. If I use fuzzy search for just one word, it works fine: index.search(''name:gogle~0.4'') However, if I try to use a phrase, it doesn''t work: index.search(''name:"gogle search engine"~0.4'') On the other hand, I could do: index.search(''name:gogle~0.4 AND

I am having some great trouble keeping my Ferret indexer for ActiveRecord working. First the get_field_names disappears (now back), then I am collectig some major trouble with locking. Same thing here: exception 6 not handled: Could not obtain write lock when trying to write index A snippet like this just deadlocks retrying endlessly: begin @ferret_index << doc

Hello, I am planning to build a bigger Internet platform and actually evaluating Java EE and Rails. I have a lot of Java experience and I am quite new to Rails. After playing some weeks with Rails I am sure that it is a mature web framework and I really like the productivtity of Rails. One of the key advantages is that new developers will understand this platform much quicker than all the Java

Hi all This week I have worked with Rails and Ferret to test Ferrets (and Lucenes) capabilities. I decided to make a mixin for ActiveRecord as it seemed the simplest possible solution and I ended up making this into a plugin. For more info on Ferret see: http://ferret.davebalmain.com/trac/ The plugin is functional but could easily be refined. Anyway I want to share it with you. Regard it as a

Hi all This week I have worked with Rails and Ferret to test Ferrets (and Lucenes) capabilities. I decided to make a mixin for ActiveRecord as it seemed the simplest possible solution and I ended up making this into a plugin. For more info on Ferret see: http://ferret.davebalmain.com/trac/ The plugin is functional but could easily be refined. Anyway I want to share it with you. Regard it as a

I''m trying to generate a rails pagination helper for some ferret search results, and I need to know how many total matches there are to my search query. I don''t see an obvious way of finding this. Any help would be appreciated. Thanks, Carl Youngblood