similar to: Indexing so slow......

I''ve been messing around with Ferret (no punn intended). After spending some time testing it out (indexing to file), I decided to index about 10% of the data I want to eventually index. It took several hours to complete the index on my local machine, but it was created without any problems and after optimising it the searches returned results at the sort of speed I was expecting. I

I''d like to use ferret to build an imap indexer and search utility, but want to check first to see if anyone else is working on this and offer my help. Anyone? Also, if you could provide any helpful pointers on indexing directories via ferret, it''ll be very much appreciated. I''m a lucene nuby. Thanks! John -- Posted via http://www.ruby-forum.com/.

Hi all This week I have worked with Rails and Ferret to test Ferrets (and Lucenes) capabilities. I decided to make a mixin for ActiveRecord as it seemed the simplest possible solution and I ended up making this into a plugin. For more info on Ferret see: http://ferret.davebalmain.com/trac/ The plugin is functional but could easily be refined. Anyway I want to share it with you. Regard it as a

Hi all This week I have worked with Rails and Ferret to test Ferrets (and Lucenes) capabilities. I decided to make a mixin for ActiveRecord as it seemed the simplest possible solution and I ended up making this into a plugin. For more info on Ferret see: http://ferret.davebalmain.com/trac/ The plugin is functional but could easily be refined. Anyway I want to share it with you. Regard it as a

Hi All, Hope all is going well. I''m having trouble with the following code creating an in memory index reader - it seems to be attempting to read from a file regardless. Here''s the simple code: require ''rubygems'' require ''ferret'' a = Ferret::Index::Index.new r = Ferret::Index::IndexReader.new(nil) Running the code on my OS X machine

Hi all, I''ve just released Ferret-0.10.1. It contains some important bug fixes and the minor addition of the Ferret::I class which is just an alias for Ferret::Index::Index. I still need to write up a release announcement for the 0.10.0 series. I haven''t forgotten about it and it may seem strange that I''ve already released 0.10.1 before writing the announcement.

Ferret 0.9.3 Ruby 1.8.2 NOT storing file contents in the index. Only indexing first 25k of each file. Very large data set (1 million files, 350 Gb) Code based on snippet from David Balmain''s forum posts. After 6 hours, Ferret bails out with Ruby "exceeds max file size". Cache: -rw-r--r-- 1 bill bill 2147483647 2006-06-01 22:45 _ntc6.tmp -rw-r--r-- 1 bill bill 1690862924

Hi, I''m trying to get parallelized ferret indexing working for my AAF indices, based on the example in the O''Reilly Ferret shortcut. However, the resulting indices after merging seem to have no actual documents. I went and made minimal changes to the example in the Ferret shortcut pdf, and indeed can''t get that to work either. I''d appreciate any help

I am trying to test drive ferret on a ubuntu dapper installation. I have a ferret-test.rb file like: ----begin--------- require ''ferret'' include Ferret index = Index::Index.new(:path => ''/opt/search-index'') ----end----------- When i issue: ruby ferret-test.rb, I get: ferret-test.rb:1:in `require'': no such file to load -- ferret (LoadError)

Just a quick note for future reference - at least for me, ferret won''t work on Ruby 1.8.4. gem install ferret Successfully installed ferret-0.11.4-mswin32 ruby -v ruby 1.8.4 (2005-12-24) [i386-mswin32] irb irb(main):001:0> require ''ferret'' A windows error message box appears - ruby.exe - Entry Point Not Found The procedure entry point rb_w32_write could not be

Hi! First, thanks a LOT for ferret. The API and documentation is great. I''m trying to integrate ferret into a RoR app (DamageControl) and have run into a problem with locks. DamageControl consists of two processes that start up and run in parallel. The first one is the webapp (which is just a plain RoR app). The second is a daemon process that runs in the background. The daemon process

Hi, David. I have recently fixed ferret C sources and successfully compile extension with MSVC.Net The problem was that MS compiler is more stricter that GCC and require that all variables were declared before using. There was ~30 such declaration. I have fixed them all. But I am not sure that it works because tests failed with following error both on clean and patched versions. So seems that it

Hello, I''m usin gferret and I''ve just attempted to build an index that contains 15,968,046 documents. I''ve rebuild the index from scratch, but when I try to search for some items I get this error: IOError: IO Error occured at <except.c>:79 in xraise Error occured in fs_store.c:289 - fsi_seek_i seeking pos -1284143798: <Invalid argument> This is

Hi Dave, i just stumbled across a new error i haven''t seen before :) caught error inside loop: IO Error occured at <except.c>:93 in xraise Error occured in fs_store.c:264 - fs_new_output couldn''t create OutStream /var/www/localhost/rails/current/ script/backgroundrb/../../config/../db/ferret.index.production/ _jei_0.f0: <Too many open files> my ulimit is

Hey all, I''ve just released Ferret version 0.10.2. It is mostly just a bug fix release. The only change is that a highlight method has been added to Ferret::Index::Index. Please try it out and let me know what you think. The big news for this release is that there is also a binary win32 gem included. This is the first time I''ve build a gem like this so please let me know if

Hi, I''m currently trying to set up a solution involving multiple servers using the same index over nfs. The problem is that from what I have seen, ferret doesn''t support multiple processes writing to the same index. Using a DRb service is not an option since this would create a single point of failure. I tried using Ferret::Store::FSDirectory to create a write lock on the the

Hello, Ferret created a 4.5GB> index file. $ 4534029210 2007-02-26 12:46 _el.cfs The creation of the index went smoothly. Searching through this index also works fine. However whenever I try to get the contents of an indexed document I get an error when the document number is above 621108: irb(main):080:0> searcher[621108].load IOError: IO Error occured at <except.c>:79 in xraise

I have a win xp box running instant rails. I installed ferret (the win version) and acts_as_ferret seemingly succesfully. I then added "require ''acts_as_ferret''" to the environment.rb file of my project. However, I cannot get webrick/mongrel to start. Can anyone suggest a solution? Rick -- Posted via http://www.ruby-forum.com/.

Trying to install ferret on my windows XP environment. Using InstantRails 2.0 with RoR 2.0.2, and NetBeans 6.0. I had successfully installed and built RailsSpace in InstantRails 1.7, but am trying to upgrade RailsSpace to RoR 2.0.2 using the code that Michael has kindly provided for us on the website. When I run the gem install ferret command, I get the following error: C:\Documents and

I am running version 3.2 of ferret and would like to upgrade to a more current version. will my existing 3.2 index files be compatible? thanks, AK -------------- next part -------------- An HTML attachment was scrubbed... URL: http://rubyforge.org/pipermail/ferret-talk/attachments/20070910/742890f2/attachment.html