similar to: Index size

I have a large index (~6GB, ~1 million docs) that was built by RDig. I wrote a script to iterate through the index to clear out some duplicate information to try to reduce the size of the index. clients.each {|client| docs = RDig.searcher.search("+supplier_id:#{client.id}") docs.each {|doc| data = doc[:data].dup #the contents of the web page new_results = {}

I implemented a "reindex" command which simply creates an IndexWriter with :create => true for a prexisting index. The "reindexing" seems to start out ok, with several thousand docs added, then Ferret throws an exception: IO Error occured: couldn''t rename file "index\_0.tmp" to "index\_0.cfs": <File exists> I guess that _0.cfs is held

I''m using ferret and acts_as_ferret,i can success save record,but sometimes when i update record,index not found error occurred(not always).I don''t know why:( [quote] File Not Found Error occured at <except.c>:117 in xpop_context Error occured in fs_store.c:329 - fs_open_input tried to open "/home/dev/www/index/development/rcu/_12q.cfs" but it doesn''t

I was optimizing a 650MB using ferret (0.11.3) and I received the following error. I''ve seen some people have similar issues but I haven''t seen any resolutions. The contents of the index directory follow the error. Has anyone seen anything like this and found a resolution? Many thanks. /mnt/apps/search/releases/20070622175637/script/../config/../vendor/

Sorry in advance for the newbie question. Can''t get aaf going and can''t find similarly stuck folks on this forum. I''m running Rails on my local machine in development mode. I installed ferret 0.11.0 gem, and the most recent stable aaf plugin (as of today). I''m having trouble getting the most basic functionality working. In my model Recipe, I have:

Hi all, I''m using ferret and acts_as_ferret on Win XP. Trying to index a location table with over 2,5 Mio. rows in UTF-8 I''m getting the error: "IO Error: IO Error occured: Error reading the segment infos. Store listing was ..." The error occurs after some hours of running. The index file system looks like this after the abort: 11.08.2007 12:30 <DIR>

I''m switching all my fulltext searching over to ferret using the acts_as_ferret plugin on windows (for development, will be deployed on linux). In my tests I have a setup method as follows to ensure the index is reset for each test: def setup Item.rebuild_index end This works fine for the initial few tests but then suddenly fails for the last few tests when it seems to be failing

Hi, I saw someone else have this earlier. The recommendation is still to downgrade to 0.11.3? Oct 01 19:56:09 ey01-s00116 rails[3175]: Ferret::FileNotFoundError (File Not Found Error occured at <except.c>:117 in xpop_contextError occured in fs_store .c:329 - fs_open_input tried to open "/data/zendesk/current/config/../index/production/ticket/_l.cfs" but it

Sorry if this is a repost- I wasn''t sure if the www.ruby-forum.com list works for postings. I''ve been having trouble with indexing a large amount of documents(2.4M). Essentially, I have one process that is following the tutorial dumping documents to an index stored on the file system. If I open the index with another process, and run the size() method it is stuck at a number

Hi, I use ruby console to experiment acts_as_ferret, but I ran into file rename error when I try to rebuild index after doing a search. is this normal? I am using Ferret 0.10.9 in windows XP. Loading development environment. >> Address.rebuild_index => {} >> Address.find_by_contents(''US'') => #<ActsAsFerret::SearchResults:0x4f2ffcc @total_hits=2,

Hello there. I get two different errors, after i installed the new ferret-version. I havn''t seen any comments about changing the API, so there should be no problem using acts_as_ferret as i did before: File Not Found Error occured at <except.c>:117 in xpop_context Error occured in fs_store.c:329 - fs_open_input tried to open

Hello, Ferret created a 4.5GB> index file. $ 4534029210 2007-02-26 12:46 _el.cfs The creation of the index went smoothly. Searching through this index also works fine. However whenever I try to get the contents of an indexed document I get an error when the document number is above 621108: irb(main):080:0> searcher[621108].load IOError: IO Error occured at <except.c>:79 in xraise

Hi, I have a model that I''ve been indexing and searching with ferret some problem. We get the following error when accessing the model File Not Found Error occured at <except.c>:117 in xpop_context Error occured in fs_store.c:329 - fs_open_input tried to open "/var/www/html/cuproject/index/development/album/_b.cfs" but it doesn''t exist: <No such file or

Hi, I noticed a 0.11.3 release and gave it a whirl. I''ve so far not been able to reproduce any segfaults with my ferret_killer[1] script, though I do get some errors. when the searching process is running and I start the indexing process, I immediately get: /usr/lib/ruby/gems/1.8/gems/ferret-0.11.3/lib/ferret/index.rb:692:in `latest?'': File Not Found Error occured at

Hi, I''m having some problems with acts_as_ferret and indexing. I''ve got a simple 5 column table, and a corresponding Ruby model. I loaded 9 rows directly into the table using mysql (for live it''ll be about .5mil rows) and configured a Rails search page along the exact same lines as ferret_demo. Unfortunately, search wouldn''t return any results; following

We''ve been running Ferret for a few months on our site with great result. But, just a monent ago the index suddenly became corrupt. It all started with this error message: :108250 is out of range [0..108183] for IndexWriter#[] /usr/local/lib/ruby/gems/1.8/gems/ferret-0.10.9/lib/ferret/index.rb:382:in `[]'' And after that every search resulted in this error: A IOError

I''m switching all my fulltext searching over to ferret using the acts_as_ferret plugin on windows (for development, will be deployed on linux). In my tests I have a setup method as follows to ensure the index is reset for each test: def setup Item.rebuild_index end This works fine for the initial few tests but then suddenly fails for the last few tests when it seems to be

The following exception occurred while trying optimize a large index: vendor/gems/rdig-0.3.4/lib/rdig/index.rb:46:in `optimize'': End-of- File Error occured at <except.c>:93 in xraise (EOFError) Error occured in store.c:216 - is_refill current pos = 0, file length = 0 Now, I get the following error any time I try to create a new index on the directory that I was trying

I''m a ferret newbie, so hopefully I''m missing something simple :) I am using ferret to index data about 36,000 products from a MySQL database. The index has one document for each product, with these important fields: id: the id (unique) of the product record in the database content: a concatenation of several bits of information from the product and associated records I

Hey .. I was thinking about the way I need to use the Ferret::Index::Index Class and its subclasses .. i find it somehow complex .. I think this can be done more easily .. Most of the Time a user needs to open up a index to do queries, the best way would be to use a IndexReader afaik. I would suggest to do it that way: index = Ferret::Index::Index.new( :path =>