I was optimizing a 650MB using ferret (0.11.3) and I received the
following error. I''ve seen some people have similar issues but I
haven''t seen any resolutions. The contents of the index directory
follow the error. Has anyone seen anything like this and found a
resolution? Many thanks.
/mnt/apps/search/releases/20070622175637/script/../config/../vendor/
gems/rdig-0.3.4/lib/rdig/index.rb:48:in `optimize'': End-of-File Error
occured at <except.c>:93 in xraise (EOFError)
Error occured in store.c:216 - is_refill
current pos = 0, file length = 0
from /mnt/apps/search/releases/20070622175637/script/../
config/../vendor/gems/rdig-0.3.4/lib/rdig/index.rb:48:in `close''
from /mnt/apps/search/releases/20070622175637/script/../
config/../vendor/gems/rdig-0.3.4/lib/rdig/crawler.rb:36:in `run''
from /mnt/apps/search/releases/20070622175637/script/../
config/../vendor/gems/rdig-0.3.4/lib/rdig.rb:274:in `run''
from /mnt/apps/search/releases/20070622175637/script/rdig:95
from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
application.rb:152:in `start_load''
from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
application.rb:229:in `start''
from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
controller.rb:69:in `run''
from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/
daemons.rb:133:in `run''
from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
cmdline.rb:105:in `catch_exceptions''
from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/
daemons.rb:132:in `run''
ls -Alh /index_dir/
total 649M
-rw------- 1 my_user my_user 3.2M Jun 22 15:40 _0.cfs
-rw------- 1 my_user my_user 22M Jun 22 17:29 _1.cfs
-rw------- 1 my_user my_user 22M Jun 22 18:53 _2.cfs
-rw------- 1 my_user my_user 23M Jun 22 20:14 _3.cfs
-rw------- 1 my_user my_user 22M Jun 22 22:01 _4.cfs
-rw------- 1 my_user my_user 20M Jun 22 21:19 _5.cfs
-rw------- 1 my_user my_user 41M Jun 22 22:02 _5.fdt
-rw------- 1 my_user my_user 113K Jun 22 22:02 _5.fdx
-rw------- 1 my_user my_user 0 Jun 22 22:02 _5.frq
-rw------- 1 my_user my_user 0 Jun 22 22:02 _5.prx
-rw------- 1 my_user my_user 0 Jun 22 22:02 _5.tfx
-rw------- 1 my_user my_user 0 Jun 22 22:02 _5.tis
-rw------- 1 my_user my_user 0 Jun 22 22:02 _5.tix
-rw------- 1 my_user my_user 57M Jun 22 21:19 _6.fdt
-rw------- 1 my_user my_user 161K Jun 22 21:19 _6.fdx
-rw------- 1 my_user my_user 0 Jun 22 21:19 _6.frq
-rw------- 1 my_user my_user 0 Jun 22 21:19 _6.prx
-rw------- 1 my_user my_user 0 Jun 22 21:19 _6.tfx
-rw------- 1 my_user my_user 0 Jun 22 21:19 _6.tis
-rw------- 1 my_user my_user 0 Jun 22 21:19 _6.tix
-rw------- 1 my_user my_user 22M Jun 22 22:50 _7.cfs
-rw------- 1 my_user my_user 135M Jun 22 22:50 _8.fdt
-rw------- 1 my_user my_user 376K Jun 22 22:50 _8.fdx
-rw------- 1 my_user my_user 0 Jun 22 22:50 _8.frq
-rw------- 1 my_user my_user 0 Jun 22 22:50 _8.prx
-rw------- 1 my_user my_user 0 Jun 22 22:50 _8.tfx
-rw------- 1 my_user my_user 0 Jun 22 22:50 _8.tis
-rw------- 1 my_user my_user 0 Jun 22 22:50 _8.tix
-rw------- 1 my_user my_user 7.9M Jun 22 23:11 _9.cfs
-rw------- 1 my_user my_user 276M Jun 22 23:11 _a.fdt
-rw------- 1 my_user my_user 767K Jun 22 23:11 _a.fdx
-rw------- 1 my_user my_user 0 Jun 22 23:11 _a.frq
-rw------- 1 my_user my_user 0 Jun 22 23:11 _a.prx
-rw------- 1 my_user my_user 0 Jun 22 23:11 _a.tfx
-rw------- 1 my_user my_user 0 Jun 22 23:11 _a.tis
-rw------- 1 my_user my_user 0 Jun 22 23:11 _a.tix
-rw------- 1 my_user my_user 16 Jun 22 23:11 segments
-rw------- 1 my_user my_user 350 Jun 22 23:11 segments_5
Quick follow up. I''m running a cluster of servers to do indexing in
parallel and I noticed a similar error on another server.
ruby 1.8.4 (2005-12-24) [i386-linux]
Linux 2.6.16-xenU #1 SMP Thu Nov 30 13:48:50 SAST 2006 i686 athlon
i386 GNU/Linux
Over all 16 out of 19 servers have died for as yet unknown reasons.
Here is the other error:
in `optimize'': End-of-File Error occured at <except.c>:93 in
xraise
(EOFError)
Error occured in compound_io.c:137 - cmpdi_read_i
Tried to read past end of file. File length is <4360> and
tried to read to <5120>
Help is very much appreciated. Thanks.
Begin forwarded message:
> From: Erik Morton <eimorton at gmail.com>
> Date: June 23, 2007 8:45:27 AM EDT
> To: Ferret Talk <ferret-talk at rubyforge.org>
> Subject: End of File Error on index optmize
>
> I was optimizing a 650MB using ferret (0.11.3) and I received the
> following error. I''ve seen some people have similar issues but I
> haven''t seen any resolutions. The contents of the index directory
> follow the error. Has anyone seen anything like this and found a
> resolution? Many thanks.
>
> /mnt/apps/search/releases/20070622175637/script/../config/../vendor/
> gems/rdig-0.3.4/lib/rdig/index.rb:48:in `optimize'': End-of-File
> Error occured at <except.c>:93 in xraise (EOFError)
> Error occured in store.c:216 - is_refill
> current pos = 0, file length = 0
>
> from /mnt/apps/search/releases/20070622175637/script/../
> config/../vendor/gems/rdig-0.3.4/lib/rdig/index.rb:48:in `close''
> from /mnt/apps/search/releases/20070622175637/script/../
> config/../vendor/gems/rdig-0.3.4/lib/rdig/crawler.rb:36:in `run''
> from /mnt/apps/search/releases/20070622175637/script/../
> config/../vendor/gems/rdig-0.3.4/lib/rdig.rb:274:in `run''
> from /mnt/apps/search/releases/20070622175637/script/rdig:95
> from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
> application.rb:152:in `start_load''
> from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
> application.rb:229:in `start''
> from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
> controller.rb:69:in `run''
> from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/
> daemons.rb:133:in `run''
> from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
> cmdline.rb:105:in `catch_exceptions''
> from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/
> daemons.rb:132:in `run''
>
> ls -Alh /index_dir/
> total 649M
> -rw------- 1 my_user my_user 3.2M Jun 22 15:40 _0.cfs
> -rw------- 1 my_user my_user 22M Jun 22 17:29 _1.cfs
> -rw------- 1 my_user my_user 22M Jun 22 18:53 _2.cfs
> -rw------- 1 my_user my_user 23M Jun 22 20:14 _3.cfs
> -rw------- 1 my_user my_user 22M Jun 22 22:01 _4.cfs
> -rw------- 1 my_user my_user 20M Jun 22 21:19 _5.cfs
> -rw------- 1 my_user my_user 41M Jun 22 22:02 _5.fdt
> -rw------- 1 my_user my_user 113K Jun 22 22:02 _5.fdx
> -rw------- 1 my_user my_user 0 Jun 22 22:02 _5.frq
> -rw------- 1 my_user my_user 0 Jun 22 22:02 _5.prx
> -rw------- 1 my_user my_user 0 Jun 22 22:02 _5.tfx
> -rw------- 1 my_user my_user 0 Jun 22 22:02 _5.tis
> -rw------- 1 my_user my_user 0 Jun 22 22:02 _5.tix
> -rw------- 1 my_user my_user 57M Jun 22 21:19 _6.fdt
> -rw------- 1 my_user my_user 161K Jun 22 21:19 _6.fdx
> -rw------- 1 my_user my_user 0 Jun 22 21:19 _6.frq
> -rw------- 1 my_user my_user 0 Jun 22 21:19 _6.prx
> -rw------- 1 my_user my_user 0 Jun 22 21:19 _6.tfx
> -rw------- 1 my_user my_user 0 Jun 22 21:19 _6.tis
> -rw------- 1 my_user my_user 0 Jun 22 21:19 _6.tix
> -rw------- 1 my_user my_user 22M Jun 22 22:50 _7.cfs
> -rw------- 1 my_user my_user 135M Jun 22 22:50 _8.fdt
> -rw------- 1 my_user my_user 376K Jun 22 22:50 _8.fdx
> -rw------- 1 my_user my_user 0 Jun 22 22:50 _8.frq
> -rw------- 1 my_user my_user 0 Jun 22 22:50 _8.prx
> -rw------- 1 my_user my_user 0 Jun 22 22:50 _8.tfx
> -rw------- 1 my_user my_user 0 Jun 22 22:50 _8.tis
> -rw------- 1 my_user my_user 0 Jun 22 22:50 _8.tix
> -rw------- 1 my_user my_user 7.9M Jun 22 23:11 _9.cfs
> -rw------- 1 my_user my_user 276M Jun 22 23:11 _a.fdt
> -rw------- 1 my_user my_user 767K Jun 22 23:11 _a.fdx
> -rw------- 1 my_user my_user 0 Jun 22 23:11 _a.frq
> -rw------- 1 my_user my_user 0 Jun 22 23:11 _a.prx
> -rw------- 1 my_user my_user 0 Jun 22 23:11 _a.tfx
> -rw------- 1 my_user my_user 0 Jun 22 23:11 _a.tis
> -rw------- 1 my_user my_user 0 Jun 22 23:11 _a.tix
> -rw------- 1 my_user my_user 16 Jun 22 23:11 segments
> -rw------- 1 my_user my_user 350 Jun 22 23:11 segments_5
> in `optimize'': End-of-File Error occured at <except.c>:93 in xraise > (EOFError) > Error occured in compound_io.c:137 - cmpdi_read_i > Tried to read past end of file. File length is <4360> and > tried to read to <5120> > > I was optimizing a 650MB using ferret (0.11.3) and I received the > > following error. I''ve seen some people have similar issues but I > > haven''t seen any resolutions. The contents of the index directory > > follow the error. Has anyone seen anything like this and found a > > resolution? Many thanks.Go to ferret 0.11.4 -- Kyle Maxwell Software Engineer CastTV, Inc http://www.casttv.com