Displaying 20 results from an estimated 10000 matches similar to: "different Analyzer defaults"
2007 May 09
3
bug when assigning new analyzer?
require ''rubygems''
require ''ferret''
include Ferret
PATH = ''/tmp/ferret_stopwords_test''
index = Index::IndexWriter.new(:path => PATH, :create => true)
index.analyzer = Analysis::StandardAnalyzer.new([])
index << {:title => ''a few good men'', :language => ''en''}
index.analyzer =
2006 Apr 13
3
QueryParser doesn''t use StandardAnalyzer correctly?
I am having a bit of a problem with my search queries being parsed
correctly it seems, and I wonder if anyone else has experienced this.
I have written an index using StandardAnalyzer for analysis. I want to
search that index by passing my user query through a QueryParser
instance which is also using a StandardAnalyzer. However the resultant
query does not seem to be a valid term query and
2006 Dec 08
6
QueryParser Exception Handling Problem
According to the following link:
http://ferret.davebalmain.com/api/classes/Ferret/QueryParser.html
:handle_parser_errors => true is enabled by default and seems to be in
acts_as_ferret in class_methods.rb of the plugin. However, when I pass a
special character as a query (e.g., !, -, <, >, etc) it throws an error
and pukes.
-- snip --
Error occured in src/q_parser.y:279 - yyerror
2007 Jan 05
3
Confused about Search Results
Hi everyone,
I''m pretty new to Lucene and Ferret, so I feel that this is most likely
myself not completely understanding the correct way to do this. I haved
indexed ~2200 text files (of various sizes), and I am now running
searches on the index to get a feel for Lucene and Ferret.
In my first program, which is using Lucene I search for ''influenza'' and
get the
2006 Jun 16
2
indexing large tokens
Hi,
I''m using the StandardAnalyzer to build an index, and passing in Documents
that have Fields that contain large tokens (22+ characters) interpersed with
normal English words. This seems to cause the IndexWriter to slow to a
crawl. Is this a known issue, or am I doing something wrong?
If this is a known issue I don''t have any problem just not indexing tokens
longer than a
2006 Apr 20
1
Creating my own analyzer
I created this analyzer:
class DescriptionAnalyzer < Ferret::Analysis::Analyzer
def token_stream(field, string)
if field == "code"
return CodeTokenStream.new(string)
else
return Ferret::Analysis::Analyzer.new.token_stream(field,string)
end
end
end
and created an IndexWriter with it:
Ferret::Index::IndexWriter.new(get_index_path,
2006 Mar 19
3
Ferret 0.9.0-alpha (port of Apache Lucene to pure ruby)
Hi Folks,
I''ve just released version 0.9.0. This latest version of Ferret is an
alpha release. I have removed the old c extension and Ferret is now
running on a fully ported C library. This has allowed some huge
performance improvements both with regard to memory and CPU usage.
There will probably be a few portability issues to start with. It has
been developed on Linux so it should
2006 Apr 11
2
setting the default operator on a QueryParser
Hi all,
Thanks to the authors for the amazing work on Ferret! I have a question
about setting up the standard operators on a QueryParser. I would like
my parser to default to AND queries rather than the default OR.
In Java I would simply do:
QueryParser parser = new QueryParser("contents", new
StandardAnalyzer());
parser.setDefaultOperator(QueryParser.Operator.AND);
But I
2007 Apr 03
3
[Repost] Problem with url searching..
Hi all,
I''ve posted that few weeks ago but no one answered, but this feature is
REALLY important for us.
I have many objects with a url field, of course containing standards
urls...
I''m trying to match them but i actually got problems with that.
Here''s a little code of what i would like to achieve:
require ''rubygems''
require
2007 Apr 10
8
ferret-0.11.4-mswin32 not compatible with Ruby1.8.4
Just a quick note for future reference - at least for me, ferret won''t
work on Ruby 1.8.4.
gem install ferret
Successfully installed ferret-0.11.4-mswin32
ruby -v
ruby 1.8.4 (2005-12-24) [i386-mswin32]
irb
irb(main):001:0> require ''ferret''
A windows error message box appears -
ruby.exe - Entry Point Not Found
The procedure entry point rb_w32_write could not be
2007 May 03
2
Custom analyzer weirdness with 0.11.3
Hi-
I was previously using 0.11.4, and I wrote my own analyzer. Everything
worked fine.
When I took the system to production, 0.11.4 starting failing updating
the index, complaining that files were missing. The failure always
happened on the same model document, and was completely reproducible.
This failure looked a lot like the one described at
http://www.ruby-forum.com/topic/104145.
I
2007 Jan 19
9
Double-quoted query with "and" fails.
Hi,
We''re using Ferret 0.9.4 and we''ve observed the following behavior.
Searching for ''fieldname: foo and bar'' works fine while ''fieldname:
"foo and bar"'' doesn''t return any results. Is there a way to make
ferret recognize the ''and'' inside the query as a search term and not
an operator? (I hope I got the
2006 Jul 18
4
Some basic questions
Hi, David and everyone,
I''ve had Ferret running fine in a production Rails application for a
while now. I haven''t updated Ferret or really looked at the
Ferret-related code since probably January, but I recently started
thinking about trying out the latest version (we were using 0.3.2, I
think). I got the latest (0.9.4) and have noticed things break. In
particular, I used to
2006 Nov 04
0
Ferret 0.10.6 released (and some benchmarks)
Hey folks,
** Description **
Firstly for those who don''t know, Ferret is a full-text search library
which makes adding search to your application a breeze. It''s much
faster than MySQL full-text search as well most other search libraries
out there. It allows you to do Boolean (+ruby + rails -jewelry) and
phrase queries ("the quick brown fox") as well as some more
2007 Sep 27
5
QueryParser.parse question
Hi there,
I am stomped as to why QueryParser''s parse method behaves differently
between query ''a'' and ''b''.
See http://pastie.caboo.se/private/4rlwrecyyow3yl6qtf4tq
Could someone please help me understand why that is the case.
p.s. I also found ''i'' produce the same behavour as ''a''
Cheers,
Andy
2007 Nov 13
8
acts_as_ferret : cannot use a customized Analyzer (as indicated in the AdvancedUsageNotes)
Hi all,
I cannot make aaf (rev. 220) use my custom analyzer, despite following the
indications @
http://projects.jkraemer.net/acts_as_ferret/wiki/AdvancedUsage
To pinpoint the problem, I created a model + a simple analyzer with 2 stop
words : "fax" and "gsm".
test 1 : model.rebuild_index + model.find_by_contents("fax") # fax is a
stop word.
=> I get a
2007 May 05
4
Stop words, fields, StandardAnalyzer quagmire
Hello,
I''m using: Ruby 1.8.6, Rails 1.2.3, ferret 0.11.4, acts_as_ferret from
svn stable.
I''ve had quite a day wrestling with trying to remove the use of
stopwords. The problem was that when searching for words like "no" or
"the", no results were found. I found a confusing thing behavior that
has taken me some time to figure out, and I hope sharing it
2006 Oct 24
2
Problem with stop words
I am seeing trouble with searches for ''you'' not returning anything. It
appears that ''you'' is a stop word to the standard analyzer:
require ''rubygems''
require ''ferret''
index = Ferret::I.new(:or_default => false)
index << ''you''
puts index.search(''you'')
returns
2006 Jul 07
4
How to add Asia token analyzer to ferret simply?
Hi,David
Can you give me an example of how to add analyzer to ferret to Asian
languages?
My web application will have to support multi language search,which
means,for example,both Chinese and English will be searched through the
form.
Currently,I have decided to use the simple token principles,which means
that every Chinese character will be a token,although this is not so
well in some
2006 May 12
2
Benchmark - Thanks Dave for making this gnawer this FAST!!
Hi List,
I''ve took some time and made some tests on the performance of
java-lucene, hyperestraier and ferret as Dave encourages the community
of ferret to do so.
Quite intersting numbers. Ferret indeed deserves to be called a
high-performance port!!
It''s MyFirstBenchmark (
http://ferret.davebalmain.com/trac/wiki/MyFirstBenchmark ) so please
don''t be too cruel on