Displaying 20 results from an estimated 10000 matches similar to: "Query strings and stop words"
2007 Apr 16
2
Plotting data with a fitted curve
Suppose you have a vector of data in x and response values in y. How
do you plot together both the points (x,y) and the curve that results
from the fitted model, if the model is not y ~ x, but a higher order
polynomial, e.g. y~poly(x,2)? (In other words, abline doesn't work
for this case.)
Thanks,
--Paul
--
Paul Lynch
Aquilent, Inc.
National Library of Medicine (Contractor)
2008 Oct 11
1
Download page for mongrel_cluster?
Is there a download page for mongrel_cluster? I see that "gem install
mongrel_cluster" works, but I can''t see where it''s coming from.
Usually gems have some sort of project page somewhere.
--
Paul Lynch
Aquilent, Inc.
National Library of Medicine (Contractor)
2008 Apr 16
1
Making a data frame into a factor ?
Hi,
I'm trying to do a linear regression style one-way ANOVA using some
data in a data frame, and (perhaps because I am still relatively
unfamiliar with both R and statistics) what I thought I should do was
to make the data frame into a factor. By that I mean that I have a
data frame whose column labels are the levels of the factor, and the
values in the frame are numeric values for the
2007 Mar 14
2
Connecting R-help and Google Groups?
This morning I tried to see if I could find the r-help mailing list on
Google Groups, which has an interface that I like. I found three
Google Groups ("The R Project for Statistical Computing", "rproject",
and "rhelp") but none of them are connected to the r-help list.
Is there perhaps some reason why it wouldn't be a good thing for there
to be a connected
2007 Mar 23
2
Fitting a line to a qqplot's points?
I've made some normal plots of my data using qqplot, and now
I would like to fit a line to the points on the plot and
check the correlation coefficient to have a more objective measure
of how straight the line is. Is there a simple way of doing that?
(I'm still pretty new to R.)
Thanks,
--Paul
--
Paul Lynch
Aquilent, Inc.
National Library of Medicine (Contractor)
2007 Mar 29
3
Vector indexing question
Suppose you have 4 related vectors:
a.id<-c(1:25, 1:25, 1:25)
a.vals <- c(101:175) # same length as a.id (the values for those IDs)
a.id.levels <- c(1:25)
a.id.ratings <- rep(letters[1:5], times=5) # same length as a.id.levels
What I would like to do is specify a rating from a.ratings (e.g. "e"),
get the vector of corresponding IDs from a.id.levels (via
2007 Dec 17
3
are index files cross-platform?
Hello!
I am trying to read Ferret index files from Windows machine on my Mac
G5 Leopard machine, but the following returns nil:
Ferret::Index::IndexReader.new( index_paths )
Should this work? Are index files guaranteed to be platform
independent or not? Is there any problem if files (top direectory)
are renamed?
izidor
P.S. I can create the index myself and then everything works.
2008 Feb 09
2
md5 hash is wrong for 2.6.2 (Windows)
Hi,
I've downloaded R-2.6.2-win32.exe (base) from two CRAN sites
(http://mirrors.ibiblio.org/pub/mirrors/CRAN/ and
http://lib.stat.cmu.edu/R/CRAN/) and for both of those sites the
expected MD5 hash is reported to be:
ed512872818707f27ca05f08be7363c2 *R-2.6.2-win32.exe
(See, for example, http://lib.stat.cmu.edu/R/CRAN/bin/windows/base/md5sum.txt).
However, when I compute the MD5
2008 Apr 16
1
Brown-Forsythe F* Statistic
I've been searching around for a function for computing the
Brown-Forsythe F* statistic which is a substitute for the normal ANOVA
F statistic for when there are unequal variances, and when there is
evidence of non-normality. A couple of other people have asked this
question, the responses I found have been:
?oneway.test
However, that function appears to use the Welch W statistic which,
2007 Jan 11
5
stop words in query
Hello all,
Quick question, I''m using AAF and the following custom analyzer:
class StemmedAnalyzer < Ferret::Analysis::Analyzer
include Ferret::Analysis
def initialize(stop_words = ENGLISH_STOP_WORDS)
@stop_words = stop_words
end
def token_stream(field, str)
StemFilter.new(StopFilter.new(LowerCaseFilter.new(StandardTokenizer.new(str)),
@stop_words))
end
However when
2006 Nov 01
8
aaf and stop words; query parser
I''ve been trying to implement acts_as_ferret in my latest project and ran into a snag. If I do a search for ''auditor state'' then the search works perfectly. If I include a stop word, as in ''auditor of state'', then I get no results. I''d prefer not to set stop words to nil and index everything.
The solution, that I have yet to attempt, is to use
2006 Aug 28
1
stop words and /''s
Hi new version of ferret and acts as ferret have sorted out the scary
glibc *** linked list pointer errors, thank god! New version are good
but some searches are still not working. It is mostly the stop words
ones. For example the "For Sale/Free/Swap" fails but works when "for" is
stripped out. I have read all the recent posts regarding this issue and
failed to get it to
2006 Oct 24
2
Problem with stop words
I am seeing trouble with searches for ''you'' not returning anything. It
appears that ''you'' is a stop word to the standard analyzer:
require ''rubygems''
require ''ferret''
index = Ferret::I.new(:or_default => false)
index << ''you''
puts index.search(''you'')
returns
2006 Nov 13
1
Stemming, stop words, acts_as_ferret
I''d like to get the following behavior:
1. Stemming. The search is on a database of summaries of California legal
cases. Things like a search for "thermal image" needs to hit "thermal
imaging."
2. Stop words. Searches for "failing to instruct the jury" should come up
with hits on a search for "fail to instruct."
3. Case-insensitive.
What I
2006 Sep 22
1
Query Objects vs. Query Strings
Hi ..
I tried to build some query objects to get some documents from my
index.. without success.. Is something wrong here?
q = Ferret::Search::BooleanQuery.new
q1 = Ferret::Search::TermQuery.new(:type, "movie")
q2 = Ferret::Search::TermQuery.new(:name, "Indiana")
q.add_query(q1, :should)
q.add_query(q2, :should)
Indexer.index.search_each(q) do |doc, score| puts doc end
0
2006 Oct 17
2
Problems with stop word analysis and queries
I have a problem, and I think it''s because stop word analysis isn''t
happenning in the queries. I think it''s the way ferret is doing things
that''s causing this bug. Let''s say I''m searching across documents with
a title. And I have a document with a title of "Bash Guide for
Beginners". If a user types in the query:
Bash Guide
2007 May 05
4
Stop words, fields, StandardAnalyzer quagmire
Hello,
I''m using: Ruby 1.8.6, Rails 1.2.3, ferret 0.11.4, acts_as_ferret from
svn stable.
I''ve had quite a day wrestling with trying to remove the use of
stopwords. The problem was that when searching for words like "no" or
"the", no results were found. I found a confusing thing behavior that
has taken me some time to figure out, and I hope sharing it
2006 Apr 03
4
Stop words in queries
I''ve run in to an issue that I''m not sure how to address. Basically, I''m
building queries with occur_default Search::BooleanClause::Occur::MUST,
and using the StandardAnalyzer which does stop filtering. The stop
filtering is working beautifully on the indexing side. The problem is
that when the query parser parses through a query with a stop word in
it, say
2007 May 17
4
R2 always increases as variables are added?
Hi, everybody,
3 questions about R-square:
---------(1)----------- Does R2 always increase as variables are added?
---------(2)----------- Does R2 always greater than 1?
---------(3)----------- How is R2 in summary(lm(y~x-1))$r.squared
calculated? It is different from (r.square=sum((y.hat-mean
(y))^2)/sum((y-mean(y))^2))
I will illustrate these problems by the following codes:
2012 Jun 04
1
Search not finding queries with stop words.
I have a search in perl that looks a bit like:
my $qp = new Search::Xapian::QueryParser();
$qp->set_stemmer(new Search::Xapian::Stem("english"));
$qp->set_stemming_strategy(STEM_SOME);
$qp->set_default_op($defaultop);
...
my $par = $qp->parse_query($query);
my $enq = $xDatabase->enquire( $par );
and in the db create script:
my $stopper =