search for: inex

Thanks for your reply! For the third question: In https://inex.mmci.uni-saarland.de/data/documentcollection.jsp, I can find inex2010-article.qrels in 2010 assessment, but can?t find query files. Could you send me the link? I have registered on INEX website. And I also need to download ``INEX 2009 collection without annotation tags: (unofficial)`` on http://www...

Hello, I wanted to decide the dataset that should be used for Letor stabilisation project. I think 2009 INEX Wikipedia Collection <http://www.mpi-inf.mpg.de/departments/databases-and-information-systems/software/inex/> should work fine. It's a collection of 2,666,190 XML articles, 115 topics <http://inex.mmci.uni-saarland.de/protected/adhoc/2009-topics.zip>, 50,275 qrel <http://inex.mmc...

...n.org/wiki/GSoC2011/LTR/Notes#QueryLevelNorm, it mentioned "the first column is the relevance judgement?. I think the value of the relevance judgement is just 0 or 1. But the code saves it as a ?double?. Is it just for convenience? Or I misunderstand the whole thing? 3. I?ve got qrels file of INEX 2010, but I can find query file. How can I get it? I can?t find it on INEX website. Thank you! Jiarong Wei -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.xapian.org/pipermail/xapian-devel/attachments/20140308/4d845805/attachment-0002.html>

Hi Parth, I?ve implemented SVMRanker class and also sorted out most of current Letor APIs. Now I?m trying to use INEX dataset to verify my implement. But I stuck in the indexing part. You said in the documentation that we have to add prefix when indexing. Also I notice that you set some metadata in omindex.cc of your version. But the omindex.cc has changed since 2011. I think that?s why my result is always wired....

Ah. If FIRE doesn't have something that can show this suitably, then > maybe Parth can advise on access to TREC, as I know he's used some of > them in the past. > ?I can say FIRE is also a reliable source but INEX/TREC are better. INEX can give you free access and TREC is not freely available. I had used INEX for xapian in the past and some details are here: https://trac.xapian.org/wiki/GSoC2011/LTR/Notes#IREvaluationofLetorrankingscheme I roughly remember that there was a discussion with our this year GSOC...

Hi, I?m trying to use Omega to index INEX dataset for Letor. But omindex told me these xml files are unknown. Olly told me I could tell omindex to handle them as HTML. (Thanks Olly :) ) Is it appropriate? Parth, could you give me some suggestions? Thank you! Jiarong Wei

...39; ./configure: line 2057: `AM_INIT_AUTOMAKE(1.10.1 -Wportability tar-ustar)` I am not too sure what to do with this. Need help with this. Thank You Regards Karthik On Mon, Sep 29, 2014 at 7:17 PM, karthik iyer <karthikiyer2000 at gmail.com> wrote: > Ok sorry, my bad. Just checked the INEX 2014 website. I believe that is > where we get the data set from. > > Cheers > Karthik > > On Mon, Sep 29, 2014 at 6:10 PM, karthik iyer <karthikiyer2000 at gmail.com> > wrote: > >> Hi, >> >> I have started getting a hang of the xapian codebase. I thi...

On Tue, Mar 11, 2014 at 12:02:15PM +0100, Parth Gupta wrote: > During the indexing with omindex, only you need to make sure is indexing > with prefix 'S' for title as explained here in Letor documentation: > xapian-letor/docs/letor.rst > > Previously when I edited omindex.cc it was modified as can be seen >

On Tue, Mar 11, 2014 at 03:20:31PM +0100, Parth Gupta wrote: > > > > On current trunk, we index the title with prefix "S" by default in > > omindex, though with a wdf inc of 5 rather than 1: > > > > indexer.index_text(title, 5, "S"); > > > > So I don't think you need that change to omindex now. > > Yes, but please

For unsupervised approaches like BM25 this approach works well but letor does not need special weighting for title in this form as it itself assigns weights to title features separately. But I see your concern it would be a problem when BM25 is used on the index with this setup. Hence its preferable to take a note of this uplift in title weight for xapian-letor and normalize it everywhere

Hi Parth, I implemented DFR algorithms in Xapian as a part of GSOC last year under the mentorship of Olly. This year, I want to work on analyzing and optimizing the performance of the DFR algorithms and comparing them with BM25.I also want to work on profiling the query expansion schemes and test the relevance(precision and recall) / speed(time taken) of the

...r instance - Xapian currently powers the Gmane search which is by default based on BM25 weighting scheme and now suppose we want to use LETOR to rank the top k retrieved search results, lets take SVMRanker for an example, will it rank the Gmane's search results based on the weights learned from INEX dataset because the client won't be providing any training file. And also I don't think it'll perform good for two datasets of different distributions. So how are we going to use it? PROPOSAL- 1.Sorting out Letor API will include - - Implementing SVMRanker and checking its evaluat...

Hi Olly, Wouldn't setting the weight of terms in title back to normal (e.g. 5 to 1) by below line, automatically adjust the wdfs and field lengths? indexer.index_text(title, 5, "S"); -> indexer.index_text(title, 1, "S"); if it does not then we should include that part in the patch too. I like to create a patch for xapian-letor for resolving common code of xapian.

...r as I know: /etc/hosts [root at cm network-scripts]# more /etc/hosts # Do not remove the following line, or various programs # that require network functionality will fail. 127.0.0.1 localhost.localdomain localhost ::1 localhost6.localdomain6 localhost6 172.17.2.1 gateway gateway.inexs.com 172.17.2.50 cm cm.inexs.com #172.17.2.52 cm2 cm2.inexs.com 172.17.2.51 cs1 cs1.inexs.com #172.17.2.53 cs2 cs2.inexs.com 172.17.2.137 ingrid ingrid.inexs.com 172.17.2.161 vail vail.inexs.com 172.17.2.162 beaver beaver.inexs.com 172.17.2.175 plotting...

Hi Parth, I have a few questions- 1. Could you please provide me with the link for query-file, qrel-file for the dataset available at http://www.mpi-inf.mpg.de/departments/d5/software/inex/ . 2. I wanted to know how automated testing would be implemented. Will there be test cases like a test query must match this particular N results and this particular ranking. Or will it be in terms of evaluation of the IR algorithm something like MAP and NDCG score must >= a particular value?...

Hi, I have started getting a hang of the xapian codebase. I think I would like to try my hands on the letor module of xapian. Could you please suggest some free data set for the training and testing of letor features. I am not able to get the INEX data set from anywhere (the one mentioned by parth gupta in his GSOC 2011 projecct. Regards Karthik On Mon, Sep 22, 2014 at 4:23 PM, Olly Betts <olly at survex.com> wrote: > On Sat, Sep 20, 2014 at 08:07:33PM +0530, karthik iyer wrote: > > I am interested in doing some developemen...

.... *Questions* -> If anyone has an experience with dowbloading wikipedia dumps, please can I get some advice on how to go about doing it and which is the best place to get them ? -> For the search and query expansion perf test, I need a query log based on the test documents I'll be using (Inex data set, as per the recent discussion with Olly on IRC.). Please can I get some advice on how to go about using the Inex data sets and the corresponding query logs. Regards Aarsh Regards Aarsh -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.xapia...

...Regards Karthik On Wed, Oct 22, 2014 at 3:39 AM, James Aylett <james-xapian at tartarus.org> wrote: > Oops, accidentally took this off-list; restoring. > > On 21 Oct 2014, at 19:19, karthik iyer <karthikiyer2000 at gmail.com> wrote: > >> Can someone help me with the INEX dataset. I am not able find it anywhere. I created an account on the INEX website but still not able to get the dataset. >> >> I have a MAP code ready with me. I am not too sure whether it is working fine or not because of the lack of INEX dataset. >> >>> It's worth p...

...", side=2, line=2) ## Puts the primary y axis on and names it correctly points(data[,3],data[,1],pch=16) ## puts my secondary y points on - also fine axis(4) mtext("Number of sun hours in April", side=4, line=2) ## if I enter "line=1" it writes over my inex numbers but if I put "line=2" it disappears. I assume that perhaps the graph automatically fills the space and does not leave any for 'odd' axes. My questions therefore are: how...

Hi James, > We probably don't want them committed in git where they're evaluation > runs (because we can recreate them); a gist might be more appropriate. Sorry, I have moved results files over to gist for each individual weighting scheme. Link: https://gist.github.com/ivmarkp/secret > I can't tell, but are some of those files from FIRE? If so, they > shouldn't be