similar to: Letor Project

Hello Rishabh, As per our previous discussion, we will talk each week now about the project. Please update the timeline/todo/journal accordingly so that we can check the status on this saturday for this week. Please remember that this half of the programme is smaller and hence we would need to be very punctual about the goals. Regards, Parth. -------------- next part -------------- An HTML

Hello Rishabh, The attached diff file should help you to refactor the existing letor code and plug in your code easily. I have defined the header files with the necessary flow. I have also specified the ranker class, which should be implemented by a new LTR models, ListNet and ListMLE in your case. The evaluation file should be used for validating the performance of the algorithm in the training

Hi Rishabh, I think its better not to expose RankiList to Letor.h and make it better user friendly. So my suggestion is to convert RankList to the following statement in this method. std::map<Xapian::docid, double> letor_score(const Xapian::MSet & mset); So just convert the RankList in std::map<Xapian::docid, double> format in the methods where you need to return. Parth. On

Hi Rishabh, As per our last progress meeting, I am off for some days and as now its the time to mid-term evaluation, it would be better to generate a progress report. For that, you should first commit the code as it is and then write 2 to 3 page summary explaining the deliverables so far and then the future plan. Tomorrow is the last day, so better by tomorrow morning, send this across and by

Hello Everyone, I am looking forward to contribute to Xapian and also apply as a Google Summer of Code student. I would like to start by introducing myself. I am a final year M.Sc.(H) Chemistry and B.E. (H) Electronics and Instrumentation student at BITS - Pilani, Goa. I am interested in Machine Learning and presently pursuing my thesis on the same. I have been selected for Google Summer of Code

Hi, I have several questions regarding the letor module,I looked at the framework of learning to rank in xapian http://rishabhmehrotra.com/gsoc/17.png, I am a little confused. Why using deep learning to find unsupervised features in test data? Since in my understanding, learning to rank model usually learn features from the training data then apply the model to the test data? Why test set and

Hi everyone, My name is Shreedhar Pawar. I have already introduced myself on Xapian-discuss... I feel that the Xapian Search/Letor Algorithm, can speed up using Parallel computing. Techniques like Map-reduce, 'compact n split', radix sort, scan, parallel hashing n much more can be used to speed up the learning algorithms as well as the search... support vector machines in the Letor

Thanks for your reply! For the third question: In https://inex.mmci.uni-saarland.de/data/documentcollection.jsp, I can find inex2010-article.qrels in 2010 assessment, but can?t find query files. Could you send me the link? I have registered on INEX website. And I also need to download ``INEX 2009 collection without annotation tags: (unofficial)`` on

Hi Maybe I can start off with Hanxiao's branch but I can see there are two repos. https://github.com/v-hasu/xapian/tree/gsoc2014-evaluation https://github.com/v-hasu/xapian/tree/gsoc2014 which one should I pick? I have already successfully built xapian from the git repository ( https://github.com/xapian/xapian) Since I am new to ML (well I dont know anything about it?), should I read the

Dear Sir, I am Pankaj Singhal from Jaipur, India. I am very much interested and strongly looking forward in getting involved in this project Learning-to-Rank. My previous experience in this field is good. Last semester I did a similar job of ranking the URLs of the given huge dataset based on their attribute values. The dataset consisted hundreds of thousands of URLs and each url

Hello James, Parth, Following our discussion on IRC and on code review, the way FeatureVector class works needs some discussion. Presently, the FeatureVector class is defined as follows, with a fixed number of feature count (19): class FeatureVector::Internal : public Xapian::Internal::intrusive_base{ friend class FeatureVector; double label; double score;

Hi Parth, I have a few questions- 1. Could you please provide me with the link for query-file, qrel-file for the dataset available at http://www.mpi-inf.mpg.de/departments/d5/software/inex/ . 2. I wanted to know how automated testing would be implemented. Will there be test cases like a test query must match this particular N results and this particular ranking. Or will it be in terms of

I'd suggest that a good thing to look at would be functional tests of the metrics and algorithms in Hanxiao Sun's work from this summer. You'll generally need to go either to the original paper, or find an alternative implementation, to build up a series of tests that demonstrate that the implementation is doing what it is supposed to. Xapian-core contains a test framework which it

Hello, I would like to work with Orange as part of GSoC 2012(and continue henceforth). Apologies for joining in a bit late- i was waiting to get a proper grasp of things before discussing it here. Currently I am a Masters students in Mathematics with my bachelors in Computer Science[integrated dual degree]. Over the last year and a half, I have worked on a few ML projects and have a couple of

Hello, I am Mudit Raj Gupta, fourth year student of M.S. (Hons.) Chemistry and B.E. (Hons.) Electronics and Instrumentation at BITS-Pilani ( http://www.bits-pilani.ac.in/). I am interested in *Machine Learning and Computaional Intelligence*. I have an interest in implementing various existing algorithms and developing modified/new algorithms related to machine learning and computational

Hello, I'm Ayush from New Delhi, India. I am interested in Letor Stabilisation project for GSoC. I have a good background in machine learning. Sorry for getting in so late, university exams were holding me back. I'll try to cover as much as I can in the coming week. I am following the plan of attack suggested on the project page. Following are the things that I have completed: 1.

Hi all, Thank you for giving me the opportunity to work with Xapian :) I am Jiarong Wei, a third year undergraduate student in Zhejiang University, China. In GSoC 2014, I will work on Letor module with Hanxiao Sun. Here are some questions I encountered these days, 1. In letor.cc, we have two parts of functions: the training part and the ranking part. I?ll use SVMRanker as an example. The

Hi Rishabh, I had this feeling before. This is a really nice idea BUT we can not go ahead with the project which is still not tested in the experimental settings. Though it may be a wonderful research exercise, I would still vote to go for the state-of-the-art methods which are completely published with full details and experimental results. Hope you get my point. Regards, Parth. On Wed, Apr 4,

Hello, I wanted to decide the dataset that should be used for Letor stabilisation project. I think 2009 INEX Wikipedia Collection <http://www.mpi-inf.mpg.de/departments/databases-and-information-systems/software/inex/> should work fine. It's a collection of 2,666,190 XML articles, 115 topics <http://inex.mmci.uni-saarland.de/protected/adhoc/2009-topics.zip>, 50,275 qrel

As Olly has already pointed out the 2012 branch is not merged. I think there are some compilation errors in the branch. The code in branch is better refactored. The Ranker and FeatureManager classes are well defined and implemented. Parth. On Wed, Sep 25, 2013 at 9:02 AM, Olly Betts <olly at survex.com> wrote: > On Tue, Sep 24, 2013 at 08:34:10PM +0800, jiangwen jiang wrote: >