search for: rankers

...nker as an example. The training part basically uses the libsvm library and training data to train a model, then save the model file. The ranking part will calculate score for each document in searching results (MSet) by using the trained model file. My question is for each of our three rankers: 1) SVMRanker 2) ListMLE 3) ListNet, do we need three different types of training part? (The ranking part for each of those have the same form I think) I?m not sure the parameters for these three different rankers are the same or not (I guess they?re different). In my understanding, the...

Hi, I have several questions regarding the letor module,I looked at the framework of learning to rank in xapian http://rishabhmehrotra.com/gsoc/17.png, I am a little confused. Why using deep learning to find unsupervised features in test data? Since in my understanding, learning to rank model usually learn features from the training data then apply the model to the test data? Why test set and

Hi I am on Debian verson 7.7, GCC 4.7.2 and make 3.8.1. I cloned the code : git clone https://github.com/v-hasu/xapian git checkout gsoc2014-evaluation rm xapian-letor/nobootstrap ./bootstrap ./configure --no-documentation make CXXFLAGS='-w' and I get a different set of errors --- ranker.cc: In member function 'std::string Xapian::Ranker::get_cwd()': ranker.cc:80:36: error:

Hello Rishabh, As per our previous discussion, we will talk each week now about the project. Please update the timeline/todo/journal accordingly so that we can check the status on this saturday for this week. Please remember that this half of the programme is smaller and hence we would need to be very punctual about the goals. Regards, Parth. -------------- next part -------------- An HTML

Hi try this function ive written it should be self explantory but let me know if you have any problems. I've only been using R for a few eeeks so apologies if its not the most efficient! rankit2<-function(rankvar,cuts,data,factor) { ranker<-rankvar ranker<-0 range<-c(1:cuts) range2<-range/cuts range3<-quantile(factor,range2) over<-length(factor) for (i in 1:over){

I use Ubuntu12.04, GNU Make 3.81 and I am not sure if I use some special configure options. The commands I use after clone the repo are as follows: cd xapian ./bootstarp ./configure make cd xapian-letor aclocal -I ../xapian-core/m4 libtoolize --force autoconf autoheader automake --add-missing ./configure make Is this normal? 2014-12-07 22:37 GMT+08:00 James Aylett <james-xapian at

As Olly has already pointed out the 2012 branch is not merged. I think there are some compilation errors in the branch. The code in branch is better refactored. The Ranker and FeatureManager classes are well defined and implemented. Parth. On Wed, Sep 25, 2013 at 9:02 AM, Olly Betts <olly at survex.com> wrote: > On Tue, Sep 24, 2013 at 08:34:10PM +0800, jiangwen jiang wrote: >

> > > > The approach I was thinking would look something like this: > > * instead of Features, which is really a namespace implemented as a > class, we separate out the calculation of the different features > into distinct subclasses of Feature, whose only job is to calculate > a single feature. Currently the FeatureManager calls these (via >

Hello, My name is Prakhar Pratyush. I am a 4th year Electronics & Communication engineering undergraduate student at Indian Institute of Technology (IIT) Roorkee. My primary areas of Interest are machine learning, and Information Security and I am proficient in C++/Python/JavaScript programming languages as well. I was looking into the past gsoc organizations, and I came across Xapian. I

Hello, I applied to letor stabilisation project for gsoc. I'd like to use coming weeks to improve the workability of xapian-letor. For that, I'm planning to refactor code in current master and begin writing some tests for it. Before adding tests, I think it would be better if xapian-letor could be made consistent with how xapian-core is written. For that, I'd first like to

Hello Rishabh, The attached diff file should help you to refactor the existing letor code and plug in your code easily. I have defined the header files with the necessary flow. I have also specified the ranker class, which should be implemented by a new LTR models, ListNet and ListMLE in your case. The evaluation file should be used for validating the performance of the algorithm in the training

Hi, Before starting my proposal, I wanted to know what is the expected output of Letor module. Is it for transfer learning (i.e you learn from one dataset and leverage it to predict the rankings of other dataset) or is it for supervised learning? For instance - Xapian currently powers the Gmane search which is by default based on BM25 weighting scheme and now suppose we want to use LETOR to rank

Hello James, Parth, Following our discussion on IRC and on code review, the way FeatureVector class works needs some discussion. Presently, the FeatureVector class is defined as follows, with a fixed number of feature count (19): class FeatureVector::Internal : public Xapian::Internal::intrusive_base{ friend class FeatureVector; double label; double score;

Dear all, My name is Hanxiao Sun and I am a master student in the University of Chinese Academy of Sciences. I am so glad to be selected by Xapian as the GSoC student. This is my first time to work with open source community. I hope I can do a good job with you in this summer ! In my proposal, I followed the scope of the LTR project on the ideas page. But, after the interview, it seems to need

...oning library we open-sourced at Harvest: http://hrv.st/f03yfi And github: https://github.com/harvesthq/ranked-model A couple reasons this is a nice option for positioning: * ARel! From the ground up this library uses ARel so sorts can be chained like any order() statement. * Multiple rankers for a single model. * Group sorted items by a common column or any scope. * Fewer database writes with a new position storage strategy. * Rspec! This lib is well tested. I think it''s a great solution for a common problem Rails folk often need to address. Any feedback or questions...

HI, Parth: Thanks for your reply. There's xapian-letor folder in current master trunk, is this code merged in 2011? the letor code of 2012 is not merged to the trunk? Regards 2013/9/23 Parth Gupta <pargup8 at gmail.com> > Dear Jiangwen Jiang, > > The current state of the project can be reached from the repo: > http://trac.xapian.org/wiki/GSoC2012/LTR > > I would

Hi I am using Xapian 1.012 here, trying to optimise the search preformance. My testing suit has 10M docs of forum threads, DB only indexed the thread title, author name, category name, and 1 optional serialize value(0) which is the unix dateline DB_full indexed all the DB terms + thread contents After couple tests, I decided to remove ALL anchor terms such as SHOW_PUBLIC, MORE_IMPORTANT

1.Could you explain why are these libraries included in all the xapian-letor headers? #include<xapian/intrusive_ptr.h> #include<xapian/types.h> #include<xapian/visibility.h> Or just provide me with the documentation of these header. I looked into these header files but couldn't anything substantial. 2.

> > > > Actually, you're doing something slightly unusual there: making the > internal member public. Protected would be better, and private is I think > most usual; library clients aren't going to have access to the Internal > class declaration, so they can't call things on it. This means it's > actually difficult right now to subclass Feature. > > I

The Wine development release 5.7 is now available. What's new in this release (see below for details): - Wine Mono engine updated to 5.0.0, with upstream WPF support. - More progress on the WineD3D Vulkan backend. - Beginnings of a USB device driver. - Support for building with Clang in MSVC mode. - Builtin modules no longer depend on libwine. - Support for configuring Windows