search for: letor

Hi all, While building from git with xapian-letor not ignored in bootstrap, I am getting the following make error: In function `main': /home/ayush/Desktop/xapian/xapian-letor/bin/xapian-letor-update.cc:98: undefined reference to `Xapian::Internal::str(unsigned int)' /home/ayush/Desktop/xapian/xapian-letor/bin/xapian-letor-update.cc:99: u...

Hello, I applied to letor stabilisation project for gsoc. I'd like to use coming weeks to improve the workability of xapian-letor. For that, I'm planning to refactor code in current master and begin writing some tests for it. Before adding tests, I think it would be better if xapian-letor could be made consistent w...

1.Could you explain why are these libraries included in all the xapian-letor headers? #include<xapian/intrusive_ptr.h> #include<xapian/types.h> #include<xapian/visibility.h> Or just provide me with the documentation of these header. I looked into these header files but couldn't anything substantial. 2. Here<https://github.com/rishabhmehrotra/xapia...

Hi Rishabh, I think its better not to expose RankiList to Letor.h and make it better user friendly. So my suggestion is to convert RankList to the following statement in this method. std::map<Xapian::docid, double> letor_score(const Xapian::MSet & mset); So just convert the RankList in std::map<Xapian::docid, double> format in the methods wher...

...t; the HTTP referrer if one were set. Neither is particularly interesting in > this case. Thanks for the explanation. So, as I understand it, we'll need some more info to be logged than this to be able to train click models for relevance judgeme- -nts. > and you'll need a way to use letor from omega, or you'll have trained a > model for no good reason :) Sorry, I may have misunderstood you here but why would we need a way to use letor from omega? For training Letor module, wouldn't we just need two files i.e. Query and Qrel as mentioned in the xapian-letor docs? Letor AP...

Just to add on top of what Olly has already mentioned. > > Now, I'm reading the resources provided on ideas' page. Do you have > > any other suggestions of knowing more about the letor? > > And I'd like to test the function of letor. But I can't find code > > example. Can u give me some suggestions? > > Hopefully Parth can help here. > In order to get started with the Letor code you need to train the model and test it with the topic and qrel file. Th...

Hi everyone, My name is Shreedhar Pawar. I have already introduced myself on Xapian-discuss... I feel that the Xapian Search/Letor Algorithm, can speed up using Parallel computing. Techniques like Map-reduce, 'compact n split', radix sort, scan, parallel hashing n much more can be used to speed up the learning algorithms as well as the search... support vector machines in the Letor algorithm involves heavy computat...

On Thu, Dec 04, 2014 at 08:28:32PM -0500, Manu Gupta wrote: > I was trying to build Han's code and was stuck here. It seems to me that > his code is trying to generate pdf for them. > > Is it possible to modify the make files to stop building the documentation. You can run the top-level configure with --disable-documentation. Cheers, Olly

...ent. I?ll go back to China on the end of April. I think it doesn?t matter I?ll change the time zone :) From the list of project?s ideas, Learning to Rank interests me a lot. Last year, I did a course on Information Retrieval at my university. Also I?m interested in Machine Learning. So, that?s why letor that combines both techs attracts me. I?d like to know more about it by improving the code. I also notice the potential mentor Parth Gupta is also the initial contributor of letor as GSOC 2011 student. That's so cool! I have built all the Xapian code from Git successfully. I got Omega running,...

Hello, I'm Ayush from New Delhi, India. I am interested in Letor Stabilisation project for GSoC. I have a good background in machine learning. Sorry for getting in so late, university exams were holding me back. I'll try to cover as much as I can in the coming week. I am following the plan of attack suggested on the project page. Following are the things th...

Hello, I wanted to decide the dataset that should be used for Letor stabilisation project. I think 2009 INEX Wikipedia Collection <http://www.mpi-inf.mpg.de/departments/databases-and-information-systems/software/inex/> should work fine. It's a collection of 2,666,190 XML articles, 115 topics <http://inex.mmci.uni-saarland.de/protected/adhoc/2009-topic...

Hi I am on Debian verson 7.7, GCC 4.7.2 and make 3.8.1. I cloned the code : git clone https://github.com/v-hasu/xapian git checkout gsoc2014-evaluation rm xapian-letor/nobootstrap ./bootstrap ./configure --no-documentation make CXXFLAGS='-w' and I get a different set of errors --- ranker.cc: In member function 'std::string Xapian::Ranker::get_cwd()': ranker.cc:80:36: error: 'getcwd' was not declared in this scope make[3]: *** [ranker.lo]...

Hi Parth, I?ve implemented SVMRanker class and also sorted out most of current Letor APIs. Now I?m trying to use INEX dataset to verify my implement. But I stuck in the indexing part. You said in the documentation that we have to add prefix when indexing. Also I notice that you set some metadata in omindex.cc of your version. But the omindex.cc has changed since 2011. I think that?...

Hi, I am unable to build the letor module. I am generating the configure file using autoconf. The configure file generated is throwing the error ./configure: line 2057: syntax error near unexpected token `1.10.1' ./configure: line 2057: `AM_INIT_AUTOMAKE(1.10.1 -Wportability tar-ustar)` I am not too sure what to do with this. Ne...

Hello Rishabh, The attached diff file should help you to refactor the existing letor code and plug in your code easily. I have defined the header files with the necessary flow. I have also specified the ranker class, which should be implemented by a new LTR models, ListNet and ListMLE in your case. The evaluation file should be used for validating the performance of the algorithm i...

I use Ubuntu12.04, GNU Make 3.81 and I am not sure if I use some special configure options. The commands I use after clone the repo are as follows: cd xapian ./bootstarp ./configure make cd xapian-letor aclocal -I ../xapian-core/m4 libtoolize --force autoconf autoheader automake --add-missing ./configure make Is this normal? 2014-12-07 22:37 GMT+08:00 James Aylett <james-xapian at tartarus.org>: > On 6 Dec 2014, at 15:55, Hanxiao Sun <sunhanxiaoisme at gmail.com> wrote: > >...

Hi, I have several questions regarding the letor module,I looked at the framework of learning to rank in xapian http://rishabhmehrotra.com/gsoc/17.png, I am a little confused. Why using deep learning to find unsupervised features in test data? Since in my understanding, learning to rank model usually learn features from the training data then app...

...HACKING under the xapian-core. It can help you to know how to hacking on Xapian more clearer. Take it easy. It also takes me many time before I can contribute something. 2014-12-06 10:01 GMT+08:00 Manu Gupta <gmanu at umich.edu>: > Hi > > Thank you!! > > I tried building the letor for both the branches and unfortunately both of > them do not build : > > gsoc2014 branch gives an error at : > > C -DPIC -o .libs/ranklist.o > ranklist.cc: In member function 'void Xapian::RankList::sort_by_score()': > ranklist.cc:98:6: error: unused variable 'fvv_...

Hi, I've read the code of letor module. And I have some questions about it: 1. In https://github.com/rishabhmehrotra/xapian/blob/master/xapian-letor/letor_internal.cc#L299, there is a write_to_file method, which save RankList into ?train.txt?. But the format for ?train.txt? is different from the one mentioned in http://trac.xapi...

...public API, which would be a friend of MSet::Internal class so that it could access/update the weights and sort MSetItems accordingly, returning an updated MSet. As you pointed out, two obvious issues with this are: 1) Unnecessary addition to Xapian public API since this class is not useful beyond letor. 2) It gives access to MSet internals to end users What would you suggest should be the way out to access MSet internals from -letor, if we can't add things to -core's public API? Regards, Ayush -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lis...