similar to: Gsoc 2012 project propojal "Weighting Scheme" -Doubt about project scope

Hi all, I am Prajwal, a sophomore Undergraduate student from IIT Bombay, India. I want to contribute to Xapian through GSoC 2012. Specifically I am interested in the Weighting Schemes project. I have not yet taken any IR related course, but IR and NLP have always been my academic interests. I want to learn more about these topics, and I think that this is the best opportunity to do so. I

Hello guys.I have sent a pull request for the code and tests of the Tf-Idf weighting scheme. Please do let me know if any changes are required.Meanwhile,Ill begin working on implementing normalizations which require additional statistics and on the DFR schemes. https://github.com/xapian/xapian/pull/6 On Tue, Feb 26, 2013 at 5:30 PM, <xapian-devel-request at lists.xapian.org>wrote: >

Hello guys :) I have sent a pull request for the Tf-Idf Weighting scheme incorporating as many normalizations as I could with the help of statistics currently available from Xapian::Weight . Please let me know what you'll think about it. I used the weighting scheme in a simple searcher and it did a fine job with it. I have no experience with writing tests for features like this.Please give me

Hi All, I'm Sumith, a postgraduate student in Monash university. I'm working in the area of Text weighting schemes and Text Mining. When I'm going through the GSOC project list, I felt interested in the 'Weighting Schemes' project. At the moment, I have worked with different weighting schemes as TF-IDF and would love to join and contribute with my ideas in this project.

Hello guys, as discussed on IRC, I've added an example of a weighting scheme that requires statistics to the howto manual of our Getting Started guide.Please do let me know if any modifications are required. The pull request is here : https://github.com/jaylett/xapian-docsprint/pull/3 -Regards -Aarsh. -------------- next part -------------- An HTML attachment was scrubbed... URL:

Hello guys,I've modified the TfIdf patch as per the feedback I got on it and have added the code to the pull request. Please do have a look and let me now what you'll think. https://github.com/xapian/xapian/pull/6 Also,I read somewhere that I need to register this weighting scheme with Xapian. Please can you'll throw some light on that ? -Regards -Aarsh -------------- next part

Hello guys.I am working on implementing the PL2 weighting scheme of the DFR framework by Gianni Amati. It uses the Poisson approximation of the Binomial as the probabilistic model (P), the Laplace law of succession to calculate the after effect of sampling or the risk gain (L) and within document frequency normalization H2(2) (as proposed by Amati in his PHD thesis). The formula for w(t,d) in

Hello everyone! I'm Ayush Tomar, junior undergrad in Computer Science from New Delhi, India. I love C++ coding and working on machine learning and information retrieval project. I was exploring the GSoC ideas for Xapian and the project on "Adding Weighting Schemes" looked really interesting to me. I wanted to work on text mining/IR this summer and this idea seems perfect! I have

Hello Everyone, I am a second year graduate student at IIIT-Bangalore and my interest is in the field of Information Retrieval. I have successfully compiled Xapian from source and have implemented some examples. While going through the project list Weighting Schemes project is the one I was looking to contribute to. So i went through the xapian-core/weight where most of the schemes are already

Hi James, Thanks for clearing doubts I had earlier. >>if we can introduce the variants using optional parameters that default to >>(effectively) 'off' that might be better than distinct ones, Yes, this will definitely be the better approach for introducing the variants of existing weighting functions. Thanks for the suggestion. Next, I will try to come up with a draft of

Hello, My name is Santiago Pina and I am currently studying two BSc(Hon) simultaneously ; one in Computer Science and the other in Mathematics as part of a pilot project at Universidad de Murcia. I am very excited to contribute in open source community through the platform of Google Summer of Code 2011. I was interested in the Weighting Schemes project and in the Matcher Optimisations project,

Hello all, I am very sorry I did not include xapian-devel mailing list in my previous mail. Thanks for responding my mail. Mohd Azeem NIT UK ________________________________ From: Olly Betts <olly at survex.com> To: Mohd Azeem <azeem201001 at yahoo.in> Cc: Parth Gupta <parthg.88 at gmail.com> Sent: Saturday, 31 March 2012 11:40 AM Subject: Re: GSoC, Xapian Project Weighting

Hello, I have updated my proposal for "project weighting schemes", If you get some time to read my proposal, I will appreciate your suggestions about it. proposal link: http://www.google-melange.com/gsoc/proposal/review/google/gsoc2012/azeembt10cse/1 Thank you with regards, Mohd Azeem NIT Uttarakhand -------------- next part -------------- An HTML attachment was scrubbed... URL:

Hi, guys I am Wenjin from Graduate School of Chinese Academy of Science, pursing a master degree and my current research interests including using Data mining and Information retrieve technology to analysis software engineering (SE) data and support SE. I have great interested in "Weight Schemes" project. and in the last few days I have learnt some detail about DFR model family by

Hello guys.I just read up about tf-idf schemes and want to implement it in Xapian (with some frequently used normalizations) as it will also give me a good hang of implementing a weighting scheme before I start working on implementing DFR schemes. I read the following as references and I think Ive understood it well and can write the hack :- 1.)

Hi Vivek, I saw your comments on IRC, as noted by olly : *<olly> vivekp: (if you check the logs) - you want: ./trec_index config* *<olly> you want to run the compiled binary (no ".cc") not the source file...* But i guess you are not able to compile the setup. I can write steps and send across how to compile and sample files from config. Most of the files in config are

> Hi, Vivek — there isn't any particular reason that I'm aware of. It's > probably worth pointing (in the omegascript documentation) to the part of > the getting started guide which talks about the different weighting schemes If there isn't any reason then I'd like to send in a patch adding support for those weighting schemes in weight.cc and I agree omegascript

Hi, all: This is the basic implementation of tf-idf scheme (basic scheme used in SMART) that can be used in the Xapian. It might still need some futher revision, but I believe it works anyway.:) I modified the weight.h to define a subclass Tf_idfWeight and add a new file tf_idf.cc in ../weight in the repo, to implement Tf_idfWeight. Here is the git diff patch: https://gist.github.com/2422049

Hello everyone, I have been working on adding support for BM25+ weighting function from the last couple of weeks. Initially, I considered modifying bm25weight.cc to add support for BM25+ function without disturbing functionalities of BM25. But that didn't work out very well. A day or two was spent trying to refactor and debug the same code. Later, I took another approach following the

Hi, I have added support for Piv normalization in Tf-Idf weighting scheme as a intermediate step to implementing the support for Piv+ normalization. All tests pass. But I'm running into some issues with Piv+ normalization. In the Piv+ formula , there are two parameters (s and delta) that control the weight assigned. I think the way I'm serialising and unserialising these parameters has