Xapian devel - May 2016 - GSoC: Weighting Schemes

Hi Vivek,

 I saw your comments on IRC,  as noted by olly :
*<olly> vivekp: (if you check the logs) - you want: ./trec_index config*
*<olly> you want to run the compiled binary (no ".cc") not the
source
file...*

But i guess you are not able to compile the setup. I can write steps and
send across how to compile and sample files from config.

Most of the files in config are from a test collection taken from FIRE, we
would need to ask permission to gain access to those files by FIRE team(
http://fire.irsi.res.in/fire/static/data). It needs to be signed to gain
access by organization to permit us to use data.

@olly and @James
Earlier being part of fire team, i was able to use this data. Not sure i
have the data now, Should we fill these form and ask permission to use this
data from FIRE team?

Thanks,
Gaurav


On Mon, May 9, 2016 at 4:03 PM, James Aylett <james-xapian at
tartarus.org>
wrote:
> On Sun, May 08, 2016 at 04:36:16PM +0530, Vivek Pal wrote:
>
> > >>you need to independently calculate, or independently
> > >>verify, the correct outputs for some test sets (you should be
able to
> > >>use the existing test databases).
> >
> > So, careful manual testing of implemented code and automated testing
> > through xapian-core/tests/api_weight.cc
> > using the existing test databases is what I'd need to perform for
> complete
> > testing of implemented weighting functions.
>
> Almost -- the manual step should just be in calculating the correct
> outputs. All the actual testing, verifying that the weights come out
> correctly, should be automated.
>
> > I've started exploring and trying to get this evaluation module
> > running on my system.  Facing some issues initially so trying to
> > sort out those issues with the help from Gaurav on IRC.
>
> Great -- I note that Olly has dropped something in IRC about this, so
> hopefully you're able to keep moving forward.
>
> > >>We may want to take the opportunity to discuss whether parts
or all of
> > >>this evaluation framework can be moved into the main Xapian
repo, and
> > >>if there are changes that will make it easier to use for
evaluation in
> > >>future.
> >
> > Yes, it'd be a huge plus for us as it would help to compare
> > Xapian's performance based on the different weighting functions.
> > I'll add this under "Additional tasks" in my project
wiki and would like
> to
> > work with Gaurav after completing my GSoC project.
>
> Perfect.
>
> J
>
> --
>   James Aylett, occasional trouble-maker
>   xapian.org
>
>

-- 
Regards,
Gaurav Arora
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.xapian.org/pipermail/xapian-devel/attachments/20160509/f758f18b/attachment.html>

On Mon, May 09, 2016 at 04:37:34PM +0530, Gaurav Arora wrote:
> Most of the files in config are from a test collection taken from FIRE, we
> would need to ask permission to gain access to those files by FIRE team(
> http://fire.irsi.res.in/fire/static/data). It needs to be signed to gain
> access by organization to permit us to use data.
> 
> Earlier being part of fire team, i was able to use this data. Not sure i
> have the data now, Should we fill these form and ask permission to use this
> data from FIRE team?
It'd be good to have access to some well-curated data sets, but I'm
not sure right now that we can really fill out the form, because we're
not incorporated or part of a university or similar. I imagine we'd be
able to do it if/when we're under the umbrella of SFC. However the
bureaucracy for FIRE seems a little onerous (to me -- maybe all
academic data sets have similar levels of paperwork). If we can find
some data sets under simpler conditions, that would be helpful.

J

-- 
  James Aylett, occasional trouble-maker
  xapian.org

Thanks James,

i will try to have word with FIRE team and see if  we can get access to
dataset without being incorporated or part of university. In parallel, will
also try to check data set with simpler condition.



On Mon, May 9, 2016 at 6:37 PM, James Aylett <james-xapian at
tartarus.org>
wrote:
> On Mon, May 09, 2016 at 04:37:34PM +0530, Gaurav Arora wrote:
>
> > Most of the files in config are from a test collection taken from
FIRE,
> we
> > would need to ask permission to gain access to those files by FIRE
team(
> > http://fire.irsi.res.in/fire/static/data). It needs to be signed to
gain
> > access by organization to permit us to use data.
> >
> > Earlier being part of fire team, i was able to use this data. Not sure
i
> > have the data now, Should we fill these form and ask permission to use
> this
> > data from FIRE team?
>
> It'd be good to have access to some well-curated data sets, but I'm
> not sure right now that we can really fill out the form, because we're
> not incorporated or part of a university or similar. I imagine we'd be
> able to do it if/when we're under the umbrella of SFC. However the
> bureaucracy for FIRE seems a little onerous (to me -- maybe all
> academic data sets have similar levels of paperwork). If we can find
> some data sets under simpler conditions, that would be helpful.
>
> J
>
> --
>   James Aylett, occasional trouble-maker
>   xapian.org
>
>

-- 
Regards,
Gaurav Arora
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.xapian.org/pipermail/xapian-devel/attachments/20160509/13df15eb/attachment.html>