Xapian devel - Jul 2012 - Dynamic Snippets - small scale result testing

Hello,

I've made a public small scale test[1] with different parameters for
generating snippets.

There is a set of queries that return different documents from
Wikipedia. For each document there are 6 snippets that I would like to
be ranked from 1 to 5.

1 - Worst snippet from the set, totally irrelevant to the _query_.
2 - Worse than the majority of the snippets from the set.
3 - Quite relevant snippet to the _query_. Not different than the
other ones from the set.
4 - Better than other relevant snippets from the set.
5 - Snippet that is totally relevant to the _query_ and document
content, best from the set.

If anyone has suggestions or any kind of feedback, please reply to this thread.
If you complete the assessment, please fill in the name field with
your IRC nickname. In case of unwanted submit (or an already existing
submit with your name), please notify me with the name of the submit
so I won't take it into account.

Thanks,
Mihai Bivol
[1] http://swarm.cs.pub.ro/~mbivol/snippet_assessor/

Mihai Bivol wrote on 7/17/12 8:28 PM:
> Hello,
> 
> I've made a public small scale test[1] with different parameters for
> generating snippets.
> 
> There is a set of queries that return different documents from
> Wikipedia. For each document there are 6 snippets that I would like to
> be ranked from 1 to 5.
> 
> 1 - Worst snippet from the set, totally irrelevant to the _query_.
> 2 - Worse than the majority of the snippets from the set.
> 3 - Quite relevant snippet to the _query_. Not different than the
> other ones from the set.
> 4 - Better than other relevant snippets from the set.
> 5 - Snippet that is totally relevant to the _query_ and document
> content, best from the set.
> 
> If anyone has suggestions or any kind of feedback, please reply to this
thread.
> If you complete the assessment, please fill in the name field with
> your IRC nickname. In case of unwanted submit (or an already existing
> submit with your name), please notify me with the name of the submit
> so I won't take it into account.

was there ever any final assessment of this project?


-- 
Peter Karman  .  http://peknet.com/  .  peter at peknet.com