Displaying 2 results from an estimated 2 matches for "clueweb09".
Did you mean:
clueweb09b
2018 Apr 27
3
GSOC 2018: Diversification of Search Results
....com>
wrote:
> Thanks for selecting my proposal for GSoC, looking forward to
> contributing further to Xapian. I've posted this in the IRC but didn't
> receive any reply, so I'm presuming this must've been missed and thus
> posting it here. As proposed, I plan to use ClueWeb09 Category B
> dataset for evaluating diversification. A hosted copy is available
> (http://lemurproject.org/clueweb09.php/index.php#Services) which may
> be accessed but requires a license. The license is free and granted to
> an organisation by applying online
> (http://lemurproject....
2018 Feb 25
3
GSOC 2018: Diversification of Search Results
...core/cluster.
3) Evaluation:
The evaluation metric widely used in literature are alpha-NDCG [4] and
ERR-IA [5]. These are also among the metrics used by the main paper [2],
thus allowing for direct comparison with the author's results. The data set
corpus used in the literature the most is ClueWeb09 with queries from TREC
2009/2010 diversification task. The problem is that both these are not
freely available. For implementation, I'd like to implement alpha-NDCG and
if time persists then ERR-IA.
Please let me know what you think, any kind of feedback is appreciated.
[1] Search Result Div...