Xapian devel - Feb 2015 - GSOC 2015

Hi!! Im planning to do the performance testing suite project for GSOC 2015.
I have done some basic reading and run tests locally.

As I have understood, if I write a test case to do the performance test
like memory check, what I have to do is basically add a new file like
mem_check.cc with a test harness and integrate it to run with the make
system. So when checking memory, should it be checked by running other
tests and doing mem checks or, should independant mem checks have to be
done without running existing tests.??

Thanks.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.xapian.org/pipermail/xapian-devel/attachments/20150214/7626f669/attachment-0002.html>

On 14 Feb 2015, at 16:40, Dulitha Kularathne <dulithamethmal at gmail.com>
wrote:
> Hi!! Im planning to do the performance testing suite project for GSOC 2015.
> I have done some basic reading and run tests locally. 
Dulitha ? welcome! You should join this mailing list
(http://lists.xapian.org/mailman/listinfo/xapian-devel) so that you get all
replies and people don?t have to remember to keep you copied on emails.
> As I have understood, if I write a test case to do the performance test
like memory check, what I have to do is basically add a new file like
mem_check.cc with a test harness and integrate it to run with the make system.
So when checking memory, should it be checked by running other tests and doing
mem checks or, should independant mem checks have to be done without running
existing tests.??
I?d have thoguht you probably want separate tests, because performance tests
should use ?real world? data (real corpus and real queries) where possible, so
it?s testing how Xapian will actually perform, rather than just theoretical
behaviour around more contrived use cases. Performance testing is quite
different from unit tests, for instance, where you?re narrowed down to just a
very small part of the system.

J

-- 
 James Aylett, occasional trouble-maker
 xapian.org