llvm dev - Nov 2013 - [LLVMdev] Proposal: Improvements to Performance Tracking Infrastructure.

On 13 November 2013 13:14, Kristof Beyls <kristof.beyls at arm.com> wrote:
>     b) evaluate if the main running time of the benchmark is caused by
> running
>
>        code compiled or by something else, e.g. file IO. Programs
> dominated by
>
>        file IO shouldn't be used to track performance changes over
time.
>
>        The proposal to resolve this is to create a way to run the test
> suite in
>
>        'benchmark mode', which includes only a subset of the test
suite
> useful
>
>        for benchmarking.  Hal Finkel volunteered to start this work.
>

Thanks to Hal for being such a corageous man! ;)

We should involve Daniel Dumbar, Chris Matthews and Michael Grottesman on
the design and planning of such a suite. Chris is working on getting better
results from the current suite, and his input would be invaluable on such a
task.

As soon as we have a "benchmark mode" for the test-suite, I will setup
a
new ARM buildbot to run those and stop sending reports from the old
test-suite bot, and leave it running for validation purposes only.

cheers,
--renato
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20131113/a7f00798/attachment.html>