search for: 7b6feeef

On 28 June 2013 10:28, David Tweed <david.tweed at arm.com> wrote: > (Inicidentally, responding to the earlier email below, I think you don't > really want to compare moving averages but use some statistical test to > quantify if the separation between the set of points within the "earlier > window" are statistically significantly higher than the "later

There are a few things we have looked at with LNT runs, so I will share the insights we have had so far. A lot of the problems we have are artificially created by our test protocols instead of the compiler changes themselves. I have been doing a lot of large sample runs of single benchmarks to characterize them better. Some key points: 1) Some benchmarks are bi-modal or multi-modal, single