search for: benchmarknig

Thanks a lot for setting this up! By using the "mean as aggregation" option one can see the noise in the results better: http://lnt.llvm.org/db_default/v4/link/graph?switch_min_mean=yes&moving_window_size=10&plot.9=1.9.7&submit=Update There are a few benchmarknig tips in https://www.llvm.org/docs/Benchmarking.html. For example, from looking at http://lab.llvm.org:8011/builders/lld-perf-testsuite/builds/285/steps/cmake-configure/logs/stdio It seems the produced lld binary is not being statically linked. A tip to make the bot a bit faster is that it could...

...or setting this up! > > By using the "mean as aggregation" option one can see the noise in the > results better: > > http://lnt.llvm.org/db_default/v4/link/graph?switch_ > min_mean=yes&moving_window_size=10&plot.9=1.9.7&submit=Update > > There are a few benchmarknig tips in https://www.llvm.org/docs/ > Benchmarking.html. > > For example, from looking at > > http://lab.llvm.org:8011/builders/lld-perf-testsuite/ > builds/285/steps/cmake-configure/logs/stdio > > It seems the produced lld binary is not being statically linked. > > A t...

Hello George, Sorry, somehow hit a send button too soon. Please ignore the previous e-mail. The bot does 10 runs for each of the benchmarks (those dots in the logs are meaningful). We can increase the number of runs if proven that this would significantly increase the accuracy. I didn't see the increase in accuracy when have been staging the bot, which would justify the extra time and larger

>Hello everyone, > >I have added a new public LLD performance builder at >http://lab.llvm.org:8011/builders/lld-perf-testsuite. >It builds LLVM and LLD by the latest releaed Clang and runs a set of >perfromance tests. > >The builder is reliable. Please pay attention on the failures. > >The performance statistics are here: