Hey llvm-dev, What's the best method to test performance of Clang generated executables? Are the nightly tests in test-suite sufficient? I'm looking for publicly available tests/suites with a good breadth of coverage... Thanks, Cam -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20190710/f37851b9/attachment.html>
The tests and benchmarks in the `test-suite` repository are pretty comprehensive, and LLVM developers often justify changes by showing performance improvements in this suite. The answers to your questions really rely on your definitions of “sufficient” and “good breadth”, but I feel the test-suite is often good enough. Sam> On 10 Jul 2019, at 5:30PM, Cameron McInally via llvm-dev <llvm-dev at lists.llvm.org> wrote: > > Hey llvm-dev, > > What's the best method to test performance of Clang generated executables? Are the nightly tests in test-suite sufficient? > > I'm looking for publicly available tests/suites with a good breadth of coverage... > > Thanks, > Cam > _______________________________________________ > LLVM Developers mailing list > llvm-dev at lists.llvm.org > https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev-- Sam Elliott Software Developer - LLVM lowRISC CIC selliott at lowrisc.org --
On Thu, Jul 11, 2019 at 5:53 AM Sam Elliott <selliott at lowrisc.org> wrote:> The tests and benchmarks in the `test-suite` repository are pretty > comprehensive, and LLVM developers often justify changes by showing > performance improvements in this suite. >Thanks, Sam. This is what I was looking for. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20190711/0d77a8f9/attachment.html>
The cmake line on this page http://llvm.org/docs/TestSuiteGuide.html should likely be changed from cmake -DCMAKE_C_COMPILER=<path to llvm build>/bin/clang \ -C../test-suite/cmake/caches/O3.cmake \ ../test-suite to cmake -DCMAKE_C_COMPILER=<path to llvm build>/bin/clang \ -C../../test-suite/cmake/caches/O3.cmake \ ../../test-suite Neil On 7/11/19 3:53 AM, Sam Elliott via llvm-dev wrote:> The tests and benchmarks in the `test-suite` repository are pretty comprehensive, and LLVM developers often justify changes by showing performance improvements in this suite. > > The answers to your questions really rely on your definitions of “sufficient” and “good breadth”, but I feel the test-suite is often good enough. > > Sam > > -- > Sam Elliott > Software Developer - LLVM > lowRISC CIC > selliott at lowrisc.org > -- > > > > > > _______________________________________________ > LLVM Developers mailing list > llvm-dev at lists.llvm.org > https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20190712/0d65d791/attachment.html>