[LLVMdev] [RFC] Benchmarking subset of the test suite

Hal Finkel
2014-05-21T11:29:26Z

----- Original Message -----
> From: "Evan Cheng" <evan.cheng at apple.com>
> To: "Hal Finkel" <hfinkel at anl.gov>
> Cc: "LLVM Developers Mailing List" <llvmdev at cs.uiuc.edu>
> Sent: Monday, May 19, 2014 3:35:45 PM
> Subject: Re: [LLVMdev] [RFC] Benchmarking subset of the test suite
>
>
>
>
> On May 4, 2014, at 5:39 AM, Hal Finkel < hfinkel at anl.gov > wrote:
>
>
> security-blowfish
>
> Sorry that I'm late to this. I scanned the list you provided and it
> makes sense to me. But this one caught me by surprise. I remember we
> put quite a bit of effort tuning the scheduler to improve codegen
> quality of blowfish. Are you sure this particular benchmark isn't
> serving its purpose?

Yes. As currently configured, the running time is much too short. On PPC64, the
running time is <= 0.001s, and -O3 and -O0 cannot be statistically
distinguished. On x86-64, the running time is even smaller (timeit reports
0.0000 for -O3 builds).

 -Hal

>
>
> Evan

--
Hal Finkel
Assistant Computational Scientist
Leadership Computing Facility
Argonne National Laboratory