[llvm-dev] RFC Adding Fortran tests to LLVM Test Suite

Renato Golin via llvm-dev
Sun, 06 Dec 2020 12:21:58 -0000

On Sat, 5 Dec 2020 at 06:15, Romero, Nichols A. <naromero at anl.gov>
wrote:

> As I was planning this out in my head, I do think in the first
> differential we would add the CMake plumbing and a simple opens source
> program or two (e.g. hand-coded GEMM or something along those lines). SPEC
> would come in the next batch.
>

That sounds like a good initial plan. Do you also plan to add more OSS
applications, benchmarks and tests right after SPEC?

The main reason for the test-suite is not benchmark, but end-to-end
regression testing on multiple architectures. We can only claim to support
languages and targets if we can compile entire applications, run them and
get the expected results.

So having a set of language tests and some real world applications on the
test-suite will be required for us to claim Fortran support of any kind.

Those are also your best friends in making sure all the work you've done on
the front-end doesn't regress on any target, from release to release, or
during normal development.

That's why I'm pushing to have those tests and applications as soon as
possible. It's for Flang's own benefit.

On a related note, are there any buildbots running the llvm-test-suite
or
> are folks just running llvm-test-suite manually?
>

Plenty, on both testing and benchmark modes. It's also part of the release
process on all architectures.

You should add support for both testing and benchmark modes, so that the
benchmarks (not SPEC) get regression tested as well as be able to report
and compare performance numbers.

cheers,
--renato
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20201206/396b262e/attachment.html>