llvm dev - Aug 2016 - Running llvm test-suite

Hi llvm-dev,

Are we still able to run llvm test-suite without LNT?

Also, is there any example of configuring test-suite to run against 3rd
party backend rather than llc?


Thanks
Hongbin
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20160810/2adbad76/attachment.html>

Yes the test-suite can be run without lnt (you can always just look at the LNT
logfiles to see what commands it is running and run those yourself).

Currently I would recommend using the cmake/lit version of the test-suite. You
typically do something like:

mkdir build && cd build
cmake -GNinja -DCMAKE_C_COMPILER=/path/to/my/clang
-DTEST_SUITE_ARCH_FLAGS="-arch arm64" /path/to/test-suite
ninja      # to build the benchmarks
llvm-lit   # to run the benchmarks

You should check "ccmake"/"cmake -LA" to learn about the
available options as well as llvm-lit. You can either use llvm-lit from an llvm
build or use the pypy packaged version (pip install lit). The cmake/lit version
has no support to run custom backends through llc at the moment, you need to
have a clang version that accepts -arch XXX for your target.

- Matthias
> On Aug 10, 2016, at 7:47 PM, Hongbin Zheng via llvm-dev <llvm-dev at
lists.llvm.org> wrote:
> 
> Hi llvm-dev,
> 
> Are we still able to run llvm test-suite without LNT? 
> 
> Also, is there any example of configuring test-suite to run against 3rd
party backend rather than llc?
> 
> 
> Thanks
> Hongbin
> _______________________________________________
> LLVM Developers mailing list
> llvm-dev at lists.llvm.org
> http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev

Hi Matthias,

Thanks a lot for the explanation.

On Thu, Aug 11, 2016 at 11:45 AM, Matthias Braun <mbraun at apple.com>
wrote:
> Yes the test-suite can be run without lnt (you can always just look at the
> LNT logfiles to see what commands it is running and run those yourself).
>
> Currently I would recommend using the cmake/lit version of the test-suite.
> You typically do something like:
>
> mkdir build && cd build
> cmake -GNinja -DCMAKE_C_COMPILER=/path/to/my/clang
> -DTEST_SUITE_ARCH_FLAGS="-arch arm64" /path/to/test-suite
> ninja      # to build the benchmarks
> llvm-lit   # to run the benchmarks
>
> You should check "ccmake"/"cmake -LA" to learn about
the available options
> as well as llvm-lit. You can either use llvm-lit from an llvm build or use
> the pypy packaged version (pip install lit). The cmake/lit version has no
> support to run custom backends through llc at the moment, you need to have
> a clang version that accepts -arch XXX for your target.
>
Sorry I didn't explain well. Here I want to use testsuite to test a
customized compilation flow like:

clang -> opt-> <some other optimization tool> -> llc.

Is this possible by changing some of the makefile of llvm testsuite?

Thanks
Hongbin


>
> - Matthias
>
> > On Aug 10, 2016, at 7:47 PM, Hongbin Zheng via llvm-dev <
> llvm-dev at lists.llvm.org> wrote:
> >
> > Hi llvm-dev,
> >
> > Are we still able to run llvm test-suite without LNT?
> >
> > Also, is there any example of configuring test-suite to run against
3rd
> party backend rather than llc?
> >
> >
> > Thanks
> > Hongbin
> > _______________________________________________
> > LLVM Developers mailing list
> > llvm-dev at lists.llvm.org
> > http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20160811/53aab0c5/attachment.html>