llvm dev - Jan 2016 - LLVM-LIT config documentation?

Dear all,

Recently I've considering using LIT for my benchmark testing framework, and
the only reference for LLVM-LIT is the man page and some READMEs. I don't
find any documentations on config, which seems to be quite important to the
tool. If I use lit outside LLVM source tree and use on my own test files,
LIT marks them as 'unresolved'.

So are there any documentations I can find about using LIT for my own
benchmarks? Thanks in advance.

Regards,
Kevin
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20160114/9a5f9f6d/attachment.html>

Hi Kevin,

I ran into a similar problem a while ago and fixed it mostly by taking 
bits from the existing lit.cfg and some info from the LIT command guide [1].

 From this I found that this is a somewhat minimal lit.cfg could look like:
---------------------------------------------------------------
import lit.formats

# Lit configuration
config.name = "FOO"
config.test_format = lit.formats.ShTest("0")
config.suffixes = {".c"}
config.target_triple = ""
---------------------------------------------------------------

I hope this will get you going.

Cheers,
  Roel

[1] http://llvm.org/docs/CommandGuide/lit.html#test-suites

On 14/01/16 23:57, Kevin Hu via llvm-dev wrote:
> Dear all,
>
> Recently I've considering using LIT for my benchmark testing framework,
> and the only reference for LLVM-LIT is the man page and some READMEs. I
> don't find any documentations on config, which seems to be quite
> important to the tool. If I use lit outside LLVM source tree and use on
> my own test files, LIT marks them as 'unresolved'.
>
> So are there any documentations I can find about using LIT for my own
> benchmarks? Thanks in advance.
>
> Regards,
> Kevin
>
>
> _______________________________________________
> LLVM Developers mailing list
> llvm-dev at lists.llvm.org
> http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev
>

On Fri, Jan 15, 2016 at 11:03:07AM +0100, Roel Jordans via llvm-dev
wrote:
> Hi Kevin,
> 
> I ran into a similar problem a while ago and fixed it mostly by taking bits
> from the existing lit.cfg and some info from the LIT command guide [1].
> 
> From this I found that this is a somewhat minimal lit.cfg could look like:
> ---------------------------------------------------------------
> import lit.formats
> 
> # Lit configuration
> config.name = "FOO"
> config.test_format = lit.formats.ShTest("0")
> config.suffixes = {".c"}
> config.target_triple = ""
> ---------------------------------------------------------------
You can have a look to the lit config we setup for our llvm dev tutorial last
year:

   
https://github.com/quarkslab/llvm-dev-meeting-tutorial-2015/blob/master/Tests/lit.cfg.in

It's slightly more complicated than the one above, but there's a decent
ratio of comments in it too ;-)

Hi Kevin,

> So are there any documentations I can find about using LIT for my own
> benchmarks? Thanks in advance.
I use lit for several non LLVM projects. Hopefully these will be useful to you.

https://github.com/symbooglix/symbooglix/tree/master/test_programs

https://github.com/boogie-org/boogie/blob/master/Test/lit.site.cfg

and also for KLEE

https://github.com/klee/klee/tree/master/test

You can also take a look at lit's own test cases too

https://github.com/llvm-mirror/llvm/tree/master/utils/lit/tests

I wish I had time to write good documentation for it because its a
fantastic tool but alas I dont.

HTH,
Dan.

Dear all,

Thanks very much for the pointers. This is very helpful and I'll keep
researching them.

Regards,
Kevin

On Fri, Jan 15, 2016 at 10:41 AM Dan Liew <dan at su-root.co.uk> wrote:
> Hi Kevin,
>
>
> > So are there any documentations I can find about using LIT for my own
> > benchmarks? Thanks in advance.
>
> I use lit for several non LLVM projects. Hopefully these will be useful to
> you.
>
> https://github.com/symbooglix/symbooglix/tree/master/test_programs
>
> https://github.com/boogie-org/boogie/blob/master/Test/lit.site.cfg
>
> and also for KLEE
>
> https://github.com/klee/klee/tree/master/test
>
> You can also take a look at lit's own test cases too
>
> https://github.com/llvm-mirror/llvm/tree/master/utils/lit/tests
>
> I wish I had time to write good documentation for it because its a
> fantastic tool but alas I dont.
>
> HTH,
> Dan.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20160115/7e121003/attachment.html>