llvm dev - Aug 2008 - [LLVMdev] Beginner question: request guidance on how to trace 'make check' failure in SVN build

Greetings everybody,

I'm at beginner level with LLVM and tried to build the sources from
SVN revision 54920 on Fedora 9 (kernel 2.6.25-14.fc9.x86_64) running
on Intel Q6600 @ 2.40GHz processor. LLVM build using 'make -j 4' was
successful. However, during 'make check', a test case failed. The
relevant snippets appear below. Can someone please point me to any
links on how the relevant error can be further traced? I am interested
in contributing to the testing efforts for LLVM on Linux and eager to
learn the essential tools for the same. I'm highly impressed with LLVM
so far.

'make check' output
-------------------
Test Run By arthay on Mon Aug 18 22:46:07 2008
Native configuration is x86_64-unknown-linux-gnu

		===  tests ==
Schedule of variations:
    unix

Running target unix
Using /home/arthay/tools/share/dejagnu/baseboards/unix.exp as board
description file for target.
Using /home/arthay/tools/share/dejagnu/config/unix.exp as generic
interface file for target.
....
....
Running /home/arthay/llvm-work/llvm/test/Transforms/LoopSimplify/dg.exp ...
Running /home/arthay/llvm-work/llvm/test/Transforms/LoopStrengthReduce/dg.exp
...
FAIL:
/home/arthay/llvm-work/llvm/test/Transforms/LoopStrengthReduce/2008-08-14-ShadowIV.ll
Failed with exit(1) at line 1
while running: llvm-as <
/home/arthay/llvm-work/llvm/test/Transforms/LoopStrengthReduce/2008-08-14-ShadowIV.ll
| opt -loop-reduce | llvm-dis | grep "phi double" | count 1
count: expected 1 lines and got 0.
child process exited abnormally
Running /home/arthay/llvm-work/llvm/test/Transforms/LoopUnroll/dg.exp ...
....
....
		===  Summary ==
# of expected passes		2661
# of unexpected failures	1
# of expected failures		11
make[1]: Leaving directory `/home/arthay/llvm-work/llvm-objects/test'
------------------

Additional Details
------------------
LLVM was configured with:
$../llvm/configure --prefix=/home/arthay/app


I'm using tcl 8.4.18, dejagnu 1.4.4, expect-5.43, gmp 4.2.2, mpfr
2.3.0. On a sidenote, gcc 4.3.1  was successfully bootstrapped and
tested using 'make check'. The gcc 4.3.1 testsuite needed autogen.
Autogen needed guile which itself depended on libtool. Thus, I used
autogen 5.9.5, guile 1.8.5 and libtool 1.5.26.  Earlier, I used the
default gcc in Fedora 9 i.e. gcc version 4.3.0 20080428 (Red Hat
4.3.0-8), to bootstrap gcc 4.3.1 and build these tools. The PATH and
LD_LIBRARY_PATH environment variables are set properly.

$ gcc -v
Using built-in specs.
Target: x86_64-redhat-linux
Configured with: ../gcc-4.3.1/configure --prefix=/home/arthay/tools
--enable-bootstrap --enable-shared --enable-threads=posix
--enable-checking=release --with-system-zlib --enable-__cxa_atexit
--disable-libunwind-exceptions --enable-languages=c,c++
--with-cpu=generic --build=x86_64-redhat-linux
--with-gmp=/home/arthay/tools --with-mpfr=/home/arthay/tools
--disable-multilib
Thread model: posix
gcc version 4.3.1 (GCC)


Thanks in advance.

Best regards,

Shailesh S. Khandekar,
Pune, India.

This a current failure on LLVM TOT. It will probably be fixed soon.

As for tracing the error, you should first read up on our testing 
framework:
http://llvm.org/docs/TestingGuide.html

Generally, you will want to look at the failing tests RUN line and 
determine what part is failing (in the case below, grep is failing). Most 
of the tests in llvm/test are pretty small, so you probably don't need to 
reduce the test case. Then its a matter of understanding what the test is 
testing for and debugging the pass/opt or whatever.

For bigger test cases, you will want to read up on bugpoint:
http://llvm.org/cmds/bugpoint.html
http://llvm.org/docs/Bugpoint.html

How to file a bug report:
http://llvm.org/docs/HowToSubmitABug.html

-Tanya

On Mon, 18 Aug 2008, Shailesh Khandekar wrote:
> Greetings everybody,
>
> I'm at beginner level with LLVM and tried to build the sources from
> SVN revision 54920 on Fedora 9 (kernel 2.6.25-14.fc9.x86_64) running
> on Intel Q6600 @ 2.40GHz processor. LLVM build using 'make -j 4'
was
> successful. However, during 'make check', a test case failed. The
> relevant snippets appear below. Can someone please point me to any
> links on how the relevant error can be further traced? I am interested
> in contributing to the testing efforts for LLVM on Linux and eager to
> learn the essential tools for the same. I'm highly impressed with LLVM
> so far.
>
> 'make check' output
> -------------------
> Test Run By arthay on Mon Aug 18 22:46:07 2008
> Native configuration is x86_64-unknown-linux-gnu
>
> 		===  tests ==>
> Schedule of variations:
>    unix
>
> Running target unix
> Using /home/arthay/tools/share/dejagnu/baseboards/unix.exp as board
> description file for target.
> Using /home/arthay/tools/share/dejagnu/config/unix.exp as generic
> interface file for target.
> ....
> ....
> Running /home/arthay/llvm-work/llvm/test/Transforms/LoopSimplify/dg.exp ...
> Running
/home/arthay/llvm-work/llvm/test/Transforms/LoopStrengthReduce/dg.exp
> ...
> FAIL:
/home/arthay/llvm-work/llvm/test/Transforms/LoopStrengthReduce/2008-08-14-ShadowIV.ll
> Failed with exit(1) at line 1
> while running: llvm-as <
>
/home/arthay/llvm-work/llvm/test/Transforms/LoopStrengthReduce/2008-08-14-ShadowIV.ll
> | opt -loop-reduce | llvm-dis | grep "phi double" | count 1
> count: expected 1 lines and got 0.
> child process exited abnormally
> Running /home/arthay/llvm-work/llvm/test/Transforms/LoopUnroll/dg.exp ...
> ....
> ....
> 		===  Summary ==>
> # of expected passes		2661
> # of unexpected failures	1
> # of expected failures		11
> make[1]: Leaving directory `/home/arthay/llvm-work/llvm-objects/test'
> ------------------
>
> Additional Details
> ------------------
> LLVM was configured with:
> $../llvm/configure --prefix=/home/arthay/app
>
>
> I'm using tcl 8.4.18, dejagnu 1.4.4, expect-5.43, gmp 4.2.2, mpfr
> 2.3.0. On a sidenote, gcc 4.3.1  was successfully bootstrapped and
> tested using 'make check'. The gcc 4.3.1 testsuite needed autogen.
> Autogen needed guile which itself depended on libtool. Thus, I used
> autogen 5.9.5, guile 1.8.5 and libtool 1.5.26.  Earlier, I used the
> default gcc in Fedora 9 i.e. gcc version 4.3.0 20080428 (Red Hat
> 4.3.0-8), to bootstrap gcc 4.3.1 and build these tools. The PATH and
> LD_LIBRARY_PATH environment variables are set properly.
>
> $ gcc -v
> Using built-in specs.
> Target: x86_64-redhat-linux
> Configured with: ../gcc-4.3.1/configure --prefix=/home/arthay/tools
> --enable-bootstrap --enable-shared --enable-threads=posix
> --enable-checking=release --with-system-zlib --enable-__cxa_atexit
> --disable-libunwind-exceptions --enable-languages=c,c++
> --with-cpu=generic --build=x86_64-redhat-linux
> --with-gmp=/home/arthay/tools --with-mpfr=/home/arthay/tools
> --disable-multilib
> Thread model: posix
> gcc version 4.3.1 (GCC)
>
>
> Thanks in advance.
>
> Best regards,
>
> Shailesh S. Khandekar,
> Pune, India.
> _______________________________________________
> LLVM Developers mailing list
> LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
>