Hi, I get the following failures when I run the test-suite on linux (Ubuntu 12.04) using LNT (lnt runtest nt ...): (all are execution failures) MultiSource/Applications/Burg MultiSource/Applications/ClamAV MultiSource/Applications/lemon MultiSource/Applications/obsequi MultiSource/Benchmarks/MiBench/automotive-bitcount MultiSource/Benchmarks/MiBench/telecomm-FFT MultiSource/Benchmarks/Olden/voronoi MultiSource/Benchmarks/Ptrdist/anagram SingleSource/Benchmarks/BenchmarkGame Everything is built off trunk. Has anyone else seen these failures and found a fix? Perhaps I'm missing a dependency? There doesn't appear to be a linux machine on llvm.org/perf to compare with either. paul
Can someone confirm if the test-suite passes 100% on linux? What is involved in adding a new perf machine? paul On 2013-01-17 5:24 PM, "Redmond, Paul" <paul.redmond at intel.com> wrote:>Hi, > >I get the following failures when I run the test-suite on linux (Ubuntu >12.04) using LNT (lnt runtest nt ...): > >(all are execution failures) >MultiSource/Applications/Burg >MultiSource/Applications/ClamAV >MultiSource/Applications/lemon >MultiSource/Applications/obsequi >MultiSource/Benchmarks/MiBench/automotive-bitcount >MultiSource/Benchmarks/MiBench/telecomm-FFT >MultiSource/Benchmarks/Olden/voronoi >MultiSource/Benchmarks/Ptrdist/anagram >SingleSource/Benchmarks/BenchmarkGame > >Everything is built off trunk. > >Has anyone else seen these failures and found a fix? Perhaps I'm missing >a dependency? There doesn't appear to be a linux machine on llvm.org/perf >to compare with either. > >paul >_______________________________________________ >LLVM Developers mailing list >LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu >http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
Hi, I figured out how to resolve the failures. I noticed that Mountain Lion includes Bison 2.3 while Ubuntu 12.04 includes Bison 2.5. I installed Bison 2.3 from source in Ubuntu and the failures went away. I'm a little concerned that the bison version fixed all the failures I was seeing. To my knowledge the only failing test that depended on bison was Burg. It almost looks like one failure can cause unrelated tests to fail. Any ideas? paul On 2013-01-17 5:24 PM, "Redmond, Paul" <paul.redmond at intel.com> wrote:>Hi, > >I get the following failures when I run the test-suite on linux (Ubuntu >12.04) using LNT (lnt runtest nt ...): > >(all are execution failures) >MultiSource/Applications/Burg >MultiSource/Applications/ClamAV >MultiSource/Applications/lemon >MultiSource/Applications/obsequi >MultiSource/Benchmarks/MiBench/automotive-bitcount >MultiSource/Benchmarks/MiBench/telecomm-FFT >MultiSource/Benchmarks/Olden/voronoi >MultiSource/Benchmarks/Ptrdist/anagram >SingleSource/Benchmarks/BenchmarkGame > >Everything is built off trunk. > >Has anyone else seen these failures and found a fix? Perhaps I'm missing >a dependency? There doesn't appear to be a linux machine on llvm.org/perf >to compare with either. > >paul >_______________________________________________ >LLVM Developers mailing list >LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu >http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
There is almost certainly a bug in lnt or the makefiles.
I changed the body of Burg main to the following:
+ printf("Hello World\n");
+ return 0;
I re-ran the test-suite again and got the following errors:
--- Tested: 986 tests --
FAIL: MultiSource/Applications/Burg/burg.execution_time (494 of 986)
FAIL: MultiSource/Applications/ClamAV/clamscan.execution_time (495 of 986)
FAIL: MultiSource/Applications/lemon/lemon.execution_time (496 of 986)
FAIL:
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount.exec
ution_time (497 of 986)
FAIL:
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft.execution_time
(498 of 986)
FAIL: MultiSource/Benchmarks/Olden/voronoi/voronoi.execution_time (499 of
986)
FAIL: MultiSource/Benchmarks/Ptrdist/anagram/anagram.execution_time (500
of 986)
FAIL: SingleSource/Benchmarks/BenchmarkGame/puzzle.execution_time (501 of
986)
Notice how the test numbers are consecutive (494-501). They all pass when
Burg passes.
paul
On 2013-01-20 2:50 PM, "Redmond, Paul" <paul.redmond at
intel.com> wrote:
>Hi,
>
>I figured out how to resolve the failures. I noticed that Mountain Lion
>includes Bison 2.3 while Ubuntu 12.04 includes Bison 2.5. I installed
>Bison 2.3 from source in Ubuntu and the failures went away.
>
>I'm a little concerned that the bison version fixed all the failures I
was
>seeing. To my knowledge the only failing test that depended on bison was
>Burg. It almost looks like one failure can cause unrelated tests to fail.
>
>Any ideas?
>
>paul
>
>On 2013-01-17 5:24 PM, "Redmond, Paul" <paul.redmond at
intel.com> wrote:
>
>>Hi,
>>
>>I get the following failures when I run the test-suite on linux (Ubuntu
>>12.04) using LNT (lnt runtest nt ...):
>>
>>(all are execution failures)
>>MultiSource/Applications/Burg
>>MultiSource/Applications/ClamAV
>>MultiSource/Applications/lemon
>>MultiSource/Applications/obsequi
>>MultiSource/Benchmarks/MiBench/automotive-bitcount
>>MultiSource/Benchmarks/MiBench/telecomm-FFT
>>MultiSource/Benchmarks/Olden/voronoi
>>MultiSource/Benchmarks/Ptrdist/anagram
>>SingleSource/Benchmarks/BenchmarkGame
>>
>>Everything is built off trunk.
>>
>>Has anyone else seen these failures and found a fix? Perhaps I'm
missing
>>a dependency? There doesn't appear to be a linux machine on
llvm.org/perf
>>to compare with either.
>>
>>paul
>>_______________________________________________
>>LLVM Developers mailing list
>>LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu
>>http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
>