On 12 March 2013 16:21, Duncan Sands <baldrick at free.fr> wrote:> IIRC the reference output is not used by default. You have to put > USE_REFERENCE_OUTPUT := 1 > in the Makefile in order to make use of the reference output. As > BenchmarkGame doesn't have this, are you sure the reference output > is causing the problem? >That was my initial assumption, too. But if I just run that test, the Makefile doesn't use GCC at all and only copies the reference_output to the out-nat file. I then copied a "good" output to the reference_output, and the test passed. I'm intrigued... ;) Attached is a test.log of a local run. The buildbots' logs are pretty similar on BenchmarkGame. cheers, --renato -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20130312/74a331bf/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: test.log Type: application/octet-stream Size: 42749 bytes Desc: not available URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20130312/74a331bf/attachment.obj>
Hi Renato, On 12/03/13 17:33, Renato Golin wrote:> On 12 March 2013 16:21, Duncan Sands <baldrick at free.fr > <mailto:baldrick at free.fr>> wrote: > > IIRC the reference output is not used by default. You have to put > USE_REFERENCE_OUTPUT := 1 > in the Makefile in order to make use of the reference output. As > BenchmarkGame doesn't have this, are you sure the reference output > is causing the problem? > > > That was my initial assumption, too. But if I just run that test, the Makefile > doesn't use GCC at all and only copies the reference_output to the out-nat file.if you look at the first line of your log 2013-03-12 15:19:41: running: "make" "-k" "TARGET_LLVMGCC=/home/rengolin/devel/llvm/build/bin/clang" "TARGET_CXX=None" "LLI_OPTFLAGS=-O3" "TARGET_CC=None" "TARGET_LLVMGXX=/home/rengolin/devel/llvm/build/bin/clang++" "TEST=simple" "CC_UNDER_TEST_IS_CLANG=1" "ENABLE_PARALLEL_REPORT=1" "TARGET_FLAGS=" "USE_REFERENCE_OUTPUT=1" "CC_UNDER_TEST_TARGET_IS_X86_64=1" "OPTFLAGS=-O3" "LLC_OPTFLAGS=-O3" "ENABLE_OPTIMIZED=1" "ARCH=x86_64" "ENABLE_HASHED_PROGRAM_OUTPUT=1" "DISABLE_JIT=1" "-C" "SingleSource/Benchmarks/BenchmarkGame" "-j" "8" "report" "report.simple.csv" then you see that it forces USE_REFERENCE_OUTPUT=1. Maybe LNT does that? Ciao, Duncan.> > I then copied a "good" output to the reference_output, and the test passed. I'm > intrigued... ;) > > Attached is a test.log of a local run. The buildbots' logs are pretty similar on > BenchmarkGame. > > cheers, > --renato
On 12 March 2013 16:48, Duncan Sands <baldrick at free.fr> wrote:> then you see that it forces USE_REFERENCE_OUTPUT=1. Maybe LNT does that? >Ha! Well spotted, thanks! ;) I think we should force it zero on random tests... --renato -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20130312/7f4b5b9a/attachment.html>