The first one failed on a diff: ******************** TEST (simple) 'sse.expandfft' FAILED! ******************** Execution Context Diff: /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 1.139094e-07 and 1.159249e-07 abs. diff = 2.015500e-09 rel.diff = 1.738626e-02 Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00 ******************** TEST (simple) 'sse.expandfft' **************************** The second one too. /llvmpb3/build/projects/test-suite/tools/fpcmp -r 0.016" simple sse.stepfft ******************** TEST (simple) 'sse.stepfft' FAILED! ******************** Execution Context Diff: /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 1.139094e-07 and 1.159249e-07 abs. diff = 2.015500e-09 rel.diff = 1.738626e-02 Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00 ******************** TEST (simple) 'sse.stepfft' **************************** The third also. /home/rkotler/workspace/llvmpb3/projects/test-suite/DiffOutput.sh "/home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp -r 0.0001" simple linpack-pc ******************** TEST (simple) 'linpack-pc' FAILED! ******************** Execution Context Diff: /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 4.500000e+01 and 0.000000e+00 abs. diff = 4.500000e+01 rel.diff = 1.000000e+00 Out of tolerance: rel/abs: 1.000000e-04/0.000000e+00 ******************** TEST (simple) 'linpack-pc' **************************** The change that I'm testing would cause massive breakage if it were wrong since it is touching fundamental classes. I don't think there is any chance that my change is causing this. On 12/12/2012 04:06 PM, Nadav Rotem wrote:> I forgot to mention that you can also run "make TEST=simple report" which will generate a nice report. > > Do you know why these tests fail ? You can step into the test directory and run 'make TEST=simple' from there. It will save you some time. > > On Dec 12, 2012, at 4:04 PM, reed kotler <rkotler at mips.com> wrote: > >> I'm getting three failures. >> >> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.expandfft >> TEST-RESULT-exec-time: user 0.3200 >> TEST-RESULT-exec-real-time: real 0.3172 >> >> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.stepfft >> TEST-RESULT-exec-time: user 0.4000 >> TEST-RESULT-exec-real-time: real 0.4172 >> make[4]: Leaving directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE' >> >> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack/linpack-pc >> TEST-RESULT-exec-time: user 164.9400 >> TEST-RESULT-exec-real-time: real 165.3131 >> make[3]: Leaving directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack' >> make[3]: Entering directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/LivermoreLoops >> _______________________________________________ >> LLVM Developers mailing list >> LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu >> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
when I create the report, there are no failures in it. so maybe these are being filtered for known failures. On 12/12/2012 05:03 PM, reed kotler wrote:> The first one failed on a diff: > ******************** TEST (simple) 'sse.expandfft' FAILED! > ******************** > Execution Context Diff: > /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: > 1.139094e-07 and 1.159249e-07 > abs. diff = 2.015500e-09 rel.diff = 1.738626e-02 > Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00 > ******************** TEST (simple) 'sse.expandfft' > **************************** > > The second one too. > > /llvmpb3/build/projects/test-suite/tools/fpcmp -r 0.016" simple > sse.stepfft > ******************** TEST (simple) 'sse.stepfft' FAILED! > ******************** > Execution Context Diff: > /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: > 1.139094e-07 and 1.159249e-07 > abs. diff = 2.015500e-09 rel.diff = 1.738626e-02 > Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00 > ******************** TEST (simple) 'sse.stepfft' > **************************** > > The third also. > > /home/rkotler/workspace/llvmpb3/projects/test-suite/DiffOutput.sh > "/home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp -r > 0.0001" simple linpack-pc > ******************** TEST (simple) 'linpack-pc' FAILED! > ******************** > Execution Context Diff: > /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: > 4.500000e+01 and 0.000000e+00 > abs. diff = 4.500000e+01 rel.diff = 1.000000e+00 > Out of tolerance: rel/abs: 1.000000e-04/0.000000e+00 > ******************** TEST (simple) 'linpack-pc' > **************************** > > The change that I'm testing would cause massive breakage if it were > wrong since it is touching fundamental classes. I don't think there is > any chance that my change is causing this. > > On 12/12/2012 04:06 PM, Nadav Rotem wrote: >> I forgot to mention that you can also run "make TEST=simple report" >> which will generate a nice report. >> >> Do you know why these tests fail ? You can step into the test >> directory and run 'make TEST=simple' from there. It will save you >> some time. >> >> On Dec 12, 2012, at 4:04 PM, reed kotler <rkotler at mips.com> wrote: >> >>> I'm getting three failures. >>> >>> TEST-FAIL: exec >>> /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.expandfft >>> TEST-RESULT-exec-time: user 0.3200 >>> TEST-RESULT-exec-real-time: real 0.3172 >>> >>> TEST-FAIL: exec >>> /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.stepfft >>> TEST-RESULT-exec-time: user 0.4000 >>> TEST-RESULT-exec-real-time: real 0.4172 >>> make[4]: Leaving directory >>> `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE' >>> >>> TEST-FAIL: exec >>> /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack/linpack-pc >>> TEST-RESULT-exec-time: user 164.9400 >>> TEST-RESULT-exec-real-time: real 165.3131 >>> make[3]: Leaving directory >>> `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack' >>> make[3]: Entering directory >>> `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/LivermoreLoops >>> _______________________________________________ >>> LLVM Developers mailing list >>> LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu >>> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev >
I use the 'make TEST=simple' as a pre-commit test. I think that everybody should run these tests before committing to LLVM. On Dec 12, 2012, at 5:06 PM, reed kotler <rkotler at mips.com> wrote:> when I create the report, there are no failures in it. so maybe these are being filtered for known failures. > > On 12/12/2012 05:03 PM, reed kotler wrote: >> The first one failed on a diff: >> ******************** TEST (simple) 'sse.expandfft' FAILED! ******************** >> Execution Context Diff: >> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 1.139094e-07 and 1.159249e-07 >> abs. diff = 2.015500e-09 rel.diff = 1.738626e-02 >> Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00 >> ******************** TEST (simple) 'sse.expandfft' **************************** >> >> The second one too. >> >> /llvmpb3/build/projects/test-suite/tools/fpcmp -r 0.016" simple sse.stepfft >> ******************** TEST (simple) 'sse.stepfft' FAILED! ******************** >> Execution Context Diff: >> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 1.139094e-07 and 1.159249e-07 >> abs. diff = 2.015500e-09 rel.diff = 1.738626e-02 >> Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00 >> ******************** TEST (simple) 'sse.stepfft' **************************** >> >> The third also. >> >> /home/rkotler/workspace/llvmpb3/projects/test-suite/DiffOutput.sh "/home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp -r 0.0001" simple linpack-pc >> ******************** TEST (simple) 'linpack-pc' FAILED! ******************** >> Execution Context Diff: >> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 4.500000e+01 and 0.000000e+00 >> abs. diff = 4.500000e+01 rel.diff = 1.000000e+00 >> Out of tolerance: rel/abs: 1.000000e-04/0.000000e+00 >> ******************** TEST (simple) 'linpack-pc' **************************** >> >> The change that I'm testing would cause massive breakage if it were wrong since it is touching fundamental classes. I don't think there is any chance that my change is causing this. >> >> On 12/12/2012 04:06 PM, Nadav Rotem wrote: >>> I forgot to mention that you can also run "make TEST=simple report" which will generate a nice report. >>> >>> Do you know why these tests fail ? You can step into the test directory and run 'make TEST=simple' from there. It will save you some time. >>> >>> On Dec 12, 2012, at 4:04 PM, reed kotler <rkotler at mips.com> wrote: >>> >>>> I'm getting three failures. >>>> >>>> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.expandfft >>>> TEST-RESULT-exec-time: user 0.3200 >>>> TEST-RESULT-exec-real-time: real 0.3172 >>>> >>>> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.stepfft >>>> TEST-RESULT-exec-time: user 0.4000 >>>> TEST-RESULT-exec-real-time: real 0.4172 >>>> make[4]: Leaving directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE' >>>> >>>> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack/linpack-pc >>>> TEST-RESULT-exec-time: user 164.9400 >>>> TEST-RESULT-exec-real-time: real 165.3131 >>>> make[3]: Leaving directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack' >>>> make[3]: Entering directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/LivermoreLoops >>>> _______________________________________________ >>>> LLVM Developers mailing list >>>> LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu >>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev >> >
Maybe Matching Threads
- [LLVMdev] failures in test-suite for make TEST=simple
- [LLVMdev] failures in test-suite for make TEST=simple
- [LLVMdev] failures in test-suite for make TEST=simple
- [LLVMdev] failures in test-suite for make TEST=simple
- [LLVMdev] [cfe-dev] LLVM 3.0rc3 Testing Beginning