From http://llvm.org/docs/TestingGuide.html Some tests are known to fail. Some are bugs that we have not fixed yet; others are features that we haven't added yet (or may never add). In DejaGNU, the result for such tests will be XFAIL (eXpected FAILure). In this way, you can tell the difference between an expected and unexpected failure. The tests in the test suite have no such feature at this time. If the test passes, only warnings and other miscellaneous output will be generated. If a test fails, a large <program> FAILED message will be displayed. This will help you separate benign warnings from actual test failures. Does this mean there is no way to selectively disable a backend or to mark a test suite test XFAIL? Thanks, --Patrick
On Jul 22, 2010, at 2:44 PMPDT, Patrick Alexander Simmons wrote:> From http://llvm.org/docs/TestingGuide.html > > Some tests are known to fail. Some are bugs that we have not fixed > yet; > others are features that we haven't added yet (or may never add). In > DejaGNU, the result for such tests will be XFAIL (eXpected FAILure). > In > this way, you can tell the difference between an expected and > unexpected > failure. > > The tests in the test suite have no such feature at this time. If the > test passes, only warnings and other miscellaneous output will be > generated. If a test fails, a large <program> FAILED message will be > displayed. This will help you separate benign warnings from actual > test > failures. > > Does this mean there is no way to selectively disable a backend or toIt can be done in the Makefiles, but it's not as clean as XFAIL. Look at External/SPEC/CINT2000/Makefile for examples.
Thanks, Dale, that really helps. What about disabling only one backend of a specific test? Thanks, --Patrick On 07/22/10 16:04, Dale Johannesen wrote:> > On Jul 22, 2010, at 2:44 PMPDT, Patrick Alexander Simmons wrote: > >> From http://llvm.org/docs/TestingGuide.html >> >> Some tests are known to fail. Some are bugs that we have not fixed yet; >> others are features that we haven't added yet (or may never add). In >> DejaGNU, the result for such tests will be XFAIL (eXpected FAILure). In >> this way, you can tell the difference between an expected and unexpected >> failure. >> >> The tests in the test suite have no such feature at this time. If the >> test passes, only warnings and other miscellaneous output will be >> generated. If a test fails, a large <program> FAILED message will be >> displayed. This will help you separate benign warnings from actual test >> failures. >> >> Does this mean there is no way to selectively disable a backend or to > > It can be done in the Makefiles, but it's not as clean as XFAIL. Look > at External/SPEC/CINT2000/Makefile for examples. >-- If I'm not here, I've gone out to find myself. If I get back before I return, please keep me here.