Vladimir Merzliakov
2004-Jun-21 07:15 UTC
[LLVMdev] llvm test results for FreeBSD platform
Is it ok sending this results for FreeBSD5.1 at daily/weekly based to this
mail list?
Now results.
Big improvement in llvm tests results from last test result sended.
New regressions:
Regression.Assembler.ConstantExprFold : FAIL , expected PASS
Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL ,
expected PASS
Regression.Transforms.PRE.basictest : FAIL , expected PASS
Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL ,
expected PASS
Full log attached.
---
STATISTICS ---------------------------------------------------------------
920 tests total
856 ( 93%) tests as expected
6 ( 1%) tests unexpected FAIL
58 ( 6%) tests unexpected PASS
--- TESTS WITH UNEXPECTED
OUTCOMES -------------------------------------------
Feature.mc.basictest : XPASS
Feature.mc.calltest : XPASS
Feature.mc.casttest : XPASS
Feature.mc.cfgstructures : XPASS
Feature.mc.constexpr : XPASS
Feature.mc.constexprbad : XPASS
Feature.mc.constpointer : XPASS
Feature.mc.forwardreftest : XPASS
Feature.mc.globalvars : XPASS
Feature.mc.indirectcall : XPASS
Feature.mc.indirectcall2 : XPASS
Feature.mc.properties : XPASS
Feature.mc.prototype : XPASS
Feature.mc.recursivetype : XPASS
Feature.mc.simplecalltest : XPASS
Feature.mc.small : XPASS
Feature.mc.smallest : XPASS
Feature.mc.testalloca : XPASS
Feature.mc.testconstants : XPASS
Feature.mc.testlogical : XPASS
Feature.mc.testmemory : XPASS
Feature.mc.testswitch : XPASS
Feature.mc.testvarargs : XPASS
Feature.mc.varargs : XPASS
Feature.mc.weirdnames : XPASS
Regression.Assembler.ConstantExprFold : FAIL , expected PASS
Script:
/usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc
ript.ConstantExprFold.llx
Output:
/usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc
ript.ConstantExprFold.llx.out
Regression.C++Frontend.2003-08-28-ForwardType : XPASS
Regression.C++Frontend.2003-09-30-ForIncrementExprBug2: XPASS
Regression.CFrontend.2003-01-30-UnionInit : FAIL , expected PASS
Compiling C code failed
Regression.CFrontend.2003-06-29-MultipleFunctionDefinition: XPASS
Regression.CFrontend.2003-08-30-AggregateInitializer: FAIL , expected
PASS
Compiling C code failed
Regression.CFrontend.2003-08-30-LargeIntegerBitfieldMember: XPASS
Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL ,
expected PASS
Script:
/usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc
ing.llx/testscript.2004-04-09-SameValueCoalescing.llx
Output:
/usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc
ing.llx/testscript.2004-04-09-SameValueCoalescing.llx.out
Regression.LLC.2002-04-14-UnexpectedUnsignedType: XPASS
Regression.LLC.2002-04-16-StackFrameSizeAlignment: XPASS
Regression.LLC.2003-05-27-phifcmpd : XPASS
Regression.LLC.2003-05-27-useboolinotherbb : XPASS
Regression.LLC.2003-05-27-usefsubasbool : XPASS
Regression.LLC.2003-05-28-ManyArgs : XPASS
Regression.LLC.2003-05-30-BadFoldGEP : XPASS
Regression.LLC.2003-05-30-BadPreselectPhi : XPASS
Regression.LLC.2003-07-06-BadIntCmp : XPASS
Regression.LLC.2003-07-07-BadLongConst : XPASS
Regression.LLC.2003-07-08-BadCastToBool : XPASS
Regression.LLC.2003-07-29-BadConstSbyte : XPASS
Regression.LLC.BurgBadRegAlloc : XPASS
Regression.LLC.badCallArgLRLLVM : XPASS
Regression.LLC.badFoldGEP : XPASS
Regression.LLC.badarg6 : XPASS
Regression.LLC.badlive : XPASS
Regression.LLC.constindices : XPASS
Regression.LLC.fwdtwice : XPASS
Regression.LLC.negintconst : XPASS
Regression.LLC.sched : XPASS
Regression.LLC.select : XPASS
Regression.LLC.spillccr : XPASS
Regression.Transforms.CorrelatedExprs.2002-10-03-PHIPropogate: XPASS
Regression.Transforms.CorrelatedExprs.whet : XPASS
Regression.Transforms.IndVarsSimplify.2003-09-23-NotAtTop: XPASS
Regression.Transforms.Inline.alloca_test : XPASS
Regression.Transforms.LICM.2003-08-04-TrappingInstHoist: XPASS
Regression.Transforms.LICM.2003-08-04-TrappingInstOkHoist: XPASS
Regression.Transforms.PRE.basictest : FAIL , expected PASS
Script:
/usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas
ictest.ll
Output:
/usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas
ictest.ll.out
Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL ,
expected PASS
Script:
/usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te
stscript.tail_call_with_branch.ll
Output:
/usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te
stscript.tail_call_with_branch.ll.out
-------------- next part --------------
A non-text attachment was scrubbed...
Name: test2004_06_21.log
Type: application/octet-stream
Size: 82446 bytes
Desc: not available
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20040621/e96f88c3/attachment.obj>
Vladimir, We had a problem with our nightly tester (a change I introduced to hopefully solve another problem) that caused most of the failures in your first test. This run looks much more like what we're used to seeing. I believe the two tests below are known problems. Reid. On Mon, 2004-06-21 at 04:54, Vladimir Merzliakov wrote:> Is it ok sending this results for FreeBSD5.1 at daily/weekly based to this > mail list? > > Now results. > Big improvement in llvm tests results from last test result sended. > > New regressions: > Regression.Assembler.ConstantExprFold : FAIL , expected PASS > Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL , > expected PASS > Regression.Transforms.PRE.basictest : FAIL , expected PASS > Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL , > expected PASS > > Full log attached. > > --- > STATISTICS --------------------------------------------------------------- > > 920 tests total > 856 ( 93%) tests as expected > 6 ( 1%) tests unexpected FAIL > 58 ( 6%) tests unexpected PASS > > --- TESTS WITH UNEXPECTED > OUTCOMES ------------------------------------------- > > Feature.mc.basictest : XPASS > > Feature.mc.calltest : XPASS > > Feature.mc.casttest : XPASS > > Feature.mc.cfgstructures : XPASS > > Feature.mc.constexpr : XPASS > > Feature.mc.constexprbad : XPASS > > Feature.mc.constpointer : XPASS > > Feature.mc.forwardreftest : XPASS > > Feature.mc.globalvars : XPASS > > Feature.mc.indirectcall : XPASS > > Feature.mc.indirectcall2 : XPASS > > Feature.mc.properties : XPASS > > Feature.mc.prototype : XPASS > > Feature.mc.recursivetype : XPASS > > Feature.mc.simplecalltest : XPASS > > Feature.mc.small : XPASS > > Feature.mc.smallest : XPASS > > Feature.mc.testalloca : XPASS > > Feature.mc.testconstants : XPASS > > Feature.mc.testlogical : XPASS > > Feature.mc.testmemory : XPASS > > Feature.mc.testswitch : XPASS > > Feature.mc.testvarargs : XPASS > > Feature.mc.varargs : XPASS > > Feature.mc.weirdnames : XPASS > > Regression.Assembler.ConstantExprFold : FAIL , expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc > ript.ConstantExprFold.llx > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc > ript.ConstantExprFold.llx.out > > Regression.C++Frontend.2003-08-28-ForwardType : XPASS > > Regression.C++Frontend.2003-09-30-ForIncrementExprBug2: XPASS > > Regression.CFrontend.2003-01-30-UnionInit : FAIL , expected PASS > Compiling C code failed > > Regression.CFrontend.2003-06-29-MultipleFunctionDefinition: XPASS > > Regression.CFrontend.2003-08-30-AggregateInitializer: FAIL , expected > PASS > Compiling C code failed > > Regression.CFrontend.2003-08-30-LargeIntegerBitfieldMember: XPASS > > Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL , > expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc > ing.llx/testscript.2004-04-09-SameValueCoalescing.llx > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc > ing.llx/testscript.2004-04-09-SameValueCoalescing.llx.out > > Regression.LLC.2002-04-14-UnexpectedUnsignedType: XPASS > > Regression.LLC.2002-04-16-StackFrameSizeAlignment: XPASS > > Regression.LLC.2003-05-27-phifcmpd : XPASS > > Regression.LLC.2003-05-27-useboolinotherbb : XPASS > > Regression.LLC.2003-05-27-usefsubasbool : XPASS > > Regression.LLC.2003-05-28-ManyArgs : XPASS > > Regression.LLC.2003-05-30-BadFoldGEP : XPASS > > Regression.LLC.2003-05-30-BadPreselectPhi : XPASS > > Regression.LLC.2003-07-06-BadIntCmp : XPASS > > Regression.LLC.2003-07-07-BadLongConst : XPASS > > Regression.LLC.2003-07-08-BadCastToBool : XPASS > > Regression.LLC.2003-07-29-BadConstSbyte : XPASS > > Regression.LLC.BurgBadRegAlloc : XPASS > > Regression.LLC.badCallArgLRLLVM : XPASS > > Regression.LLC.badFoldGEP : XPASS > > Regression.LLC.badarg6 : XPASS > > Regression.LLC.badlive : XPASS > > Regression.LLC.constindices : XPASS > > Regression.LLC.fwdtwice : XPASS > > Regression.LLC.negintconst : XPASS > > Regression.LLC.sched : XPASS > > Regression.LLC.select : XPASS > > Regression.LLC.spillccr : XPASS > > Regression.Transforms.CorrelatedExprs.2002-10-03-PHIPropogate: XPASS > > Regression.Transforms.CorrelatedExprs.whet : XPASS > > Regression.Transforms.IndVarsSimplify.2003-09-23-NotAtTop: XPASS > > Regression.Transforms.Inline.alloca_test : XPASS > > Regression.Transforms.LICM.2003-08-04-TrappingInstHoist: XPASS > > Regression.Transforms.LICM.2003-08-04-TrappingInstOkHoist: XPASS > > Regression.Transforms.PRE.basictest : FAIL , expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas > ictest.ll > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas > ictest.ll.out > > Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL , > expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te > stscript.tail_call_with_branch.ll > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te > stscript.tail_call_with_branch.ll.out >-------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: This is a digitally signed message part URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20040621/0c2f1eac/attachment.sig>
On Mon, 21 Jun 2004, Vladimir Merzliakov wrote:> Is it ok sending this results for FreeBSD5.1 at daily/weekly based to this > mail list?A better list for it would be the llvmbugs list for now. I beginning to think that we need a new test results mailing list. We have 3 instances of the nightly tester going now (x86/linux, sparc, ppc) and may have more in the future. The nightly tester spits out notification of changes (new test failures, etc) that get sent to whoever "owns" the tester. It would be good of having a way of keeping track of these reports. I don't really like the idea of adding yet another mailing list, especially because few people will probably subscribe to it, but I also don't want to spam any of the other lists too badly. What do others think? BTW, if you are interested in running the nightly tester on your freebsd box, let me know and I can help you get it set up.> Now results. > Big improvement in llvm tests results from last test result sended.Great! That's what we want to see. :)> New regressions: > Regression.Assembler.ConstantExprFold : FAIL , expected PASS > Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL , > expected PASS > Regression.Transforms.PRE.basictest : FAIL , expected PASS > Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL , > expected PASSThese should all be xfails right now, so this is ok.> 920 tests total > 856 ( 93%) tests as expected > 6 ( 1%) tests unexpected FAIL > 58 ( 6%) tests unexpected PASSThe 58 XPASSes are strange. It looks like qmtest isn't expecting you to have a working code generator, but you do. qmtest probably needs to be updated somehow to reflect this... -Chris> --- TESTS WITH UNEXPECTED > OUTCOMES ------------------------------------------- > > Feature.mc.basictest : XPASS > > Feature.mc.calltest : XPASS > > Feature.mc.casttest : XPASS > > Feature.mc.cfgstructures : XPASS > > Feature.mc.constexpr : XPASS > > Feature.mc.constexprbad : XPASS > > Feature.mc.constpointer : XPASS > > Feature.mc.forwardreftest : XPASS > > Feature.mc.globalvars : XPASS > > Feature.mc.indirectcall : XPASS > > Feature.mc.indirectcall2 : XPASS > > Feature.mc.properties : XPASS > > Feature.mc.prototype : XPASS > > Feature.mc.recursivetype : XPASS > > Feature.mc.simplecalltest : XPASS > > Feature.mc.small : XPASS > > Feature.mc.smallest : XPASS > > Feature.mc.testalloca : XPASS > > Feature.mc.testconstants : XPASS > > Feature.mc.testlogical : XPASS > > Feature.mc.testmemory : XPASS > > Feature.mc.testswitch : XPASS > > Feature.mc.testvarargs : XPASS > > Feature.mc.varargs : XPASS > > Feature.mc.weirdnames : XPASS > > Regression.Assembler.ConstantExprFold : FAIL , expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc > ript.ConstantExprFold.llx > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc > ript.ConstantExprFold.llx.out > > Regression.C++Frontend.2003-08-28-ForwardType : XPASS > > Regression.C++Frontend.2003-09-30-ForIncrementExprBug2: XPASS > > Regression.CFrontend.2003-01-30-UnionInit : FAIL , expected PASS > Compiling C code failed > > Regression.CFrontend.2003-06-29-MultipleFunctionDefinition: XPASS > > Regression.CFrontend.2003-08-30-AggregateInitializer: FAIL , expected > PASS > Compiling C code failed > > Regression.CFrontend.2003-08-30-LargeIntegerBitfieldMember: XPASS > > Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL , > expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc > ing.llx/testscript.2004-04-09-SameValueCoalescing.llx > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc > ing.llx/testscript.2004-04-09-SameValueCoalescing.llx.out > > Regression.LLC.2002-04-14-UnexpectedUnsignedType: XPASS > > Regression.LLC.2002-04-16-StackFrameSizeAlignment: XPASS > > Regression.LLC.2003-05-27-phifcmpd : XPASS > > Regression.LLC.2003-05-27-useboolinotherbb : XPASS > > Regression.LLC.2003-05-27-usefsubasbool : XPASS > > Regression.LLC.2003-05-28-ManyArgs : XPASS > > Regression.LLC.2003-05-30-BadFoldGEP : XPASS > > Regression.LLC.2003-05-30-BadPreselectPhi : XPASS > > Regression.LLC.2003-07-06-BadIntCmp : XPASS > > Regression.LLC.2003-07-07-BadLongConst : XPASS > > Regression.LLC.2003-07-08-BadCastToBool : XPASS > > Regression.LLC.2003-07-29-BadConstSbyte : XPASS > > Regression.LLC.BurgBadRegAlloc : XPASS > > Regression.LLC.badCallArgLRLLVM : XPASS > > Regression.LLC.badFoldGEP : XPASS > > Regression.LLC.badarg6 : XPASS > > Regression.LLC.badlive : XPASS > > Regression.LLC.constindices : XPASS > > Regression.LLC.fwdtwice : XPASS > > Regression.LLC.negintconst : XPASS > > Regression.LLC.sched : XPASS > > Regression.LLC.select : XPASS > > Regression.LLC.spillccr : XPASS > > Regression.Transforms.CorrelatedExprs.2002-10-03-PHIPropogate: XPASS > > Regression.Transforms.CorrelatedExprs.whet : XPASS > > Regression.Transforms.IndVarsSimplify.2003-09-23-NotAtTop: XPASS > > Regression.Transforms.Inline.alloca_test : XPASS > > Regression.Transforms.LICM.2003-08-04-TrappingInstHoist: XPASS > > Regression.Transforms.LICM.2003-08-04-TrappingInstOkHoist: XPASS > > Regression.Transforms.PRE.basictest : FAIL , expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas > ictest.ll > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas > ictest.ll.out > > Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL , > expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te > stscript.tail_call_with_branch.ll > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te > stscript.tail_call_with_branch.ll.out > >-Chris -- http://llvm.cs.uiuc.edu/ http://www.nondot.org/~sabre/Projects/
Vladimir Merzliakov
2004-Jun-21 09:06 UTC
[LLVMdev] llvm test results for FreeBSD platform
> > Is it ok sending this results for FreeBSD5.1 at daily/weekly based tothis> > mail list? > > A better list for it would be the llvmbugs list for now.ok> BTW, if you are interested in running the nightly tester on your freebsd > box, let me know and I can help you get it set up.What i must install or have installed ? I doesn't have root access at this machine, but admin ready to help. Vladimir
On Mon, 2004-06-21 at 05:44, Chris Lattner wrote:> I beginning to think that we need a new test results mailing list. > > What do others think?I think its a great idea. I'd subscribe. Reid -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: This is a digitally signed message part URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20040621/8670aee2/attachment.sig>