Vladimir Merzliakov
2004-Jun-21 07:15 UTC
[LLVMdev] llvm test results for FreeBSD platform
Is it ok sending this results for FreeBSD5.1 at daily/weekly based to this mail list? Now results. Big improvement in llvm tests results from last test result sended. New regressions: Regression.Assembler.ConstantExprFold : FAIL , expected PASS Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL , expected PASS Regression.Transforms.PRE.basictest : FAIL , expected PASS Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL , expected PASS Full log attached. --- STATISTICS --------------------------------------------------------------- 920 tests total 856 ( 93%) tests as expected 6 ( 1%) tests unexpected FAIL 58 ( 6%) tests unexpected PASS --- TESTS WITH UNEXPECTED OUTCOMES ------------------------------------------- Feature.mc.basictest : XPASS Feature.mc.calltest : XPASS Feature.mc.casttest : XPASS Feature.mc.cfgstructures : XPASS Feature.mc.constexpr : XPASS Feature.mc.constexprbad : XPASS Feature.mc.constpointer : XPASS Feature.mc.forwardreftest : XPASS Feature.mc.globalvars : XPASS Feature.mc.indirectcall : XPASS Feature.mc.indirectcall2 : XPASS Feature.mc.properties : XPASS Feature.mc.prototype : XPASS Feature.mc.recursivetype : XPASS Feature.mc.simplecalltest : XPASS Feature.mc.small : XPASS Feature.mc.smallest : XPASS Feature.mc.testalloca : XPASS Feature.mc.testconstants : XPASS Feature.mc.testlogical : XPASS Feature.mc.testmemory : XPASS Feature.mc.testswitch : XPASS Feature.mc.testvarargs : XPASS Feature.mc.varargs : XPASS Feature.mc.weirdnames : XPASS Regression.Assembler.ConstantExprFold : FAIL , expected PASS Script: /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc ript.ConstantExprFold.llx Output: /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc ript.ConstantExprFold.llx.out Regression.C++Frontend.2003-08-28-ForwardType : XPASS Regression.C++Frontend.2003-09-30-ForIncrementExprBug2: XPASS Regression.CFrontend.2003-01-30-UnionInit : FAIL , expected PASS Compiling C code failed Regression.CFrontend.2003-06-29-MultipleFunctionDefinition: XPASS Regression.CFrontend.2003-08-30-AggregateInitializer: FAIL , expected PASS Compiling C code failed Regression.CFrontend.2003-08-30-LargeIntegerBitfieldMember: XPASS Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL , expected PASS Script: /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc ing.llx/testscript.2004-04-09-SameValueCoalescing.llx Output: /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc ing.llx/testscript.2004-04-09-SameValueCoalescing.llx.out Regression.LLC.2002-04-14-UnexpectedUnsignedType: XPASS Regression.LLC.2002-04-16-StackFrameSizeAlignment: XPASS Regression.LLC.2003-05-27-phifcmpd : XPASS Regression.LLC.2003-05-27-useboolinotherbb : XPASS Regression.LLC.2003-05-27-usefsubasbool : XPASS Regression.LLC.2003-05-28-ManyArgs : XPASS Regression.LLC.2003-05-30-BadFoldGEP : XPASS Regression.LLC.2003-05-30-BadPreselectPhi : XPASS Regression.LLC.2003-07-06-BadIntCmp : XPASS Regression.LLC.2003-07-07-BadLongConst : XPASS Regression.LLC.2003-07-08-BadCastToBool : XPASS Regression.LLC.2003-07-29-BadConstSbyte : XPASS Regression.LLC.BurgBadRegAlloc : XPASS Regression.LLC.badCallArgLRLLVM : XPASS Regression.LLC.badFoldGEP : XPASS Regression.LLC.badarg6 : XPASS Regression.LLC.badlive : XPASS Regression.LLC.constindices : XPASS Regression.LLC.fwdtwice : XPASS Regression.LLC.negintconst : XPASS Regression.LLC.sched : XPASS Regression.LLC.select : XPASS Regression.LLC.spillccr : XPASS Regression.Transforms.CorrelatedExprs.2002-10-03-PHIPropogate: XPASS Regression.Transforms.CorrelatedExprs.whet : XPASS Regression.Transforms.IndVarsSimplify.2003-09-23-NotAtTop: XPASS Regression.Transforms.Inline.alloca_test : XPASS Regression.Transforms.LICM.2003-08-04-TrappingInstHoist: XPASS Regression.Transforms.LICM.2003-08-04-TrappingInstOkHoist: XPASS Regression.Transforms.PRE.basictest : FAIL , expected PASS Script: /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas ictest.ll Output: /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas ictest.ll.out Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL , expected PASS Script: /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te stscript.tail_call_with_branch.ll Output: /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te stscript.tail_call_with_branch.ll.out -------------- next part -------------- A non-text attachment was scrubbed... Name: test2004_06_21.log Type: application/octet-stream Size: 82446 bytes Desc: not available URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20040621/e96f88c3/attachment.obj>
Vladimir, We had a problem with our nightly tester (a change I introduced to hopefully solve another problem) that caused most of the failures in your first test. This run looks much more like what we're used to seeing. I believe the two tests below are known problems. Reid. On Mon, 2004-06-21 at 04:54, Vladimir Merzliakov wrote:> Is it ok sending this results for FreeBSD5.1 at daily/weekly based to this > mail list? > > Now results. > Big improvement in llvm tests results from last test result sended. > > New regressions: > Regression.Assembler.ConstantExprFold : FAIL , expected PASS > Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL , > expected PASS > Regression.Transforms.PRE.basictest : FAIL , expected PASS > Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL , > expected PASS > > Full log attached. > > --- > STATISTICS --------------------------------------------------------------- > > 920 tests total > 856 ( 93%) tests as expected > 6 ( 1%) tests unexpected FAIL > 58 ( 6%) tests unexpected PASS > > --- TESTS WITH UNEXPECTED > OUTCOMES ------------------------------------------- > > Feature.mc.basictest : XPASS > > Feature.mc.calltest : XPASS > > Feature.mc.casttest : XPASS > > Feature.mc.cfgstructures : XPASS > > Feature.mc.constexpr : XPASS > > Feature.mc.constexprbad : XPASS > > Feature.mc.constpointer : XPASS > > Feature.mc.forwardreftest : XPASS > > Feature.mc.globalvars : XPASS > > Feature.mc.indirectcall : XPASS > > Feature.mc.indirectcall2 : XPASS > > Feature.mc.properties : XPASS > > Feature.mc.prototype : XPASS > > Feature.mc.recursivetype : XPASS > > Feature.mc.simplecalltest : XPASS > > Feature.mc.small : XPASS > > Feature.mc.smallest : XPASS > > Feature.mc.testalloca : XPASS > > Feature.mc.testconstants : XPASS > > Feature.mc.testlogical : XPASS > > Feature.mc.testmemory : XPASS > > Feature.mc.testswitch : XPASS > > Feature.mc.testvarargs : XPASS > > Feature.mc.varargs : XPASS > > Feature.mc.weirdnames : XPASS > > Regression.Assembler.ConstantExprFold : FAIL , expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc > ript.ConstantExprFold.llx > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc > ript.ConstantExprFold.llx.out > > Regression.C++Frontend.2003-08-28-ForwardType : XPASS > > Regression.C++Frontend.2003-09-30-ForIncrementExprBug2: XPASS > > Regression.CFrontend.2003-01-30-UnionInit : FAIL , expected PASS > Compiling C code failed > > Regression.CFrontend.2003-06-29-MultipleFunctionDefinition: XPASS > > Regression.CFrontend.2003-08-30-AggregateInitializer: FAIL , expected > PASS > Compiling C code failed > > Regression.CFrontend.2003-08-30-LargeIntegerBitfieldMember: XPASS > > Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL , > expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc > ing.llx/testscript.2004-04-09-SameValueCoalescing.llx > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc > ing.llx/testscript.2004-04-09-SameValueCoalescing.llx.out > > Regression.LLC.2002-04-14-UnexpectedUnsignedType: XPASS > > Regression.LLC.2002-04-16-StackFrameSizeAlignment: XPASS > > Regression.LLC.2003-05-27-phifcmpd : XPASS > > Regression.LLC.2003-05-27-useboolinotherbb : XPASS > > Regression.LLC.2003-05-27-usefsubasbool : XPASS > > Regression.LLC.2003-05-28-ManyArgs : XPASS > > Regression.LLC.2003-05-30-BadFoldGEP : XPASS > > Regression.LLC.2003-05-30-BadPreselectPhi : XPASS > > Regression.LLC.2003-07-06-BadIntCmp : XPASS > > Regression.LLC.2003-07-07-BadLongConst : XPASS > > Regression.LLC.2003-07-08-BadCastToBool : XPASS > > Regression.LLC.2003-07-29-BadConstSbyte : XPASS > > Regression.LLC.BurgBadRegAlloc : XPASS > > Regression.LLC.badCallArgLRLLVM : XPASS > > Regression.LLC.badFoldGEP : XPASS > > Regression.LLC.badarg6 : XPASS > > Regression.LLC.badlive : XPASS > > Regression.LLC.constindices : XPASS > > Regression.LLC.fwdtwice : XPASS > > Regression.LLC.negintconst : XPASS > > Regression.LLC.sched : XPASS > > Regression.LLC.select : XPASS > > Regression.LLC.spillccr : XPASS > > Regression.Transforms.CorrelatedExprs.2002-10-03-PHIPropogate: XPASS > > Regression.Transforms.CorrelatedExprs.whet : XPASS > > Regression.Transforms.IndVarsSimplify.2003-09-23-NotAtTop: XPASS > > Regression.Transforms.Inline.alloca_test : XPASS > > Regression.Transforms.LICM.2003-08-04-TrappingInstHoist: XPASS > > Regression.Transforms.LICM.2003-08-04-TrappingInstOkHoist: XPASS > > Regression.Transforms.PRE.basictest : FAIL , expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas > ictest.ll > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas > ictest.ll.out > > Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL , > expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te > stscript.tail_call_with_branch.ll > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te > stscript.tail_call_with_branch.ll.out >-------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: This is a digitally signed message part URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20040621/0c2f1eac/attachment.sig>
On Mon, 21 Jun 2004, Vladimir Merzliakov wrote:> Is it ok sending this results for FreeBSD5.1 at daily/weekly based to this > mail list?A better list for it would be the llvmbugs list for now. I beginning to think that we need a new test results mailing list. We have 3 instances of the nightly tester going now (x86/linux, sparc, ppc) and may have more in the future. The nightly tester spits out notification of changes (new test failures, etc) that get sent to whoever "owns" the tester. It would be good of having a way of keeping track of these reports. I don't really like the idea of adding yet another mailing list, especially because few people will probably subscribe to it, but I also don't want to spam any of the other lists too badly. What do others think? BTW, if you are interested in running the nightly tester on your freebsd box, let me know and I can help you get it set up.> Now results. > Big improvement in llvm tests results from last test result sended.Great! That's what we want to see. :)> New regressions: > Regression.Assembler.ConstantExprFold : FAIL , expected PASS > Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL , > expected PASS > Regression.Transforms.PRE.basictest : FAIL , expected PASS > Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL , > expected PASSThese should all be xfails right now, so this is ok.> 920 tests total > 856 ( 93%) tests as expected > 6 ( 1%) tests unexpected FAIL > 58 ( 6%) tests unexpected PASSThe 58 XPASSes are strange. It looks like qmtest isn't expecting you to have a working code generator, but you do. qmtest probably needs to be updated somehow to reflect this... -Chris> --- TESTS WITH UNEXPECTED > OUTCOMES ------------------------------------------- > > Feature.mc.basictest : XPASS > > Feature.mc.calltest : XPASS > > Feature.mc.casttest : XPASS > > Feature.mc.cfgstructures : XPASS > > Feature.mc.constexpr : XPASS > > Feature.mc.constexprbad : XPASS > > Feature.mc.constpointer : XPASS > > Feature.mc.forwardreftest : XPASS > > Feature.mc.globalvars : XPASS > > Feature.mc.indirectcall : XPASS > > Feature.mc.indirectcall2 : XPASS > > Feature.mc.properties : XPASS > > Feature.mc.prototype : XPASS > > Feature.mc.recursivetype : XPASS > > Feature.mc.simplecalltest : XPASS > > Feature.mc.small : XPASS > > Feature.mc.smallest : XPASS > > Feature.mc.testalloca : XPASS > > Feature.mc.testconstants : XPASS > > Feature.mc.testlogical : XPASS > > Feature.mc.testmemory : XPASS > > Feature.mc.testswitch : XPASS > > Feature.mc.testvarargs : XPASS > > Feature.mc.varargs : XPASS > > Feature.mc.weirdnames : XPASS > > Regression.Assembler.ConstantExprFold : FAIL , expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc > ript.ConstantExprFold.llx > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trConstantExprFold.llx/testsc > ript.ConstantExprFold.llx.out > > Regression.C++Frontend.2003-08-28-ForwardType : XPASS > > Regression.C++Frontend.2003-09-30-ForIncrementExprBug2: XPASS > > Regression.CFrontend.2003-01-30-UnionInit : FAIL , expected PASS > Compiling C code failed > > Regression.CFrontend.2003-06-29-MultipleFunctionDefinition: XPASS > > Regression.CFrontend.2003-08-30-AggregateInitializer: FAIL , expected > PASS > Compiling C code failed > > Regression.CFrontend.2003-08-30-LargeIntegerBitfieldMember: XPASS > > Regression.CodeGen.Generic.2004-04-09-SameValueCoalescing: FAIL , > expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc > ing.llx/testscript.2004-04-09-SameValueCoalescing.llx > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/tr2004-04-09-SameValueCoalesc > ing.llx/testscript.2004-04-09-SameValueCoalescing.llx.out > > Regression.LLC.2002-04-14-UnexpectedUnsignedType: XPASS > > Regression.LLC.2002-04-16-StackFrameSizeAlignment: XPASS > > Regression.LLC.2003-05-27-phifcmpd : XPASS > > Regression.LLC.2003-05-27-useboolinotherbb : XPASS > > Regression.LLC.2003-05-27-usefsubasbool : XPASS > > Regression.LLC.2003-05-28-ManyArgs : XPASS > > Regression.LLC.2003-05-30-BadFoldGEP : XPASS > > Regression.LLC.2003-05-30-BadPreselectPhi : XPASS > > Regression.LLC.2003-07-06-BadIntCmp : XPASS > > Regression.LLC.2003-07-07-BadLongConst : XPASS > > Regression.LLC.2003-07-08-BadCastToBool : XPASS > > Regression.LLC.2003-07-29-BadConstSbyte : XPASS > > Regression.LLC.BurgBadRegAlloc : XPASS > > Regression.LLC.badCallArgLRLLVM : XPASS > > Regression.LLC.badFoldGEP : XPASS > > Regression.LLC.badarg6 : XPASS > > Regression.LLC.badlive : XPASS > > Regression.LLC.constindices : XPASS > > Regression.LLC.fwdtwice : XPASS > > Regression.LLC.negintconst : XPASS > > Regression.LLC.sched : XPASS > > Regression.LLC.select : XPASS > > Regression.LLC.spillccr : XPASS > > Regression.Transforms.CorrelatedExprs.2002-10-03-PHIPropogate: XPASS > > Regression.Transforms.CorrelatedExprs.whet : XPASS > > Regression.Transforms.IndVarsSimplify.2003-09-23-NotAtTop: XPASS > > Regression.Transforms.Inline.alloca_test : XPASS > > Regression.Transforms.LICM.2003-08-04-TrappingInstHoist: XPASS > > Regression.Transforms.LICM.2003-08-04-TrappingInstOkHoist: XPASS > > Regression.Transforms.PRE.basictest : FAIL , expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas > ictest.ll > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trbasictest.ll/testscript.bas > ictest.ll.out > > Regression.Transforms.TailCallElim.tail_call_with_branch: FAIL , > expected PASS > Script: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te > stscript.tail_call_with_branch.ll > Output: > /usr/home/wanderer/pkg/build/llvm/obj/test/tmp/trtail_call_with_branch.ll/te > stscript.tail_call_with_branch.ll.out > >-Chris -- http://llvm.cs.uiuc.edu/ http://www.nondot.org/~sabre/Projects/
Vladimir Merzliakov
2004-Jun-21 09:06 UTC
[LLVMdev] llvm test results for FreeBSD platform
> > Is it ok sending this results for FreeBSD5.1 at daily/weekly based tothis> > mail list? > > A better list for it would be the llvmbugs list for now.ok> BTW, if you are interested in running the nightly tester on your freebsd > box, let me know and I can help you get it set up.What i must install or have installed ? I doesn't have root access at this machine, but admin ready to help. Vladimir
On Mon, 2004-06-21 at 05:44, Chris Lattner wrote:> I beginning to think that we need a new test results mailing list. > > What do others think?I think its a great idea. I'd subscribe. Reid -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: This is a digitally signed message part URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20040621/8670aee2/attachment.sig>