Bill Schmidt via llvm-dev
2015-Sep-29 20:13 UTC
[llvm-dev] Fwd: buildbot failure in LLVM on clang-ppc64-elf-linux2
On Tue, 2015-09-29 at 14:29 -0500, Hal Finkel wrote:> [+Bill and Bill] > > ----- Original Message ----- > > From: "David Blaikie via llvm-dev" <llvm-dev at lists.llvm.org> > > To: "llvm-dev" <llvm-dev at lists.llvm.org> > > Sent: Tuesday, September 29, 2015 12:39:02 PM > > Subject: [llvm-dev] Fwd: buildbot failure in LLVM on clang-ppc64-elf-linux2 > > > > > > > > This buildbot appears to have been failing for several weeks now ( > > http://lab.llvm.org:8011/builders/clang-ppc64-elf-linux2/builds/19490 > > ). Does anyone know/own/care about it?Answer: yes. We've had it under investigation since the problem started happening. It was difficult to track it down. Eventually we traced it back to the shrink-wrap enablement, and the developer provided a fix. The fix has proven to be insufficient; it fixed a problem with a gcc-built Clang, but we still have a problem with a self-hosted Clang. The developer is currently verifying that disabling shrink-wrap on a self-hosting build will resolve the problem. If so, the change to enable shrink-wrap for PowerPC will be reverted at once. If not, I believe we will have to XFAIL the test to let the bot start working again until we can figure out another cause. So, people have been working on this, but it is Not Good that the bot has been disabled for this long, and we will try to make sure this doesn't happen again. The problem has been figuring out exactly what to revert, which has been more difficult than usual this time. Thanks, Bill> > > > > > ---------- Forwarded message ---------- > > From: < llvm.buildmaster at lab.llvm.org > > > Date: Mon, Sep 28, 2015 at 11:17 PM > > Subject: buildbot failure in LLVM on clang-ppc64-elf-linux2 > > To: Aaron Ballman < aaron at aaronballman.com >, Adrian Prantl < > > aprantl at apple.com >, Andrew Kaylor < andrew.kaylor at intel.com >, > > Artem Belevich < tra at google.com >, Artur Pilipenko < > > apilipenko at azulsystems.com >, Dan Gohman < dan433584 at gmail.com >, > > Daniel Jasper < djasper at google.com >, Daniel Sanders < > > daniel.sanders at imgtec.com >, David Blaikie < dblaikie at gmail.com >, > > Evgeniy Stepanov < eugeni.stepanov at gmail.com >, Fiona Glaser < > > escha at apple.com >, Guillaume Papin < guillaume.papin at epitech.eu >, > > Matt Arsenault < Matthew.Arsenault at amd.com >, Matthias Braun < > > matze at braunis.de >, Philip Reames < listmail at philipreames.com >, > > Piotr Padlewski < prazek at google.com >, Reid Kleckner < > > rnk at google.com >, Richard Trieu < rtrieu at google.com >, Sanjay Patel > > < spatel at rotateright.com >, Sanjoy Das < > > sanjoy at playingwithpointers.com >, Sean Silva < chisophugis at gmail.com > > >, Weiming Zhao < weimingz at codeaurora.org > > > Cc: gkistanova at gmail.com > > > > > > The Buildbot has detected a new failure on builder > > clang-ppc64-elf-linux2 while building cfe. > > Full details are available at: > > http://lab.llvm.org:8011/builders/clang-ppc64-elf-linux2/builds/19559 > > > > Buildbot URL: http://lab.llvm.org:8011/ > > > > Buildslave for this Build: chinook-clangslave2 > > > > Build Reason: scheduler > > Build Source Stamp: [branch trunk] 248769 > > Blamelist: > > aaronballman,adrian,akaylor,apilipenko,arsenm,dblaikie,djasper,djg,dsanders,escha,eugenis,matze,papin_g,prazek,reames,rnk,rtrieu,sanjoy,silvas,spatel,tra,weimingz > > > > BUILD FAILED: failed check-all_1 > > > > sincerely, > > -The Buildbot > > > > > > > > > > > > _______________________________________________ > > LLVM Developers mailing list > > llvm-dev at lists.llvm.org > > http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev > > >
David Blaikie via llvm-dev
2015-Sep-29 20:28 UTC
[llvm-dev] Fwd: buildbot failure in LLVM on clang-ppc64-elf-linux2
On Tue, Sep 29, 2015 at 1:13 PM, Bill Schmidt <wschmidt at linux.vnet.ibm.com> wrote:> On Tue, 2015-09-29 at 14:29 -0500, Hal Finkel wrote: > > [+Bill and Bill] > > > > ----- Original Message ----- > > > From: "David Blaikie via llvm-dev" <llvm-dev at lists.llvm.org> > > > To: "llvm-dev" <llvm-dev at lists.llvm.org> > > > Sent: Tuesday, September 29, 2015 12:39:02 PM > > > Subject: [llvm-dev] Fwd: buildbot failure in LLVM on > clang-ppc64-elf-linux2 > > > > > > > > > > > > This buildbot appears to have been failing for several weeks now ( > > > http://lab.llvm.org:8011/builders/clang-ppc64-elf-linux2/builds/19490 > > > ). Does anyone know/own/care about it? > > Answer: yes. > > We've had it under investigation since the problem started happening. > It was difficult to track it down. Eventually we traced it back to the > shrink-wrap enablement, and the developer provided a fix. The fix has > proven to be insufficient; it fixed a problem with a gcc-built Clang, > but we still have a problem with a self-hosted Clang. The developer is > currently verifying that disabling shrink-wrap on a self-hosting build > will resolve the problem. If so, the change to enable shrink-wrap for > PowerPC will be reverted at once. If not, I believe we will have to > XFAIL the test to let the bot start working again until we can figure > out another cause. >Thanks for the update!> So, people have been working on this, but it is Not Good that the bot > has been disabled for this long,It's more than that the bot has been disabled - were it just disabled, I wouldn't have seen it, nor written that email. The bot has been red and prone to (though not always - as Renato's pointed out, a red bot that remains red may not send email, but purple (exception)->red (even if it were red before the exceptional result) does send email) send email on some of its failures, which adds noise to the system and makes it hard for developers to trust/act on buildbot results.> and we will try to make sure this > doesn't happen again. The problem has been figuring out exactly what to > revert, which has been more difficult than usual this time. >Is there any reason the test couldn't've been XFAIL'd from the start, while investigation continued? - Dave> > Thanks, > Bill > > > > > > > > > > ---------- Forwarded message ---------- > > > From: < llvm.buildmaster at lab.llvm.org > > > > Date: Mon, Sep 28, 2015 at 11:17 PM > > > Subject: buildbot failure in LLVM on clang-ppc64-elf-linux2 > > > To: Aaron Ballman < aaron at aaronballman.com >, Adrian Prantl < > > > aprantl at apple.com >, Andrew Kaylor < andrew.kaylor at intel.com >, > > > Artem Belevich < tra at google.com >, Artur Pilipenko < > > > apilipenko at azulsystems.com >, Dan Gohman < dan433584 at gmail.com >, > > > Daniel Jasper < djasper at google.com >, Daniel Sanders < > > > daniel.sanders at imgtec.com >, David Blaikie < dblaikie at gmail.com >, > > > Evgeniy Stepanov < eugeni.stepanov at gmail.com >, Fiona Glaser < > > > escha at apple.com >, Guillaume Papin < guillaume.papin at epitech.eu >, > > > Matt Arsenault < Matthew.Arsenault at amd.com >, Matthias Braun < > > > matze at braunis.de >, Philip Reames < listmail at philipreames.com >, > > > Piotr Padlewski < prazek at google.com >, Reid Kleckner < > > > rnk at google.com >, Richard Trieu < rtrieu at google.com >, Sanjay Patel > > > < spatel at rotateright.com >, Sanjoy Das < > > > sanjoy at playingwithpointers.com >, Sean Silva < chisophugis at gmail.com > > > >, Weiming Zhao < weimingz at codeaurora.org > > > > Cc: gkistanova at gmail.com > > > > > > > > > The Buildbot has detected a new failure on builder > > > clang-ppc64-elf-linux2 while building cfe. > > > Full details are available at: > > > http://lab.llvm.org:8011/builders/clang-ppc64-elf-linux2/builds/19559 > > > > > > Buildbot URL: http://lab.llvm.org:8011/ > > > > > > Buildslave for this Build: chinook-clangslave2 > > > > > > Build Reason: scheduler > > > Build Source Stamp: [branch trunk] 248769 > > > Blamelist: > > > > aaronballman,adrian,akaylor,apilipenko,arsenm,dblaikie,djasper,djg,dsanders,escha,eugenis,matze,papin_g,prazek,reames,rnk,rtrieu,sanjoy,silvas,spatel,tra,weimingz > > > > > > BUILD FAILED: failed check-all_1 > > > > > > sincerely, > > > -The Buildbot > > > > > > > > > > > > > > > > > > _______________________________________________ > > > LLVM Developers mailing list > > > llvm-dev at lists.llvm.org > > > http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev > > > > > > > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20150929/37e0a071/attachment.html>
Bill Schmidt via llvm-dev
2015-Sep-29 20:38 UTC
[llvm-dev] Fwd: buildbot failure in LLVM on clang-ppc64-elf-linux2
On Tue, 2015-09-29 at 13:28 -0700, David Blaikie wrote:> > > On Tue, Sep 29, 2015 at 1:13 PM, Bill Schmidt > <wschmidt at linux.vnet.ibm.com> wrote: > On Tue, 2015-09-29 at 14:29 -0500, Hal Finkel wrote: > > [+Bill and Bill] > > > > ----- Original Message ----- > > > From: "David Blaikie via llvm-dev" > <llvm-dev at lists.llvm.org> > > > To: "llvm-dev" <llvm-dev at lists.llvm.org> > > > Sent: Tuesday, September 29, 2015 12:39:02 PM > > > Subject: [llvm-dev] Fwd: buildbot failure in LLVM on > clang-ppc64-elf-linux2 > > > > > > > > > > > > This buildbot appears to have been failing for several > weeks now ( > > > > http://lab.llvm.org:8011/builders/clang-ppc64-elf-linux2/builds/19490 > > > ). Does anyone know/own/care about it? > > Answer: yes. > > We've had it under investigation since the problem started > happening. > It was difficult to track it down. Eventually we traced it > back to the > shrink-wrap enablement, and the developer provided a fix. The > fix has > proven to be insufficient; it fixed a problem with a gcc-built > Clang, > but we still have a problem with a self-hosted Clang. The > developer is > currently verifying that disabling shrink-wrap on a > self-hosting build > will resolve the problem. If so, the change to enable > shrink-wrap for > PowerPC will be reverted at once. If not, I believe we will > have to > XFAIL the test to let the bot start working again until we can > figure > out another cause. > > > Thanks for the update! > > So, people have been working on this, but it is Not Good that > the bot > has been disabled for this long, > > > It's more than that the bot has been disabled - were it just disabled, > I wouldn't have seen it, nor written that email. The bot has been red > and prone to (though not always - as Renato's pointed out, a red bot > that remains red may not send email, but purple (exception)->red (even > if it were red before the exceptional result) does send email) send > email on some of its failures, which adds noise to the system and > makes it hard for developers to trust/act on buildbot results. > > and we will try to make sure this > doesn't happen again. The problem has been figuring out > exactly what to > revert, which has been more difficult than usual this time. > > Is there any reason the test couldn't've been XFAIL'd from the start, > while investigation continued?None. We'll educate folks on this and attempt to ensure we do better next time. Bill> > - Dave > > > Thanks, > Bill > > > > > > > > > > ---------- Forwarded message ---------- > > > From: < llvm.buildmaster at lab.llvm.org > > > > Date: Mon, Sep 28, 2015 at 11:17 PM > > > Subject: buildbot failure in LLVM on > clang-ppc64-elf-linux2 > > > To: Aaron Ballman < aaron at aaronballman.com >, Adrian > Prantl < > > > aprantl at apple.com >, Andrew Kaylor < > andrew.kaylor at intel.com >, > > > Artem Belevich < tra at google.com >, Artur Pilipenko < > > > apilipenko at azulsystems.com >, Dan Gohman < > dan433584 at gmail.com >, > > > Daniel Jasper < djasper at google.com >, Daniel Sanders < > > > daniel.sanders at imgtec.com >, David Blaikie < > dblaikie at gmail.com >, > > > Evgeniy Stepanov < eugeni.stepanov at gmail.com >, Fiona > Glaser < > > > escha at apple.com >, Guillaume Papin < > guillaume.papin at epitech.eu >, > > > Matt Arsenault < Matthew.Arsenault at amd.com >, Matthias > Braun < > > > matze at braunis.de >, Philip Reames < > listmail at philipreames.com >, > > > Piotr Padlewski < prazek at google.com >, Reid Kleckner < > > > rnk at google.com >, Richard Trieu < rtrieu at google.com >, > Sanjay Patel > > > < spatel at rotateright.com >, Sanjoy Das < > > > sanjoy at playingwithpointers.com >, Sean Silva < > chisophugis at gmail.com > > > >, Weiming Zhao < weimingz at codeaurora.org > > > > Cc: gkistanova at gmail.com > > > > > > > > > The Buildbot has detected a new failure on builder > > > clang-ppc64-elf-linux2 while building cfe. > > > Full details are available at: > > > > http://lab.llvm.org:8011/builders/clang-ppc64-elf-linux2/builds/19559 > > > > > > Buildbot URL: http://lab.llvm.org:8011/ > > > > > > Buildslave for this Build: chinook-clangslave2 > > > > > > Build Reason: scheduler > > > Build Source Stamp: [branch trunk] 248769 > > > Blamelist: > > > > aaronballman,adrian,akaylor,apilipenko,arsenm,dblaikie,djasper,djg,dsanders,escha,eugenis,matze,papin_g,prazek,reames,rnk,rtrieu,sanjoy,silvas,spatel,tra,weimingz > > > > > > BUILD FAILED: failed check-all_1 > > > > > > sincerely, > > > -The Buildbot > > > > > > > > > > > > > > > > > > _______________________________________________ > > > LLVM Developers mailing list > > > llvm-dev at lists.llvm.org > > > http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev > > > > > > > > > >
Philip Reames via llvm-dev
2015-Sep-29 21:59 UTC
[llvm-dev] Fwd: buildbot failure in LLVM on clang-ppc64-elf-linux2
On 09/29/2015 01:28 PM, David Blaikie via llvm-dev wrote:> The bot has been red and prone to (though not always - as Renato's > pointed out, a red bot that remains red may not send email, but purple > (exception)->red (even if it were red before the exceptional result) > does send email) send email on some of its failures, which adds noise > to the system and makes it hard for developers to trust/act on > buildbot results.Does anyone other than the bot owner get value out of this email? It seems like we should not be emailing contributors on a exceptional->error condition. Making this change might cut down the noise on the bots materially. Philip