On 10/07/2015 02:44 PM, Eric Christopher via cfe-dev wrote:> > > On Wed, Oct 7, 2015 at 2:24 PM Renato Golin <renato.golin at linaro.org > <mailto:renato.golin at linaro.org>> wrote: > > On 7 October 2015 at 22:14, Eric Christopher <echristo at gmail.com > <mailto:echristo at gmail.com>> wrote: > > As a foreword: I haven't read a lot of the thread here and it's > just a > > single developer talking here :) > > I recommend you to, then. Most of your arguments are similar to > David's and they don't take into account the difficulty in maintaining > non-x86 buildbots. > > > OK. I've now read the rest of the thread and don't find any of the > arguments compelling for keeping flaky bots around for notifications. > I also don't think that the x86-ness of it matters here. The powerpc64 > and hexagon bots are very reliable.After reading the thread, this is also my view. Philip -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20151007/38766a31/attachment.html>
On 8 Oct 2015 5:39 am, "Philip Reames" <listmail at philipreames.com> wrote:> After reading the thread, this is also my view.Keeping flaky bots was never the argument. But the meaning of flaky. That's what this thread was all about and people seem to have missed the point. The ARM bots are very stable, too, but were requested to be shut down as "flaky", because of the nature of the genuine problems they found, which is unfair. Cheers, Renato -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20151008/9c74eba5/attachment.html>
We are not saying "don't test on ARM". We are merely saying "don't send low-value email notifications". Bots that don't send email still provide value through their logs for after the fact fault finding. This would be a departure from what we have done in the past, and I agree, it does place a lot more burden on buildbot maintainers to monitor infrastructure failures etc. That said, I think it's a *good* thing, for the reasons already outlined. The way I see it, being able to send lots of email notifications to developers who might have broken your bot platform or configuration is a privilege. To earn that privilege, you have to also put in work to ensure that those notifications are meaningful. I know maintaining CI infrastructure is grueling work, and the LLVM community as a whole may not have the coordination or manpower to keep the infrastructure reliable. Until that changes (and I hope it does), disabling flaky notifications is probably better than tolerating them. --- Hopefully that captures how developers feel. I also want to thank Renato for maintaining all these bots over the years. He has already done a huge amount of the buildbot stabilization and reliability work that I'm talking about. I'm sure we can find a way forward for ARM testing. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20151008/c5b09896/attachment.html>