llvm dev - Sep 2016 - [cfe-dev] Many bots don't build anything -- does anyone know why?

Hi,

It seems the problem is that the bot is updating llvm.src, but trying
to build from llvm.

Galina, it looks like this is related to your recent changes to zorg,
you probably missed a spot somewhere and I can't find it on a first
glance. Could you have a look?

Thanks,
Diana

On 5 September 2016 at 12:01, Diana Picus <diana.picus at linaro.org>
wrote:
> Hi Nico,
>
> Thanks for reporting this. I restarted clang-cmake-thumbv7-a15 and cleared
> its ccache, I'll be keeping an eye on it.
>
> Regards,
> Diana
>
> On 5 September 2016 at 05:26, Nico Weber via cfe-dev
> <cfe-dev at lists.llvm.org> wrote:
>>
>> Hi,
>>
>> many of the bots on http://lab.llvm.org:8011/console don't do
anything in
>> their compile phase, even if they should.
>>
>> For example, these bots all don't do anything in their compile
phase in
>> any builds, even if they should:
>> http://lab.llvm.org:8011/builders/clang-x64-ninja-win7/
>> http://lab.llvm.org:8011/builders/clang-ppc64be-linux
>> http://lab.llvm.org:8011/builders/clang-atom-d525-fedora-rel
>> http://lab.llvm.org:8011/builders/clang-cmake-thumbv7-a15
>> http://lab.llvm.org:8011/builders/clang-s390x-linux
>>
>> At least the ninja-win7 bot used to work fine last week Thu and early
Fri,
>> so this looks like a recent regression. The clang_fast bots seem to
still
>> work, so we're not flying completely blind, but we for example
don't have
>> Windows coverage at the moment. Does anyone know what changed? How can
we
>> get working bots again?
>>
>> Thanks,
>> Nico
>>
>> _______________________________________________
>> cfe-dev mailing list
>> cfe-dev at lists.llvm.org
>> http://lists.llvm.org/cgi-bin/mailman/listinfo/cfe-dev
>>
>

Also, I have removed the llvm directory from the bot and moved it to
the silent master until we fix this.

Diana

On 6 September 2016 at 00:01, Diana Picus <diana.picus at linaro.org>
wrote:
> Hi,
>
> It seems the problem is that the bot is updating llvm.src, but trying
> to build from llvm.
>
> Galina, it looks like this is related to your recent changes to zorg,
> you probably missed a spot somewhere and I can't find it on a first
> glance. Could you have a look?
>
> Thanks,
> Diana
>
> On 5 September 2016 at 12:01, Diana Picus <diana.picus at linaro.org>
wrote:
>> Hi Nico,
>>
>> Thanks for reporting this. I restarted clang-cmake-thumbv7-a15 and
cleared
>> its ccache, I'll be keeping an eye on it.
>>
>> Regards,
>> Diana
>>
>> On 5 September 2016 at 05:26, Nico Weber via cfe-dev
>> <cfe-dev at lists.llvm.org> wrote:
>>>
>>> Hi,
>>>
>>> many of the bots on http://lab.llvm.org:8011/console don't do
anything in
>>> their compile phase, even if they should.
>>>
>>> For example, these bots all don't do anything in their compile
phase in
>>> any builds, even if they should:
>>> http://lab.llvm.org:8011/builders/clang-x64-ninja-win7/
>>> http://lab.llvm.org:8011/builders/clang-ppc64be-linux
>>> http://lab.llvm.org:8011/builders/clang-atom-d525-fedora-rel
>>> http://lab.llvm.org:8011/builders/clang-cmake-thumbv7-a15
>>> http://lab.llvm.org:8011/builders/clang-s390x-linux
>>>
>>> At least the ninja-win7 bot used to work fine last week Thu and
early Fri,
>>> so this looks like a recent regression. The clang_fast bots seem to
still
>>> work, so we're not flying completely blind, but we for example
don't have
>>> Windows coverage at the moment. Does anyone know what changed? How
can we
>>> get working bots again?
>>>
>>> Thanks,
>>> Nico
>>>
>>> _______________________________________________
>>> cfe-dev mailing list
>>> cfe-dev at lists.llvm.org
>>> http://lists.llvm.org/cgi-bin/mailman/listinfo/cfe-dev
>>>
>>

On 5 September 2016 at 22:01, Diana Picus via llvm-dev
<llvm-dev at lists.llvm.org> wrote:
> It seems the problem is that the bot is updating llvm.src, but trying
> to build from llvm.
Right, this affected all of our bots, as files became stale when a
test was moved.

Now, it seems, all the buildbots are green, not because they're
passing, but because they're building from a time when they were
passing, and the SVN update is making no difference... :S

All our dirty bots are taking 1s to build (no changes) and our clean
bots are taking 8 minutes (ccache's work).

Should we revert this? This is pretty serious? Can we fix this quickly
on the bots?

--renato

On 5 September 2016 at 22:12, Renato Golin <renato.golin at linaro.org>
wrote:
> Should we revert this? This is pretty serious? Can we fix this quickly
> on the bots?
Just FYI, I'm moving the "llvm" directory away and making it as a
symlink to "llvm.src", at least until we sort out this problem.

Since this has been going on from Sep 1st, I believe we'll find *many*
breakages in the bots... :(

cheers,
--renato