llvm dev - Jul 2020 - [Buildbots] - Looking for help with new 32 bit Windows buildbot

Hi folks,

*tl;dr*
I'm having some trouble setting up a Windows buildbot and I'm looking
for
someone with LLVM-on-Windows experience to help me.

*Long story*
Hans Wennborg recently pointed
<http://lists.llvm.org/pipermail/llvm-dev/2020-May/141803.html>out
<http://lists.llvm.org/pipermail/llvm-dev/2020-May/141803.html>, that
we're
missing a 32 bit Windows buildbot and I wanted to jump in and set one up.
However running the LLVM builds on Windows proved to be much more
challenging than on Linux and I'm stumbling from one issue to the next for
the last weeks. I'm down to about 40 failing tests now with the "clean
stage" failing permanently.
>From my experience so far, there are 3 main problem areas:
   - building LLVM on Windows with Visual Studio
   - running a Windows buildbot
   - Running Windows in a cloud environment in a stable, reproducible and
   maintainable way


So I'm looking for someone to help me to debug and fix the buildbot
<http://lab.llvm.org:8014/builders/clang-x86-ninja-win10?numbuilds=200>and
get it into a stable state.

Links on the current state and the setup:

   - Builder
   <http://lab.llvm.org:8014/builders/clang-x86-ninja-win10?numbuilds=200>
on
   staging with current list of failing tests
   - generic Visual Studio Docker image
  
<https://github.com/llvm/llvm-zorg/tree/master/buildbot/google/docker/windows-base-vscode2019>
and
   the 32bit buildbot Docker image
  
<https://github.com/llvm/llvm-zorg/tree/master/buildbot/google/docker/buildbot-windows10-vs2019>
   - Deployment
  
<https://github.com/llvm/llvm-zorg/blob/master/buildbot/google/terraform/main.tf>
   of the container on Google Cloud.
   - Additional documentation
   <https://github.com/llvm/llvm-zorg/tree/master/buildbot/google> on the
   setup



Best,
Christian
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20200730/595dbf3a/attachment.html>

>  building LLVM on Windows with Visual Studio
I do this regularly, so I can probably help figure out some of those
problems.  Buildbot and cloud deployments, however, are outside my
wheelhouse.

We were recently talking about setting up another 64-bit Windows bot as
well, since our current one needs a Cmake update
<https://bugs.llvm.org/show_bug.cgi?id=46755> and we're having trouble
getting access to the existing one.

Adrian.

On Thu, Jul 30, 2020 at 2:32 AM Christian Kühnel via llvm-dev <
llvm-dev at lists.llvm.org> wrote:
> Hi folks,
>
> *tl;dr*
> I'm having some trouble setting up a Windows buildbot and I'm
looking for
> someone with LLVM-on-Windows experience to help me.
>
> *Long story*
> Hans Wennborg recently pointed
> <http://lists.llvm.org/pipermail/llvm-dev/2020-May/141803.html>out
> <http://lists.llvm.org/pipermail/llvm-dev/2020-May/141803.html>, that
> we're missing a 32 bit Windows buildbot and I wanted to jump in and set
one
> up. However running the LLVM builds on Windows proved to be much more
> challenging than on Linux and I'm stumbling from one issue to the next
for
> the last weeks. I'm down to about 40 failing tests now with the
"clean
> stage" failing permanently.
>
> From my experience so far, there are 3 main problem areas:
>
>    - building LLVM on Windows with Visual Studio
>    - running a Windows buildbot
>    - Running Windows in a cloud environment in a stable, reproducible and
>    maintainable way
>
>
> So I'm looking for someone to help me to debug and fix the buildbot
>
<http://lab.llvm.org:8014/builders/clang-x86-ninja-win10?numbuilds=200>and
> get it into a stable state.
>
> Links on the current state and the setup:
>
>    - Builder
>   
<http://lab.llvm.org:8014/builders/clang-x86-ninja-win10?numbuilds=200> on
>    staging with current list of failing tests
>    - generic Visual Studio Docker image
>   
<https://github.com/llvm/llvm-zorg/tree/master/buildbot/google/docker/windows-base-vscode2019>
and
>    the 32bit buildbot Docker image
>   
<https://github.com/llvm/llvm-zorg/tree/master/buildbot/google/docker/buildbot-windows10-vs2019>
>    - Deployment
>   
<https://github.com/llvm/llvm-zorg/blob/master/buildbot/google/terraform/main.tf>
>    of the container on Google Cloud.
>    - Additional documentation
>    <https://github.com/llvm/llvm-zorg/tree/master/buildbot/google> on
the
>    setup
>
>
>
> Best,
> Christian
> _______________________________________________
> LLVM Developers mailing list
> llvm-dev at lists.llvm.org
> https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20200730/0dcf55c1/attachment.html>

Hi Adrian,

that would be great!

I can help you set up another buildbot for Windows. One reason for the time
investment in the cloud infrastructure was to make it simple to add more
bots, especially with similar configurations.
Depending on what you need, we might be able to use the same image and just
set up two instances with different names to run 32 and 64 bit builds.



Best,
Christian


On Thu, Jul 30, 2020 at 7:01 PM Adrian McCarthy <amccarth at google.com>
wrote:
> >  building LLVM on Windows with Visual Studio
>
> I do this regularly, so I can probably help figure out some of those
> problems.  Buildbot and cloud deployments, however, are outside my
> wheelhouse.
>
> We were recently talking about setting up another 64-bit Windows bot as
> well, since our current one needs a Cmake update
> <https://bugs.llvm.org/show_bug.cgi?id=46755> and we're having
trouble
> getting access to the existing one.
>
> Adrian.
>
> On Thu, Jul 30, 2020 at 2:32 AM Christian Kühnel via llvm-dev <
> llvm-dev at lists.llvm.org> wrote:
>
>> Hi folks,
>>
>> *tl;dr*
>> I'm having some trouble setting up a Windows buildbot and I'm
looking for
>> someone with LLVM-on-Windows experience to help me.
>>
>> *Long story*
>> Hans Wennborg recently pointed
>>
<http://lists.llvm.org/pipermail/llvm-dev/2020-May/141803.html>out
>> <http://lists.llvm.org/pipermail/llvm-dev/2020-May/141803.html>,
that
>> we're missing a 32 bit Windows buildbot and I wanted to jump in and
set one
>> up. However running the LLVM builds on Windows proved to be much more
>> challenging than on Linux and I'm stumbling from one issue to the
next for
>> the last weeks. I'm down to about 40 failing tests now with the
"clean
>> stage" failing permanently.
>>
>> From my experience so far, there are 3 main problem areas:
>>
>>    - building LLVM on Windows with Visual Studio
>>    - running a Windows buildbot
>>    - Running Windows in a cloud environment in a stable, reproducible
>>    and maintainable way
>>
>>
>> So I'm looking for someone to help me to debug and fix the buildbot
>>
<http://lab.llvm.org:8014/builders/clang-x86-ninja-win10?numbuilds=200>and
>> get it into a stable state.
>>
>> Links on the current state and the setup:
>>
>>    - Builder
>>   
<http://lab.llvm.org:8014/builders/clang-x86-ninja-win10?numbuilds=200> on
>>    staging with current list of failing tests
>>    - generic Visual Studio Docker image
>>   
<https://github.com/llvm/llvm-zorg/tree/master/buildbot/google/docker/windows-base-vscode2019>
and
>>    the 32bit buildbot Docker image
>>   
<https://github.com/llvm/llvm-zorg/tree/master/buildbot/google/docker/buildbot-windows10-vs2019>
>>    - Deployment
>>   
<https://github.com/llvm/llvm-zorg/blob/master/buildbot/google/terraform/main.tf>
>>    of the container on Google Cloud.
>>    - Additional documentation
>>   
<https://github.com/llvm/llvm-zorg/tree/master/buildbot/google> on
>>    the setup
>>
>>
>>
>> Best,
>> Christian
>> _______________________________________________
>> LLVM Developers mailing list
>> llvm-dev at lists.llvm.org
>> https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20200731/533054d9/attachment.html>