Nick.Adamson at generaldynamics.uk.com
2011-Apr-15 15:47 UTC
[Cruisecontrolrb-users] multiple builders, why do they keep stopping.
Hi All. We''ve been using CCRB, v 1.4.0, on a project for nearly a year now and have found it pretty stable however recently we''ve had some issues. The project is cross platform so there are multiple builders monitoring the same subversion path. When there are just 2 builders this works fine. We''ve recently introduced a new platform so have added another project which monitors the same subversion path. This has caused some stability issues. Every so often, seems like every 2 or 3 builds one of the builders will die for no apparent reason. The dashboard indicates the builder is stopped and the log doesn''t seem to say anything. It seems random which builder will die out of the 3 that are running. Has anyone seen anything like this or have any ideas how I can get them to be stable again. Switching the builds in to serial rather than parallel isn''t an option as each build can take up to half an hour, some times longer. Any ideas gratefully received. Thanks. Nick. Nick Adamson Software Engineer Advanced Projects and Technologies Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA Telephone: +44 (0) 1495 236467 Email: nick.adamson at generaldynamics.uk.com <mailto:nick.adamson at generaldynamics.uk.com> Website: www.generaldynamics.uk.com <http://www.generaldynamics.uk.com/> Please consider the environment before printing this email This email and any files attached are intended for the addressee and may contain information of a confidential nature. If you are not the intended recipient, be aware that this email was sent to you in error and you should not disclose, distribute, print, copy or make other use of this email or its attachments. Such actions, in fact, may be unlawful. In compliance with the various Regulations and Acts, General Dynamics United Kingdom Limited reserves the right to monitor (and examine for viruses) all emails and email attachments, both inbound and outbound. Email communications and their attachments may not be secure or error- or virus-free and the company does not accept liability or responsibility for such matters or the consequences thereof. General Dynamics United Kingdom Limited, Registered Office: 21 Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: 1911653. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://rubyforge.org/pipermail/cruisecontrolrb-users/attachments/20110415/79c8fffa/attachment-0001.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/bmp Size: 5402 bytes Desc: Signature.bmp URL: <http://rubyforge.org/pipermail/cruisecontrolrb-users/attachments/20110415/79c8fffa/attachment-0001.bmp>
Alexey Verkhovsky
2011-Apr-15 16:32 UTC
[Cruisecontrolrb-users] multiple builders, why do they keep stopping.
Does builder log say anything about the cause of death? On Fri, Apr 15, 2011 at 9:47 AM, <Nick.Adamson at generaldynamics.uk.com>wrote:> Hi All. > > We''ve been using CCRB, v 1.4.0, on a project for nearly a year now and have > found it pretty stable however recently we''ve had some issues. > > The project is cross platform so there are multiple builders monitoring the > same subversion path. > > When there are just 2 builders this works fine. > We''ve recently introduced a new platform so have added another project > which monitors the same subversion path. This has caused some stability > issues. > Every so often, seems like every 2 or 3 builds one of the builders will die > for no apparent reason. The dashboard indicates the builder is stopped and > the log doesn''t seem to say anything. It seems random which builder will die > out of the 3 that are running. > > Has anyone seen anything like this or have any ideas how I can get them to > be stable again. > > Switching the builds in to serial rather than parallel isn''t an option as > each build can take up to half an hour, some times longer. > Any ideas gratefully received. > > Thanks. > Nick. > > > > *Nick Adamson* > Software Engineer > > Advanced Projects and Technologies > > [image: General Dynamics United Kingdom Limited] > Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA > > Telephone: +44 (0) 1495 236467 > Email: nick.adamson at generaldynamics.uk.com > Website: *www.generaldynamics.uk.com* > > *Please consider the environment before printing this email * > > > > > ------------------------------ > This email and any files attached are intended for the addressee and may > contain information of a confidential nature. If you are not the intended > recipient, be aware that this email was sent to you in error and you should > not disclose, distribute, print, copy or make other use of this email or its > attachments. Such actions, in fact, may be unlawful. In compliance with the > various Regulations and Acts, General Dynamics United Kingdom Limited > reserves the right to monitor (and examine for viruses) all emails and email > attachments, both inbound and outbound. Email communications and their > attachments may not be secure or error- or virus-free and the company does > not accept liability or responsibility for such matters or the consequences > thereof. General Dynamics United Kingdom Limited, Registered Office: 21 > Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: > 1911653. > > _______________________________________________ > Cruisecontrolrb-users mailing list > Cruisecontrolrb-users at rubyforge.org > http://rubyforge.org/mailman/listinfo/cruisecontrolrb-users > >-- Alexey Verkhovsky http://alex-verkhovsky.blogspot.com/ CruiseControl.rb [http://cruisecontrolrb.thoughtworks.com] -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://rubyforge.org/pipermail/cruisecontrolrb-users/attachments/20110415/d5e15049/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/bmp Size: 5401 bytes Desc: not available URL: <http://rubyforge.org/pipermail/cruisecontrolrb-users/attachments/20110415/d5e15049/attachment.bmp>
Nick.Adamson at generaldynamics.uk.com
2011-Apr-18 08:53 UTC
[Cruisecontrolrb-users] multiple builders, why do they keep stopping.
Hi Alexey. Nothing useful as far as I can tell. On Friday before I left work I restarted the project builder, with in 2 hours it had gone down again. Here''s the log. Sorry, its only at info, I''ll restart CCRB with trace logging in a minute to see if that gives us any more info. [info] [2011-04-15 16:42:58] Builder for project ''ATIS-Vsap'' started [info] [2011-04-15 16:43:01] New revision 4323 detected [info] [2011-04-15 16:43:15] Build 4323 started [info] [2011-04-15 17:11:46] Build 4323 finished SUCCESSFULLY Sent mail: Date: Fri, 15 Apr 2011 17:11:46 +0100 From: noreply at generaldynamics.uk.com To: nick.adamson at generaldynamics.uk.com Subject: [CruiseControl] ATIS-Vsap build 4323 fixed Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 The build has been fixed. CHANGES ------- New revision 4323 detected Revision 4323 committed by pwhite on 2011-04-15 14:33:58 ***** content of email removed as there''s nothing useful. ***** [info] [2011-04-15 17:12:46] Builder for project ''ATIS-Vsap'' exited That''s it folks! I looked in the production log and there was nothing useful. Will forward on the trace logs when it happens again. Nick Adamson Software Engineer General Dynamics United Kingdom Limited Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA Telephone: +44 (0)1495 23 6467 Email: Nick.Adamson at generaldynamics.uk.com Website: www.generaldynamics.uk.com To help reduce waste paper, please only print this email if you really need to. -----Original Message----- From: cruisecontrolrb-users-bounces at rubyforge.org [mailto:cruisecontrolrb-users-bounces at rubyforge.org] On Behalf Of Alexey Verkhovsky Sent: 15 April 2011 17:33 To: cruisecontrolrb-users at rubyforge.org Subject: Re: [Cruisecontrolrb-users] multiple builders,why do they keep stopping. Does builder log say anything about the cause of death? On Fri, Apr 15, 2011 at 9:47 AM, <Nick.Adamson at generaldynamics.uk.com> wrote: Hi All. We''ve been using CCRB, v 1.4.0, on a project for nearly a year now and have found it pretty stable however recently we''ve had some issues. The project is cross platform so there are multiple builders monitoring the same subversion path. When there are just 2 builders this works fine. We''ve recently introduced a new platform so have added another project which monitors the same subversion path. This has caused some stability issues. Every so often, seems like every 2 or 3 builds one of the builders will die for no apparent reason. The dashboard indicates the builder is stopped and the log doesn''t seem to say anything. It seems random which builder will die out of the 3 that are running. Has anyone seen anything like this or have any ideas how I can get them to be stable again. Switching the builds in to serial rather than parallel isn''t an option as each build can take up to half an hour, some times longer. Any ideas gratefully received. Thanks. Nick. Nick Adamson Software Engineer Advanced Projects and Technologies General Dynamics United Kingdom Limited<http://gdonline/new/Communications/img/Signature/Signature.bmp> Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA Telephone: +44 (0) 1495 236467 Email: nick.adamson at generaldynamics.uk.com <mailto:nick.adamson at generaldynamics.uk.com> Website: www.generaldynamics.uk.com <http://www.generaldynamics.uk.com/> Please consider the environment before printing this email ________________________________ This email and any files attached are intended for the addressee and may contain information of a confidential nature. If you are not the intended recipient, be aware that this email was sent to you in error and you should not disclose, distribute, print, copy or make other use of this email or its attachments. Such actions, in fact, may be unlawful. In compliance with the various Regulations and Acts, General Dynamics United Kingdom Limited reserves the right to monitor (and examine for viruses) all emails and email attachments, both inbound and outbound. Email communications and their attachments may not be secure or error- or virus-free and the company does not accept liability or responsibility for such matters or the consequences thereof. General Dynamics United Kingdom Limited, Registered Office: 21 Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: 1911653. _______________________________________________ Cruisecontrolrb-users mailing list Cruisecontrolrb-users at rubyforge.org http://rubyforge.org/mailman/listinfo/cruisecontrolrb-users -- Alexey Verkhovsky http://alex-verkhovsky.blogspot.com/ CruiseControl.rb [http://cruisecontrolrb.thoughtworks.com] This email and any files attached are intended for the addressee and may contain information of a confidential nature. If you are not the intended recipient, be aware that this email was sent to you in error and you should not disclose, distribute, print, copy or make other use of this email or its attachments. Such actions, in fact, may be unlawful. In compliance with the various Regulations and Acts, General Dynamics United Kingdom Limited reserves the right to monitor (and examine for viruses) all emails and email attachments, both inbound and outbound. Email communications and their attachments may not be secure or error- or virus-free and the company does not accept liability or responsibility for such matters or the consequences thereof. General Dynamics United Kingdom Limited, Registered Office: 21 Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: 1911653.
Nick.Adamson at generaldynamics.uk.com
2011-Apr-21 15:02 UTC
[Cruisecontrolrb-users] multiple builders, why do they keep stopping.
Hi All. Interestingly enough regarding the below issue. When the servers running at trace all the builders stay up. I''ve not had any die on me since I switched it to trace on Monday. Thanks. Nick. Nick Adamson Software Engineer General Dynamics United Kingdom Limited Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA Telephone: +44 (0)1495 23 6467 Email: Nick.Adamson at generaldynamics.uk.com Website: www.generaldynamics.uk.com To help reduce waste paper, please only print this email if you really need to. -----Original Message----- From: cruisecontrolrb-users-bounces at rubyforge.org [mailto:cruisecontrolrb-users-bounces at rubyforge.org] On Behalf Of Alexey Verkhovsky Sent: 15 April 2011 17:33 To: cruisecontrolrb-users at rubyforge.org Subject: Re: [Cruisecontrolrb-users] multiple builders,why do they keep stopping. Does builder log say anything about the cause of death? On Fri, Apr 15, 2011 at 9:47 AM, <Nick.Adamson at generaldynamics.uk.com> wrote: Hi All. We''ve been using CCRB, v 1.4.0, on a project for nearly a year now and have found it pretty stable however recently we''ve had some issues. The project is cross platform so there are multiple builders monitoring the same subversion path. When there are just 2 builders this works fine. We''ve recently introduced a new platform so have added another project which monitors the same subversion path. This has caused some stability issues. Every so often, seems like every 2 or 3 builds one of the builders will die for no apparent reason. The dashboard indicates the builder is stopped and the log doesn''t seem to say anything. It seems random which builder will die out of the 3 that are running. Has anyone seen anything like this or have any ideas how I can get them to be stable again. Switching the builds in to serial rather than parallel isn''t an option as each build can take up to half an hour, some times longer. Any ideas gratefully received. Thanks. Nick. Nick Adamson Software Engineer Advanced Projects and Technologies General Dynamics United Kingdom Limited<http://gdonline/new/Communications/img/Signature/Signature.bmp> Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA Telephone: +44 (0) 1495 236467 Email: nick.adamson at generaldynamics.uk.com <mailto:nick.adamson at generaldynamics.uk.com> Website: www.generaldynamics.uk.com <http://www.generaldynamics.uk.com/> Please consider the environment before printing this email ________________________________ This email and any files attached are intended for the addressee and may contain information of a confidential nature. If you are not the intended recipient, be aware that this email was sent to you in error and you should not disclose, distribute, print, copy or make other use of this email or its attachments. Such actions, in fact, may be unlawful. In compliance with the various Regulations and Acts, General Dynamics United Kingdom Limited reserves the right to monitor (and examine for viruses) all emails and email attachments, both inbound and outbound. Email communications and their attachments may not be secure or error- or virus-free and the company does not accept liability or responsibility for such matters or the consequences thereof. General Dynamics United Kingdom Limited, Registered Office: 21 Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: 1911653. _______________________________________________ Cruisecontrolrb-users mailing list Cruisecontrolrb-users at rubyforge.org http://rubyforge.org/mailman/listinfo/cruisecontrolrb-users -- Alexey Verkhovsky http://alex-verkhovsky.blogspot.com/ CruiseControl.rb [http://cruisecontrolrb.thoughtworks.com] This email and any files attached are intended for the addressee and may contain information of a confidential nature. If you are not the intended recipient, be aware that this email was sent to you in error and you should not disclose, distribute, print, copy or make other use of this email or its attachments. Such actions, in fact, may be unlawful. In compliance with the various Regulations and Acts, General Dynamics United Kingdom Limited reserves the right to monitor (and examine for viruses) all emails and email attachments, both inbound and outbound. Email communications and their attachments may not be secure or error- or virus-free and the company does not accept liability or responsibility for such matters or the consequences thereof. General Dynamics United Kingdom Limited, Registered Office: 21 Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: 1911653.
Nick.Adamson at generaldynamics.uk.com
2011-May-03 12:25 UTC
[Cruisecontrolrb-users] multiple builders, why do they keep stopping.
Hi All. 2 of the 3 builders have gone down again. I''m logging at trace however there is nothing useful. On both builders that died a build completes and the following 2 lines are seen: [debug] [2011-04-27 16:23:48] Sleeping [info] [2011-04-27 16:23:48] Builder for project ''ATIS-Vsap'' exited Any further ideas? Thanks. Nick. Nick Adamson Software Engineer General Dynamics United Kingdom Limited Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA Telephone: +44 (0)1495 23 6467 Email: Nick.Adamson at generaldynamics.uk.com Website: www.generaldynamics.uk.com To help reduce waste paper, please only print this email if you really need to. -----Original Message----- From: cruisecontrolrb-users-bounces at rubyforge.org [mailto:cruisecontrolrb-users-bounces at rubyforge.org] On Behalf Of Alexey Verkhovsky Sent: 15 April 2011 17:33 To: cruisecontrolrb-users at rubyforge.org Subject: Re: [Cruisecontrolrb-users] multiple builders,why do they keep stopping. Does builder log say anything about the cause of death? On Fri, Apr 15, 2011 at 9:47 AM, <Nick.Adamson at generaldynamics.uk.com> wrote: Hi All. We''ve been using CCRB, v 1.4.0, on a project for nearly a year now and have found it pretty stable however recently we''ve had some issues. The project is cross platform so there are multiple builders monitoring the same subversion path. When there are just 2 builders this works fine. We''ve recently introduced a new platform so have added another project which monitors the same subversion path. This has caused some stability issues. Every so often, seems like every 2 or 3 builds one of the builders will die for no apparent reason. The dashboard indicates the builder is stopped and the log doesn''t seem to say anything. It seems random which builder will die out of the 3 that are running. Has anyone seen anything like this or have any ideas how I can get them to be stable again. Switching the builds in to serial rather than parallel isn''t an option as each build can take up to half an hour, some times longer. Any ideas gratefully received. Thanks. Nick. Nick Adamson Software Engineer Advanced Projects and Technologies General Dynamics United Kingdom Limited<http://gdonline/new/Communications/img/Signature/Signature.bmp> Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA Telephone: +44 (0) 1495 236467 Email: nick.adamson at generaldynamics.uk.com <mailto:nick.adamson at generaldynamics.uk.com> Website: www.generaldynamics.uk.com <http://www.generaldynamics.uk.com/> Please consider the environment before printing this email ________________________________ This email and any files attached are intended for the addressee and may contain information of a confidential nature. If you are not the intended recipient, be aware that this email was sent to you in error and you should not disclose, distribute, print, copy or make other use of this email or its attachments. Such actions, in fact, may be unlawful. In compliance with the various Regulations and Acts, General Dynamics United Kingdom Limited reserves the right to monitor (and examine for viruses) all emails and email attachments, both inbound and outbound. Email communications and their attachments may not be secure or error- or virus-free and the company does not accept liability or responsibility for such matters or the consequences thereof. General Dynamics United Kingdom Limited, Registered Office: 21 Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: 1911653. _______________________________________________ Cruisecontrolrb-users mailing list Cruisecontrolrb-users at rubyforge.org http://rubyforge.org/mailman/listinfo/cruisecontrolrb-users -- Alexey Verkhovsky http://alex-verkhovsky.blogspot.com/ CruiseControl.rb [http://cruisecontrolrb.thoughtworks.com] This email and any files attached are intended for the addressee and may contain information of a confidential nature. If you are not the intended recipient, be aware that this email was sent to you in error and you should not disclose, distribute, print, copy or make other use of this email or its attachments. Such actions, in fact, may be unlawful. In compliance with the various Regulations and Acts, General Dynamics United Kingdom Limited reserves the right to monitor (and examine for viruses) all emails and email attachments, both inbound and outbound. Email communications and their attachments may not be secure or error- or virus-free and the company does not accept liability or responsibility for such matters or the consequences thereof. General Dynamics United Kingdom Limited, Registered Office: 21 Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: 1911653.
Nick.Adamson at generaldynamics.uk.com
2011-May-11 07:40 UTC
[Cruisecontrolrb-users] multiple builders, why do they keep stopping.
Hi All. Sorry to post again but the issues described below are still happening, if anything the builders seam to stop more often. Does anyone have any ideas? Thanks. Nick. Nick Adamson Software Engineer General Dynamics United Kingdom Limited Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA Telephone: +44 (0)1495 23 6467 Email: Nick.Adamson at generaldynamics.uk.com Website: www.generaldynamics.uk.com To help reduce waste paper, please only print this email if you really need to. -----Original Message----- From: Nick Adamson Sent: 03 May 2011 13:26 To: ''cruisecontrolrb-users at rubyforge.org'' Subject: RE: [Cruisecontrolrb-users] multiple builders,why do they keep stopping. Hi All. 2 of the 3 builders have gone down again. I''m logging at trace however there is nothing useful. On both builders that died a build completes and the following 2 lines are seen: [debug] [2011-04-27 16:23:48] Sleeping [info] [2011-04-27 16:23:48] Builder for project ''ATIS-Vsap'' exited Any further ideas? Thanks. Nick. Nick Adamson Software Engineer General Dynamics United Kingdom Limited Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA Telephone: +44 (0)1495 23 6467 Email: Nick.Adamson at generaldynamics.uk.com Website: www.generaldynamics.uk.com To help reduce waste paper, please only print this email if you really need to. -----Original Message----- From: cruisecontrolrb-users-bounces at rubyforge.org [mailto:cruisecontrolrb-users-bounces at rubyforge.org] On Behalf Of Alexey Verkhovsky Sent: 15 April 2011 17:33 To: cruisecontrolrb-users at rubyforge.org Subject: Re: [Cruisecontrolrb-users] multiple builders,why do they keep stopping. Does builder log say anything about the cause of death? On Fri, Apr 15, 2011 at 9:47 AM, <Nick.Adamson at generaldynamics.uk.com> wrote: Hi All. We''ve been using CCRB, v 1.4.0, on a project for nearly a year now and have found it pretty stable however recently we''ve had some issues. The project is cross platform so there are multiple builders monitoring the same subversion path. When there are just 2 builders this works fine. We''ve recently introduced a new platform so have added another project which monitors the same subversion path. This has caused some stability issues. Every so often, seems like every 2 or 3 builds one of the builders will die for no apparent reason. The dashboard indicates the builder is stopped and the log doesn''t seem to say anything. It seems random which builder will die out of the 3 that are running. Has anyone seen anything like this or have any ideas how I can get them to be stable again. Switching the builds in to serial rather than parallel isn''t an option as each build can take up to half an hour, some times longer. Any ideas gratefully received. Thanks. Nick. Nick Adamson Software Engineer Advanced Projects and Technologies General Dynamics United Kingdom Limited<http://gdonline/new/Communications/img/Signature/Signature.bmp> Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA Telephone: +44 (0) 1495 236467 Email: nick.adamson at generaldynamics.uk.com <mailto:nick.adamson at generaldynamics.uk.com> Website: www.generaldynamics.uk.com <http://www.generaldynamics.uk.com/> Please consider the environment before printing this email ________________________________ This email and any files attached are intended for the addressee and may contain information of a confidential nature. If you are not the intended recipient, be aware that this email was sent to you in error and you should not disclose, distribute, print, copy or make other use of this email or its attachments. Such actions, in fact, may be unlawful. In compliance with the various Regulations and Acts, General Dynamics United Kingdom Limited reserves the right to monitor (and examine for viruses) all emails and email attachments, both inbound and outbound. Email communications and their attachments may not be secure or error- or virus-free and the company does not accept liability or responsibility for such matters or the consequences thereof. General Dynamics United Kingdom Limited, Registered Office: 21 Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: 1911653. _______________________________________________ Cruisecontrolrb-users mailing list Cruisecontrolrb-users at rubyforge.org http://rubyforge.org/mailman/listinfo/cruisecontrolrb-users -- Alexey Verkhovsky http://alex-verkhovsky.blogspot.com/ CruiseControl.rb [http://cruisecontrolrb.thoughtworks.com] This email and any files attached are intended for the addressee and may contain information of a confidential nature. If you are not the intended recipient, be aware that this email was sent to you in error and you should not disclose, distribute, print, copy or make other use of this email or its attachments. Such actions, in fact, may be unlawful. In compliance with the various Regulations and Acts, General Dynamics United Kingdom Limited reserves the right to monitor (and examine for viruses) all emails and email attachments, both inbound and outbound. Email communications and their attachments may not be secure or error- or virus-free and the company does not accept liability or responsibility for such matters or the consequences thereof. General Dynamics United Kingdom Limited, Registered Office: 21 Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: 1911653.