flight 11807 xen-unstable real [real] http://www.chiark.greenend.org.uk/~xensrcts/logs/11807/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-i386-xl-credit2 9 guest-start fail REGR. vs. 11643 test-amd64-i386-xl-win7-amd64 7 windows-install fail REGR. vs. 11643 Regressions which are regarded as allowable (not blocking): test-i386-i386-win 14 guest-start.2 fail like 11643 Tests which did not succeed, but are not blocking: test-amd64-amd64-xl-pcipt-intel 9 guest-start fail never pass test-amd64-i386-rhel6hvm-intel 11 leak-check/check fail never pass test-amd64-i386-rhel6hvm-amd 11 leak-check/check fail never pass test-amd64-amd64-xl-win7-amd64 13 guest-stop fail never pass test-amd64-i386-xl-winxpsp3-vcpus1 13 guest-stop fail never pass test-amd64-i386-win-vcpus1 16 leak-check/check fail never pass test-amd64-i386-xend-winxpsp3 16 leak-check/check fail never pass test-amd64-amd64-xl-win 13 guest-stop fail never pass test-amd64-i386-xl-win-vcpus1 13 guest-stop fail never pass test-i386-i386-xl-win 13 guest-stop fail never pass test-amd64-i386-win 16 leak-check/check fail never pass test-i386-i386-xl-winxpsp3 13 guest-stop fail never pass test-amd64-amd64-win 16 leak-check/check fail never pass test-amd64-amd64-xl-winxpsp3 13 guest-stop fail never pass version targeted for testing: xen a91aa7a582fb baseline version: xen e2722b24dc09 ------------------------------------------------------------ People who touched revisions under test: Adin Scannell <adin@scannell.ca> Alex Zeffertt <alex.zeffertt@eu.citrix.com> Andres Lagar-Cavilla <andres@lagarcavilla.org> Andrew Cooper <andrew.cooper3@citrix.com> Daniel De Graaf <dgdegra@tycho.nsa.gov> Dario Faggioli <dario.faggioli@citrix.com> Diego Ongaro <diego.ongaro@citrix.com> Dietmar Hahn <dietmar.hahn@ts.fujitsu.com> Ian Campbell <ian.campbell@citrix.com> Ian Jackson <ian.jackson@eu.citrix.com> Jan Beulich <jbeulich@suse.com> Jim Fehlig <jfehlig@suse.com> juergen.gross@ts.fujitsu.com Keir Fraser <keir@xen.org> Olaf Hering <olaf@aepfle.de> Paulian Bogdan Marinca <paulian@marinca.net> Roger Pau Monne <roger.pau@entel.upc.edu> Stefano Stabellini <stefano.stabellini@eu.citrix.com> Tim Deegan <tim@xen.org> Wei Wang <wei.wang2@amd.com> ------------------------------------------------------------ jobs: build-amd64 pass build-i386 pass build-amd64-oldkern pass build-i386-oldkern pass build-amd64-pvops pass build-i386-pvops pass test-amd64-amd64-xl pass test-amd64-i386-xl pass test-i386-i386-xl pass test-amd64-i386-rhel6hvm-amd fail test-amd64-amd64-xl-win7-amd64 fail test-amd64-i386-xl-win7-amd64 fail test-amd64-i386-xl-credit2 fail test-amd64-amd64-xl-pcipt-intel fail test-amd64-i386-rhel6hvm-intel fail test-amd64-i386-xl-multivcpu pass test-amd64-amd64-pair pass test-amd64-i386-pair pass test-i386-i386-pair pass test-amd64-amd64-xl-sedf-pin pass test-amd64-amd64-pv pass test-amd64-i386-pv pass test-i386-i386-pv pass test-amd64-amd64-xl-sedf pass test-amd64-i386-win-vcpus1 fail test-amd64-i386-xl-win-vcpus1 fail test-amd64-i386-xl-winxpsp3-vcpus1 fail test-amd64-amd64-win fail test-amd64-i386-win fail test-i386-i386-win fail test-amd64-amd64-xl-win fail test-i386-i386-xl-win fail test-amd64-i386-xend-winxpsp3 fail test-amd64-amd64-xl-winxpsp3 fail test-i386-i386-xl-winxpsp3 fail ------------------------------------------------------------ sg-report-flight on woking.cam.xci-test.com logs: /home/xc_osstest/logs images: /home/xc_osstest/images Logs, config files, etc. are available at http://www.chiark.greenend.org.uk/~xensrcts/logs Test harness code can be found at http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary Not pushing. (No revision log; it would be 1232 lines long.)
xen.org writes ("[xen-unstable test] 11807: regressions - FAIL"):> Tests which did not succeed and are blocking, > including tests which could not be run: > test-amd64-i386-xl-credit2 9 guest-start fail REGR. vs. 11643 > test-amd64-i386-xl-win7-amd64 7 windows-install fail REGR. vs. 11643Both of these seem to be high-probability heisenbugs. In both cases LThe failure seems to be much more likely (perhaps even restricted to) on certain hosts, and now that my tester is "sticky" when it sees a fail these will give us more trouble. For this one> test-amd64-i386-xl-win7-amd64 7 windows-install fail REGR. vs. 11643the failure mode is that Windows sits waiting at a login screen rather than logging in the user which is supposed to run the test responder which was installed with the image. Most likely cause is that it has stopped making progress for some reason. None of the logs seem interesting. This one> test-amd64-i386-xl-credit2 9 guest-start fail REGR. vs. 11643which occasionally also manifests as various other failures of the same test run, is this assertion: Feb 2 02:34:49.293506 (XEN) Assertion ''test_bit(vector, desc->arch.used_vectors)'' failed at irq.c:670 which I mentioned yesterday. My bisector had a go at the guest-saverestore test and produced inconclusive results but looking at the revision graph output I suspect that something between 24612:54000bca7a6a (probably good) and 24620:926e0820d615 (definitely bad) may be implicated. Given that this bug seems to be pretty specific to a particular host, which happens to be a dual-socket six-core AMD Opteron 2427, I''m wondering whether 24613:04623ceabb72 "amd iommu: disable iommu emulation on non-iommu systems" might be relevant. Suggestions for either bug, and offers to debug these, gratefully received. Failing that we will probably get lucky and get a push eventually. Ian.
This patch ought to help narrow down the problem. -- Andrew Cooper - Dom0 Kernel Engineer, Citrix XenServer T: +44 (0)1223 225 900, http://www.citrix.com _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
On 07/02/2012 18:09, "Ian Jackson" <Ian.Jackson@eu.citrix.com> wrote:> Andrew Cooper writes ("Re: [Xen-devel] [xen-unstable test] 11807: regressions > - FAIL"): >> This patch ought to help narrow down the problem. > > Thanks. Keir, does this look reasonable to you ?Ah, yes it did. Please apply it. Acked-by: Keir Fraser <keir@xen.org>> Thanks, > Ian.
Andrew Cooper writes ("Re: [Xen-devel] [xen-unstable test] 11807: regressions - FAIL"):> This patch ought to help narrow down the problem.Thanks. Keir, does this look reasonable to you ? Thanks, Ian.
Keir Fraser writes ("Re: [Xen-devel] [xen-unstable test] 11807: regressions - FAIL"):> On 07/02/2012 18:09, "Ian Jackson" <Ian.Jackson@eu.citrix.com> wrote: > > Thanks. Keir, does this look reasonable to you ? > > Ah, yes it did. Please apply it. > > Acked-by: Keir Fraser <keir@xen.org>Thanks, done. Ian.