flight 10231 xen-unstable real [real] http://www.chiark.greenend.org.uk/~xensrcts/logs/10231/ Regressions :-( Tests which did not succeed and are blocking: test-amd64-amd64-xl-win 8 guest-saverestore fail REGR. vs. 10201 test-amd64-i386-win-vcpus1 8 guest-saverestore fail REGR. vs. 10201 test-amd64-i386-win 8 guest-saverestore fail REGR. vs. 10201 test-i386-i386-win 8 guest-saverestore fail REGR. vs. 10201 test-amd64-i386-xl-win-vcpus1 8 guest-saverestore fail REGR. vs. 10201 test-i386-i386-xl-win 8 guest-saverestore fail REGR. vs. 10201 test-amd64-amd64-win 8 guest-saverestore fail REGR. vs. 10201 Tests which did not succeed, but are not blocking, including regressions (tests previously passed) regarded as allowable: test-amd64-i386-xend-winxpsp3 7 windows-install fail never pass test-amd64-amd64-xl-win7-amd64 7 windows-install fail never pass test-amd64-amd64-xl-winxpsp3 7 windows-install fail never pass test-amd64-i386-xl-winxpsp3-vcpus1 7 windows-install fail never pass test-amd64-i386-xl-win7-amd64 7 windows-install fail never pass test-i386-i386-xl-winxpsp3 7 windows-install fail never pass test-amd64-i386-rhel6hvm-intel 9 guest-start.2 fail never pass test-amd64-i386-rhel6hvm-amd 9 guest-start.2 fail never pass test-amd64-amd64-xl-pcipt-intel 9 guest-start fail never pass version targeted for testing: xen 3f815406feb2 baseline version: xen 62ff6a318c5d ------------------------------------------------------------ People who touched revisions under test: Adin Scannell <adin@scannell.ca> Andres Lagar-Cavilla <andres@lagarcavilla.org> Anthony PERARD <anthony.perard@citrix.com> Brendan Cully <brendan@cs.ubc.ca> Daniel De Graaf <dgdegra@tycho.nsa.gov> Ian Campbell <ian.campbell@citrix.com> Ian Jackson <ian.jackson.citrix.com> Ian Jackson <ian.jackson@eu.citrix.com> Jan Beulich <jbeulich@suse.com> Jean Guyader <jean.guyader@eu.citrix.com> Jonathan Davies <jonathan.davies@citrix.com> juergen.gross@ts.fujitsu.com Keir Fraser <keir@xen.org> Liu, Jinsong <jinsong.liu@intel.com> Olaf Hering <olaf@aepfle.de> Philipp Hahn <hahn@univention.de> Shriram Rajagopalan <rshriram@cs.ubc.ca> Stefano Stabellini <stefano.stabellini@eu.citrix.com> Tim Deegan <tim@xen.org> ------------------------------------------------------------ jobs: build-amd64 pass build-i386 pass build-amd64-oldkern pass build-i386-oldkern pass build-amd64-pvops pass build-i386-pvops pass test-amd64-amd64-xl pass test-amd64-i386-xl pass test-i386-i386-xl pass test-amd64-i386-rhel6hvm-amd fail test-amd64-amd64-xl-win7-amd64 fail test-amd64-i386-xl-win7-amd64 fail test-amd64-i386-xl-credit2 pass test-amd64-amd64-xl-pcipt-intel fail test-amd64-i386-rhel6hvm-intel fail test-amd64-i386-xl-multivcpu pass test-amd64-amd64-pair pass test-amd64-i386-pair pass test-i386-i386-pair pass test-amd64-amd64-pv pass test-amd64-i386-pv pass test-i386-i386-pv pass test-amd64-amd64-xl-sedf pass test-amd64-i386-win-vcpus1 fail test-amd64-i386-xl-win-vcpus1 fail test-amd64-i386-xl-winxpsp3-vcpus1 fail test-amd64-amd64-win fail test-amd64-i386-win fail test-i386-i386-win fail test-amd64-amd64-xl-win fail test-i386-i386-xl-win fail test-amd64-i386-xend-winxpsp3 fail test-amd64-amd64-xl-winxpsp3 fail test-i386-i386-xl-winxpsp3 fail ------------------------------------------------------------ sg-report-flight on woking.cam.xci-test.com logs: /home/xc_osstest/logs images: /home/xc_osstest/images Logs, config files, etc. are available at http://www.chiark.greenend.org.uk/~xensrcts/logs Test harness code can be found at http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary Not pushing. (No revision log; it would be 1073 lines long.)
On Fri, 2011-12-02 at 04:23 +0000, xen.org wrote:> flight 10231 xen-unstable real [real] > http://www.chiark.greenend.org.uk/~xensrcts/logs/10231/ > > Regressions :-( > > Tests which did not succeed and are blocking: > test-amd64-amd64-xl-win 8 guest-saverestore fail REGR. vs. 10201 > test-amd64-i386-win-vcpus1 8 guest-saverestore fail REGR. vs. 10201 > test-amd64-i386-win 8 guest-saverestore fail REGR. vs. 10201 > test-i386-i386-win 8 guest-saverestore fail REGR. vs. 10201 > test-amd64-i386-xl-win-vcpus1 8 guest-saverestore fail REGR. vs. 10201 > test-i386-i386-xl-win 8 guest-saverestore fail REGR. vs. 10201 > test-amd64-amd64-win 8 guest-saverestore fail REGR. vs. 10201The xl ones are all failing with: 2011-12-02 04:17:52 Z executing ssh ... root@10.80.249.56 xl save win.guest.osstest image Saving to image new xl format (info 0x0/0x0/625) libxl: error: libxl_exec.c:257:libxl__wait_for_offspring: Device Model not ready while the xm ones are failing with: 2011-12-02 03:22:20 Z executing ssh ... root@10.80.250.28 xm save win.guest.osstest image Usage: xm save [-c] <Domain> <CheckpointFile> Save a domain state to restore later. -c, --checkpoint Leave domain running after creating snapshot Error: Timed out waiting for device model action In the xl case the test harness doesn''t appear to have noticed the failure. Might be bad error handling in xl or a bug in the harness. (my money would be on the former). I can''t see anything in the qemu logs for the xm case but in one xl case there is: Error -22 while loading savevm file ''/var/lib/xen/qemu-resume.5'' In the xm case xend logs say: 011-12-02 03:22:22 2185] WARNING (image:552) domain migrating-win.guest.osstest: device model failure: pid 4278: malfunctioning (closed sentinel), killed; see /var/log/xen/qemu-dm-win.guest.osstest.log [2011-12-02 03:22:32 2185] INFO (XendCheckpoint:423) xc: error: Suspend request failed: Internal error [2011-12-02 03:22:32 2185] INFO (XendCheckpoint:423) xc: error: Domain appears not to have suspended: Internal error but as I say nothing interesting appears in qemu-dm...log [...]> version targeted for testing: > xen 3f815406feb2 > baseline version: > xen 62ff6a318c5dchangeset: 24332:6b26fb894ca0 user: Ian Jackson <Ian.Jackson@eu.citrix.com> date: Thu Dec 01 18:26:45 2011 +0000 summary: Update QEMU_TAG is in there but appears to represent a bunch of passthrough updates. There also a bunch of Remus compression stuff which appears to touch non-Remus suspend/resume code in libxc too, that''s a plausible candidate for the cause, I think There is also a bunch of paging stuff, which I guess/hope is harmless if paging is not in use? Tim, Andreas?. Otherwise it appears to all be docs and emulator changes which all seem less likely. There''s some libxl stuff but you wouldn''t expect that to hurt xend... I guess the bisector is on the case.> > ------------------------------------------------------------ > People who touched revisions under test: > Adin Scannell <adin@scannell.ca> > Andres Lagar-Cavilla <andres@lagarcavilla.org> > Anthony PERARD <anthony.perard@citrix.com> > Brendan Cully <brendan@cs.ubc.ca> > Daniel De Graaf <dgdegra@tycho.nsa.gov> > Ian Campbell <ian.campbell@citrix.com> > Ian Jackson <ian.jackson.citrix.com> > Ian Jackson <ian.jackson@eu.citrix.com> > Jan Beulich <jbeulich@suse.com> > Jean Guyader <jean.guyader@eu.citrix.com> > Jonathan Davies <jonathan.davies@citrix.com> > juergen.gross@ts.fujitsu.com > Keir Fraser <keir@xen.org> > Liu, Jinsong <jinsong.liu@intel.com> > Olaf Hering <olaf@aepfle.de> > Philipp Hahn <hahn@univention.de> > Shriram Rajagopalan <rshriram@cs.ubc.ca> > Stefano Stabellini <stefano.stabellini@eu.citrix.com> > Tim Deegan <tim@xen.org> > ------------------------------------------------------------ > > jobs: > build-amd64 pass > build-i386 pass > build-amd64-oldkern pass > build-i386-oldkern pass > build-amd64-pvops pass > build-i386-pvops pass > test-amd64-amd64-xl pass > test-amd64-i386-xl pass > test-i386-i386-xl pass > test-amd64-i386-rhel6hvm-amd fail > test-amd64-amd64-xl-win7-amd64 fail > test-amd64-i386-xl-win7-amd64 fail > test-amd64-i386-xl-credit2 pass > test-amd64-amd64-xl-pcipt-intel fail > test-amd64-i386-rhel6hvm-intel fail > test-amd64-i386-xl-multivcpu pass > test-amd64-amd64-pair pass > test-amd64-i386-pair pass > test-i386-i386-pair pass > test-amd64-amd64-pv pass > test-amd64-i386-pv pass > test-i386-i386-pv pass > test-amd64-amd64-xl-sedf pass > test-amd64-i386-win-vcpus1 fail > test-amd64-i386-xl-win-vcpus1 fail > test-amd64-i386-xl-winxpsp3-vcpus1 fail > test-amd64-amd64-win fail > test-amd64-i386-win fail > test-i386-i386-win fail > test-amd64-amd64-xl-win fail > test-i386-i386-xl-win fail > test-amd64-i386-xend-winxpsp3 fail > test-amd64-amd64-xl-winxpsp3 fail > test-i386-i386-xl-winxpsp3 fail > > > ------------------------------------------------------------ > sg-report-flight on woking.cam.xci-test.com > logs: /home/xc_osstest/logs > images: /home/xc_osstest/images > > Logs, config files, etc. are available at > http://www.chiark.greenend.org.uk/~xensrcts/logs > > Test harness code can be found at > http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary > > > Not pushing. > > (No revision log; it would be 1073 lines long.) > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xensource.com > http://lists.xensource.com/xen-devel
Andres Lagar-Cavilla
2011-Dec-02 15:40 UTC
Re: [xen-unstable test] 10231: regressions - FAIL
> On Fri, 2011-12-02 at 04:23 +0000, xen.org wrote: >> flight 10231 xen-unstable real [real] >> http://www.chiark.greenend.org.uk/~xensrcts/logs/10231/ >> >> Regressions :-( >> >> Tests which did not succeed and are blocking: >> test-amd64-amd64-xl-win 8 guest-saverestore fail REGR. >> vs. 10201 >> test-amd64-i386-win-vcpus1 8 guest-saverestore fail REGR. >> vs. 10201 >> test-amd64-i386-win 8 guest-saverestore fail REGR. >> vs. 10201 >> test-i386-i386-win 8 guest-saverestore fail REGR. >> vs. 10201 >> test-amd64-i386-xl-win-vcpus1 8 guest-saverestore fail REGR. >> vs. 10201 >> test-i386-i386-xl-win 8 guest-saverestore fail REGR. >> vs. 10201 >> test-amd64-amd64-win 8 guest-saverestore fail REGR. >> vs. 10201 > > The xl ones are all failing with: > 2011-12-02 04:17:52 Z executing ssh ... root@10.80.249.56 xl save > win.guest.osstest image > Saving to image new xl format (info 0x0/0x0/625) > libxl: error: libxl_exec.c:257:libxl__wait_for_offspring: Device > Model not ready > > while the xm ones are failing with: > 2011-12-02 03:22:20 Z executing ssh ... root@10.80.250.28 xm save > win.guest.osstest image > Usage: xm save [-c] <Domain> <CheckpointFile> > > Save a domain state to restore later. > -c, --checkpoint Leave domain running after > creating > snapshot > > Error: Timed out waiting for device model action > > In the xl case the test harness doesn''t appear to have noticed the > failure. Might be bad error handling in xl or a bug in the harness. (my > money would be on the former). > > I can''t see anything in the qemu logs for the xm case but in one xl case > there is: > Error -22 while loading savevm file ''/var/lib/xen/qemu-resume.5'' > > In the xm case xend logs say: > 011-12-02 03:22:22 2185] WARNING (image:552) domain > migrating-win.guest.osstest: device model failure: pid 4278: > malfunctioning (closed sentinel), killed; see > /var/log/xen/qemu-dm-win.guest.osstest.log > [2011-12-02 03:22:32 2185] INFO (XendCheckpoint:423) xc: error: Suspend > request failed: Internal error > [2011-12-02 03:22:32 2185] INFO (XendCheckpoint:423) xc: error: Domain > appears not to have suspended: Internal error > > but as I say nothing interesting appears in qemu-dm...log > [...] >> version targeted for testing: >> xen 3f815406feb2 >> baseline version: >> xen 62ff6a318c5d > > changeset: 24332:6b26fb894ca0 > user: Ian Jackson <Ian.Jackson@eu.citrix.com> > date: Thu Dec 01 18:26:45 2011 +0000 > summary: Update QEMU_TAG > > is in there but appears to represent a bunch of passthrough updates. > There also a bunch of Remus compression stuff which appears to touch > non-Remus suspend/resume code in libxc too, that''s a plausible candidate > for the cause, I think > > There is also a bunch of paging stuff, which I guess/hope is harmless if > paging is not in use? Tim, Andreas?.I''d be surprised. Afaict, the only realistic possibilities from my side are f71ecec8be2e "x86/mm: Ensure maps used by nested hvm code cannot be paged out" and 75f4e4d9f039 "x86/mm: Don''t trigger unnecessary shadow scans on p2m entry update" Andres> > Otherwise it appears to all be docs and emulator changes which all seem > less likely. There''s some libxl stuff but you wouldn''t expect that to > hurt xend... > > I guess the bisector is on the case. > >> >> ------------------------------------------------------------ >> People who touched revisions under test: >> Adin Scannell <adin@scannell.ca> >> Andres Lagar-Cavilla <andres@lagarcavilla.org> >> Anthony PERARD <anthony.perard@citrix.com> >> Brendan Cully <brendan@cs.ubc.ca> >> Daniel De Graaf <dgdegra@tycho.nsa.gov> >> Ian Campbell <ian.campbell@citrix.com> >> Ian Jackson <ian.jackson.citrix.com> >> Ian Jackson <ian.jackson@eu.citrix.com> >> Jan Beulich <jbeulich@suse.com> >> Jean Guyader <jean.guyader@eu.citrix.com> >> Jonathan Davies <jonathan.davies@citrix.com> >> juergen.gross@ts.fujitsu.com >> Keir Fraser <keir@xen.org> >> Liu, Jinsong <jinsong.liu@intel.com> >> Olaf Hering <olaf@aepfle.de> >> Philipp Hahn <hahn@univention.de> >> Shriram Rajagopalan <rshriram@cs.ubc.ca> >> Stefano Stabellini <stefano.stabellini@eu.citrix.com> >> Tim Deegan <tim@xen.org> >> ------------------------------------------------------------ >> >> jobs: >> build-amd64 pass >> build-i386 pass >> build-amd64-oldkern pass >> build-i386-oldkern pass >> build-amd64-pvops pass >> build-i386-pvops pass >> test-amd64-amd64-xl pass >> test-amd64-i386-xl pass >> test-i386-i386-xl pass >> test-amd64-i386-rhel6hvm-amd fail >> test-amd64-amd64-xl-win7-amd64 fail >> test-amd64-i386-xl-win7-amd64 fail >> test-amd64-i386-xl-credit2 pass >> test-amd64-amd64-xl-pcipt-intel fail >> test-amd64-i386-rhel6hvm-intel fail >> test-amd64-i386-xl-multivcpu pass >> test-amd64-amd64-pair pass >> test-amd64-i386-pair pass >> test-i386-i386-pair pass >> test-amd64-amd64-pv pass >> test-amd64-i386-pv pass >> test-i386-i386-pv pass >> test-amd64-amd64-xl-sedf pass >> test-amd64-i386-win-vcpus1 fail >> test-amd64-i386-xl-win-vcpus1 fail >> test-amd64-i386-xl-winxpsp3-vcpus1 fail >> test-amd64-amd64-win fail >> test-amd64-i386-win fail >> test-i386-i386-win fail >> test-amd64-amd64-xl-win fail >> test-i386-i386-xl-win fail >> test-amd64-i386-xend-winxpsp3 fail >> test-amd64-amd64-xl-winxpsp3 fail >> test-i386-i386-xl-winxpsp3 fail >> >> >> ------------------------------------------------------------ >> sg-report-flight on woking.cam.xci-test.com >> logs: /home/xc_osstest/logs >> images: /home/xc_osstest/images >> >> Logs, config files, etc. are available at >> http://www.chiark.greenend.org.uk/~xensrcts/logs >> >> Test harness code can be found at >> http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary >> >> >> Not pushing. >> >> (No revision log; it would be 1073 lines long.) >> >> _______________________________________________ >> Xen-devel mailing list >> Xen-devel@lists.xensource.com >> http://lists.xensource.com/xen-devel > > > >