flight 19031 xen-4.2-testing real [real]
http://www.chiark.greenend.org.uk/~xensrcts/logs/19031/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-i386-xend-qemut-winxpsp3 7 windows-install fail REGR. vs. 18801
Tests which did not succeed, but are not blocking:
build-armhf 4 xen-build fail never pass
test-amd64-amd64-xl-pcipt-intel 9 guest-start fail never pass
test-amd64-i386-xl-winxpsp3-vcpus1 13 guest-stop fail never pass
test-amd64-i386-xl-qemut-win7-amd64 13 guest-stop fail never pass
test-amd64-i386-xend-winxpsp3 16 leak-check/check fail never pass
test-amd64-amd64-xl-win7-amd64 13 guest-stop fail never pass
test-amd64-amd64-xl-qemuu-win7-amd64 13 guest-stop fail never pass
test-amd64-amd64-xl-qemut-win7-amd64 13 guest-stop fail never pass
test-amd64-amd64-xl-qemut-winxpsp3 13 guest-stop fail never pass
test-i386-i386-xl-qemut-winxpsp3 13 guest-stop fail never pass
test-i386-i386-xl-qemuu-winxpsp3 13 guest-stop fail never pass
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 13 guest-stop fail never pass
test-amd64-i386-xl-win7-amd64 13 guest-stop fail never pass
test-i386-i386-xl-winxpsp3 13 guest-stop fail never pass
test-amd64-amd64-xl-qemuu-winxpsp3 13 guest-stop fail never pass
test-amd64-amd64-xl-winxpsp3 13 guest-stop fail never pass
version targeted for testing:
xen 9f93027afd796a98d7b92898f4ccc772796a4874
baseline version:
xen 56b2771863b7835faf6fa07290bcacb3a68a8326
------------------------------------------------------------
People who touched revisions under test:
David Scott <dave.scott@eu.citrix.com>
Ian Jackson <ian.jackson@eu.citrix.com>
John Liu <john.liuqiming@huawei.com>
------------------------------------------------------------
jobs:
build-amd64 pass
build-armhf fail
build-i386 pass
build-amd64-oldkern pass
build-i386-oldkern pass
build-amd64-pvops pass
build-i386-pvops pass
test-amd64-amd64-xl pass
test-amd64-i386-xl pass
test-i386-i386-xl pass
test-amd64-i386-rhel6hvm-amd pass
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-amd64-xl-win7-amd64 fail
test-amd64-i386-xl-win7-amd64 fail
test-amd64-i386-xl-credit2 pass
test-amd64-amd64-xl-pcipt-intel fail
test-amd64-i386-rhel6hvm-intel pass
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-i386-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-i386-i386-pair pass
test-amd64-amd64-xl-sedf-pin pass
test-amd64-amd64-pv pass
test-amd64-i386-pv pass
test-i386-i386-pv pass
test-amd64-amd64-xl-sedf pass
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 fail
test-amd64-i386-xl-winxpsp3-vcpus1 fail
test-amd64-i386-xend-qemut-winxpsp3 fail
test-amd64-amd64-xl-qemut-winxpsp3 fail
test-i386-i386-xl-qemut-winxpsp3 fail
test-amd64-amd64-xl-qemuu-winxpsp3 fail
test-i386-i386-xl-qemuu-winxpsp3 fail
test-amd64-i386-xend-winxpsp3 fail
test-amd64-amd64-xl-winxpsp3 fail
test-i386-i386-xl-winxpsp3 fail
------------------------------------------------------------
sg-report-flight on woking.cam.xci-test.com
logs: /home/xc_osstest/logs
images: /home/xc_osstest/images
Logs, config files, etc. are available at
http://www.chiark.greenend.org.uk/~xensrcts/logs
Test harness code can be found at
http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary
Not pushing.
------------------------------------------------------------
commit 9f93027afd796a98d7b92898f4ccc772796a4874
Author: Ian Jackson <ian.jackson@eu.citrix.com>
Date: Tue Sep 3 11:55:48 2013 +0100
oxenstored: Protect oxenstored from malicious domains.
add check logic when read from IO ring, and if error happens,
then mark the reading connection as "bad", Unless vm reboot,
oxenstored will not handle message from this connection any more.
xs_ring_stubs.c: add a more strict check on ring reading
connection.ml, domain.ml: add getter and setter for bad flag
process.ml: if exception raised when reading from domain''s ring,
mark this domain as "bad"
xenstored.ml: if a domain is marked as "bad", do not handle it.
Signed-off-by: John Liu <john.liuqiming@huawei.com>
Acked-by: David Scott <dave.scott@eu.citrix.com>
(cherry picked from commit 704302ce9404c73cfb687d31adcf67094ab5bb53)
(cherry picked from commit a978634bee4db6c5e0ceeb66adcc5114f3f9bc48)
Conflicts:
tools/ocaml/xenstored/domain.ml
Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
(qemu changes not included)
>>> On 04.09.13 at 07:17, xen.org <ian.jackson@eu.citrix.com> wrote: > flight 19031 xen-4.2-testing real [real] > http://www.chiark.greenend.org.uk/~xensrcts/logs/19031/ > > Regressions :-( > > Tests which did not succeed and are blocking, > including tests which could not be run: > test-amd64-i386-xend-qemut-winxpsp3 7 windows-install fail REGR. vs. 18801So the stable trees are apparently using the 3.10-based kernels too, and woodlouse is giving a problem there too. Which hints even more strongly at a kernel side problem on that specific box than a regression in recent -unstable commits. Which in turn raises the question of how to best get -unstable''s staging tree''s backlog taken care of, alongside the question of how to get pushes on the soon-to-be-released stable trees. Jan
Konrad Rzeszutek Wilk
2013-Sep-04 14:50 UTC
Re: [xen-4.2-testing test] 19031: regressions - FAIL
On Wed, Sep 04, 2013 at 09:12:49AM +0100, Jan Beulich wrote:> >>> On 04.09.13 at 07:17, xen.org <ian.jackson@eu.citrix.com> wrote: > > flight 19031 xen-4.2-testing real [real] > > http://www.chiark.greenend.org.uk/~xensrcts/logs/19031/ > > > > Regressions :-( > > > > Tests which did not succeed and are blocking, > > including tests which could not be run: > > test-amd64-i386-xend-qemut-winxpsp3 7 windows-install fail REGR. vs. 18801 > > So the stable trees are apparently using the 3.10-based kernels > too, and woodlouse is giving a problem there too. Which hints > even more strongly at a kernel side problem on that specific box > than a regression in recent -unstable commits. Which in turn > raises the question of how to best get -unstable''s staging tree''s > backlog taken care of, alongside the question of how to get > pushes on the soon-to-be-released stable trees.It is interesting that it fails at the same problem the linux-real had been failing. That is when doing rsync. 5120 bytes (5.1 kB) copied, 0.0194138 s, 264 kB/s 2013-09-04 04:42:13 Z execution took 19 seconds [**>30/2**]: ssh -o StrictHostKeyChecking=no -o BatchMode=yes -o ConnectTimeout=100 -o ServerAliveInterval=100 -o PasswordAuthentication=no -o ChallengeResponseAuthentication=no -o UserKnownHostsFile=tmp/t.known_hosts_19031.test-amd64-i386-xend-qemut-winxpsp3 root@10.80.248.105 dd if=/dev/zero of=/dev/woodlouse/win.guest.osstest-disk count=10 2013-09-04 04:42:13 Z executing rsync ... -p /home/xc_osstest/images/winxpsp3.iso root@10.80.248.105:/root/19031.test-amd64-i386-xend-qemut-winxpsp3.winxpsp3.iso 2013-09-04 04:58:53 Z command timed out [1000]: rsync -e ssh -o StrictHostKeyChecking=no -o BatchMode=yes -o ConnectTimeout=100 -o ServerAliveInterval=100 -o PasswordAuthentication=no -o ChallengeResponseAuthentication=no -o UserKnownHostsFile=tmp/t.known_hosts_19031.test-amd64-i386-xend-qemut-winxpsp3 -p /home/xc_osstest/images/winxpsp3.iso root@10.80.248.105:/root/19031.test-amd64-i386-xend-qemut-winxpsp3.winxpsp3.iso status (timed out) at Osstest/TestSupport.pm line 375. + rc=4 + date -u ''+%Y-%m-%d %H:%M:%S Z exit status 4'' 2013-09-04 04:58:53 Z exit status 4 + exit 4 rsync error: unexplained error (code 143) at rsync.c(541) [sender=3.0.3] Ian, is it possible to a bit more verbose - perhaps that will shed some light at this awful speed. There does not seem to be anything about the ''tg3'' blowing up? Ian, would it also be able to get the interrupt count _Before_ and _after_ the timeout? Perhaps the interrupts aren''t going to the device? Thanks.> > Jan > > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xen.org > http://lists.xen.org/xen-devel
Konrad Rzeszutek Wilk writes ("Re: [Xen-devel] [xen-4.2-testing test]
19031: regressions - FAIL"):> It is interesting that it fails at the same problem the linux-real had
> been failing. That is when doing rsync.
>
>
> 5120 bytes (5.1 kB) copied, 0.0194138 s, 264 kB/s
> 2013-09-04 04:42:13 Z execution took 19 seconds [**>30/2**]: ssh -o
StrictHostKeyChecking=no -o BatchMode=yes -o ConnectTimeout=100 -o
ServerAliveInterval=100 -o PasswordAuthentication=no -o
ChallengeResponseAuthentication=no -o
UserKnownHostsFile=tmp/t.known_hosts_19031.test-amd64-i386-xend-qemut-winxpsp3
root@10.80.248.105 dd if=/dev/zero of=/dev/woodlouse/win.guest.osstest-disk
count=10
> 2013-09-04 04:42:13 Z executing rsync ... -p
/home/xc_osstest/images/winxpsp3.iso
root@10.80.248.105:/root/19031.test-amd64-i386-xend-qemut-winxpsp3.winxpsp3.iso
This is obviously badly broken. It''s copying a tiny known_hosts file,
and it took 19 seconds.
> Ian, is it possible to a bit more verbose - perhaps that will shed some
light
> at this awful speed.
I could add a -v but I''m not sure it will be much more illuminating.
> There does not seem to be anything about the ''tg3''
blowing up?
> Ian, would it also be able to get the interrupt count _Before_ and
> _after_ the timeout? Perhaps the interrupts aren''t going to the
> device?
Surely that wouldn''t produce these symptoms...
Ian.
Konrad Rzeszutek Wilk
2013-Sep-04 18:18 UTC
Re: [xen-4.2-testing test] 19031: regressions - FAIL
On Wed, Sep 04, 2013 at 04:11:15PM +0100, Ian Jackson wrote:> Konrad Rzeszutek Wilk writes ("Re: [Xen-devel] [xen-4.2-testing test] 19031: regressions - FAIL"): > > It is interesting that it fails at the same problem the linux-real had > > been failing. That is when doing rsync. > > > > > > 5120 bytes (5.1 kB) copied, 0.0194138 s, 264 kB/s > > 2013-09-04 04:42:13 Z execution took 19 seconds [**>30/2**]: ssh -o StrictHostKeyChecking=no -o BatchMode=yes -o ConnectTimeout=100 -o ServerAliveInterval=100 -o PasswordAuthentication=no -o ChallengeResponseAuthentication=no -o UserKnownHostsFile=tmp/t.known_hosts_19031.test-amd64-i386-xend-qemut-winxpsp3 root@10.80.248.105 dd if=/dev/zero of=/dev/woodlouse/win.guest.osstest-disk count=10 > > 2013-09-04 04:42:13 Z executing rsync ... -p /home/xc_osstest/images/winxpsp3.iso root@10.80.248.105:/root/19031.test-amd64-i386-xend-qemut-winxpsp3.winxpsp3.iso > > This is obviously badly broken. It''s copying a tiny known_hosts file, > and it took 19 seconds. > > > Ian, is it possible to a bit more verbose - perhaps that will shed some light > > at this awful speed. > > I could add a -v but I''m not sure it will be much more illuminating. > > > There does not seem to be anything about the ''tg3'' blowing up? > > Ian, would it also be able to get the interrupt count _Before_ and > > _after_ the timeout? Perhaps the interrupts aren''t going to the > > device? > > Surely that wouldn''t produce these symptoms...Does this happen _only_ with 32-bit dom0? The theory about /proc/interrupts is that the tg3 is not using the DMA API properly and the device driver has submitted commands. The hardware sits there and occassionaly polls instead of going over the commands quickly. That would explain the slowness. But that won''t explain why it works with 64-bit dom0s unless there is some truncation of physical addresses. Perhaps you could build with CONFIG_DEBUG_DMA_API=? Perhaps that will shed some light on it?