Sander Eikelenboom
2010-Jul-22 19:32 UTC
[Xen-devel] xen-swiotlb: WARNING: at kernel/smp.c:421 smp_call_function_many+0x66/0x1a1()
Hi Konrad, Finally found the time to test the xen-swiotlb again (together with usb3/xhci isoc pathes) I began with your tree: git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git devel/merge.2.6.35-rc3 and after that i merged in a tree for the xhci part that is based on 2.6.35-rc4: git://git.kernel.org/pub/scm/linux/kernel/git/sarah/xhci.git amd-isoc That all went without a problem, booting the resulting kernel in a PV domU gives the warnings below, i hope these can be addressed before the next merge window and xen-swiotlb will make it in ! Despite the 2 warnings, the usb devices i passed through seem to work ok. -- Sander info: Xen version: xen-4.0-testing-pre4 (changeset: 21263:57859775f88f) Dom0 kernel: 2.6.32.16 pvops (commit 006bfe8f594370f36f09d8e8ab13692d34e88533) Attached: - xm dmesg (the part where the domU gets created - dmesg of the domU - lspci -vvvknn of the domU [ 1.471104] ------------[ cut here ]------------ [ 1.471120] WARNING: at kernel/smp.c:421 smp_call_function_many+0x66/0x1a1() [ 1.471126] Modules linked in: thermal_sys [last unloaded: scsi_wait_scan] [ 1.471135] Pid: 153, comm: khubd Not tainted 2.6.35-rc4+konrad+xhci-isoc+ #2 [ 1.471140] Call Trace: [ 1.471147] [<ffffffff81063987>] ? smp_call_function_many+0x66/0x1a1 [ 1.471153] [<ffffffff81063987>] ? smp_call_function_many+0x66/0x1a1 [ 1.471159] [<ffffffff8103d85e>] ? warn_slowpath_common+0x78/0xa2 [ 1.471166] [<ffffffff81063987>] ? smp_call_function_many+0x66/0x1a1 [ 1.471177] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 [ 1.471182] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 [ 1.471188] [<ffffffff81063ae2>] ? smp_call_function+0x20/0x25 [ 1.471195] [<ffffffff8104300f>] ? on_each_cpu+0x10/0x2e [ 1.471201] [<ffffffff810bd26c>] ? __purge_vmap_area_lazy+0xf6/0x14f [ 1.471207] [<ffffffff810bf62f>] ? vm_unmap_aliases+0x168/0x179 [ 1.471214] [<ffffffff8100470e>] ? xen_create_contiguous_region+0x3f/0xe6 [ 1.471221] [<ffffffff8123859f>] ? xen_swiotlb_alloc_coherent+0x66/0xd3 [ 1.471227] [<ffffffff8100633f>] ? xen_restore_fl_direct_end+0x0/0x1 [ 1.471234] [<ffffffff810c3832>] ? pool_alloc_page+0x10a/0x194 [ 1.471240] [<ffffffff810c3932>] ? dma_pool_alloc+0x76/0x163 [ 1.471248] [<ffffffff8138d215>] ? hid_alloc_buffers+0x23/0xf4 [ 1.471254] [<ffffffff8138e75e>] ? usbhid_start+0x15d/0x49b [ 1.471260] [<ffffffff8111c6a1>] ? sysfs_do_create_link+0xee/0x13c [ 1.471266] [<ffffffff81380f77>] ? hid_device_probe+0x93/0xce [ 1.471274] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e [ 1.471279] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 [ 1.471285] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 [ 1.471293] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 [ 1.471298] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b [ 1.471304] [<ffffffff812baee5>] ? device_add+0x29c/0x406 [ 1.471310] [<ffffffff81380b80>] ? hid_add_device+0x17c/0x1a0 [ 1.471316] [<ffffffff8138da3e>] ? usbhid_probe+0x40b/0x468 [ 1.471322] [<ffffffff8132fcc7>] ? usb_match_one_id+0x23/0x7f [ 1.471328] [<ffffffff8133077a>] ? usb_probe_interface+0xd4/0x11b [ 1.471334] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e [ 1.471340] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 [ 1.471346] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 [ 1.471352] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 [ 1.471358] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b [ 1.471364] [<ffffffff812baee5>] ? device_add+0x29c/0x406 [ 1.471369] [<ffffffff8132f97a>] ? usb_set_configuration+0x5d6/0x655 [ 1.471376] [<ffffffff8133710f>] ? generic_probe+0x71/0xc6 [ 1.471381] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e [ 1.471387] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 [ 1.471394] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 [ 1.471400] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 [ 1.471406] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b [ 1.471411] [<ffffffff812baee5>] ? device_add+0x29c/0x406 [ 1.471417] [<ffffffff81329b25>] ? usb_new_device+0x7b/0xdc [ 1.471422] [<ffffffff8132a6f5>] ? hub_port_connect_change+0x5fc/0x89e [ 1.471428] [<ffffffff8132e9ac>] ? usb_control_msg+0x12f/0x140 [ 1.471434] [<ffffffff8132ad64>] ? hub_events+0x3cd/0x51d [ 1.471440] [<ffffffff8132aef0>] ? hub_thread+0x3c/0x158 [ 1.471446] [<ffffffff81054c0c>] ? autoremove_wake_function+0x0/0x2e [ 1.471452] [<ffffffff8132aeb4>] ? hub_thread+0x0/0x158 [ 1.471457] [<ffffffff810547d5>] ? kthread+0x79/0x81 [ 1.471463] [<ffffffff81009564>] ? kernel_thread_helper+0x4/0x10 [ 1.471468] [<ffffffff81008961>] ? int_ret_from_sys_call+0x7/0x1b [ 1.471476] [<ffffffff8143121d>] ? retint_restore_args+0x5/0x6 [ 1.471481] [<ffffffff81009560>] ? kernel_thread_helper+0x0/0x10 [ 1.471486] ---[ end trace 0680a6f27492dd31 ]--- [ 1.471490] ------------[ cut here ]------------ [ 1.471495] WARNING: at kernel/smp.c:293 smp_call_function_single+0x6e/0x108() [ 1.471500] Modules linked in: thermal_sys [last unloaded: scsi_wait_scan] [ 1.471509] Pid: 153, comm: khubd Tainted: G W 2.6.35-rc4+konrad+xhci-isoc+ #2 [ 1.471514] Call Trace: [ 1.471519] [<ffffffff8106380a>] ? smp_call_function_single+0x6e/0x108 [ 1.471524] [<ffffffff8106380a>] ? smp_call_function_single+0x6e/0x108 [ 1.471530] [<ffffffff8103d85e>] ? warn_slowpath_common+0x78/0xa2 [ 1.471536] [<ffffffff8106380a>] ? smp_call_function_single+0x6e/0x108 [ 1.471542] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 [ 1.471547] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 [ 1.471553] [<ffffffff81063ae2>] ? smp_call_function+0x20/0x25 [ 1.471559] [<ffffffff8104300f>] ? on_each_cpu+0x10/0x2e [ 1.471564] [<ffffffff810bd26c>] ? __purge_vmap_area_lazy+0xf6/0x14f [ 1.471570] [<ffffffff810bf62f>] ? vm_unmap_aliases+0x168/0x179 [ 1.471576] [<ffffffff8100470e>] ? xen_create_contiguous_region+0x3f/0xe6 [ 1.471582] [<ffffffff8123859f>] ? xen_swiotlb_alloc_coherent+0x66/0xd3 [ 1.471588] [<ffffffff8100633f>] ? xen_restore_fl_direct_end+0x0/0x1 [ 1.471594] [<ffffffff810c3832>] ? pool_alloc_page+0x10a/0x194 [ 1.471600] [<ffffffff810c3932>] ? dma_pool_alloc+0x76/0x163 [ 1.472021] [<ffffffff8138d215>] ? hid_alloc_buffers+0x23/0xf4 [ 1.472021] [<ffffffff8138e75e>] ? usbhid_start+0x15d/0x49b [ 1.472021] [<ffffffff8111c6a1>] ? sysfs_do_create_link+0xee/0x13c [ 1.472021] [<ffffffff81380f77>] ? hid_device_probe+0x93/0xce [ 1.472021] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e [ 1.472021] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 [ 1.472021] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 [ 1.472021] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 [ 1.472021] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b [ 1.472021] [<ffffffff812baee5>] ? device_add+0x29c/0x406 [ 1.472021] [<ffffffff81380b80>] ? hid_add_device+0x17c/0x1a0 [ 1.472021] [<ffffffff8138da3e>] ? usbhid_probe+0x40b/0x468 [ 1.472021] [<ffffffff8132fcc7>] ? usb_match_one_id+0x23/0x7f [ 1.472021] [<ffffffff8133077a>] ? usb_probe_interface+0xd4/0x11b [ 1.472021] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e [ 1.472021] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 [ 1.472021] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 [ 1.472021] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 [ 1.472021] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b [ 1.472021] [<ffffffff812baee5>] ? device_add+0x29c/0x406 [ 1.472021] [<ffffffff8132f97a>] ? usb_set_configuration+0x5d6/0x655 [ 1.472021] [<ffffffff8133710f>] ? generic_probe+0x71/0xc6 [ 1.472021] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e [ 1.472021] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 [ 1.472021] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 [ 1.472021] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 [ 1.472021] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b [ 1.472021] [<ffffffff812baee5>] ? device_add+0x29c/0x406 [ 1.472021] [<ffffffff81329b25>] ? usb_new_device+0x7b/0xdc [ 1.472021] [<ffffffff8132a6f5>] ? hub_port_connect_change+0x5fc/0x89e [ 1.472021] [<ffffffff8132e9ac>] ? usb_control_msg+0x12f/0x140 [ 1.472021] [<ffffffff8132ad64>] ? hub_events+0x3cd/0x51d [ 1.472021] [<ffffffff8132aef0>] ? hub_thread+0x3c/0x158 [ 1.472021] [<ffffffff81054c0c>] ? autoremove_wake_function+0x0/0x2e [ 1.472021] [<ffffffff8132aeb4>] ? hub_thread+0x0/0x158 [ 1.472021] [<ffffffff810547d5>] ? kthread+0x79/0x81 [ 1.472021] [<ffffffff81009564>] ? kernel_thread_helper+0x4/0x10 [ 1.472021] [<ffffffff81008961>] ? int_ret_from_sys_call+0x7/0x1b [ 1.472021] [<ffffffff8143121d>] ? retint_restore_args+0x5/0x6 [ 1.472021] [<ffffffff81009560>] ? kernel_thread_helper+0x0/0x10 [ 1.472021] ---[ end trace 0680a6f27492dd32 ]--- _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2010-Jul-22 19:59 UTC
Re: [Xen-devel] xen-swiotlb: WARNING: at kernel/smp.c:421 smp_call_function_many+0x66/0x1a1()
On 07/22/2010 12:32 PM, Sander Eikelenboom wrote:> Hi Konrad, > > Finally found the time to test the xen-swiotlb again (together with usb3/xhci isoc pathes) > I began with your tree: > git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git devel/merge.2.6.35-rc3 > > and after that i merged in a tree for the xhci part that is based on 2.6.35-rc4: > > git://git.kernel.org/pub/scm/linux/kernel/git/sarah/xhci.git amd-isoc > > That all went without a problem, booting the resulting kernel in a PV domU gives the warnings below, i hope these can be addressed before the next merge window and xen-swiotlb will make it in ! > Despite the 2 warnings, the usb devices i passed through seem to work ok. >Looks like you need changes: c2ae7934bba9f4e0492497953b60ffe75f9c3f5b 3ada8ba278a91fc73062d1ff6c6cd80bf7a058f3 J> -- > Sander > > > > info: > Xen version: xen-4.0-testing-pre4 (changeset: 21263:57859775f88f) > Dom0 kernel: 2.6.32.16 pvops (commit 006bfe8f594370f36f09d8e8ab13692d34e88533) > > Attached: > - xm dmesg (the part where the domU gets created > - dmesg of the domU > - lspci -vvvknn of the domU > > > > [ 1.471104] ------------[ cut here ]------------ > [ 1.471120] WARNING: at kernel/smp.c:421 smp_call_function_many+0x66/0x1a1() > [ 1.471126] Modules linked in: thermal_sys [last unloaded: scsi_wait_scan] > [ 1.471135] Pid: 153, comm: khubd Not tainted 2.6.35-rc4+konrad+xhci-isoc+ #2 > [ 1.471140] Call Trace: > [ 1.471147] [<ffffffff81063987>] ? smp_call_function_many+0x66/0x1a1 > [ 1.471153] [<ffffffff81063987>] ? smp_call_function_many+0x66/0x1a1 > [ 1.471159] [<ffffffff8103d85e>] ? warn_slowpath_common+0x78/0xa2 > [ 1.471166] [<ffffffff81063987>] ? smp_call_function_many+0x66/0x1a1 > [ 1.471177] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 > [ 1.471182] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 > [ 1.471188] [<ffffffff81063ae2>] ? smp_call_function+0x20/0x25 > [ 1.471195] [<ffffffff8104300f>] ? on_each_cpu+0x10/0x2e > [ 1.471201] [<ffffffff810bd26c>] ? __purge_vmap_area_lazy+0xf6/0x14f > [ 1.471207] [<ffffffff810bf62f>] ? vm_unmap_aliases+0x168/0x179 > [ 1.471214] [<ffffffff8100470e>] ? xen_create_contiguous_region+0x3f/0xe6 > [ 1.471221] [<ffffffff8123859f>] ? xen_swiotlb_alloc_coherent+0x66/0xd3 > [ 1.471227] [<ffffffff8100633f>] ? xen_restore_fl_direct_end+0x0/0x1 > [ 1.471234] [<ffffffff810c3832>] ? pool_alloc_page+0x10a/0x194 > [ 1.471240] [<ffffffff810c3932>] ? dma_pool_alloc+0x76/0x163 > [ 1.471248] [<ffffffff8138d215>] ? hid_alloc_buffers+0x23/0xf4 > [ 1.471254] [<ffffffff8138e75e>] ? usbhid_start+0x15d/0x49b > [ 1.471260] [<ffffffff8111c6a1>] ? sysfs_do_create_link+0xee/0x13c > [ 1.471266] [<ffffffff81380f77>] ? hid_device_probe+0x93/0xce > [ 1.471274] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e > [ 1.471279] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 > [ 1.471285] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 > [ 1.471293] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 > [ 1.471298] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b > [ 1.471304] [<ffffffff812baee5>] ? device_add+0x29c/0x406 > [ 1.471310] [<ffffffff81380b80>] ? hid_add_device+0x17c/0x1a0 > [ 1.471316] [<ffffffff8138da3e>] ? usbhid_probe+0x40b/0x468 > [ 1.471322] [<ffffffff8132fcc7>] ? usb_match_one_id+0x23/0x7f > [ 1.471328] [<ffffffff8133077a>] ? usb_probe_interface+0xd4/0x11b > [ 1.471334] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e > [ 1.471340] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 > [ 1.471346] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 > [ 1.471352] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 > [ 1.471358] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b > [ 1.471364] [<ffffffff812baee5>] ? device_add+0x29c/0x406 > [ 1.471369] [<ffffffff8132f97a>] ? usb_set_configuration+0x5d6/0x655 > [ 1.471376] [<ffffffff8133710f>] ? generic_probe+0x71/0xc6 > [ 1.471381] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e > [ 1.471387] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 > [ 1.471394] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 > [ 1.471400] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 > [ 1.471406] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b > [ 1.471411] [<ffffffff812baee5>] ? device_add+0x29c/0x406 > [ 1.471417] [<ffffffff81329b25>] ? usb_new_device+0x7b/0xdc > [ 1.471422] [<ffffffff8132a6f5>] ? hub_port_connect_change+0x5fc/0x89e > [ 1.471428] [<ffffffff8132e9ac>] ? usb_control_msg+0x12f/0x140 > [ 1.471434] [<ffffffff8132ad64>] ? hub_events+0x3cd/0x51d > [ 1.471440] [<ffffffff8132aef0>] ? hub_thread+0x3c/0x158 > [ 1.471446] [<ffffffff81054c0c>] ? autoremove_wake_function+0x0/0x2e > [ 1.471452] [<ffffffff8132aeb4>] ? hub_thread+0x0/0x158 > [ 1.471457] [<ffffffff810547d5>] ? kthread+0x79/0x81 > [ 1.471463] [<ffffffff81009564>] ? kernel_thread_helper+0x4/0x10 > [ 1.471468] [<ffffffff81008961>] ? int_ret_from_sys_call+0x7/0x1b > [ 1.471476] [<ffffffff8143121d>] ? retint_restore_args+0x5/0x6 > [ 1.471481] [<ffffffff81009560>] ? kernel_thread_helper+0x0/0x10 > [ 1.471486] ---[ end trace 0680a6f27492dd31 ]--- > [ 1.471490] ------------[ cut here ]------------ > [ 1.471495] WARNING: at kernel/smp.c:293 smp_call_function_single+0x6e/0x108() > [ 1.471500] Modules linked in: thermal_sys [last unloaded: scsi_wait_scan] > [ 1.471509] Pid: 153, comm: khubd Tainted: G W 2.6.35-rc4+konrad+xhci-isoc+ #2 > [ 1.471514] Call Trace: > [ 1.471519] [<ffffffff8106380a>] ? smp_call_function_single+0x6e/0x108 > [ 1.471524] [<ffffffff8106380a>] ? smp_call_function_single+0x6e/0x108 > [ 1.471530] [<ffffffff8103d85e>] ? warn_slowpath_common+0x78/0xa2 > [ 1.471536] [<ffffffff8106380a>] ? smp_call_function_single+0x6e/0x108 > [ 1.471542] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 > [ 1.471547] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 > [ 1.471553] [<ffffffff81063ae2>] ? smp_call_function+0x20/0x25 > [ 1.471559] [<ffffffff8104300f>] ? on_each_cpu+0x10/0x2e > [ 1.471564] [<ffffffff810bd26c>] ? __purge_vmap_area_lazy+0xf6/0x14f > [ 1.471570] [<ffffffff810bf62f>] ? vm_unmap_aliases+0x168/0x179 > [ 1.471576] [<ffffffff8100470e>] ? xen_create_contiguous_region+0x3f/0xe6 > [ 1.471582] [<ffffffff8123859f>] ? xen_swiotlb_alloc_coherent+0x66/0xd3 > [ 1.471588] [<ffffffff8100633f>] ? xen_restore_fl_direct_end+0x0/0x1 > [ 1.471594] [<ffffffff810c3832>] ? pool_alloc_page+0x10a/0x194 > [ 1.471600] [<ffffffff810c3932>] ? dma_pool_alloc+0x76/0x163 > [ 1.472021] [<ffffffff8138d215>] ? hid_alloc_buffers+0x23/0xf4 > [ 1.472021] [<ffffffff8138e75e>] ? usbhid_start+0x15d/0x49b > [ 1.472021] [<ffffffff8111c6a1>] ? sysfs_do_create_link+0xee/0x13c > [ 1.472021] [<ffffffff81380f77>] ? hid_device_probe+0x93/0xce > [ 1.472021] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e > [ 1.472021] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 > [ 1.472021] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 > [ 1.472021] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 > [ 1.472021] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b > [ 1.472021] [<ffffffff812baee5>] ? device_add+0x29c/0x406 > [ 1.472021] [<ffffffff81380b80>] ? hid_add_device+0x17c/0x1a0 > [ 1.472021] [<ffffffff8138da3e>] ? usbhid_probe+0x40b/0x468 > [ 1.472021] [<ffffffff8132fcc7>] ? usb_match_one_id+0x23/0x7f > [ 1.472021] [<ffffffff8133077a>] ? usb_probe_interface+0xd4/0x11b > [ 1.472021] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e > [ 1.472021] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 > [ 1.472021] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 > [ 1.472021] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 > [ 1.472021] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b > [ 1.472021] [<ffffffff812baee5>] ? device_add+0x29c/0x406 > [ 1.472021] [<ffffffff8132f97a>] ? usb_set_configuration+0x5d6/0x655 > [ 1.472021] [<ffffffff8133710f>] ? generic_probe+0x71/0xc6 > [ 1.472021] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e > [ 1.472021] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 > [ 1.472021] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 > [ 1.472021] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 > [ 1.472021] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b > [ 1.472021] [<ffffffff812baee5>] ? device_add+0x29c/0x406 > [ 1.472021] [<ffffffff81329b25>] ? usb_new_device+0x7b/0xdc > [ 1.472021] [<ffffffff8132a6f5>] ? hub_port_connect_change+0x5fc/0x89e > [ 1.472021] [<ffffffff8132e9ac>] ? usb_control_msg+0x12f/0x140 > [ 1.472021] [<ffffffff8132ad64>] ? hub_events+0x3cd/0x51d > [ 1.472021] [<ffffffff8132aef0>] ? hub_thread+0x3c/0x158 > [ 1.472021] [<ffffffff81054c0c>] ? autoremove_wake_function+0x0/0x2e > [ 1.472021] [<ffffffff8132aeb4>] ? hub_thread+0x0/0x158 > [ 1.472021] [<ffffffff810547d5>] ? kthread+0x79/0x81 > [ 1.472021] [<ffffffff81009564>] ? kernel_thread_helper+0x4/0x10 > [ 1.472021] [<ffffffff81008961>] ? int_ret_from_sys_call+0x7/0x1b > [ 1.472021] [<ffffffff8143121d>] ? retint_restore_args+0x5/0x6 > [ 1.472021] [<ffffffff81009560>] ? kernel_thread_helper+0x0/0x10 > [ 1.472021] ---[ end trace 0680a6f27492dd32 ]--- > > > > > > > > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xensource.com > http://lists.xensource.com/xen-devel >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Konrad Rzeszutek Wilk
2010-Jul-22 20:07 UTC
Re: [Xen-devel] xen-swiotlb: WARNING: at kernel/smp.c:421 smp_call_function_many+0x66/0x1a1()
On Thu, Jul 22, 2010 at 12:59:28PM -0700, Jeremy Fitzhardinge wrote:> On 07/22/2010 12:32 PM, Sander Eikelenboom wrote: > > Hi Konrad, > > > > Finally found the time to test the xen-swiotlb again (together with usb3/xhci isoc pathes) > > I began with your tree: > > git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git devel/merge.2.6.35-rc3 > > > > and after that i merged in a tree for the xhci part that is based on 2.6.35-rc4: > > > > git://git.kernel.org/pub/scm/linux/kernel/git/sarah/xhci.git amd-isoc > > > > That all went without a problem, booting the resulting kernel in a PV domU gives the warnings below, i hope these can be addressed before the next merge window and xen-swiotlb will make it in ! > > Despite the 2 warnings, the usb devices i passed through seem to work ok. > > > > Looks like you need changes: > c2ae7934bba9f4e0492497953b60ffe75f9c3f5b > 3ada8ba278a91fc73062d1ff6c6cd80bf7a058f3Yup! Thanks for finding them. Sander, I should have a tree shortly up - with some other fixes in the xen-pcifront in them. _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sander Eikelenboom
2010-Jul-22 20:11 UTC
Re: [Xen-devel] xen-swiotlb: WARNING: at kernel/smp.c:421 smp_call_function_many+0x66/0x1a1()
Thursday, July 22, 2010, 10:07:37 PM, you wrote:> On Thu, Jul 22, 2010 at 12:59:28PM -0700, Jeremy Fitzhardinge wrote: >> On 07/22/2010 12:32 PM, Sander Eikelenboom wrote: >> > Hi Konrad, >> > >> > Finally found the time to test the xen-swiotlb again (together with usb3/xhci isoc pathes) >> > I began with your tree: >> > git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git devel/merge.2.6.35-rc3 >> > >> > and after that i merged in a tree for the xhci part that is based on 2.6.35-rc4: >> > >> > git://git.kernel.org/pub/scm/linux/kernel/git/sarah/xhci.git amd-isoc >> > >> > That all went without a problem, booting the resulting kernel in a PV domU gives the warnings below, i hope these can be addressed before the next merge window and xen-swiotlb will make it in ! >> > Despite the 2 warnings, the usb devices i passed through seem to work ok. >> > >> >> Looks like you need changes: >> c2ae7934bba9f4e0492497953b60ffe75f9c3f5b >> 3ada8ba278a91fc73062d1ff6c6cd80bf7a058f3> Yup! > Thanks for finding them.> Sander, I should have a tree shortly up - with some other fixes in the > xen-pcifront in them.OK just give a shout and i will try them ! _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sander Eikelenboom
2010-Jul-23 09:22 UTC
Re: [Xen-devel] xen-swiotlb: WARNING: at kernel/smp.c:421 smp_call_function_many+0x66/0x1a1()
Thursday, July 22, 2010, 9:59:28 PM, you wrote:> On 07/22/2010 12:32 PM, Sander Eikelenboom wrote: >> Hi Konrad, >> >> Finally found the time to test the xen-swiotlb again (together with usb3/xhci isoc pathes) >> I began with your tree: >> git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git devel/merge.2.6.35-rc3 >> >> and after that i merged in a tree for the xhci part that is based on 2.6.35-rc4: >> >> git://git.kernel.org/pub/scm/linux/kernel/git/sarah/xhci.git amd-isoc >> >> That all went without a problem, booting the resulting kernel in a PV domU gives the warnings below, i hope these can be addressed before the next merge window and xen-swiotlb will make it in ! >> Despite the 2 warnings, the usb devices i passed through seem to work ok. >>> Looks like you need changes: > c2ae7934bba9f4e0492497953b60ffe75f9c3f5b > 3ada8ba278a91fc73062d1ff6c6cd80bf7a058f3In which tree would those commits be ? It seems i can''t find them with the search on http://git.kernel.org in your tree, or the main tree of Linus. -- Sander> J>> -- >> Sander >> >> >> >> info: >> Xen version: xen-4.0-testing-pre4 (changeset: 21263:57859775f88f) >> Dom0 kernel: 2.6.32.16 pvops (commit 006bfe8f594370f36f09d8e8ab13692d34e88533) >> >> Attached: >> - xm dmesg (the part where the domU gets created >> - dmesg of the domU >> - lspci -vvvknn of the domU >> >> >> >> [ 1.471104] ------------[ cut here ]------------ >> [ 1.471120] WARNING: at kernel/smp.c:421 smp_call_function_many+0x66/0x1a1() >> [ 1.471126] Modules linked in: thermal_sys [last unloaded: scsi_wait_scan] >> [ 1.471135] Pid: 153, comm: khubd Not tainted 2.6.35-rc4+konrad+xhci-isoc+ #2 >> [ 1.471140] Call Trace: >> [ 1.471147] [<ffffffff81063987>] ? smp_call_function_many+0x66/0x1a1 >> [ 1.471153] [<ffffffff81063987>] ? smp_call_function_many+0x66/0x1a1 >> [ 1.471159] [<ffffffff8103d85e>] ? warn_slowpath_common+0x78/0xa2 >> [ 1.471166] [<ffffffff81063987>] ? smp_call_function_many+0x66/0x1a1 >> [ 1.471177] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 >> [ 1.471182] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 >> [ 1.471188] [<ffffffff81063ae2>] ? smp_call_function+0x20/0x25 >> [ 1.471195] [<ffffffff8104300f>] ? on_each_cpu+0x10/0x2e >> [ 1.471201] [<ffffffff810bd26c>] ? __purge_vmap_area_lazy+0xf6/0x14f >> [ 1.471207] [<ffffffff810bf62f>] ? vm_unmap_aliases+0x168/0x179 >> [ 1.471214] [<ffffffff8100470e>] ? xen_create_contiguous_region+0x3f/0xe6 >> [ 1.471221] [<ffffffff8123859f>] ? xen_swiotlb_alloc_coherent+0x66/0xd3 >> [ 1.471227] [<ffffffff8100633f>] ? xen_restore_fl_direct_end+0x0/0x1 >> [ 1.471234] [<ffffffff810c3832>] ? pool_alloc_page+0x10a/0x194 >> [ 1.471240] [<ffffffff810c3932>] ? dma_pool_alloc+0x76/0x163 >> [ 1.471248] [<ffffffff8138d215>] ? hid_alloc_buffers+0x23/0xf4 >> [ 1.471254] [<ffffffff8138e75e>] ? usbhid_start+0x15d/0x49b >> [ 1.471260] [<ffffffff8111c6a1>] ? sysfs_do_create_link+0xee/0x13c >> [ 1.471266] [<ffffffff81380f77>] ? hid_device_probe+0x93/0xce >> [ 1.471274] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e >> [ 1.471279] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 >> [ 1.471285] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 >> [ 1.471293] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 >> [ 1.471298] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b >> [ 1.471304] [<ffffffff812baee5>] ? device_add+0x29c/0x406 >> [ 1.471310] [<ffffffff81380b80>] ? hid_add_device+0x17c/0x1a0 >> [ 1.471316] [<ffffffff8138da3e>] ? usbhid_probe+0x40b/0x468 >> [ 1.471322] [<ffffffff8132fcc7>] ? usb_match_one_id+0x23/0x7f >> [ 1.471328] [<ffffffff8133077a>] ? usb_probe_interface+0xd4/0x11b >> [ 1.471334] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e >> [ 1.471340] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 >> [ 1.471346] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 >> [ 1.471352] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 >> [ 1.471358] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b >> [ 1.471364] [<ffffffff812baee5>] ? device_add+0x29c/0x406 >> [ 1.471369] [<ffffffff8132f97a>] ? usb_set_configuration+0x5d6/0x655 >> [ 1.471376] [<ffffffff8133710f>] ? generic_probe+0x71/0xc6 >> [ 1.471381] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e >> [ 1.471387] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 >> [ 1.471394] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 >> [ 1.471400] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 >> [ 1.471406] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b >> [ 1.471411] [<ffffffff812baee5>] ? device_add+0x29c/0x406 >> [ 1.471417] [<ffffffff81329b25>] ? usb_new_device+0x7b/0xdc >> [ 1.471422] [<ffffffff8132a6f5>] ? hub_port_connect_change+0x5fc/0x89e >> [ 1.471428] [<ffffffff8132e9ac>] ? usb_control_msg+0x12f/0x140 >> [ 1.471434] [<ffffffff8132ad64>] ? hub_events+0x3cd/0x51d >> [ 1.471440] [<ffffffff8132aef0>] ? hub_thread+0x3c/0x158 >> [ 1.471446] [<ffffffff81054c0c>] ? autoremove_wake_function+0x0/0x2e >> [ 1.471452] [<ffffffff8132aeb4>] ? hub_thread+0x0/0x158 >> [ 1.471457] [<ffffffff810547d5>] ? kthread+0x79/0x81 >> [ 1.471463] [<ffffffff81009564>] ? kernel_thread_helper+0x4/0x10 >> [ 1.471468] [<ffffffff81008961>] ? int_ret_from_sys_call+0x7/0x1b >> [ 1.471476] [<ffffffff8143121d>] ? retint_restore_args+0x5/0x6 >> [ 1.471481] [<ffffffff81009560>] ? kernel_thread_helper+0x0/0x10 >> [ 1.471486] ---[ end trace 0680a6f27492dd31 ]--- >> [ 1.471490] ------------[ cut here ]------------ >> [ 1.471495] WARNING: at kernel/smp.c:293 smp_call_function_single+0x6e/0x108() >> [ 1.471500] Modules linked in: thermal_sys [last unloaded: scsi_wait_scan] >> [ 1.471509] Pid: 153, comm: khubd Tainted: G W 2.6.35-rc4+konrad+xhci-isoc+ #2 >> [ 1.471514] Call Trace: >> [ 1.471519] [<ffffffff8106380a>] ? smp_call_function_single+0x6e/0x108 >> [ 1.471524] [<ffffffff8106380a>] ? smp_call_function_single+0x6e/0x108 >> [ 1.471530] [<ffffffff8103d85e>] ? warn_slowpath_common+0x78/0xa2 >> [ 1.471536] [<ffffffff8106380a>] ? smp_call_function_single+0x6e/0x108 >> [ 1.471542] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 >> [ 1.471547] [<ffffffff8102b071>] ? do_flush_tlb_all+0x0/0x43 >> [ 1.471553] [<ffffffff81063ae2>] ? smp_call_function+0x20/0x25 >> [ 1.471559] [<ffffffff8104300f>] ? on_each_cpu+0x10/0x2e >> [ 1.471564] [<ffffffff810bd26c>] ? __purge_vmap_area_lazy+0xf6/0x14f >> [ 1.471570] [<ffffffff810bf62f>] ? vm_unmap_aliases+0x168/0x179 >> [ 1.471576] [<ffffffff8100470e>] ? xen_create_contiguous_region+0x3f/0xe6 >> [ 1.471582] [<ffffffff8123859f>] ? xen_swiotlb_alloc_coherent+0x66/0xd3 >> [ 1.471588] [<ffffffff8100633f>] ? xen_restore_fl_direct_end+0x0/0x1 >> [ 1.471594] [<ffffffff810c3832>] ? pool_alloc_page+0x10a/0x194 >> [ 1.471600] [<ffffffff810c3932>] ? dma_pool_alloc+0x76/0x163 >> [ 1.472021] [<ffffffff8138d215>] ? hid_alloc_buffers+0x23/0xf4 >> [ 1.472021] [<ffffffff8138e75e>] ? usbhid_start+0x15d/0x49b >> [ 1.472021] [<ffffffff8111c6a1>] ? sysfs_do_create_link+0xee/0x13c >> [ 1.472021] [<ffffffff81380f77>] ? hid_device_probe+0x93/0xce >> [ 1.472021] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e >> [ 1.472021] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 >> [ 1.472021] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 >> [ 1.472021] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 >> [ 1.472021] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b >> [ 1.472021] [<ffffffff812baee5>] ? device_add+0x29c/0x406 >> [ 1.472021] [<ffffffff81380b80>] ? hid_add_device+0x17c/0x1a0 >> [ 1.472021] [<ffffffff8138da3e>] ? usbhid_probe+0x40b/0x468 >> [ 1.472021] [<ffffffff8132fcc7>] ? usb_match_one_id+0x23/0x7f >> [ 1.472021] [<ffffffff8133077a>] ? usb_probe_interface+0xd4/0x11b >> [ 1.472021] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e >> [ 1.472021] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 >> [ 1.472021] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 >> [ 1.472021] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 >> [ 1.472021] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b >> [ 1.472021] [<ffffffff812baee5>] ? device_add+0x29c/0x406 >> [ 1.472021] [<ffffffff8132f97a>] ? usb_set_configuration+0x5d6/0x655 >> [ 1.472021] [<ffffffff8133710f>] ? generic_probe+0x71/0xc6 >> [ 1.472021] [<ffffffff812bceef>] ? really_probe+0x8a/0x12e >> [ 1.472021] [<ffffffff812bd01c>] ? __device_attach+0x0/0x39 >> [ 1.472021] [<ffffffff812bc500>] ? bus_for_each_drv+0x46/0x77 >> [ 1.472021] [<ffffffff812bd0cd>] ? device_attach+0x55/0x66 >> [ 1.472021] [<ffffffff812bc350>] ? bus_probe_device+0x22/0x3b >> [ 1.472021] [<ffffffff812baee5>] ? device_add+0x29c/0x406 >> [ 1.472021] [<ffffffff81329b25>] ? usb_new_device+0x7b/0xdc >> [ 1.472021] [<ffffffff8132a6f5>] ? hub_port_connect_change+0x5fc/0x89e >> [ 1.472021] [<ffffffff8132e9ac>] ? usb_control_msg+0x12f/0x140 >> [ 1.472021] [<ffffffff8132ad64>] ? hub_events+0x3cd/0x51d >> [ 1.472021] [<ffffffff8132aef0>] ? hub_thread+0x3c/0x158 >> [ 1.472021] [<ffffffff81054c0c>] ? autoremove_wake_function+0x0/0x2e >> [ 1.472021] [<ffffffff8132aeb4>] ? hub_thread+0x0/0x158 >> [ 1.472021] [<ffffffff810547d5>] ? kthread+0x79/0x81 >> [ 1.472021] [<ffffffff81009564>] ? kernel_thread_helper+0x4/0x10 >> [ 1.472021] [<ffffffff81008961>] ? int_ret_from_sys_call+0x7/0x1b >> [ 1.472021] [<ffffffff8143121d>] ? retint_restore_args+0x5/0x6 >> [ 1.472021] [<ffffffff81009560>] ? kernel_thread_helper+0x0/0x10 >> [ 1.472021] ---[ end trace 0680a6f27492dd32 ]--- >> >> >> >> >> >> >> >> >> _______________________________________________ >> Xen-devel mailing list >> Xen-devel@lists.xensource.com >> http://lists.xensource.com/xen-devel >>-- Best regards, Sander mailto:linux@eikelenboom.it _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2010-Jul-23 14:10 UTC
Re: [Xen-devel] xen-swiotlb: WARNING: at kernel/smp.c:421 smp_call_function_many+0x66/0x1a1()
On 07/23/2010 02:22 AM, Sander Eikelenboom wrote:> Thursday, July 22, 2010, 9:59:28 PM, you wrote: > > >> On 07/22/2010 12:32 PM, Sander Eikelenboom wrote: >> >>> Hi Konrad, >>> >>> Finally found the time to test the xen-swiotlb again (together with usb3/xhci isoc pathes) >>> I began with your tree: >>> git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git devel/merge.2.6.35-rc3 >>> >>> and after that i merged in a tree for the xhci part that is based on 2.6.35-rc4: >>> >>> git://git.kernel.org/pub/scm/linux/kernel/git/sarah/xhci.git amd-isoc >>> >>> That all went without a problem, booting the resulting kernel in a PV domU gives the warnings below, i hope these can be addressed before the next merge window and xen-swiotlb will make it in ! >>> Despite the 2 warnings, the usb devices i passed through seem to work ok. >>> >>> > >> Looks like you need changes: >> c2ae7934bba9f4e0492497953b60ffe75f9c3f5b >> 3ada8ba278a91fc73062d1ff6c6cd80bf7a058f3 >> > > In which tree would those commits be ? > It seems i can''t find them with the search on http://git.kernel.org in your tree, or the main tree of Linus. >They''re merged into xen/next, so you should be able to find them as part of the history. If you have a local git tree, "git show" should be able to display the patch unconditionally, and git cherry-pick should bring each into your branch. J _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Konrad Rzeszutek Wilk
2010-Jul-24 00:02 UTC
Re: [Xen-devel] xen-swiotlb: WARNING: at kernel/smp.c:421 smp_call_function_many+0x66/0x1a1()
> > Sander, I should have a tree shortly up - with some other fixes in the > > xen-pcifront in them. > > OK just give a shout and i will try them !Done. They are available at git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git devel/merge.2.6.35-rc6 You also need for your Dom0 to have this patch: xen-pciback: Redo spinlock usage. You can merge it from git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git pv/pciback-2.6.32 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel