Nouveau - Dec 2014 - [Bug 87244] New: [NV94] X hangs, logs show kernel: nouveau E[ PFIFO][0000:01:00.0] still angry after 101 spins, halt followed by an X trace

https://bugs.freedesktop.org/show_bug.cgi?id=87244

            Bug ID: 87244
           Summary: [NV94] X hangs, logs show kernel: nouveau E[
                    PFIFO][0000:01:00.0] still angry after 101 spins, halt
                    followed by an X trace
           Product: xorg
           Version: unspecified
          Hardware: x86-64 (AMD64)
                OS: All
            Status: NEW
          Severity: critical
          Priority: medium
         Component: Driver/nouveau
          Assignee: nouveau at lists.freedesktop.org
          Reporter: adamw at happyassassin.net
        QA Contact: xorg-team at lists.x.org

I just upgraded my desktop to Fedora Rawhide, and since then X has twice
crashed with the same symptoms. Oddly, I was using kernel 3.18 from
kernel-rawhide-nodebug before upgrading from F21 to Rawhide, and 21 and Rawhide
seem to have similar versions of the nouveau driver and Xorg components, so
I'm
not sure what's changed - libdrm or mesa, perhaps?

Anyway, the non-debug log I have so far is:

Dec 11 11:42:05 adam.happyassassin.net kernel: nouveau E[  
PFIFO][0000:01:00.0] still angry after 101 spins, halt
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) [mi] EQ
overflowing.  Additional events will be discarded until existing events are
processed.
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE)
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) Backtrace:
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 0:
/usr/libexec/Xorg.bin (mieqEnqueue+0x24b) [0x5795ab]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 1:
/usr/libexec/Xorg.bin (QueuePointerEvents+0x52) [0x450af2]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 2:
/usr/lib64/xorg/modules/input/evdev_drv.so (_init+0x2eff) [0x7fa8c403295f]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 3:
/usr/lib64/xorg/modules/input/evdev_drv.so (_init+0x3645) [0x7fa8c4033c25]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 4:
/usr/libexec/Xorg.bin (DPMSSupported+0xe8) [0x4774c8]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 5:
/usr/libexec/Xorg.bin (xf86SerialModemClearBits+0x277) [0x4a1f17]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 6:
/lib64/libc.so.6 (__restore_rt+0x0) [0x7fa8cf438e7f]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 7:
/lib64/libc.so.6 (ioctl+0x7) [0x7fa8cf4fde07]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 8:
/lib64/libdrm.so.2 (drmIoctl+0x28) [0x7fa8d07e96c8]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 9:
/lib64/libdrm.so.2 (drmCommandWrite+0x1b) [0x7fa8d07ebefb]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 10:
/lib64/libdrm_nouveau.so.2 (nouveau_bo_wait+0x99) [0x7fa8c9f6f779]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 11:
/usr/lib64/xorg/modules/drivers/nouveau_drv.so (_init+0x2a3b) [0x7fa8ca17e80b]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 12:
/usr/lib64/xorg/modules/libexa.so (exaMoveOutPixmap+0x123b) [0x7fa8c993289b]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 13:
/usr/lib64/xorg/modules/libexa.so (exaMoveOutPixmap+0x39df) [0x7fa8c993780f]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 14:
/usr/lib64/xorg/modules/libexa.so (exaEnableDisableFBAccess+0x493b)
[0x7fa8c9941ffb]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 15:
/usr/lib64/xorg/modules/libexa.so (exaEnableDisableFBAccess+0x1690)
[0x7fa8c993bde0]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 16:
/usr/libexec/Xorg.bin (DamageRegionAppend+0x541) [0x51ef81]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 17:
/usr/libexec/Xorg.bin (AddTraps+0x4154) [0x518824]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 18:
/usr/libexec/Xorg.bin (SendErrorToClient+0x2f7) [0x4391b7]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 19:
/usr/libexec/Xorg.bin (remove_fs_handlers+0x416) [0x43d316]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 20:
/lib64/libc.so.6 (__libc_start_main+0xf0) [0x7fa8cf4240e0]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 21:
/usr/libexec/Xorg.bin (_start+0x29) [0x4276f9]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) 22: ? (?+0x29)
[0x29]
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE)
Dec 11 11:44:13 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) [mi] These
backtraces from mieqEnqueue may point to a culprit higher up the stack.

then there's a bunch of similar X traces, I'll attach the whole thing.
I'll try
and get drm.debug logs and attach those also.

There is one EE line during initial X start:

Dec 11 10:52:16 adam.happyassassin.net gdm-Xorg-:0[1540]: (EE) NOUVEAU(0):
[COPY] failed to allocate class.

but that line seems to be present in older boots where I didn't encounter
this
problem, too.

I'm running GNOME Shell and have dual monitors attached to DVI, in portrait
orientation.

xorg-x11-drv-nouveau-1.0.11-1.fc22.x86_64
kernel-3.18.0-1.fc22.x86_64
xorg-x11-server-common-1.16.2.901-1.fc22.x86_64
mesa-dri-drivers-10.5.0-0.devel.3.29c7cf2.fc22.x86_64
libdrm-2.4.58-3.fc22.x86_64

01:00.0 VGA compatible controller [0300]: NVIDIA Corporation G94 [GeForce 9600
GT] [10de:0622] (rev a1)

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20141211/d5cc162c/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #1 from Adam Williamson <adamw at happyassassin.net> ---
Created attachment 110752
  --> https://bugs.freedesktop.org/attachment.cgi?id=110752&action=edit
journal extract from the crash (with all the X tracebacks)

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20141211/5d9cbadb/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #2 from Adam Williamson <adamw at happyassassin.net> ---
Just saw this again, but between occurrences I had a boot running for like
three days with drm.debug=15 and it didn't happen, eventually I had to give
up
because I needed to see something else in my logs :( I'll try another boot
with
drm.debug=14 and hope to catch it...

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20141223/6083b104/attachment-0001.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #3 from Zlatko Calusic <zcalusic at bitsync.net> ---
Created attachment 111369
  --> https://bugs.freedesktop.org/attachment.cgi?id=111369&action=edit
Revert-drm-nouveau-fifo-g84-ack-non-stall-interrupt

Also G94 here, and the same bug. It works for a while then GPU locks up with
"still angry after 101 spins". But, I bisected and eventually
19a10828814aa
commit (drm/nouveau/fifo/g84-: ack non-stall interrupt before handling it) came
out as culprit. It's the last nouveau commit before 3.18 was releases.

If you can compile your own kernel, I'm attaching the patch that reverses
that
commit. It fixes the issue for me completely, no more lockups.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20141226/8ba5483d/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #4 from Adam Williamson <adamw at happyassassin.net> ---
awesome - I love it when someone else does the hard work. I'll build with
that
revert and confirm if I can, thanks! (it doesn't happen very often to me, so
a
bit hard to confirm a negative, but I'll do my best).

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20141226/2cbce1d9/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #5 from Zlatko Calusic <zcalusic at bitsync.net> ---
Ha ha ha, you made me laugh with "hard to confirm a negative" comment,
been
there - done that. :) This time I got a bit lucky, because I ran
3.18-rc-something the whole time (fixing some other kernel bugs I reported),
and when 3.18 got released and suddenly become unstable there were only about a
dozen nouveau commits to bisect. It was quite easy to find the faulty one.

Also, I was getting lockups pretty fast, about 6-12 hours after reboot, before
I reverted that commit. And now my system has been rock solid for 2 weeks, so
I'm pretty confident the revert is the right fix.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20141226/464b7933/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #6 from Adam Williamson <adamw at happyassassin.net> ---
So I didn't hit this for like two weeks (12-26 till today) but then I hit it
twice today. I'm now running a kernel with the reversion applied, so I guess
I'll have to see if that survives three weeks? :)

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150107/003e5acd/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #7 from Ungifted <ungift-ed at ya.ru> ---
Nouveau still angry in 3.19-rc5
Filed issue on kernel.org: https://bugzilla.kernel.org/show_bug.cgi?id=91581

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150120/0d5dfcb1/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #8 from Adam Williamson <adamw at happyassassin.net> ---
I've been up on the patched kernel for 2 weeks now without seeing the issue.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150120/97c1dd1f/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #9 from Ben Skeggs <skeggsb at gmail.com> ---
It'd be worth giving this patch a try:

http://cgit.freedesktop.org/~darktama/nouveau/commit/?id=c869d99187a356b886bdecc757caa0038d142844

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150127/a21ceba6/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #10 from Zlatko Calusic <zcalusic at bitsync.net> ---
Created attachment 112875
  --> https://bugs.freedesktop.org/attachment.cgi?id=112875&action=edit
fifo-nv04-remove-the-loop-from-the-interrupt-handler

Would not apply cleanly to 3.19.0-rc6+, so I modified it and attached the patch
that I have currently applied and testing. I'd give it at least 2 days
before
we can be reasonably sure it fixes the issue.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150127/65d5b22f/attachment-0001.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #11 from Zlatko Calusic <zcalusic at bitsync.net> ---
Good news! 2 days and 13 hours later, no lockups, all fine. I'm pretty
confident that this patch resolves the issue. It would be great if it could be
applied before 3.19 stable comes out.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150129/b334427c/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #12 from Adam Williamson <adamw at happyassassin.net> ---
So Ben told me on IRC he'd committed a change that should address this, but
I
guess it didn't make it in time for 3.19 because I just hit it with 3.19
stable
:( Ben, any chance it could be backported for 3.19 updates? It's a pretty
icky
bug.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150211/5df58d7f/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #13 from Aleksander Morgado <aleksander at aleksander.es> ---
(In reply to Adam Williamson from comment #12)
> So Ben told me on IRC he'd committed a change that should address this,
but
> I guess it didn't make it in time for 3.19 because I just hit it with
3.19
> stable :( Ben, any chance it could be backported for 3.19 updates? It's
a
> pretty icky bug.
If it's not yet pulled by Linus, what's the kernel git tree where that
was
submitted?

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150218/6017e211/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #14 from Aleksander Morgado <aleksander at aleksander.es> ---
Just for reference, I cherry-picked that fix for my 3.18.6 and I no longer get
the X stuck. Hoping it hits the stables soon...

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150218/b8d2b5a1/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #15 from K1 <keivan at gmail.com> ---
I have the same problem and it is usually triggered within minutes of using
PyCharm IDE. When I work with Eclipse and other things it seems fine but as
soon as I have PyCharm running (even in the background while I am not working
with it) this happens. I am using 3.18.7-200.fc21.x86_64.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150219/006fecdb/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #16 from Arif Saleem <ahsaleem at gmail.com> ---
Hi All,
We're having this issue on a whole bunch of F21 x86_64 machines. I took the
3.18.7-200 F21 source rpm, and applied Zlatko's patch from Comment 10, and
rebuilt the kernel. The important rpms are here :
http://arif.easyss.net/stuff/kernel-3.18.7-nouveau/

I haven't actually rebooted any of the machines onto this kernel yet, but
this
might help some people.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150220/940bfdf6/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #17 from Zlatko Calusic <zcalusic at bitsync.net> ---
JFTR, I've been running with the same patch applied for 3 weeks now and the
system is rock solid. If you use 3.18 or 3.19 and experience lockups, the patch
will fix it. Hopefully it finds its way to 3.20^H^H4.0 soon. :P

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150220/f33c76e3/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #18 from Adam Williamson <adamw at happyassassin.net> ---
The patch is in Ben's personal tree already:

http://cgit.freedesktop.org/~darktama/nouveau/commit/?id=c869d99187a356b886bdecc757caa0038d142844

but hasn't yet made its way from there into the nouveau tree from which
it'd
get merged to linus':

http://cgit.freedesktop.org/nouveau/linux-2.6/log/?h=linux-3.20

I have, however, prevailed on the Fedora kernel maintainers to put it in at
least the F22/Rawhide kernels; the builds of both that are running as I type
this will include it. I'm hoping we can get it backported from there to 21
as
well.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150220/a797943f/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

Pierre Moreau <pierre.morrow at free.fr> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |shuihuzhuan at free.fr

--- Comment #19 from Pierre Moreau <pierre.morrow at free.fr> ---
*** Bug 88822 has been marked as a duplicate of this bug. ***

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150311/e2c415c3/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

aebenjam at opentext.com changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |aebenjam at opentext.com

--- Comment #20 from aebenjam at opentext.com ---
This sounds horribly familiar.  Seeing the same behaviour after I hit the
3.18.x kernels with Fedora 20.  I'm using a "NVIDIA Corporation G86
[Quadro NVS
290] (rev a1)".  Not sure if the additional card information helps or if
the
bug and fix are definitely the one posted.  Here's hoping it's brought
into the
mainline kernel soon... (but I will likely try recompiling my own kernel with
the offered patch sometime soon.)

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150318/26fcdd6c/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #21 from Adam Williamson <adamw at happyassassin.net> ---
The fix is already in mainline, just hasn't been backported.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150318/54ef37f8/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

--- Comment #22 from Sergio Pascual <sergio.pasra at gmail.com> ---
(In reply to Adam Williamson from comment #21)
> The fix is already in mainline, just hasn't been backported.
Is the fix going to appear in F21 any time soon?

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.freedesktop.org/archives/nouveau/attachments/20150325/60ccc351/attachment.html>

https://bugs.freedesktop.org/show_bug.cgi?id=87244

Martin Peres <martin.peres at free.fr> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|---                         |MOVED

--- Comment #23 from Martin Peres <martin.peres at free.fr> ---
-- GitLab Migration Automatic Message --

This bug has been migrated to freedesktop.org's GitLab instance and has been
closed from further activity.

You can subscribe and participate further through the new bug through this link
to our GitLab instance:
https://gitlab.freedesktop.org/xorg/driver/xf86-video-nouveau/issues/155.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<https://lists.freedesktop.org/archives/nouveau/attachments/20191204/efa6fab0/attachment.html>