This is a 2.2.19 machine with ext3-0.0.7a and quota support running. The
symptoms are a particular NFS export hangs (for linux clients but not
Solaris clients?) the local filesystem gives the following:
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 2213
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 1563120916, count = 1
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 1263356887, count = 1
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 2213
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 1566266724, count = 1
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 1263356887, count = 1
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 2213
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 771
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 2766253208, count = 1
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 2169
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 3597459144, count = 1
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 2315291364, count = 1
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 2319223356, count = 1
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 2112
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 1559975108, count = 1
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 1291668583, count = 1
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 2213
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 1563120916, count = 1
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 1291668583, count = 1
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 2213
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 1566266724, count = 1
EXT3-fs error (device sd(8,49)): ext3_free_blocks: Freeing blocks not in
datazone - block = 1291668583, count = 1
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 2213
Assertion failure in journal_forget() at transaction.c line 860:
"!test_and_set_bit(BH_Freed, &bh->b_state)"
Unable to handle kernel NULL pointer dereference at virtual address 00000000
current->tss.cr3 = 00101000, %cr3 = 00101000
*pde = 00000000
Oops: 0002
CPU: 0EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit
already cleared for block 56037886
EXT3-fs error (device sd(8,49)): ext3_readdir: bad entry in directory
#2933557: directory entry across blocks - offset=0, inode=1986311577,
rec_len=30216, name_len=5EXT3-fs warning (device sd(8,49)):
ext3_free_blocks: bit already cleared for block 56037886
EXT3-fs error (device sd(8,49)): ext3_readdir: bad entry in directory
#2933557: directory entry across blocks - offset=0, inode=1986311577,
rec_len=30216, name_len=5
EXT3-fs warning (device sd(8,49)): empty_dir: bad directory (dir
#2933557) - no `.' or `..'
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 4466464
EXT3-fs warning (device sd(8,49)): empty_dir: bad directory (dir
#2933557) - no `.' or `..'
EXT3-fs warning (device sd(8,49)): ext3_free_blocks: bit already cleared
for block 4466464
EIP: 0010:[<c01564a5>]JFS DEBUG: (recovery.c, 255): journal_recover:
JFS: recovery, exit status 0, recovered transactions 35634 to 35641
EFLAGS: 00010282
eax: 00000070 ebx: e9173c80 ecx: c0250808 edx: f87dc000
esi: dff81a40 edi: ccc57d40 ebp: ccc57d40 esp: f8491db0
ds: 0018 es: 0018 ss: 0018
Process nfsd (pid: 615, process nr: 40, stackpage=f8491000)
Stack: c02114f7 0000035c c0211ba0 e9173c80 f60257e8 00000000 c0151f20
ccc57d40
e9173c80 e9173c80 00000001 03030000 00000001 c0152980 ccc57d40
00000000
f60257e8 e9173c80 03030000 00000000 ccc57d40 00000000 f60257e8
00001000
Call Trace: [<c02114f7>] [<c0211ba0>] [<c0151f20>]
[<c0152980>]
[<c0152fcd>] [<c014b8ff>] [<c014b546>]
[<c013595f>] [<c01346de>] [<c014f19c>]
[<c012ffe9>] [<c0173ea7>]
[<c017094c>] [<c016fd13>] [<c01ad6ec>]
[<c016fb41>] [<c010653b>]
Code: c6 05 00 00 00 00 00 83 c4 14 90 b8 0b 00 00 00 f0 0f b3 43
On reboot when the server runs the recover:
JFS DEBUG: (recovery.c, 255): journal_recover: JFS: recovery, exit
status 0, recovered transactions 35634 to 35641
JFS DEBUG: (recovery.c, 257): journal_recover: JFS: Replayed 31 and
revoked 0/0 blocks
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
JFS DEBUG: (recovery.c, 255): journal_recover: JFS: recovery, exit
status 0, recovered transactions 221773 to 221774
JFS DEBUG: (recovery.c, 257): journal_recover: JFS: Replayed 15 and
revoked 0/0 blocks
EXT3-fs error (device sd(8,49)): ext3_check_blocks_bitmap: Block #76 of
the inode table in group 1606 is marked free
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
JFS DEBUG: (recovery.c, 255): journal_recover: JFS: recovery, exit
status 0, recovered transactions 334911 to 334918
JFS DEBUG: (recovery.c, 257): journal_recover: JFS: Replayed 111 and
revoked 0/0 blocks
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
And once the machine gets up the syslog reports:
Oct 16 16:20:01 ara kernel: EXT3-fs warning (device sd(8,49)):
ext3_free_blocks: bit already cleared for block 56037886
Oct 16 16:20:16 ara kernel: EXT3-fs error (device sd(8,49)):
ext3_readdir: bad entry in directory #2933557: directory entry
across blocks - offset=0, inode=1986311577, rec_len=30216, name_len=5
Oct 16 16:20:16 ara kernel: EXT3-fs warning (device sd(8,49)):
empty_dir: bad directory (dir #2933557) - no `.' or `..'
Oct 16 16:21:33 ara kernel: EXT3-fs warning (device sd(8,49)):
ext3_free_blocks: bit already cleared for block 4466464
Any ideas would be greatly appreciated,
-RW
