Roman Mamedov
2013-Mar-31 22:15 UTC
BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
Hello, Trying to balance a 2TB filesystem on the 3.8.5 kernel: Label: ''p2'' uuid: 01f6cc8b-d305-40e1-bac8-8fdd548f611e Total devices 1 FS bytes used 1.32TB devid 1 size 1.80TB used 1.37TB path /dev/sda2 System: total=4.00MB, used=156.00KB Data+Metadata: total=1.37TB, used=1.32TB I am getting a Segmentation fault in ''btrfs'' utility, and following in dmesg. What is the problem here? [12259.667681] btrfs: relocating block group 246973202432 flags 5 [12274.481651] btrfs: found 80 extents [12284.273736] btrfs: found 1 extents [12290.803209] btrfs: relocating block group 245899460608 flags 5 [12298.070756] btrfs: found 48 extents [12304.272924] btrfs: relocating block group 244825718784 flags 5 [12318.361116] btrfs: found 511 extents [12327.932489] btrfs: found 6 extents [12335.071480] btrfs: relocating block group 243751976960 flags 5 [12346.588372] btrfs: found 221 extents [12357.535910] btrfs: found 2 extents [12363.295088] btrfs: relocating block group 242678235136 flags 5 [12377.999629] btrfs: found 67 extents [12389.909611] btrfs: found 8 extents [12397.101725] btrfs: relocating block group 241604493312 flags 5 [12411.303919] btrfs: found 94 extents [12418.516308] btrfs: relocating block group 240530751488 flags 5 [12432.028091] btrfs: found 176 extents [12439.785920] btrfs: relocating block group 239457009664 flags 5 [12451.489826] ------------[ cut here ]------------ [12451.489873] WARNING: at fs/btrfs/super.c:256 __btrfs_abort_transaction+0xdf/0x100 [btrfs]() [12451.489880] Hardware name: KS [12451.489885] btrfs: Transaction aborted [12451.489890] Modules linked in: nf_conntrack_ipv6(F) nf_defrag_ipv6(F) ip6t_REJECT(F) ip6table_filter(F) ip6_tables(F) ipt_REJECT(F) xt_tcpudp(F) xt_state(F) xt_limit(F) iptable_nat(F) nf_conntrack_ipv4(F) nf_defrag_ipv4(F) nf_nat_ipv4(F) nf_nat(F) nf_conntrack(F) iptable_filter(F) ip_tables(F) x_tables(F) btrfs(F) zlib_deflate(F) libcrc32c(F) w83627ehf(F) hwmon_vid(F) coretemp(F) gpio_ich(F) snd_pcm(F) i915(F) snd_timer(F) snd(F) soundcore(F) snd_page_alloc(F) microcode(F) psmouse(F) tpm_tis(F) drm_kms_helper(F) pcspkr(F) serio_raw(F) drm(F) lpc_ich(F) i2c_i801(F) r8169(F) i2c_algo_bit(F) mac_hid(F) video(F) [12451.489981] Pid: 1053, comm: btrfs Tainted: GF 3.8.5-gnu #1 [12451.489987] Call Trace: [12451.490006] [<ffffffff81058bef>] warn_slowpath_common+0x7f/0xc0 [12451.490020] [<ffffffff81058ce6>] warn_slowpath_fmt+0x46/0x50 [12451.490064] [<ffffffffa0220b37>] ? free_extent_buffer+0x37/0x90 [btrfs] [12451.490098] [<ffffffffa01da01f>] __btrfs_abort_transaction+0xdf/0x100 [btrfs] [12451.490204] [<ffffffffa01e6d8c>] ? insert_tree_block_ref+0x4c/0x70 [btrfs] [12451.490295] [<ffffffffa01e9908>] __btrfs_inc_extent_ref+0x1b8/0x200 [btrfs] [12451.490337] [<ffffffffa02450d9>] ? btrfs_merge_delayed_refs+0x289/0x300 [btrfs] [12451.490408] [<ffffffffa01ef87e>] run_clustered_refs+0x9ce/0xae0 [btrfs] [12451.490438] [<ffffffffa01dd8bd>] ? btrfs_put_tree_mod_seq+0x10d/0x150 [btrfs] [12451.490470] [<ffffffffa01f32c0>] btrfs_run_delayed_refs+0xd0/0x2f0 [btrfs] [12451.490504] [<ffffffffa0203987>] __btrfs_end_transaction+0xf7/0x410 [btrfs] [12451.490538] [<ffffffffa0203cd3>] btrfs_end_transaction_throttle+0x13/0x20 [btrfs] [12451.490576] [<ffffffffa024bf34>] merge_reloc_root+0x274/0x500 [btrfs] [12451.490606] [<ffffffffa01dd32a>] ? btrfs_free_path+0x2a/0x40 [btrfs] [12451.490698] [<ffffffffa024c2d8>] merge_reloc_roots+0x118/0x150 [btrfs] [12451.490741] [<ffffffffa024c91b>] relocate_block_group+0x3db/0x640 [btrfs] [12451.490784] [<ffffffffa024cd45>] btrfs_relocate_block_group+0x1c5/0x300 [btrfs] [12451.490825] [<ffffffffa02250b5>] btrfs_relocate_chunk.isra.54+0x75/0x730 [btrfs] [12451.490864] [<ffffffffa021b5e1>] ? release_extent_buffer.isra.26+0x81/0xf0 [btrfs] [12451.490904] [<ffffffffa0220b37>] ? free_extent_buffer+0x37/0x90 [btrfs] [12451.490945] [<ffffffffa02294d7>] btrfs_balance+0x8e7/0xe00 [btrfs] [12451.490988] [<ffffffffa023135f>] btrfs_ioctl_balance+0x22f/0x570 [btrfs] [12451.491030] [<ffffffffa0233cb0>] btrfs_ioctl+0xee0/0x1b70 [btrfs] [12451.491045] [<ffffffff811a66a3>] ? user_path_at_empty+0x63/0xa0 [12451.491058] [<ffffffff816d74a0>] ? __do_page_fault+0x240/0x540 [12451.491157] [<ffffffff811a87d8>] do_vfs_ioctl+0x98/0x550 [12451.491182] [<ffffffff81162173>] ? do_brk+0x1b3/0x330 [12451.491191] [<ffffffff811a8d21>] sys_ioctl+0x91/0xb0 [12451.491201] [<ffffffff816dbe1d>] system_call_fastpath+0x1a/0x1f [12451.491208] ---[ end trace a10e7cae6b920c78 ]--- [12451.491217] BTRFS error (device sda2) in __btrfs_inc_extent_ref:1935: Object already exists [12451.494408] btrfs is forced readonly [12451.495143] ------------[ cut here ]------------ [12451.498178] Kernel BUG at ffffffffa024bdbe [verbose debug info unavailable] [12451.498178] invalid opcode: 0000 [#1] SMP [12451.498178] Modules linked in: nf_conntrack_ipv6(F) nf_defrag_ipv6(F) ip6t_REJECT(F) ip6table_filter(F) ip6_tables(F) ipt_REJECT(F) xt_tcpudp(F) xt_state(F) xt_limit(F) iptable_nat(F) nf_conntrack_ipv4(F) nf_defrag_ipv4(F) nf_nat_ipv4(F) nf_nat(F) nf_conntrack(F) iptable_filter(F) ip_tables(F) x_tables(F) btrfs(F) zlib_deflate(F) libcrc32c(F) w83627ehf(F) hwmon_vid(F) coretemp(F) gpio_ich(F) snd_pcm(F) i915(F) snd_timer(F) snd(F) soundcore(F) snd_page_alloc(F) microcode(F) psmouse(F) tpm_tis(F) drm_kms_helper(F) pcspkr(F) serio_raw(F) drm(F) lpc_ich(F) i2c_i801(F) r8169(F) i2c_algo_bit(F) mac_hid(F) video(F) [12451.498178] CPU 0 [12451.498178] Pid: 1053, comm: btrfs Tainted: GF W 3.8.5-gnu #1 OVH KS/D425KT [12451.498178] RIP: 0010:[<ffffffffa024bdbe>] [<ffffffffa024bdbe>] merge_reloc_root+0xfe/0x500 [btrfs] [12451.498178] RSP: 0018:ffff88011c9bb998 EFLAGS: 00010206 [12451.498178] RAX: ffffffffffffffe2 RBX: ffff880114c24cf0 RCX: 0000000000000002 [12451.498178] RDX: 0000000000000000 RSI: ffff88012976e000 RDI: ffff88011a987800 [12451.498178] RBP: ffff88011c9bba58 R08: ffffea00047430c0 R09: 0000000000000000 [12451.498178] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88011a066000 [12451.498178] R13: ffffffffffffffe2 R14: ffff88011a987800 R15: ffff880119ade800 [12451.498178] FS: 00007f116b017760(0000) GS:ffff88012fc00000(0000) knlGS:0000000000000000 [12451.498178] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [12451.498178] CR2: ffffffffff600400 CR3: 0000000119fed000 CR4: 00000000000007f0 [12451.498178] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12451.498178] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [12451.498178] Process btrfs (pid: 1053, threadinfo ffff88011c9ba000, task ffff880128231740) [12451.498178] Stack: [12451.498178] ffff880100000002 ffffffffa01dd32a ffff880119ade000 0000000000000000 [12451.498178] 000000021c9bba58 0000e00000000001 ffff88011c9bb9d8 000774ff81350f5b [12451.498178] 00006c0000000000 080d000000000068 006c000000000000 74000000003cba70 [12451.498178] Call Trace: [12451.498178] [<ffffffffa01dd32a>] ? btrfs_free_path+0x2a/0x40 [btrfs] [12451.498178] [<ffffffffa024c2d8>] merge_reloc_roots+0x118/0x150 [btrfs] [12451.498178] [<ffffffffa024c91b>] relocate_block_group+0x3db/0x640 [btrfs] [12451.498178] [<ffffffffa024cd45>] btrfs_relocate_block_group+0x1c5/0x300 [btrfs] [12451.498178] [<ffffffffa02250b5>] btrfs_relocate_chunk.isra.54+0x75/0x730 [btrfs] [12451.498178] [<ffffffffa021b5e1>] ? release_extent_buffer.isra.26+0x81/0xf0 [btrfs] [12451.498178] [<ffffffffa0220b37>] ? free_extent_buffer+0x37/0x90 [btrfs] [12451.498178] [<ffffffffa02294d7>] btrfs_balance+0x8e7/0xe00 [btrfs] [12451.498178] [<ffffffffa023135f>] btrfs_ioctl_balance+0x22f/0x570 [btrfs] [12451.498178] [<ffffffffa0233cb0>] btrfs_ioctl+0xee0/0x1b70 [btrfs] [12451.498178] [<ffffffff811a66a3>] ? user_path_at_empty+0x63/0xa0 [12451.498178] [<ffffffff816d74a0>] ? __do_page_fault+0x240/0x540 [12451.498178] [<ffffffff811a87d8>] do_vfs_ioctl+0x98/0x550 [12451.498178] [<ffffffff81162173>] ? do_brk+0x1b3/0x330 [12451.498178] [<ffffffff811a8d21>] sys_ioctl+0x91/0xb0 [12451.498178] [<ffffffff816dbe1d>] system_call_fastpath+0x1a/0x1f [12451.498178] Code: 00 00 4c 89 f7 49 89 45 40 49 8b 74 24 18 e8 6a 1d fa ff 85 c0 74 16 83 f8 f5 75 0f 4c 89 f6 4c 89 ef e8 b6 6f fb ff 85 c0 74 b2 <0f> 0b 8b 45 cc 48 8d 55 cc 48 89 de 4c 89 ff 89 85 64 ff ff ff [12451.498178] RIP [<ffffffffa024bdbe>] merge_reloc_root+0xfe/0x500 [btrfs] [12451.498178] RSP <ffff88011c9bb998> [12451.740494] ---[ end trace a10e7cae6b920c79 ]--- -- With respect, Roman
Roman Mamedov
2013-Mar-31 22:36 UTC
Re: BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
Hello, After a reboot the filesystem now does not mount at all, with similar messages. [ 66.874267] Btrfs loaded [ 66.876222] device label p2 devid 1 transid 22985 /dev/sda2 [ 66.878175] btrfs: use lzo compression [ 66.878185] btrfs: disk space caching is enabled [ 79.112680] ------------[ cut here ]------------ [ 79.112713] WARNING: at fs/btrfs/super.c:256 __btrfs_abort_transaction+0xdf/0x100 [btrfs]() [ 79.112717] Hardware name: KS [ 79.112721] btrfs: Transaction aborted [ 79.112724] Modules linked in: btrfs(F) zlib_deflate(F) libcrc32c(F) nf_conntrack_ipv6(F) nf_defrag_ipv6(F) ip6t_REJECT(F) ip6table_filter(F) ip6_tables(F) ipt_REJECT(F) xt_tcpudp(F) xt_state(F) xt_limit(F) iptable_nat(F) nf_conntrack_ipv4(F) nf_defrag_ipv4(F) nf_nat_ipv4(F) nf_nat(F) nf_conntrack(F) iptable_filter(F) ip_tables(F) x_tables(F) w83627ehf(F) hwmon_vid(F) coretemp(F) gpio_ich(F) i915(F) snd_pcm(F) snd_timer(F) tpm_tis(F) drm_kms_helper(F) microcode(F) snd(F) soundcore(F) drm(F) snd_page_alloc(F) psmouse(F) pcspkr(F) r8169(F) mac_hid(F) i2c_algo_bit(F) i2c_i801(F) serio_raw(F) lpc_ich(F) video(F) [ 79.112793] Pid: 1037, comm: mount Tainted: GF 3.8.5-gnu #1 [ 79.112796] Call Trace: [ 79.112810] [<ffffffff81058bef>] warn_slowpath_common+0x7f/0xc0 [ 79.112818] [<ffffffff81058ce6>] warn_slowpath_fmt+0x46/0x50 [ 79.112848] [<ffffffffa028db37>] ? free_extent_buffer+0x37/0x90 [btrfs] [ 79.112870] [<ffffffffa024701f>] __btrfs_abort_transaction+0xdf/0x100 [btrfs] [ 79.112893] [<ffffffffa0253d8c>] ? insert_tree_block_ref+0x4c/0x70 [btrfs] [ 79.112916] [<ffffffffa0256908>] __btrfs_inc_extent_ref+0x1b8/0x200 [btrfs] [ 79.112947] [<ffffffffa02b20d9>] ? btrfs_merge_delayed_refs+0x289/0x300 [btrfs] [ 79.112971] [<ffffffffa025c87e>] run_clustered_refs+0x9ce/0xae0 [btrfs] [ 79.112994] [<ffffffffa024a8bd>] ? btrfs_put_tree_mod_seq+0x10d/0x150 [btrfs] [ 79.113018] [<ffffffffa02602c0>] btrfs_run_delayed_refs+0xd0/0x2f0 [btrfs] [ 79.113045] [<ffffffffa0270987>] __btrfs_end_transaction+0xf7/0x410 [btrfs] [ 79.113072] [<ffffffffa0270cd3>] btrfs_end_transaction_throttle+0x13/0x20 [btrfs] [ 79.113102] [<ffffffffa02b8f34>] merge_reloc_root+0x274/0x500 [btrfs] [ 79.113125] [<ffffffffa024a32a>] ? btrfs_free_path+0x2a/0x40 [btrfs] [ 79.113155] [<ffffffffa02b92d8>] merge_reloc_roots+0x118/0x150 [btrfs] [ 79.113186] [<ffffffffa02ba22b>] btrfs_recover_relocation+0x3ab/0x400 [btrfs] [ 79.113212] [<ffffffffa026e472>] open_ctree+0x1c52/0x1d70 [btrfs] [ 79.113235] [<ffffffffa0246bbb>] btrfs_mount+0x57b/0x670 [btrfs] [ 79.113245] [<ffffffff8119aa53>] mount_fs+0x43/0x1b0 [ 79.113252] [<ffffffff811b5226>] vfs_kern_mount+0x76/0x120 [ 79.113260] [<ffffffff811b748d>] do_mount+0x1fd/0xa40 [ 79.113267] [<ffffffff811b70fa>] ? copy_mount_options+0x3a/0x180 [ 79.113274] [<ffffffff811b7d60>] sys_mount+0x90/0xe0 [ 79.113283] [<ffffffff816dbe1d>] system_call_fastpath+0x1a/0x1f [ 79.113288] ---[ end trace abe4f5e37903fe08 ]--- [ 79.113294] BTRFS error (device sda2) in __btrfs_inc_extent_ref:1935: Object already exists [ 79.115793] ------------[ cut here ]------------ [ 79.116014] Kernel BUG at ffffffffa02b8dbe [verbose debug info unavailable] [ 79.116014] invalid opcode: 0000 [#1] SMP [ 79.116014] Modules linked in: btrfs(F) zlib_deflate(F) libcrc32c(F) nf_conntrack_ipv6(F) nf_defrag_ipv6(F) ip6t_REJECT(F) ip6table_filter(F) ip6_tables(F) ipt_REJECT(F) xt_tcpudp(F) xt_state(F) xt_limit(F) iptable_nat(F) nf_conntrack_ipv4(F) nf_defrag_ipv4(F) nf_nat_ipv4(F) nf_nat(F) nf_conntrack(F) iptable_filter(F) ip_tables(F) x_tables(F) w83627ehf(F) hwmon_vid(F) coretemp(F) gpio_ich(F) i915(F) snd_pcm(F) snd_timer(F) tpm_tis(F) drm_kms_helper(F) microcode(F) snd(F) soundcore(F) drm(F) snd_page_alloc(F) psmouse(F) pcspkr(F) r8169(F) mac_hid(F) i2c_algo_bit(F) i2c_i801(F) serio_raw(F) lpc_ich(F) video(F) [ 79.116014] CPU 1 [ 79.116014] Pid: 1037, comm: mount Tainted: GF W 3.8.5-gnu #1 OVH KS/D425KT [ 79.116014] RIP: 0010:[<ffffffffa02b8dbe>] [<ffffffffa02b8dbe>] merge_reloc_root+0xfe/0x500 [btrfs] [ 79.116014] RSP: 0018:ffff88011eef1a08 EFLAGS: 00010202 [ 79.116014] RAX: ffffffffffffffef RBX: ffff8801204e6ea0 RCX: 0000000000000064 [ 79.116014] RDX: 0000000000000063 RSI: ffff8801205ba980 RDI: 000000000001bdc0 [ 79.116014] RBP: ffff88011eef1ac8 R08: ffffea0004816e80 R09: 0000000000000000 [ 79.116014] R10: 0000000000000000 R11: ffffffff81850668 R12: ffff88011ff24800 [ 79.116014] R13: ffffffffffffffef R14: ffff88012765f800 R15: ffff880127cbf000 [ 79.116014] FS: 00007f0025e1c7e0(0000) GS:ffff88012fc80000(0000) knlGS:0000000000000000 [ 79.116014] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [ 79.116014] CR2: ffffffffff600400 CR3: 000000011edf9000 CR4: 00000000000007e0 [ 79.116014] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 79.116014] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 79.116014] Process mount (pid: 1037, threadinfo ffff88011eef0000, task ffff880129311740) [ 79.116014] Stack: [ 79.116014] ffff880100000002 ffffffffa024a32a ffff88012765f000 0000000000000000 [ 79.116014] 000000021eef1ac8 0000e00000000001 ffff88011eef1a48 000774ff81350f5b [ 79.116014] 00006c0000000000 080d000000000068 006c000000000000 74000000003cba70 [ 79.116014] Call Trace: [ 79.116014] [<ffffffffa024a32a>] ? btrfs_free_path+0x2a/0x40 [btrfs] [ 79.116014] [<ffffffffa02b92d8>] merge_reloc_roots+0x118/0x150 [btrfs] [ 79.116014] [<ffffffffa02ba22b>] btrfs_recover_relocation+0x3ab/0x400 [btrfs] [ 79.116014] [<ffffffffa026e472>] open_ctree+0x1c52/0x1d70 [btrfs] [ 79.116014] [<ffffffffa0246bbb>] btrfs_mount+0x57b/0x670 [btrfs] [ 79.116014] [<ffffffff8119aa53>] mount_fs+0x43/0x1b0 [ 79.116014] [<ffffffff811b5226>] vfs_kern_mount+0x76/0x120 [ 79.116014] [<ffffffff811b748d>] do_mount+0x1fd/0xa40 [ 79.116014] [<ffffffff811b70fa>] ? copy_mount_options+0x3a/0x180 [ 79.116014] [<ffffffff811b7d60>] sys_mount+0x90/0xe0 [ 79.116014] [<ffffffff816dbe1d>] system_call_fastpath+0x1a/0x1f [ 79.116014] Code: 00 00 4c 89 f7 49 89 45 40 49 8b 74 24 18 e8 6a 1d fa ff 85 c0 74 16 83 f8 f5 75 0f 4c 89 f6 4c 89 ef e8 b6 6f fb ff 85 c0 74 b2 <0f> 0b 8b 45 cc 48 8d 55 cc 48 89 de 4c 89 ff 89 85 64 ff ff ff [ 79.116014] RIP [<ffffffffa02b8dbe>] merge_reloc_root+0xfe/0x500 [btrfs] [ 79.116014] RSP <ffff88011eef1a08> [ 79.264721] ---[ end trace abe4f5e37903fe09 ]--- -- With respect, Roman
Roman Mamedov
2013-Apr-01 08:12 UTC
Re: BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
On Mon, 1 Apr 2013 04:36:05 +0600 Roman Mamedov <rm@romanrm.ru> wrote:> Hello, > > After a reboot the filesystem now does not mount at all, with similar messages.So thinking this was an isolated incident, I foolishly continued setting up scheduled balance on other systems with btrfs that I have. And got into exactly the same situation on another machine!! Trying to balance this with -dusage=5, on kernel 3.8.5: Data: total=215.01GB, used=141.76GB System, DUP: total=32.00MB, used=32.00KB System: total=4.00MB, used=0.00 Metadata, DUP: total=9.38GB, used=1.09GB Same messages, "Object already exists". While I currently left the previously mentioned 2TB FS in an unmounted broken state, still waiting for any response from you on how to properly recover from this problem, in this new case I needed to restore the machine as soon as possible. I tried btrfsck --repair, it corrected a lot of errors, but in the end gave up with a message saying that it can''t repair the filesystem; then I did btrfs-zero-log. After this the FS started mounting successfully again. Not sure if I got any data corruption as a result, but this is the root FS and /home, and the machine successfully booted up with no data lost in any of the apps that were active just before the crash (e.g browser, IM and IRC clients), so probably not. -- With respect, Roman
Josef Bacik
2013-Apr-01 13:31 UTC
Re: BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
On Mon, Apr 01, 2013 at 02:12:07AM -0600, Roman Mamedov wrote:> On Mon, 1 Apr 2013 04:36:05 +0600 > Roman Mamedov <rm@romanrm.ru> wrote: > > > Hello, > > > > After a reboot the filesystem now does not mount at all, with similar messages. > > So thinking this was an isolated incident, I foolishly continued setting up > scheduled balance on other systems with btrfs that I have. > > And got into exactly the same situation on another machine!! > > Trying to balance this with -dusage=5, on kernel 3.8.5: > > Data: total=215.01GB, used=141.76GB > System, DUP: total=32.00MB, used=32.00KB > System: total=4.00MB, used=0.00 > Metadata, DUP: total=9.38GB, used=1.09GB > > Same messages, "Object already exists". > > While I currently left the previously mentioned 2TB FS in an unmounted broken > state, still waiting for any response from you on how to properly recover from > this problem, in this new case I needed to restore the machine as soon as > possible. > > I tried btrfsck --repair, it corrected a lot of errors, but in the end gave up > with a message saying that it can''t repair the filesystem; then I did > btrfs-zero-log. After this the FS started mounting successfully again. > > Not sure if I got any data corruption as a result, but this is the root FS > and /home, and the machine successfully booted up with no data lost in any of > the apps that were active just before the crash (e.g browser, IM and IRC > clients), so probably not. >Can you capture an image of these broken file systems the next time it happens? You''ll need to clone the progs here git://github.com/josefbacik/btrfs-progs.git and build and then run btrfs-image -w /dev/whatever blah.img and then upload blah.img up somewhere I can pull it down. You can use the -t and -c options too, but the -w is the most important since you have extent tree corruption. Thanks, Josef -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Chris Kastorff
2013-Apr-01 13:45 UTC
Re: BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
I have a (larger, 7x2TB at RAID10) filesystem that was recently hit by this. Same story; filesystem works normally, balance start, works for a while, then fails with similar stack traces and remounts read-only, after a reboot does not mount at all with similar error messages and stack traces. The FS is still in that state. I''ll grab an image and mail a link privately. I don''t need to do anything special for btrfs-image on a multi-device fs, right? Kernel version is 3.8.4-1-ARCH (archlinux.) On Mon, Apr 1, 2013 at 6:31 AM, Josef Bacik <jbacik@fusionio.com> wrote:> On Mon, Apr 01, 2013 at 02:12:07AM -0600, Roman Mamedov wrote: >> On Mon, 1 Apr 2013 04:36:05 +0600 >> Roman Mamedov <rm@romanrm.ru> wrote: >> >> > Hello, >> > >> > After a reboot the filesystem now does not mount at all, with similar messages. >> >> So thinking this was an isolated incident, I foolishly continued setting up >> scheduled balance on other systems with btrfs that I have. >> >> And got into exactly the same situation on another machine!! >> >> Trying to balance this with -dusage=5, on kernel 3.8.5: >> >> Data: total=215.01GB, used=141.76GB >> System, DUP: total=32.00MB, used=32.00KB >> System: total=4.00MB, used=0.00 >> Metadata, DUP: total=9.38GB, used=1.09GB >> >> Same messages, "Object already exists". >> >> While I currently left the previously mentioned 2TB FS in an unmounted broken >> state, still waiting for any response from you on how to properly recover from >> this problem, in this new case I needed to restore the machine as soon as >> possible. >> >> I tried btrfsck --repair, it corrected a lot of errors, but in the end gave up >> with a message saying that it can''t repair the filesystem; then I did >> btrfs-zero-log. After this the FS started mounting successfully again. >> >> Not sure if I got any data corruption as a result, but this is the root FS >> and /home, and the machine successfully booted up with no data lost in any of >> the apps that were active just before the crash (e.g browser, IM and IRC >> clients), so probably not. >> > > Can you capture an image of these broken file systems the next time it happens? > You''ll need to clone the progs here > > git://github.com/josefbacik/btrfs-progs.git > > and build and then run > > btrfs-image -w /dev/whatever blah.img > > and then upload blah.img up somewhere I can pull it down. You can use the -t > and -c options too, but the -w is the most important since you have extent tree > corruption. Thanks, > > Josef > -- > To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html-- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Josef Bacik
2013-Apr-01 13:51 UTC
Re: BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
On Mon, Apr 01, 2013 at 07:45:16AM -0600, Chris Kastorff wrote:> I have a (larger, 7x2TB at RAID10) filesystem that was recently hit by > this. Same story; filesystem works normally, balance start, works for > a while, then fails with similar stack traces and remounts read-only, > after a reboot does not mount at all with similar error messages and > stack traces. > > The FS is still in that state. I''ll grab an image and mail a link > privately. I don''t need to do anything special for btrfs-image on a > multi-device fs, right? >Right it will grab stuff from whatever mirror it''s on and put it in the image. Make sure to use -w, if the extent tree is corrupt the -w will make sure it actually grabs all of the file system. Thanks, Josef -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Roman Mamedov
2013-Apr-01 15:16 UTC
Re: BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
On Mon, 1 Apr 2013 09:31:10 -0400 Josef Bacik <jbacik@fusionio.com> wrote:> Can you capture an image of these broken file systems the next time it happens? > You''ll need to clone the progs here > > git://github.com/josefbacik/btrfs-progs.git > > and build and then run > > btrfs-image -w /dev/whatever blah.img > > and then upload blah.img up somewhere I can pull it down. You can use the -t > and -c options too, but the -w is the most important since you have extent tree > corruption. Thanks,Hello, I have sent the link privately to your E-Mail. -- With respect, Roman
anand jain
2013-Apr-01 23:00 UTC
Re: BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
> I tried btrfsck --repair,I am not indicating this is the cause but, kindly note that btrfsck --repair has a bug which it will let kernel to reset the uuid of the root. the fix is at: [PATCH] btrfs-progs: root_item generation_v2 is out of sync after btrfsck Thanks, Anand -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Josef Bacik
2013-Apr-02 00:46 UTC
Re: BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
On Sun, Mar 31, 2013 at 04:15:40PM -0600, Roman Mamedov wrote:> Hello, > > Trying to balance a 2TB filesystem on the 3.8.5 kernel: > > Label: ''p2'' uuid: 01f6cc8b-d305-40e1-bac8-8fdd548f611e > Total devices 1 FS bytes used 1.32TB > devid 1 size 1.80TB used 1.37TB path /dev/sda2 > > System: total=4.00MB, used=156.00KB > Data+Metadata: total=1.37TB, used=1.32TB > > I am getting a Segmentation fault in ''btrfs'' utility, and following in dmesg. > What is the problem here? >I just posted a patch for this bug, I can mount your image now without it panicing and it passes fsck on either side of the mount. Let me know if it doesn''t work for you. Thanks, Josef -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Roman Mamedov
2013-Apr-02 05:21 UTC
Re: BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
On Mon, 1 Apr 2013 20:46:45 -0400 Josef Bacik <jbacik@fusionio.com> wrote:> I just posted a patch for this bug, I can mount your image now without it > panicing and it passes fsck on either side of the mount. Let me know if it > doesn''t work for you. Thanks,Thank you, it now mounted and works without issues. -- With respect, Roman