[RESOLVED, DUPLICATE] Using BTRFS on N2: Unable to handle kernel NULL pointer dereference

[xabolcs]

Hi!


I'm using meveric's Debian image which uses ODROID's 4.9.162+ kernel.

I'd like to use BTRFS, but it seems like too unstable.

I formatted the eMMC to btrfs, and mounted it, and soon Kernel Ooops happened:

Code: Select all

[  213.457774] BTRFS info (device mmcblk0p2): disk space caching is enabled
[  213.459068] BTRFS info (device mmcblk0p2): has skinny extents
[  213.475160] BTRFS info (device mmcblk0p2): detected SSD devices, enabling SSD mode
[  254.985396] Unable to handle kernel NULL pointer dereference at virtual address 00000044
[  254.988022] pgd = ffffff800a886000
[  254.992320] [00000044] *pgd=00000000cf3fe003, *pud=00000000cf3fe003, *pmd=0000000000000000
[  254.999979] Internal error: Oops: 96000005 [#1] PREEMPT SMP
[  255.005697] Modules linked in: rtc_pcf8563 i2c_meson_master ip_tables x_tables ipv6 btrfs xor hid_logitech_hidpp hid_logitech_dj raid6_pq
[  255.018178] CPU: 1 PID: 2379 Comm: btrfs-transacti Not tainted 4.9.162+ #1
[  255.025195] Hardware name: Hardkernel ODROID-N2 (DT)
[  255.030309] task: ffffffc0c95e5400 task.stack: ffffffc0c849c000
[  255.036385] PC is at __do_page_cache_readahead+0x58/0x2a8
[  255.041924] LR is at ondemand_readahead+0x13c/0x278
[  255.046948] pc : [<ffffff80091d4f90>] lr : [<ffffff80091d531c>] pstate: 20000145
[  255.054488] sp : ffffffc0c849f480
[  255.057955] x29: ffffffc0c849f480 x28: ffffffc0bced8620
[  255.063414] x27: ffffffc0c849f518 x26: 000000000000000e
[  255.068875] x25: 0000000000000000 x24: 0000000000000000
[  255.074334] x23: 0000000000000080 x22: 0000000000000000
[  255.079794] x21: 0000000000000000 x20: ffffffc0bced8788
[  255.085254] x19: 0000000000000041 x18: 0000000000000014
[  255.090714] x17: 0000007f9639f848 x16: ffffff800924cf88
[  255.096174] x15: 9196000000000000 x14: 0000000000000005
[  255.101634] x13: 0000000000000000 x12: 0000000000000004
[  255.107094] x11: 0000000000000277 x10: 0000000000000a20
[  255.112554] x9 : 0000000000000000 x8 : ffffffc0c76edd00
[  255.118014] x7 : 0000000000000000 x6 : 000000000000003f
[  255.123474] x5 : 000000000000003f x4 : 0000000000000041
[  255.128935] x3 : 0000000000000000 x2 : 0000000000000000
[  255.134394] x1 : ffffff800a597e90 x0 : ffffffc0bced8620
[  255.139855]
               SP: 0xffffffc0c849f400:
[  255.145141] f400  00000000 00000000 00000080 00000000 00000000 00000000 00000000 00000000
[  255.153461] f420  0000000e 00000000 c849f518 ffffffc0 bced8620 ffffffc0 c849f480 ffffffc0
[  255.161781] f440  091d531c ffffff80 c849f480 ffffffc0 091d4f90 ffffff80 20000145 00000000
[  255.170101] f460  c849f510 ffffffc0 01c66d68 ffffff80 ffffffff ffffffff c849f690 ffffffc0
[  255.178421] f480  c849f560 ffffffc0 091d531c ffffff80 c76edcc0 ffffffc0 00000000 00000000
[  255.186741] f4a0  bced8788 ffffffc0 00000000 00000000 0000003f 00000000 00000400 00000000
[  255.195061] f4c0  00000000 00000000 0000000e 00000000 000032d1 00000000 bced8620 ffffffc0
[  255.203381] f4e0  c849f540 ffffffc0 00000000 00000000 bced8788 ffffffc0 090d9a38 ffffff80
[  255.211701]
               X0: 0xffffffc0bced85a0:
[  255.216987] 85a0  00000000 00000000 0000000e 00000000 00000000 00000000 0000001b 00000000
[  255.225308] 85c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  255.233627] 85e0  bced85e0 ffffffc0 bced85e0 ffffffc0 00000000 00000000 00000000 00000000
[  255.241948] 8600  bced8600 ffffffc0 bced8600 ffffffc0 00000000 00000000 00000000 00000000
[  255.250267] 8620  00088180 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  255.258587] 8640  01d27880 ffffff80 c70d2800 ffffffc0 bced8788 ffffffc0 c75d8410 ffffffc0
[  255.266907] 8660  00000100 00000000 00000001 00000000 00040000 00000000 00000000 00000000
[  255.275227] 8680  00000000 00000000 00000000 00000000 00000000 00000000 5cad3f7f 00000000
[  255.283549]
               X8: 0xffffffc0c76edc80:
[  255.288834] dc80  c76edc40 ffffffc0 00000001 00000000 c76edc48 ffffffc0 00000000 00000000
[  255.297154] dca0  00000000 00000000 0000004d 002e0201 00000000 00000000 00000000 00000000
[  255.305474] dcc0  00000000 00000000 00000080 00000041 00000400 00000000 ffffffff ffffffff
[  255.313794] dce0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  255.322114] dd00  00000001 00000001 00000000 00000000 00000000 00000000 00000000 00000000
[  255.330434] dd20  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  255.338754] dd40  00000001 00000001 00000000 00000000 00000000 00000000 c76edd58 ffffffc0
[  255.347074] dd60  c76edd58 ffffffc0 09224288 ffffff80 00000000 00000000 00000000 00000000
[  255.355397]
               X20: 0xffffffc0bced8708:
[  255.360767] 8708  cae89778 ffffffc0 bced8710 ffffffc0 bced8710 ffffffc0 bced8720 ffffffc0
[  255.369087] 8728  bced8720 ffffffc0 bcfbdf20 ffffffc0 c70d2e08 ffffffc0 bced8740 ffffffc0
[  255.377407] 8748  bced8740 ffffffc0 00000000 00000000 00000000 00000000 00000009 00000000
[  255.385727] 8768  00000002 00000000 00000000 00000000 01d27fa0 ffffff80 00000000 00000000
[  255.394047] 8788  bced8620 ffffffc0 02180020 00000000 00000000 00000000 00000000 00000000
[  255.402367] 87a8  00000000 00000000 00000000 00000000 bced87b8 ffffffc0 bced87b8 ffffffc0
[  255.410687] 87c8  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  255.419007] 87e8  00000000 00000000 01d277b0 ffffff80 00000000 00000000 00000000 02420048
[  255.427329]
               X27: 0xffffffc0c849f498:
[  255.432701] f498  00000000 00000000 bced8788 ffffffc0 00000000 00000000 0000003f 00000000
[  255.441021] f4b8  00000400 00000000 00000000 00000000 0000000e 00000000 000032d1 00000000
[  255.449341] f4d8  bced8620 ffffffc0 c849f540 ffffffc0 00000000 00000000 bced8788 ffffffc0
[  255.457661] f4f8  090d9a38 ffffff80 09f24250 ffffff80 00000189 00000000 00000000 00000000
[  255.465981] f518  c70d3000 ffffffc0 c849f550 ffffffc0 0921d064 ffffff80 c849f560 ffffffc0
[  255.474301] f538  090d9a38 ffffff80 09f24250 ffffff80 00000189 00000000 00000000 00000000
[  255.482621] f558  000409a2 00000000 c849f5c0 ffffffc0 091d56c0 ffffff80 00000000 00000000
[  255.490941] f578  c76edcc0 ffffffc0 bced8788 ffffffc0 00000000 00000000 0000003f 00000000
[  255.499261]
               X28: 0xffffffc0bced85a0:
[  255.504634] 85a0  00000000 00000000 0000000e 00000000 00000000 00000000 0000001b 00000000
[  255.512954] 85c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  255.521274] 85e0  bced85e0 ffffffc0 bced85e0 ffffffc0 00000000 00000000 00000000 00000000
[  255.529594] 8600  bced8600 ffffffc0 bced8600 ffffffc0 00000000 00000000 00000000 00000000
[  255.537914] 8620  00088180 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  255.546234] 8640  01d27880 ffffff80 c70d2800 ffffffc0 bced8788 ffffffc0 c75d8410 ffffffc0
[  255.554554] 8660  00000100 00000000 00000001 00000000 00040000 00000000 00000000 00000000
[  255.562874] 8680  00000000 00000000 00000000 00000000 00000000 00000000 5cad3f7f 00000000
[  255.571195]
               X29: 0xffffffc0c849f400:
[  255.576567] f400  00000000 00000000 00000080 00000000 00000000 00000000 00000000 00000000
[  255.584887] f420  0000000e 00000000 c849f518 ffffffc0 bced8620 ffffffc0 c849f480 ffffffc0
[  255.593207] f440  091d531c ffffff80 c849f480 ffffffc0 091d4f90 ffffff80 20000145 00000000
[  255.601527] f460  c849f510 ffffffc0 01c66d68 ffffff80 ffffffff ffffffff c849f690 ffffffc0
[  255.609847] f480  c849f560 ffffffc0 091d531c ffffff80 c76edcc0 ffffffc0 00000000 00000000
[  255.618167] f4a0  bced8788 ffffffc0 00000000 00000000 0000003f 00000000 00000400 00000000
[  255.626487] f4c0  00000000 00000000 0000000e 00000000 000032d1 00000000 bced8620 ffffffc0
[  255.634807] f4e0  c849f540 ffffffc0 00000000 00000000 bced8788 ffffffc0 090d9a38 ffffff80

[  255.644776] Process btrfs-transacti (pid: 2379, stack limit = 0xffffffc0c849c000)
[  255.652403] Stack: (0xffffffc0c849f480 to 0xffffffc0c84a0000)
[  255.658297] f480: ffffffc0c849f560 ffffff80091d531c ffffffc0c76edcc0 0000000000000000
[  255.666270] f4a0: ffffffc0bced8788 0000000000000000 000000000000003f 0000000000000400
[  255.674243] f4c0: 0000000000000000 000000000000000e 00000000000032d1 ffffffc0bced8620
[  255.682216] f4e0: ffffffc0c849f540 0000000000000000 ffffffc0bced8788 ffffff80090d9a38
[  255.690190] f500: ffffff8009f24250 0000000000000189 0000000000000000 ffffffc0c70d3000
[  255.698163] f520: ffffffc0c849f550 ffffff800921d064 ffffffc0c849f560 ffffff80090d9a38
[  255.706137] f540: ffffff8009f24250 0000000000000189 0000000000000000 00000000000409a2
[  255.714109] f560: ffffffc0c849f5c0 ffffff80091d56c0 0000000000000000 ffffffc0c76edcc0
[  255.722083] f580: ffffffc0bced8788 0000000000000000 000000000000003f 0000000001400000
[  255.730056] f5a0: ffffffc0c8032000 000000000000000e 0000000000000000 ffffff800a7eaee0
[  255.738030] f5c0: ffffffc0c849f600 ffffff8001ce2598 ffffffc0c849f680 ffffff800a597e90
[  255.746003] f5e0: ffffffc0c76edcc0 ffffff800a7eaee0 ffffffc0c70d3000 ffffff800a597e90
[  255.753976] f600: ffffffc0c849f700 ffffff8001ce2b60 ffffffc0c85c0c00 ffffffc0c85c0c40
[  255.761949] f620: 0000000000000000 ffffffc0c8429070 ffffffc0c8db0000 ffffffc0c8032000
[  255.769923] f640: 0000000001d2c000 ffffffc0bced8620 ffffffc0c9a7b410 0000000000000001
[  255.777896] f660: ffffffc0c8429070 ffffff800921ca7c 0000000000000001 00000000000000a9
[  255.785870] f680: ffffffc0c849f680 ffffffc0c849f680 fffffffffffffff5 0000000140000000
[  255.793842] f6a0: ffffffc0c849f600 0000000000000000 0000000000000000 0000000000000000
[  255.801817] f6c0: ffffffc0c85c5e00 ffffffc0c70d3000 ffffffc0bced8620 0000000000000000
[  255.809789] f6e0: 0000004000000000 0000000000000000 0000000000000001 00000000000409a2
[  255.817763] f700: ffffffc0c849f750 ffffff8001c6f7a8 ffffff8001d474c0 ffffffc0c85c0c00
[  255.825736] f720: ffffffc0c85c0c40 ffffffc0c9a7b3c0 ffffffc0c8db0000 ffffff800a597e90
[  255.833710] f740: ffffffc0c9a7b3f8 ffffffc0c9a7b3d0 ffffffc0c849f7f0 ffffff8001c7f2cc
[  255.841683] f760: ffffffc0c85c0c00 ffffffc0c85c1738 ffffffc0c8db0b18 ffffffc0c8db0b1c
[  255.849656] f780: 0000000000000000 0000000000004000 0000000001400000 0000000000000000
[  255.857629] f7a0: ffffffc0c85c1600 0000000000000001 0000000000000000 0000000000000001
[  255.865603] f7c0: 0000000000000000 ffffffc0c95e5400 ffffff80090fdbb8 ffffffc0c849f7d8
[  255.873576] f7e0: ffffffc0c849f7d8 00000000000409a2 ffffffc0c849f8f0 ffffff8001c80100
[  255.881549] f800: 0000000000002000 ffffffc0c7dd4800 0000000000000000 0000000000000004
[  255.889523] f820: 0000000000000000 0000000000000000 0000000000004000 ffffffc0c849f9f0
[  255.897496] f840: 0000000000000001 0000000000004000 0000000000000000 0000000100000000
[  255.905469] f860: 0000000000004000 ffffffc0c85c1600 0000000100000000 0000000000000004
[  255.913443] f880: ffffffc0c85c16d0 ffffffc0c7dd4800 ffffffc0c849f9f0 0000000000004000
[  255.921416] f8a0: 0000000000000004 ffffffc0c85c0cc4 ffffffc0c7dd0800 0000000100000004
[  255.929389] f8c0: 0000000000000000 ffffff8000000000 0000000000004000 0000000000000000
[  255.937363] f8e0: 0000000000200000 00000000000409a2 ffffffc0c849f970 ffffff8001c80328
[  255.945336] f900: 0000000000004000 ffffffc0c8db0000 ffffff800a597e90 0000000000000000
[  255.953309] f920: ffffffc0bcfb7000 0000000000000000 ffffffc0c8db01d0 0000000000000000
[  255.961283] f940: ffffffc0c849faa0 ffffffc0c7dd4800 ffffff800a597e90 ffffffc0c8db0000
[  255.969256] f960: 0000000000000000 fffffffffffffff8 ffffffc0c849fa10 ffffff8001c653ec
[  255.977230] f980: ffffffc0c7dd4800 ffffffc0c7574c08 ffffffc0bcfb7000 0000000000000000
[  255.985203] f9a0: ffffffc0c7dd4a00 ffffff800a597e90 0000000000000000 ffffffc0c849fba8
[  255.993176] f9c0: 0000000000000000 ffffffc0c849faa0 0000000000000161 0000000001c653a0
[  256.001149] f9e0: 0000000000000000 0000000000000005 0000000000000000 00000000000000a8
[  256.009123] fa00: 0000000000000000 00000000000409a2 ffffffc0c849fac0 ffffff8001c65964
[  256.017096] fa20: ffffffc0bcfb7000 ffffffc0c7574c08 ffffffc0c7dd4800 ffffffc0c849fba8
[  256.025069] fa40: 0000000000000000 0000000000000000 0000000000000000 0000000000000001
[  256.033043] fa60: 0000000000000000 ffffffc0c8429000 00000000c7574c08 ffffffc0c7574c08
[  256.041016] fa80: 0000000000000000 0000000000000000 ffffffc0c849fab0 0000000001cd35d4
[  256.048989] faa0: 0000000000000100 0000000000000001 ffffffc0bcfb7000 00000000000409a2
[  256.056963] fac0: ffffffc0c849fb10 ffffff8001c691a4 0000000000000000 ffffffc0c7dd4800
[  256.064936] fae0: ffffffc0c849fc88 00000040ffffffff 00000000ffffffff 0000000000000000
[  256.072910] fb00: ffffffc0bcfb7000 ffffffc0c7dd4800 ffffffc0c849fbd0 ffffff8001c87a48
[  256.080883] fb20: ffffffc0c849fc88 0000000000000001 ffffff800a597e90 ffffffc0c8429000
[  256.088856] fb40: ffffffc0bcfb7000 ffffffc0c7dd4800 ffffffc0bcfb7000 0000000000000000
[  256.096829] fb60: 0000000000000000 0000000000000000 ffffffc0c849fba0 ffffff80090d9a38
[  256.104803] fb80: ffffff8009f12910 0000000100000000 0000000000000000 0000000100000000
[  256.112776] fba0: 00000000c849fbd0 ffffffc0c7574c08 ffffffc0c849fbf0 ffffff8001cf2a7c
[  256.120750] fbc0: ffffffc0c84ac000 00000000000409a2 ffffffc0c849fc30 ffffff8001cf2c48
[  256.128723] fbe0: ffffffc0c84ac000 ffffffc0c8429000 00000000ffffffff ffffffc0bcfb7000
[  256.136696] fc00: ffffff800a597e90 ffffffc0c7dd4800 00000000ffffffff ffffffc0bcfb7000
[  256.144670] fc20: ffffffc0c8429000 00000000000409a2 ffffffc0c849fcc0 ffffff8001cf32f4
[  256.152643] fc40: ffffffc0c84ac000 ffffffc0c7dd4800 00000000ffffffff ffffffc0bcfb7000
[  256.160616] fc60: ffffffc0c8429000 00000000ffffffff ffffffc0c84ac048 ffffff8009bef5fc
[  256.168590] fc80: ffffffc0c84ac048 0000000000000100 0000000000000001 ffffff800a597e00
[  256.176563] fca0: ffffffc0c849fcc0 ffffff8001cf32a4 ffffffc0c84ac000 00000000000409a2
[  256.184537] fcc0: ffffffc0c849fd10 ffffff8001cf38b4 ffffffc0bcfb7000 ffffffc0c70d3000
[  256.192509] fce0: 0000000000000000 ffffffc0bced0000 ffffff800a597e90 0000000000000001
[  256.200483] fd00: 00000000000000fa ffffff800a597e90 ffffffc0c849fd30 ffffff8001c9307c
[  256.208456] fd20: ffffffc0bcfb7000 ffffffc0c70d3000 ffffffc0c849fdb0 ffffff8001c8e1f4
[  256.216430] fd40: ffffffc0c70d3000 0000000000001d4c ffffffc0c95e5400 ffffff8001c8e078
[  256.224403] fd60: ffffff8001c8e120 0000000000000001 00000000000000fa ffffff800a597e90
[  256.232377] fd80: 000000000000000f 0000000000000000 ffffffc0c849fdb0 ffffff8001c8e1b8
[  256.240349] fda0: ffffffc0c70d3000 00000000000409a2 ffffffc0c849fe20 ffffff80090cd698
[  256.248323] fdc0: ffffffc0c7da84c0 ffffff800a7389d0 ffffffc0c95e5400 ffffff8009f0ba30
[  256.256296] fde0: ffffffc0c70d3000 ffffff8001c8e028 0000000000000000 0000000000000000
[  256.264269] fe00: 0000000000000000 ffffff8009f0ba30 ffffffc0c70d3000 00000000000409a2
[  256.272243] fe20: 0000000000000000 ffffff8009083950 ffffff80090cd5a0 ffffffc0c7da84c0
[  256.280216] fe40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[  256.288189] fe60: 0000000000000000 ffffffc0c7da84c0 ffffffc0c70d3000 0000000000000000
[  256.296163] fe80: 0000000000000000 ffffffc0c849fe88 ffffffc0c849fe88 ffffff8000000000
[  256.304136] fea0: ffffff8000000000 ffffffc0c849fea8 ffffffc0c849fea8 00000000000409a2
[  256.312110] fec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[  256.320082] fee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[  256.328057] ff00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[  256.336029] ff20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[  256.344002] ff40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[  256.351976] ff60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[  256.359949] ff80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[  256.367922] ffa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[  256.375896] ffc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000
[  256.383869] ffe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[  256.391843] Call trace:
[  256.394443] Exception stack(0xffffffc0c849f290 to 0xffffffc0c849f3c0)
[  256.401029] f280:                                   0000000000000041 0000007fffffffff
[  256.409003] f2a0: ffffffc0c849f480 ffffff80091d4f90 0000000020000145 0000000000000000
[  256.416977] f2c0: ffffffc0c849f2e0 ffffff8009106588 ffffffc0c849f2e0 ffffff800944e9a8
[  256.424949] f2e0: ffffffc0c849f310 ffffff80090f1048 ffffffc0c849f310 ffffff80090f11e8
[  256.432923] f300: 00000000000000df ffffff80090f1b88 ffffffc0c849f4a0 ffffff80090f2ca0
[  256.440896] f320: 0000000000000000 0000000000000000 0000000000000277 0000000000000001
[  256.448870] f340: ffffffc0c849f380 00000000000409a2 ffffffc0bced8620 ffffff800a597e90
[  256.456842] f360: 0000000000000000 0000000000000000 0000000000000041 000000000000003f
[  256.464816] f380: 000000000000003f 0000000000000000 ffffffc0c76edd00 0000000000000000
[  256.472789] f3a0: 0000000000000a20 0000000000000277 0000000000000004 0000000000000000
[  256.480767] [<ffffff80091d4f90>] __do_page_cache_readahead+0x58/0x2a8
[  256.487350] [<ffffff80091d531c>] ondemand_readahead+0x13c/0x278
[  256.493417] [<ffffff80091d56c0>] page_cache_sync_readahead+0x60/0xa0
[  256.500119] [<ffffff8001ce2598>] __load_free_space_cache+0x1d8/0x688 [btrfs]
[  256.507305] [<ffffff8001ce2b60>] load_free_space_cache+0x118/0x1c8 [btrfs]
[  256.514300] [<ffffff8001c6f7a8>] cache_block_group+0x188/0x3c0 [btrfs]
[  256.520968] [<ffffff8001c7f2cc>] find_free_extent+0x2d4/0x1058 [btrfs]
[  256.527631] [<ffffff8001c80100>] btrfs_reserve_extent+0xb0/0x1c8 [btrfs]
[  256.534468] [<ffffff8001c80328>] btrfs_alloc_tree_block+0x110/0x3f0 [btrfs]
[  256.541590] [<ffffff8001c653ec>] __btrfs_cow_block+0x124/0x538 [btrfs]
[  256.548254] [<ffffff8001c65964>] btrfs_cow_block+0xcc/0x228 [btrfs]
[  256.554678] [<ffffff8001c691a4>] btrfs_search_slot+0x1dc/0x9c0 [btrfs]
[  256.561340] [<ffffff8001c87a48>] btrfs_lookup_inode+0x60/0x118 [btrfs]
[  256.568009] [<ffffff8001cf2c48>] __btrfs_update_delayed_inode+0x78/0x268 [btrfs]
[  256.575567] [<ffffff8001cf32f4>] __btrfs_run_delayed_items.isra.0+0x15c/0x1d8 [btrfs]
[  256.583530] [<ffffff8001cf38b4>] btrfs_run_delayed_items+0x2c/0x38 [btrfs]
[  256.590558] [<ffffff8001c9307c>] btrfs_commit_transaction+0x2bc/0x9f8 [btrfs]
[  256.597825] [<ffffff8001c8e1f4>] transaction_kthread+0x1cc/0x208 [btrfs]
[  256.604530] [<ffffff80090cd698>] kthread+0xf8/0x110
[  256.609553] [<ffffff8009083950>] ret_from_fork+0x10/0x40
[  256.615012] Code: f9400280 f9400023 f9006fa3 d2800003 (b94046a1)
[  256.621387] ---[ end trace 4a7305cdff18d238 ]---

BTRFS is: 4.7.3

Code: Select all

# btrfs --version
btrfs-progs v4.7.3

The same happens with Ubuntu 18.04 LTS too.

How could be fixed this? Another version of btrfs-progs? Custom Kernel 5.x build?

[elatllat]

Yah, finding a 5.1 branch that is close to mainline is the best thing to do, that way if the issue persists you can report it upstream.

[xabolcs]

Looks like the BTRFS instability problem is gone with the 4.9.168+ update!

Code: Select all

root@odroid-stretch64:~# uname -a
Linux odroid-stretch64 4.9.168+ #1 SMP PREEMPT Thu Apr 18 08:53:21 CEST 2019 aarch64 GNU/Linux

Code: Select all

[13892.346459] BTRFS: device label emmcbtrfs devid 1 transid 5 /dev/mmcblk0p2
[14029.295254] BTRFS info (device mmcblk0p2): disk space caching is enabled
[14029.296499] BTRFS info (device mmcblk0p2): has skinny extents
[14029.303042] BTRFS info (device mmcblk0p2): flagging fs with big metadata feature
[14029.318766] BTRFS info (device mmcblk0p2): detected SSD devices, enabling SSD mode
[14029.321594] BTRFS info (device mmcblk0p2): creating UUID tree

Test on BTRFS subvolume on eMMC:

Code: Select all

root@odroid-stretch64:/mnt/p2# f3write h2w/
Free space: 116.21 GB
Creating file 1.h2w ... OK!                         
Creating file 2.h2w ... OK!                         
Creating file 3.h2w ... OK!                         
Creating file 4.h2w ... OK!                         
Creating file 5.h2w ... OK!                         
...
Creating file 110.h2w ... OK!                         
Creating file 111.h2w ... OK!                         
Creating file 112.h2w ... OK!                         
Creating file 113.h2w ... OK!                        
Creating file 114.h2w ... OK!                        
Creating file 115.h2w ... OK!                        
Creating file 116.h2w ... OK!                        
Free space: 795.74 MB
Average writing speed: 75.35 MB/s

Code: Select all

root@odroid-stretch64:/mnt/p2# f3read h2w/
                  SECTORS      ok/corrupted/changed/overwritten
Validating file 1.h2w ... 2097152/        0/      0/      0
Validating file 2.h2w ... 2097152/        0/      0/      0
Validating file 3.h2w ... 2097152/        0/      0/      0
Validating file 4.h2w ... 2097152/        0/      0/      0
Validating file 5.h2w ... 2097152/        0/      0/      0
Validating file 6.h2w ... 2097152/        0/      0/      0
...
Validating file 115.h2w ... 2097152/        0/      0/      0
Validating file 116.h2w ...  447748/        0/      0/      0

  Data OK: 115.21 GB (241620228 sectors)
Data LOST: 0.00 Byte (0 sectors)
	       Corrupted: 0.00 Byte (0 sectors)
	Slightly changed: 0.00 Byte (0 sectors)
	     Overwritten: 0.00 Byte (0 sectors)
Average reading speed: 143.72 MB/s

Code: Select all

root@odroid-stretch64:/mnt/p2/h2w# iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
	Iozone: Performance Test of File I/O
	        Version $Revision: 3.429 $
		Compiled for 64 bit mode.
		Build: linux 

	Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
	             Al Slater, Scott Rhine, Mike Wisner, Ken Goss
	             Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
	             Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
	             Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
	             Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
	             Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,
	             Vangel Bojaxhi, Ben England, Vikentsi Lapa.

	Run began: Wed Apr 24 00:07:49 2019

	Include fsync in write timing
	O_DIRECT feature enabled
	Auto Mode
	File size set to 102400 kB
	Record Size 4 kB
	Record Size 16 kB
	Record Size 512 kB
	Record Size 1024 kB
	Record Size 16384 kB
	Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
	Output is in kBytes/sec
	Time Resolution = 0.000001 seconds.
	Processor cache size set to 1024 kBytes.
	Processor cache line size set to 32 bytes.
	File stride size set to 17 * record size.
                                                              random    random     bkwd    record    stride                                    
              kB  reclen    write  rewrite    read    reread    read     write     read   rewrite      read   fwrite frewrite    fread  freread
          102400       4    18645    17473    18536    18576    14483    20623                                                          
          102400      16    39697    34144    50162    50373    42374    39984                                                          
          102400     512    77815    74817   105667   106074   105037    69614                                                          
          102400    1024    93629    75258   110760   110799   110421    90400                                                          
          102400   16384   116097   104527   132907   133695   133787   106414                                                          

iozone test complete.

[xabolcs]

Glad to hear that!
4.9.165 and 167 had a few BTRFS related patches and they might help to solve the problem.

[xabolcs]

I was able to reproduce the problem.

Will dig into the details.

[sbi]

I'm trying to get gentoo running on my N2 and also formatted the root partition as btrfs. I run into the same problem like you getting the kernel oops "unable to handle kernel null pointer dereference at virtual address 00000044" a few seconds after kernel boot is completed. I can see the first few lines of systemd before it crashes.

Right now I am running the 4.9.170+ kernel from hardkernel.

How do you get the kernel output out of your odroid? I don't have the uart serial adapter to connect to another pc.

I started to write down what I've done so far to get gentoo onto my N2 here https://wiki.gentoo.org/wiki/Odroid_N2

I love the idea to get the mainline (or something close to it) to run on the N2. With my xu4 I always ran the mainline kernel and was quite happy. A lot of improvements have happened to btrfs since the 4.9 kernel too.

[xabolcs]

I have no stable results of reproducing the crash.
I don't have USB-UART yet, so the most detailed message is the dmesg in the opening post.

I think it's related to the attached devices, but I'm really unsure. As you can see, there were working cases some posts above.

Thanks for the BTRFS root how-to!

[xabolcs]

sbi, did you try to run with the latest u-boot version (25)?

[sbi]

sbi, did you try to run with the latest u-boot version (25)?

Actually I don't know the uboot version as i took it from latest ubuntu image. I will check that when I am back home but for now one week of vacation.

BTW: very interesting is this work done by Neil Armstrong that is done to get basic N2 support into the mainline kernel. His patchset is already reviewed an will hopefully go into the 5.2 (this month?!)

[xabolcs]

About the mainline kernel: there is already a topic for it!
Any plan for basic mainline linux support?

And in the armbian support topic:

@brad
this working on my board
https://github.com/150balbes/Build-Armbian

you can build ubuntu 19.04 with linux 5.1rc1

... and ...:

@brad
I emailed to Neal and he said that he is focusing on g12a
then he will plan to add g12b to linux kernel and to u-boot
his estimation is for linux kernel 5.3 rc1

[sbi]

So finally my u-boot version

U-Boot 2015.01 (Mar 31 2019 - 08:22:28)

Any news or are you waiting until the problems solves itself?

The longer I was thinking about it I remembered that I had btrfs problems with the xu4 on the 4.9 kernel also. With a more recent kernel the problems were gone so I hope that the 5.2 kernel will solve our problem as welll

[xabolcs]

Yup!
I'm waiting for usb-uart is available again, and for a usable mainline kernel!

[elatllat]

using upstream kernel and Ubuntu

Code: Select all

dd if=/dev/zero of=~/test.dev bs=1M count=100
losetup -f ~/test.dev
mkfs.btrfs -L test /dev/loop0
mount /dev/loop0 /media/test
echo ok > /media/test/ok.txt
sleep 60

results in no issues

Code: Select all

N2> dmesg | grep -A 99 Btrfs
[ 1496.601212] Btrfs loaded, crc32c=crc32c-generic
[ 1496.602064] BTRFS: device label test devid 1 transid 5 /dev/loop0
[ 1596.365427] BTRFS info (device loop0): disk space caching is enabled
[ 1596.365435] BTRFS info (device loop0): has skinny extents
[ 1596.365438] BTRFS info (device loop0): flagging fs with big metadata feature
[ 1596.368009] BTRFS info (device loop0): enabling ssd optimizations
[ 1596.368358] BTRFS info (device loop0): creating UUID tree
N2> uname -r
5.3.0-rc2-next-20190730
N2> btrfs --version
btrfs-progs v4.15.1

[sbi]

I am also experimenting with the mainline kernel but had some issues. Three or four times my btrfs fs got broken. First I thought that it was related to unclean shutdowns but yesterday my system didn't boot even it was properly shut down. I suspect my micro sdcard right know so I've ordered a new one and will try with that.

Besides this problem I hadn't any issues with btrfs yet.

[xabolcs]

elatllat, thanks for the steps, will test them on odroid's kernel too.

[xabolcs]

I was able to reproduce the problem.

Will dig into the details.

I was unable to reproduce on eMMC with odroid's latest kernel.
I was able to reproduce on USB disk (native btrfs partition, btrfs partition on a RAID 10 volume) with odroid's kernel, so I think it's related to Syncing two UAS devices causes Ubuntu to hang topic.

Adding the "usb-xhci.tablesize=2" parameter to command line only, and leaving the IRQs intact, the "IRQRatio" messages pop up, and also the bug.

Code: Select all

[  383.679702] IRQRatio___ERR.irq:22 ratio:41
[  383.679731] t_isr:415  t_total:1000, cnt:11546
[  385.682961] IRQRatio___ERR.irq:22 ratio:40
[  385.682990] t_isr:408  t_total:1000, cnt:11513
[  386.686203] IRQRatio___ERR.irq:22 ratio:38
[  386.686231] t_isr:389  t_total:1000, cnt:11138
[  387.689446] IRQRatio___ERR.irq:22 ratio:38
[  387.689474] t_isr:387  t_total:1000, cnt:10884
[  393.757028] IRQRatio___ERR.irq:22 ratio:41
[  393.757055] t_isr:413  t_total:1000, cnt:11586
[  396.767973] IRQRatio___ERR.irq:22 ratio:41
[  396.768003] t_isr:411  t_total:1000, cnt:11959
[  398.771227] IRQRatio___ERR.irq:22 ratio:40
[  398.771254] t_isr:407  t_total:1000, cnt:11611
[  402.820798] IRQRatio___ERR.irq:22 ratio:41
[  402.820826] t_isr:413  t_total:1000, cnt:11788
[  407.841000] IRQRatio___ERR.irq:22 ratio:39
[  407.841027] t_isr:394  t_total:1000, cnt:11041
[  410.619760] Unable to handle kernel NULL pointer dereference at virtual address 00000044
[  410.622400] pgd = ffffffc0c7977000
[  410.626537] [0000000000000044] *pgd=0000000000000000, *pud=0000000000000000
[  410.643653] Internal error: Oops: 96000005 [#1] PREEMPT SMP
[  410.645897] Modules linked in: raid10 md_mod btrfs raid6_pq xor rtc_pcf8563 mali_kbase i2c_meson_master ip_tables x_tables ipv6
[  410.657511] CPU: 1 PID: 2228 Comm: btrfs-transacti Not tainted 4.9.185+ #1
[  410.664528] Hardware name: Hardkernel ODROID-N2 (DT)
[  410.669643] task: ffffffc0ca3e5400 task.stack: ffffffc0c5088000
[  410.675718] PC is at __do_page_cache_readahead+0x58/0x2a8
[  410.681257] LR is at ondemand_readahead+0x13c/0x278
[  410.686281] pc : [<ffffff80091d5720>] lr : [<ffffff80091d5aac>] pstate: 20000145
[  410.693820] sp : ffffffc0c508b480
[  410.697286] x29: ffffffc0c508b480 x28: ffffffc09e0381f0

I was unable to reproduce the issue with mainline kernel 5.3.0-rc2-next-20190730 on USB (native and RAID10 partition).

[ollil]

Hello xabolcs,

is there a documentation / how to install / get the mainline kernel 5.3.0-rc2-next-20190730?

best regards,

olli

[elatllat]

...how to install / get the mainline kernel...

viewtopic.php?f=176&t=33993&start=300#p263225

[ollil]

Thank you elatllat.
I'll try the kernel next week.