[Bug 1646565] Re: GPF when removing lots of files from hfsplus partition
Is HFS+ support broken in Linux since 4.9? Can we have this officially acknowledged here? It's a high ranking result. For what it's worth, mounting large HFS+ volumes, like this Drobo I own, just hangs: uname -a Linux hiddenswitch-2 4.19.66-v7+ #1253 SMP Thu Aug 15 11:49:46 BST 2019 armv7l GNU/Linux Dec 7 03:14:24 hiddenswitch-2 kernel: [ 59.131448] usb 1-1.1.2: new high-speed USB device number 5 using dwc_otg Dec 7 03:14:24 hiddenswitch-2 kernel: [ 59.262082] usb 1-1.1.2: New USB device found, idVendor=19b9, idProduct=4d10 Dec 7 03:14:24 hiddenswitch-2 kernel: [ 59.262089] usb 1-1.1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3 Dec 7 03:14:24 hiddenswitch-2 kernel: [ 59.262093] usb 1-1.1.2: Product: Drobo Dec 7 03:14:24 hiddenswitch-2 kernel: [ 59.262097] usb 1-1.1.2: Manufacturer: Data Robotics Inc. Dec 7 03:14:24 hiddenswitch-2 kernel: [ 59.262100] usb 1-1.1.2: SerialNumber: 0DB100221405 Dec 7 03:14:24 hiddenswitch-2 kernel: [ 59.337663] usb-storage 1-1.1.2:1.0: USB Mass Storage device detected Dec 7 03:14:24 hiddenswitch-2 kernel: [ 59.338383] scsi host0: usb-storage 1-1.1.2:1.0 Dec 7 03:14:25 hiddenswitch-2 kernel: [ 60.392032] scsi 0:0:0:0: Direct-Access TRUSTED Mass Storage 2.00 PQ: 0 ANSI: 5 Dec 7 03:14:25 hiddenswitch-2 kernel: [ 60.392751] sd 0:0:0:0: [sda] Very big device. Trying to use READ CAPACITY(16). Dec 7 03:14:25 hiddenswitch-2 kernel: [ 60.392996] sd 0:0:0:0: [sda] 34359738368 512-byte logical blocks: (17.6 TB/16.0 TiB) Dec 7 03:14:25 hiddenswitch-2 kernel: [ 60.393375] sd 0:0:0:0: [sda] Write Protect is off Dec 7 03:14:25 hiddenswitch-2 kernel: [ 60.393380] sd 0:0:0:0: [sda] Mode Sense: 03 00 00 00 Dec 7 03:14:25 hiddenswitch-2 kernel: [ 60.393827] sd 0:0:0:0: [sda] No Caching mode page found Dec 7 03:14:25 hiddenswitch-2 kernel: [ 60.393835] sd 0:0:0:0: [sda] Assuming drive cache: write through Dec 7 03:14:25 hiddenswitch-2 kernel: [ 60.403220] sd 0:0:0:0: Attached scsi generic sg0 type 0 Dec 7 03:14:53 hiddenswitch-2 kernel: [ 88.767530] sda: sda1 sda2 sda3 Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667794] INFO: task mount:2282 blocked for more than 120 seconds. Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667800] Tainted: G C 4.14.79-v7+ #1159 Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667802] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667806] mount D0 2282 2278 0x0001 Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667831] [<8079ef70>] (__schedule) from [<8079f5d8>] (schedule+0x50/0xa8) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667840] [<8079f5d8>] (schedule) from [<8079fa50>] (schedule_preempt_disabled+0x18/0x1c) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667848] [<8079fa50>] (schedule_preempt_disabled) from [<807a1358>] (__mutex_lock.constprop.3+0x190/0x58c) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667857] [<807a1358>] (__mutex_lock.constprop.3) from [<807a1870>] (__mutex_lock_slowpath+0x1c/0x20) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667865] [<807a1870>] (__mutex_lock_slowpath) from [<807a18d0>] (mutex_lock+0x5c/0x60) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667874] [<807a18d0>] (mutex_lock) from [<802cbc00>] (__blkdev_get+0x70/0x44c) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667882] [<802cbc00>] (__blkdev_get) from [<802cbd88>] (__blkdev_get+0x1f8/0x44c) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667889] [<802cbd88>] (__blkdev_get) from [<802cc1ec>] (blkdev_get+0x210/0x378) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667896] [<802cc1ec>] (blkdev_get) from [<802cc938>] (blkdev_get_by_path+0x60/0x98) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667904] [<802cc938>] (blkdev_get_by_path) from [<8028e2b4>] (mount_bdev+0x40/0x19c) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667930] [<8028e2b4>] (mount_bdev) from [<7f7080e4>] (hfsplus_mount+0x28/0x30 [hfsplus]) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667973] [<7f7080e4>] (hfsplus_mount [hfsplus]) from [<8028f320>] (mount_fs+0x24/0xb8) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667981] [<8028f320>] (mount_fs) from [<802acf08>] (vfs_kern_mount+0x58/0x110) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667989] [<802acf08>] (vfs_kern_mount) from [<802b0788>] (do_mount+0x174/0xbd4) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.667996] [<802b0788>] (do_mount) from [<802b1538>] (SyS_mount+0x84/0xac) Dec 7 03:17:28 hiddenswitch-2 kernel: [ 243.668005] [<802b1538>] (SyS_mount) from [<80108000>] (ret_fast_syscall+0x0/0x28) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1646565 Title: GPF when removing lots of files from hfsplus partition To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1646565/+subscriptions -- ubu
[Bug 1646565] Re: GPF when removing lots of files from hfsplus partition
Are there any work-arounds or planned fixes to this problem? I'm getting the same fault when deleting a large number of files from a directory using the following bash shell script; mkdir test_dir; for i in {1..300}; do touch test_dir/$i; done ; rm /test_dir/* After this, fsck cannot fix the HFS+ partition, meaning all files are lost. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1646565 Title: GPF when removing lots of files from hfsplus partition To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1646565/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1646565] Re: GPF when removing lots of files from hfsplus partition
Hi, for me this problem persists in 4.9.0 (compiled myself, on debian8). It's reproducible: create new empty filesystem, add files, delete files --> leading to a segfault and unrecoverable corruption of the filesystem. I tried this on two different hard drives, so I would exclude the possibility of a hardware failure. see attached part of kern.log. cheers, lukas Jan 9 14:33:00 debianPro kernel: [ 338.991315] hfsplus: trying to free free bnode 0(1) Jan 9 14:33:00 debianPro kernel: [ 338.991320] hfsplus: trying to free free bnode 0(1) Jan 9 14:33:00 debianPro kernel: [ 338.991329] hfsplus: trying to free free bnode 0(1) Jan 9 14:33:00 debianPro kernel: [ 338.991349] general protection fault: [#1] SMP Jan 9 14:33:00 debianPro kernel: [ 338.991374] Modules linked in: bnep binfmt_misc dm_crypt af_alg nls_iso8859_1 nls_cp437 vfat fat btusb btrtl btbcm btintel nls_utf8 hfsplus bluetooth input_leds arc4 hid_generic hid_apple ssb bcm5974 mac80211 cfg80211 usbhid hid applesmc input_polldev iTCO_wdt iTCO_vendor_support x86_pkg_temp_thermal coretemp kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw glue_helper uvcvideo videobuf2_vmalloc videobuf2_memops snd_pcsp videobuf2_v4l2 videobuf2_core videodev i2c_i801 i2c_smbus bcma snd_hda_codec_hdmi snd_hda_codec_cirrus thunderbolt snd_hda_codec_generic i915 fbcon bitblit softcursor tileblit intel_gtt snd_hda_intel apple_gmux snd_hda_codec snd_hda_core drm_kms_helper snd_hwdep snd_pcm_oss drm snd_mixer_oss snd_pcm video i2c_algo_bit fb_sys_fops snd_timer Jan 9 14:33:00 debianPro kernel: [ 338.991744] syscopyarea snd sysfillrect apple_bl sysimgblt soundcore tpm_tis lpc_ich shpchp tpm_tis_core tpm firewire_sbp2 fuse ppdev lp parport crc32c_intel firewire_ohci firewire_core crc_itu_t sdhci_pci sdhci led_class ahci tg3 ptp libahci pps_core xhci_pci xhci_hcd [last unloaded: b43] Jan 9 14:33:00 debianPro kernel: [ 338.991885] CPU: 1 PID: 6238 Comm: rm Not tainted 4.9.0 #1 Jan 9 14:33:00 debianPro kernel: [ 338.991908] Hardware name: Apple Inc. MacBookPro9,2/Mac-6F01561E16C75D06, BIOS MBP91.88Z.00D3.B0C.1509111653 09/11/2015 Jan 9 14:33:00 debianPro kernel: [ 338.991950] task: 88042df2d780 task.stack: c90008e04000 Jan 9 14:33:00 debianPro kernel: [ 338.991973] RIP: 0010:[] [] hfsplus_bnode_write+0x94/0x115 [hfsplus] Jan 9 14:33:00 debianPro kernel: [ 338.992014] RSP: 0018:c90008e07c00 EFLAGS: 00010286 Jan 9 14:33:00 debianPro kernel: [ 338.992035] RAX: 8800 RBX: 0002 RCX: 0002 Jan 9 14:33:00 debianPro kernel: [ 338.992063] RDX: 1600 RSI: c90008e07c56 RDI: ffe7091333456000 Jan 9 14:33:00 debianPro kernel: [ 338.992090] RBP: c90008e07c40 R08: c90008e07c24 R09: 88044ccd10d0 Jan 9 14:33:00 debianPro kernel: [ 338.992118] R10: ea0011333440 R11: R12: ffe7091333456000 Jan 9 14:33:00 debianPro kernel: [ 338.992146] R13: 88044ccd1120 R14: 0002 R15: ffe7091333456000 Jan 9 14:33:00 debianPro kernel: [ 338.992175] FS: 7f018ffbb700() GS:88046f28() knlGS: Jan 9 14:33:00 debianPro kernel: [ 338.992206] CS: 0010 DS: ES: CR0: 80050033 Jan 9 14:33:00 debianPro kernel: [ 338.992229] CR2: 00c7c118 CR3: 00045c8ec000 CR4: 001406e0 Jan 9 14:33:00 debianPro kernel: [ 338.992257] Stack: Jan 9 14:33:00 debianPro kernel: [ 338.992268] 88044ccd10d0 1600 c90008e07c56 88044ccd10c0 Jan 9 14:33:00 debianPro kernel: [ 338.992304] c90008e07ce0 1ffc 0048 1ff4 Jan 9 14:33:00 debianPro kernel: [ 338.992340] c90008e07c58 a0dad82f c6ff000e c90008e07c98 Jan 9 14:33:00 debianPro kernel: [ 338.992374] Call Trace: Jan 9 14:33:00 debianPro kernel: [ 338.992389] [] hfsplus_bnode_write_u16+0x22/0x24 [hfsplus] Jan 9 14:33:00 debianPro kernel: [ 338.992421] [] hfsplus_brec_remove+0x10d/0x15b [hfsplus] Jan 9 14:33:00 debianPro kernel: [ 338.992453] [] __hfsplus_delete_attr+0x99/0xc0 [hfsplus] Jan 9 14:33:00 debianPro kernel: [ 338.992481] [] hfsplus_delete_all_attrs+0x8b/0xa7 [hfsplus] Jan 9 14:33:00 debianPro kernel: [ 338.992510] [] hfsplus_delete_cat+0x297/0x2ba [hfsplus] Jan 9 14:33:00 debianPro kernel: [ 338.992539] [] hfsplus_unlink+0xdc/0x19e [hfsplus] Jan 9 14:33:00 debianPro kernel: [ 338.992566] [] ? __inode_permission+0x82/0xa4 Jan 9 14:33:00 debianPro kernel: [ 338.992590] [] vfs_unlink+0xe1/0x172 Jan 9 14:33:00 debianPro kernel: [ 338.992612] [] do_unlinkat+0x10e/0x218 Jan 9 14:33:00 debianPro kernel: [ 338.992635] [] SyS_unlinkat+0x29/0x2b Jan 9 14:33:00 debianPro kernel: [ 338.992657] [] entry_SYSCALL_64_fastpath+0x13/0x94 Jan 9 14:33:00 debianPro kernel: [ 338.992683] Code: 00 00 00 00 00 88 ff ff 48 8b 75 d0 49 01 d7 4c 8b 4d c0 48 63 cb 49 c1 ff 06 48 89 5
[Bug 1646565] Re: GPF when removing lots of files from hfsplus partition
I have not been running Ubuntu on this machine so can't say if it works on any earlier version. I verified that the problem is still there with mainline kernel v4.9-rc7. After this problem happens it is not possible to unmount the drive so I am not able to reboot the machine properly. After a power button forced reboot running fsck reports errors like this: fsck från util-linux 2.28.2 ** /dev/sdc2 Using cacheBlockSize=32K cacheTotalBlock=1024 cacheSize=32768K. ** Checking HFS Plus volume. ** Detected a case-sensitive catalog. ** Checking Extents Overflow file. ** Checking Catalog file. ** Checking Catalog hierarchy. Invalid directory item count (It should be 0 instead of 80) Invalid directory item count (It should be 1 instead of 11) Invalid directory item count (It should be 8 instead of 12) ** Checking Extended Attributes file. Invalid sibling link (8, 65) ** Volume check failed. volume check failed with error 7 volume type is pure HFS+ primary MDB is at block 0 0x00 alternate MDB is at block 0 0x00 primary VHB is at block 2 0x02 alternate VHB is at block 5859651494 0x15d432fa6 sector size = 512 0x200 VolumeObject flags = 0x07 total sectors for volume = 5859651496 0x15d432fa8 total sectors for embedded volume = 0 0x00 Don't know if it's caused by this reported bug or by the power button shutdown. I repaired the disk with Mac OS disk utility and verified that fsck in Ubuntu finds it OK again. Then ran the "test" once again. The problem happened again so crash is not because of existing file system errors. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1646565 Title: GPF when removing lots of files from hfsplus partition To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1646565/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1646565] Re: GPF when removing lots of files from hfsplus partition
** Changed in: linux (Ubuntu) Status: Incomplete => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1646565 Title: GPF when removing lots of files from hfsplus partition To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1646565/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1646565] Re: GPF when removing lots of files from hfsplus partition
** Tags added: kernel-bug-exists-upstream -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1646565 Title: GPF when removing lots of files from hfsplus partition To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1646565/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1646565] Re: GPF when removing lots of files from hfsplus partition
Did this issue start happening after an update/upgrade? Was there a prior kernel version where you were not having this particular problem? Would it be possible for you to test the latest upstream kernel? Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Please test the latest v4.9 kernel[0]. If this bug is fixed in the mainline kernel, please add the following tag 'kernel-fixed-upstream'. If the mainline kernel does not fix this bug, please add the tag: 'kernel-bug-exists-upstream'. Once testing of the upstream kernel is complete, please mark this bug as "Confirmed". Thanks in advance. [0] http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.9-rc7 ** Changed in: linux (Ubuntu) Importance: Undecided => Medium ** Changed in: linux (Ubuntu) Status: Confirmed => Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1646565 Title: GPF when removing lots of files from hfsplus partition To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1646565/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs