Re: NTFS corruption with Fedora 37 and 38

2023-08-02 Thread Richard W.M. Jones
On Tue, Aug 01, 2023 at 07:51:29PM +0200, Michael Schwendt wrote:
> On Mon, 31 Jul 2023 18:50:30 +0100, Richard W.M. Jones wrote:
> 
> > Did you get to the bottom of what's really happening here?
> 
> As in the message that opened this topic, it is suspected that there
> has been a change to mount with kernel ntfs3 instead of ntfs-3g.
> 
> I remember I've not had corruption with fuse/ntfs-3g, but for some time
> with Fedora 37 and 38, ntfs3 is used. Test with an USB drive:
> 
> # mount|grep -i ntfs
> /dev/sda1 on /run/media/ms38/HD-PCU2 type ntfs3 
> (rw,nosuid,nodev,relatime,uid=1000,gid=1000,windows_names,iocharset=utf8,uhelper=udisks2)
> 
> # lsmod|grep -i ntfs
> ntfs3 323584  1
> 
> > We use and test ntfs-3g
> > extensively and have not seen any reports of corruption.
> 
> Right, but it is kernel ntfs3 that causes the corruption. Even if only
> copying a single folder to a drive and unmounting + safe-removing the drive
> with Nautilus.

Thanks - it wasn't clear from the thread that the "suspicion" that
ntfs3.ko was involved was actually proven, but the above is proof.

Did anyone file a bug?

Rich.

-- 
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
Read my programming and virtualization blog: http://rwmj.wordpress.com
virt-top is 'top' for virtual machines.  Tiny program with many
powerful monitoring features, net stats, disk stats, logging, etc.
http://people.redhat.com/~rjones/virt-top
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: NTFS corruption with Fedora 37 and 38

2023-08-01 Thread Michael Schwendt
On Mon, 31 Jul 2023 18:50:30 +0100, Richard W.M. Jones wrote:

> Did you get to the bottom of what's really happening here?

As in the message that opened this topic, it is suspected that there
has been a change to mount with kernel ntfs3 instead of ntfs-3g.

I remember I've not had corruption with fuse/ntfs-3g, but for some time
with Fedora 37 and 38, ntfs3 is used. Test with an USB drive:

# mount|grep -i ntfs
/dev/sda1 on /run/media/ms38/HD-PCU2 type ntfs3 
(rw,nosuid,nodev,relatime,uid=1000,gid=1000,windows_names,iocharset=utf8,uhelper=udisks2)

# lsmod|grep -i ntfs
ntfs3 323584  1

> We use and test ntfs-3g
> extensively and have not seen any reports of corruption.

Right, but it is kernel ntfs3 that causes the corruption. Even if only
copying a single folder to a drive and unmounting + safe-removing the drive
with Nautilus.
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: NTFS corruption with Fedora 37 and 38

2023-07-31 Thread Richard W.M. Jones
On Sun, Jul 30, 2023 at 10:54:01AM +0200, Michael Schwendt wrote:
> On Tue, 25 Jul 2023 16:29:20 +0200, Ralf Corsépius wrote:
> 
> > [1] I've only sporadically used NTFS, before, but for a couple of weeks, 
> > I had to use it more frequently.
> 
> I would also call my usage "sporadic" (accessing NTFS USB sticks and
> camera SD cards), but the worst symptoms I've had ever had before was
> default auto-mounting in Nautilus offering only a read-only mount. Never
> corruption while simply copying a single folder to NTFS (and, btw,
> correctly unmounting and safe-removing the media).

Did you get to the bottom of what's really happening here?  If you're
using ntfs-3g (the FUSE module) there should be a process called
ntfs-3g (see 'ps ax' output).  If you're using ntfs3.ko (the kernel
module) then 'lsmod' output should show this.  We use and test ntfs-3g
extensively and have not seen any reports of corruption.

> A bit of Google searching suggests ntfs-3g has been the more stable but
> slower solution so far.

ntfs-3g is far more mature, and it's highly unlikely you'll notice any
speed difference unless you're copying gigantic files.

> Here's another Fedora 38 user reporting corruption:
> https://unix.stackexchange.com/questions/751529/ntfsfix-volume-is-corrupt-you-should-run-chkdsk-even-after-chkdsk

Rich.

-- 
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
Read my programming and virtualization blog: http://rwmj.wordpress.com
nbdkit - Flexible, fast NBD server with plugins
https://gitlab.com/nbdkit/nbdkit
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: NTFS corruption with Fedora 37 and 38

2023-07-30 Thread Michael Schwendt
On Tue, 25 Jul 2023 16:29:20 +0200, Ralf Corsépius wrote:

> [1] I've only sporadically used NTFS, before, but for a couple of weeks, 
> I had to use it more frequently.

I would also call my usage "sporadic" (accessing NTFS USB sticks and
camera SD cards), but the worst symptoms I've had ever had before was
default auto-mounting in Nautilus offering only a read-only mount. Never
corruption while simply copying a single folder to NTFS (and, btw,
correctly unmounting and safe-removing the media).

A bit of Google searching suggests ntfs-3g has been the more stable but
slower solution so far.

Here's another Fedora 38 user reporting corruption:
https://unix.stackexchange.com/questions/751529/ntfsfix-volume-is-corrupt-you-should-run-chkdsk-even-after-chkdsk
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: NTFS corruption with Fedora 37 and 38

2023-07-25 Thread Ralf Corsépius

Am 25.07.23 um 13:29 schrieb Michael Schwendt:

Trying to figure out what has changed in Fedora land that causes NTFS
corruption for some time. This is with default workstation with GNOME
Shell auto-mounting external storage media when plugging them in.

A ticket in bugzilla suggests there has been a changed from ntfs-3g to ntfs3:

https://bugzilla.redhat.com/2182206
( udisks switched to kernel ntfs3 driver instead of ntfs-3g for mounting ntfs 
since the kernel 6.2 update )

The current state of development is highly dangerous.
It could be random coincidence[1], but since Sunday (the date I updated 
kernel-6.4.4), I had 2 serious NTFS corruptions on an external USB-disk.


Win11 was able to repair the first one (Fedora was not), but the second 
one was fatal. Both Linux and Win11 refused any operation on the file 
system. I resorted to reformating.


Ralf

[1] I've only sporadically used NTFS, before, but for a couple of weeks, 
I had to use it more frequently.

___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


NTFS corruption with Fedora 37 and 38

2023-07-25 Thread Michael Schwendt
Trying to figure out what has changed in Fedora land that causes NTFS
corruption for some time. This is with default workstation with GNOME
Shell auto-mounting external storage media when plugging them in.

A ticket in bugzilla suggests there has been a changed from ntfs-3g to ntfs3:

https://bugzilla.redhat.com/2182206
( udisks switched to kernel ntfs3 driver instead of ntfs-3g for mounting ntfs 
since the kernel 6.2 update )

The current state of development is highly dangerous.
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue