Re: [DNG] How to mount NTFS(and create an computing museum?)
g4sra : Anybody with a computer museum wanna give me a job ? Hi, I've got a bunch of historical computers of different sorts(most of them are working fine), pieces, documentations, magazines, books, ads... and dream about such a place too(especially with fully working NeXT stations!!!)! Good old times when computing was fun. But I'm sure it couldn't work without being paid by public money. -- Sincerely, Stephane Ascoet ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
Quoting Hendrik Boom (hend...@topoi.pooq.com): > Isn't there another FAT? called something like exfat? WHich is > required (only by spec) for sd cards above a specific size? Yes. https://en.wikipedia.org/wiki/ExFAT -- Cheers, "My hot flight attendant asked how I like my coffee. Rick Moen And that's when she told me: 'That's cute, honey, but r...@linuxmafia.com the coffee's free. You don't have to pay for it, here." McQ! (4x80)(seen on Twitter) ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Sun, Aug 09, 2020 at 03:33:19PM -0700, Rick Moen wrote: > Quoting Simon Hobson (li...@thehobsons.co.uk): > > > I have a suggestion ... > > Create a small partition in NTFS or Fat, and put some files on there > > saying what else is on the drive - and some hints on how to access it. > > Well, and (assuming this drive is in an external case) attach ruggedly > to the case a prominent note explaining what the drive contains and > what file within, in which one can find further details. > > I've gone through variants of this problem, and you as a planner need to > ensure that anyone casually looking at the object can grasp the essence > of the problem within a few seconds of glancing, and motivate him/her to > get the object to an appropriate person. > > Usually prominent in such plans is a sealed envelope, entrusted to > someone believed reliable, that says 'Open in the event of $PERSON'S > death or incapacitation.' > > On reflection, maybe further measures are in order, like two or three > other people having similar sealed envelopes that, when open, reveal > only a note in red lettering saying 'Tell $BELIEVED_RELIABLE_PERSON to > open his damned envelope already.' Or several such sealed envelopes, each with full instructions about the disk drive, each in costody of a different trusted person living at a different place. In case one of the envelopes is mislaid or destroyed in a house fire. Maybe even a few off-site backups as well. -- hendrik > > -- > Cheers, "My hot flight attendant asked how I like my coffee. > Rick Moen And that's when she told me: 'That's cute, honey, > but > r...@linuxmafia.com the coffee's free. You don't have to pay for it, > here." > McQ! (4x80)(seen on Twitter) > ___ > Dng mailing list > Dng@lists.dyne.org > https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Sun, Aug 09, 2020 at 03:38:32PM -0700, Rick Moen wrote: > Quoting Haines Brown (hai...@histomat.net): > > > With a sector of 512 bytes, it fat32 is apparently limit to 2 Tb. I'm > > unclear whether a limit on the number of files becomes a problem. Vfat > > might be analternative. > > VFAT _is_ FAT32, just with a very dodgy long-filename extension. Isn't there another FAT? called something like exfat? WHich is required (only by spec) for sd cards above a specific size? -- hendrik > > Of possible historical interest: The user group editorial from > 1995 when I sleuthed out the fairly ghastly details: > http://linuxmafia.com/faq/Legacy_Microsoft/win95-bn.html#vfat > ___ > Dng mailing list > Dng@lists.dyne.org > https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
Quoting Haines Brown (hai...@histomat.net): > With a sector of 512 bytes, it fat32 is apparently limit to 2 Tb. I'm > unclear whether a limit on the number of files becomes a problem. Vfat > might be analternative. VFAT _is_ FAT32, just with a very dodgy long-filename extension. Of possible historical interest: The user group editorial from 1995 when I sleuthed out the fairly ghastly details: http://linuxmafia.com/faq/Legacy_Microsoft/win95-bn.html#vfat ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
Quoting Simon Hobson (li...@thehobsons.co.uk): > I have a suggestion ... > Create a small partition in NTFS or Fat, and put some files on there > saying what else is on the drive - and some hints on how to access it. Well, and (assuming this drive is in an external case) attach ruggedly to the case a prominent note explaining what the drive contains and what file within, in which one can find further details. I've gone through variants of this problem, and you as a planner need to ensure that anyone casually looking at the object can grasp the essence of the problem within a few seconds of glancing, and motivate him/her to get the object to an appropriate person. Usually prominent in such plans is a sealed envelope, entrusted to someone believed reliable, that says 'Open in the event of $PERSON'S death or incapacitation.' On reflection, maybe further measures are in order, like two or three other people having similar sealed envelopes that, when open, reveal only a note in red lettering saying 'Tell $BELIEVED_RELIABLE_PERSON to open his damned envelope already.' -- Cheers, "My hot flight attendant asked how I like my coffee. Rick Moen And that's when she told me: 'That's cute, honey, but r...@linuxmafia.com the coffee's free. You don't have to pay for it, here." McQ! (4x80)(seen on Twitter) ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
Haines Brown wrote: > I left the drive NTFS because I wanted easy access to the drive for folks > (granschildren) who do not run Linux. > > Othersie I prefer ext4. When you say NTFS is slower, to you mean three times > slower (which I am experiencing) or a bit slower? In my experience, as already said, very significantly slower - so yes, could easily be the /3 performance hit you've observed. I have a suggestion ... Create a small partition in NTFS or Fat, and put some files on there saying what else is on the drive - and some hints on how to access it. The way things are, it is highly unlikely that none of the intended recipients would not know anyone with the skills and ability to read the backups - as long as they (your descendants) actually know what to ask. So yes, if you just have an EXT4 partition, they'll have no idea - if they get a small disk with notes saying "the files are on another partition - find someone who knows Linux or [list of other OSs that handle EXT4], or find software for your Windows machine that can handle it (it does exist), then they'll have the basic information to get at your files. PS - yes, I second the suggestion for rsync. Simon ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Sun, Aug 09, 2020 at 03:04:12PM -0400, Haines Brown wrote: > On Sun, Aug 09, 2020 at 05:33:16PM +0100, g4sra via Dng wrote: > > > > My bad, changed from '#!/bin/bash' syntax to '#!/bin/sh' > > > > # this must follow immediately after the mount command > > if [ $? -ne 0 ]; then > > echo "Mount Failed!" > > exit 1 > > fi > > I'll give it a try. Thanks. > > > Easy access to files is exactly why I use 'rsync', no need to go down the > > painful > > 'restore master backup' followed by 'restore all further incremental > > backups'. > > Plus it only copies as required and optionally backs up the backup. > > So you get protection against 'User' error as well as device failure. > > Trust me on this, read the 'rsync' manual. > > I'll look into that. And there's rdiff-backup. It's the one I use. Keeps old versions of files as well as new ones. The latest version is just there in the file system, as if everything just got copied there. I've oftern been able to restore single files with the normal shell tools. There are mechanisms whereby it can save pernissions, attributes and the like even if the backup file system doesn't handle them itself If yo use rdiff-backup to restore files instead of just cp, it will find and restore these extras as well. And it will also do backups over the net if you have rdiff-backup available on two hosts. When on of my machines USB ports failed, I could happily run my backups from my laptop, connecting to the failing machine by rdiff-backup over ssh. Not as fast, but it worked. -- hendrik > -- > Haines Brown > ___ > Dng mailing list > Dng@lists.dyne.org > https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Sun, Aug 09, 2020 at 05:33:16PM +0100, g4sra via Dng wrote: > > My bad, changed from '#!/bin/bash' syntax to '#!/bin/sh' > > # this must follow immediately after the mount command > if [ $? -ne 0 ]; then > echo "Mount Failed!" > exit 1 > fi I'll give it a try. Thanks. > Easy access to files is exactly why I use 'rsync', no need to go down the > painful > 'restore master backup' followed by 'restore all further incremental backups'. > Plus it only copies as required and optionally backs up the backup. > So you get protection against 'User' error as well as device failure. > Trust me on this, read the 'rsync' manual. I'll look into that. -- Haines Brown ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Sun, Aug 09, 2020 at 01:38:57PM -0400, Hendrik Boom wrote: > On Sun, Aug 09, 2020 at 12:02:37PM -0400, Haines Brown wrote: > > On Sat, Aug 08, 2020 at 12:11:46AM +0200, Harald Arnesen via Dng wrote: > > > Haines Brown [07.08.2020 18:19]: > > > > > > > Yes, for sure. If you are right about the speed difference between > > > > NTFS and ext4, then is there another FS that can be accessed by a > > > > Windows machine that is not much slower than ext4? > > > > > > fat32. Or if you run a recent kernel on your Linux machine (Devuan 5.4 > > > is ok), then exfat. > > > -- > > > Hilsen Harald > > > > Hilsen, going to fat32 might be my bset bet if its speed is more like > > ext4 than ntfs. Is it the consensus that this is the case? > > Isn't there a limit on the number of data blocks you can have > on a FAT volume? > Meaning that for large volumes you end up with absurdly large blocks. > And because you can't pack multiple files into a data block, this limits > the number of files you can have. With a sector of 512 bytes, it fat32 is apparently limit to 2 Tb. I'm unclear whether a limit on the number of files becomes a problem. Vfat might be analternative. > > -- hendrik > ___ > Dng mailing list > Dng@lists.dyne.org > https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng -- Haines Brown ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Sun, Aug 09, 2020 at 12:02:37PM -0400, Haines Brown wrote: > On Sat, Aug 08, 2020 at 12:11:46AM +0200, Harald Arnesen via Dng wrote: > > Haines Brown [07.08.2020 18:19]: > > > > > Yes, for sure. If you are right about the speed difference between > > > NTFS and ext4, then is there another FS that can be accessed by a > > > Windows machine that is not much slower than ext4? > > > > fat32. Or if you run a recent kernel on your Linux machine (Devuan 5.4 > > is ok), then exfat. > > -- > > Hilsen Harald > > Hilsen, going to fat32 might be my bset bet if its speed is more like > ext4 than ntfs. Is it the consensus that this is the case? Isn't there a limit on the number of data blocks you can have on a FAT volume? Meaning that for large volumes you end up with absurdly large blocks. And because you can't pack multiple files into a data block, this limits the number of files you can have. -- hendrik ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On 09/08/2020 16:55, Haines Brown wrote:
> On Sat, Aug 08, 2020 at 02:53:13PM +0100, g4sra via Dng wrote:
>> 3) abort if the mount fails
>> [ $? -eq 0 ] || {echo "Mount Failed!"; exit 1;}
>
> I put this line into my backup script and only got a syntax error.
My bad, changed from '#!/bin/bash' syntax to '#!/bin/sh'
# this must follow immediately after the mount command
if [ $? -ne 0 ]; then
echo "Mount Failed!"
exit 1
fi
>>
>> You are backing up files that have not changed since the last backup.
>> Do you really need all of that kerfuffle ?
>
> The only price paid for the "kerfuffle" is the expense of a large
> backup disk and the extra time that a backup takes in the backgroundñ.
> In the past (back in my OS/2 days) I did incremental backups, but
> since then like easy access to files that have not changed. Of course
> the majority of people are not inclinded to see thigs this way.
>
Easy access to files is exactly why I use 'rsync', no need to go down the
painful
'restore master backup' followed by 'restore all further incremental backups'.
Plus it only copies as required and optionally backs up the backup.
So you get protection against 'User' error as well as device failure.
Trust me on this, read the 'rsync' manual.
As an aside, that coding style looks like late 60's to me. Nothing wrong with
that,
just not common to see cpio used other than behind the scenes nowadays
(initramfs).
I wonder how many brain cells are 'out there' that still use 'cpio' 'tar' and
'/etc/rmt' or know how to low level format an ST506 MFM HDD.
I am living proof dinosaurs are not extinct!
Anybody with a computer museum wanna give me a job ?
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Sat, Aug 08, 2020 at 12:11:46AM +0200, Harald Arnesen via Dng wrote: > Haines Brown [07.08.2020 18:19]: > > > Yes, for sure. If you are right about the speed difference between > > NTFS and ext4, then is there another FS that can be accessed by a > > Windows machine that is not much slower than ext4? > > fat32. Or if you run a recent kernel on your Linux machine (Devuan 5.4 > is ok), then exfat. > -- > Hilsen Harald Hilsen, going to fat32 might be my bset bet if its speed is more like ext4 than ntfs. Is it the consensus that this is the case? -- Haines Brown ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Sat, Aug 08, 2020 at 02:53:13PM +0100, g4sra via Dng wrote:
> On 07/08/2020 21:01, Haines Brown wrote:
> > On Fri, Aug 07, 2020 at 06:34:04PM +0100, g4sra wrote:
> >
> >> Post your backup script for others to look over.
> >
> >
> > #!/bin/bash
> > a="="
> > b="Start: "
> > c=$(date)
> > mount /mnt/backup &
>
> 1) Don't do this in the background, script execution will proceed straight
> into the 'find' command below before the mount is ready.
Indeed, I think that has happened upon occassion (backup to mount
point rather than to backup drive).
> 2) Ensure you are mounting using 'ntfs-3g' or you will get a large
> performance hit and unsafe writes (last time I checked the Docs).
> E.g. /etc/fstab
>/dev/XXX /mnt/backup ntfs-3g defaults 0 0
> Or in the script
> 'ntfs-3g /dev/XXX /mnt/backup
I changed from ntfs to ftfs-3g in fstab, but didn't see any signficant
gain in back up speed. However the script no longer hangs if if finds
the drive already mounted. It complains but proceeds with the backup.
>
> 3) abort if the mount fails
> [ $? -eq 0 ] || {echo "Mount Failed!"; exit 1;}
I put this line into my backup script and only got a syntax error.
> > find /mnt/backup/20* -maxdepth 0 -type d | sort -n | head -n 1 | xargs rm
> > -rfv
> > sleep 3s
> > dirName=`date +%Y.%m.%d`
> > mkdir /mnt/backup/"$dirName"
> > find / -print | egrep
> > "^/mnt^/var^/mail|^/home|^/etc|^/opt|^/storage|^/info|^/usr/local" | cpio
> > -pdmuv /mnt/backup/"$dirName" 2>&1 | cat -vT
> > d="End:"
> > e=$(date +%H:%M:%S)
> > f="Disk used: "
> > g=`df /mnt/backup | tail -n 1 | awk '{print $5}'`
> > printf "$a \n $b $c \n $d $e \n $f %s\n" "$g" >> /home/haines/.backup.log
>
> You are backing up files that have not changed since the last backup.
> Do you really need all of that kerfuffle ?
The only price paid for the "kerfuffle" is the expense of a large
backup disk and the extra time that a backup takes in the backgroundñ.
In the past (back in my OS/2 days) I did incremental backups, but
since then like easy access to files that have not changed. Of course
the majority of people are not inclinded to see thigs this way.
--
Haines Brown
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Fri, Aug 07, 2020 at 04:17:06PM -0400, Curtis Maurand via Dng wrote: > I just mounted up an NTFS mount on my Ascii desktop. It loaded up fairly > quickly. Any other operation such as opening a folder with a lot of entries > took a very long time. This is on a Seagate Baracuda 1TB plugged into a > generic drive dock and connected by USB 3.0. > > I would say that the NTFS driver is not a speedy thing. You might try the > noatime option and see if that speeds things up. > > --Curtis Unfortunately, noatime in fstab did nothing for me. It may have cut time from 10 to 8 hours, but not sure. -- Haines Brown ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On 08/08/2020 14:53, g4sra via Dng wrote: > On 07/08/2020 21:01, Haines Brown wrote: >> On Fri, Aug 07, 2020 at 06:34:04PM +0100, g4sra wrote: > E.g. /etc/fstab >/dev/XXX /mnt/backup ntfs-3g defaults 0 0 That should be /dev/XXX /mnt/backup ntfs-3g defaults,noauto 0 0 ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On 07/08/2020 21:01, Haines Brown wrote:
> On Fri, Aug 07, 2020 at 06:34:04PM +0100, g4sra wrote:
>
>> Post your backup script for others to look over.
>
>
> #!/bin/bash
> a="="
> b="Start: "
> c=$(date)
> mount /mnt/backup &
1) Don't do this in the background, script execution will proceed straight into
the 'find' command below before the mount is ready.
2) Ensure you are mounting using 'ntfs-3g' or you will get a large performance
hit and unsafe writes (last time I checked the Docs).
E.g. /etc/fstab
/dev/XXX /mnt/backup ntfs-3g defaults 0 0
Or in the script
'ntfs-3g /dev/XXX /mnt/backup
3) abort if the mount fails
[ $? -eq 0 ] || {echo "Mount Failed!"; exit 1;}
> find /mnt/backup/20* -maxdepth 0 -type d | sort -n | head -n 1 | xargs rm -rfv
> sleep 3s
> dirName=`date +%Y.%m.%d`
> mkdir /mnt/backup/"$dirName"
> find / -print | egrep
> "^/mnt^/var^/mail|^/home|^/etc|^/opt|^/storage|^/info|^/usr/local" | cpio
> -pdmuv /mnt/backup/"$dirName" 2>&1 | cat -vT
> d="End:"
> e=$(date +%H:%M:%S)
> f="Disk used: "
> g=`df /mnt/backup | tail -n 1 | awk '{print $5}'`
> printf "$a \n $b $c \n $d $e \n $f %s\n" "$g" >> /home/haines/.backup.log
You are backing up files that have not changed since the last backup.
Do you really need all of that kerfuffle ?
As an example I use:
#!/bin/bash -e
# exclude paths are relative to the '/home/user/' source path e.g
'/home/user/.cache/'
ionice -c Best-effort -n 7 -t rsync -abv --delete --backup-dir
/mnt/backup/history/user.$(date +%Y%m%d%H%M) --exclude='/.cache/*' /home/user/
/mnt/backup/home/user/
You could do worse than read the man page for 'rsync'
Experienced others on the list please chime in and pick up\holes in anything I
have missed...
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Fri, Aug 07, 2020 at 03:27:43PM -1000, Joel Roth via Dng wrote: > Haines Brown wrote: > > Cron automatiically backs up some partitions on my HD by means of a > > script. Not sure of the size of thse backupos, but perhaps 300 Mb. > > > > I have been doing the backups to an external WD USB drive, and they > > took around 3 hours. However, I became nervous about the condition of > > the drive which is quite old, and so bought a 2 Tb replacement. Now > > the back up takes 10 hours. > > > > The only thing that I can think of that might account for its being > > slow is that my old WD drive was formatted ext4, but I thought best to > > leave my new drive with NTFS. > > You can create a large file in the drive, format it as > ext4 and mount it. That will avoid the speed cost of NTFS. But it won't achieve compatibility with his heirs' computer systems. -- hendrik > > -- > Joel Roth > ___ > Dng mailing list > Dng@lists.dyne.org > https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
Haines Brown wrote: > Cron automatiically backs up some partitions on my HD by means of a > script. Not sure of the size of thse backupos, but perhaps 300 Mb. > > I have been doing the backups to an external WD USB drive, and they > took around 3 hours. However, I became nervous about the condition of > the drive which is quite old, and so bought a 2 Tb replacement. Now > the back up takes 10 hours. > > The only thing that I can think of that might account for its being > slow is that my old WD drive was formatted ext4, but I thought best to > leave my new drive with NTFS. You can create a large file in the drive, format it as ext4 and mount it. That will avoid the speed cost of NTFS. -- Joel Roth ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
Haines Brown [07.08.2020 18:19]: > Yes, for sure. If you are right about the speed difference between > NTFS and ext4, then is there another FS that can be accessed by a > Windows machine that is not much slower than ext4? fat32. Or if you run a recent kernel on your Linux machine (Devuan 5.4 is ok), then exfat. -- Hilsen Harald ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Fri, Aug 07, 2020 at 04:01:09PM -0400, Haines Brown wrote: > Nothing in logs. But I don't unserstand this DBus syslog message that > comes up every second or so: > > Aug 7 09:29:26 engels brltty[720]: DBus error: send message: > org.freedesktop.DBus.Error.ServiceUnknown: The name org.bluez was not > provided by any .service file Uninstall brltty if you don't use it, and that should get rid of the message. Greg -- web site: http://www.gregn.net gpg public key: http://www.gregn.net/pubkey.asc skype: gregn1 (authorization required, add me to your contacts list first) If we haven't been in touch before, e-mail me before adding me to your contacts. -- Free domains: http://www.eu.org/ or mail dns-mana...@eu.org ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
I just mounted up an NTFS mount on my Ascii desktop. It loaded up
fairly quickly. Any other operation such as opening a folder with a lot
of entries took a very long time. This is on a Seagate Baracuda 1TB
plugged into a generic drive dock and connected by USB 3.0.
I would say that the NTFS driver is not a speedy thing. You might try
the noatime option and see if that speeds things up.
--Curtis
On 8/7/20 4:01 PM, Haines Brown wrote:
On Fri, Aug 07, 2020 at 06:34:04PM +0100, g4sra wrote:
Check your logs for USB Bus resets, any device on the USB bus can
cause these which will add seconds for every occurrence (a USB TV
stick can make a backup crawl).
Nothing in logs. But I don't unserstand this DBus syslog message that
comes up every second or so:
Aug 7 09:29:26 engels brltty[720]: DBus error: send message:
org.freedesktop.DBus.Error.ServiceUnknown: The name org.bluez was not
provided by any .service file
Post your backup script for others to look over.
#!/bin/bash
a="="
b="Start: "
c=$(date)
mount /mnt/backup &
find /mnt/backup/20* -maxdepth 0 -type d | sort -n | head -n 1 | xargs rm -rfv
sleep 3s
dirName=`date +%Y.%m.%d`
mkdir /mnt/backup/"$dirName"
find / -print | egrep "^/mnt^/var^/mail|^/home|^/etc|^/opt|^/storage|^/info|^/usr/local" | cpio
-pdmuv /mnt/backup/"$dirName" 2>&1 | cat -vT
d="End:"
e=$(date +%H:%M:%S)
f="Disk used: "
g=`df /mnt/backup | tail -n 1 | awk '{print $5}'`
printf "$a \n $b $c \n $d $e \n $f %s\n" "$g" >> /home/haines/.backup.log
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Fri, Aug 07, 2020 at 06:34:04PM +0100, g4sra wrote:
> Check your logs for USB Bus resets, any device on the USB bus can
> cause these which will add seconds for every occurrence (a USB TV
> stick can make a backup crawl).
Nothing in logs. But I don't unserstand this DBus syslog message that
comes up every second or so:
Aug 7 09:29:26 engels brltty[720]: DBus error: send message:
org.freedesktop.DBus.Error.ServiceUnknown: The name org.bluez was not
provided by any .service file
> Post your backup script for others to look over.
#!/bin/bash
a="="
b="Start: "
c=$(date)
mount /mnt/backup &
find /mnt/backup/20* -maxdepth 0 -type d | sort -n | head -n 1 | xargs rm -rfv
sleep 3s
dirName=`date +%Y.%m.%d`
mkdir /mnt/backup/"$dirName"
find / -print | egrep
"^/mnt^/var^/mail|^/home|^/etc|^/opt|^/storage|^/info|^/usr/local" | cpio
-pdmuv /mnt/backup/"$dirName" 2>&1 | cat -vT
d="End:"
e=$(date +%H:%M:%S)
f="Disk used: "
g=`df /mnt/backup | tail -n 1 | awk '{print $5}'`
printf "$a \n $b $c \n $d $e \n $f %s\n" "$g" >> /home/haines/.backup.log
--
Haines Brown
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On 07/08/2020 17:19, Haines Brown wrote: On Fri, Aug 07, 2020 at 04:57:18PM +0100, Rowland penny via Dng wrote: It is extremely slow, but I am unsure just how slow, but 3-4 times slower sounds about right. Wow! If the drive is never plugged into a Windows machine, then there is no point in it being formatted as NTFS. I do not have clients. I'm well past life expectancy, and so I need to know that my grandchildren can simply plug the drive into a Windows machine or Mac to access the files. Ah, that is different and I asked that ;-) If you are going to move the USB drive about, then, from a Windows point of view, you are going to have to stick to NTFS and put up with the slow speed, not sure about the Macs, I think they have their own version of ntfs-3g. , but it would be better formatted with ext4 or another Linux filesystem. Yes, for sure. If you are right about the speed difference between NTFS and ext4, then is there another FS that can be accessed by a Windows machine that is not much slower than ext4? Windows being Windows, you are stuck with NTFS or exfat etc You could always set up Samba and share the files with that, that would allow you to use ext4 and all your clients (grandchildren) should be able to connect to the shares, that I can help you set up. Life expectancy is what you make it and I am catching up ;-) Rowland ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Fri, Aug 07, 2020 at 04:57:18PM +0100, Rowland penny via Dng wrote: > It is extremely slow, but I am unsure just how slow, but 3-4 times slower > sounds about right. Wow! > If the drive is never plugged into a Windows machine, then there is no point > in it being formatted as NTFS. I do not have clients. I'm well past life expectancy, and so I need to know that my grandchildren can simply plug the drive into a Windows machine or Mac to access the files. > , but it would be better formatted with ext4 or another Linux > filesystem. Yes, for sure. If you are right about the speed difference between NTFS and ext4, then is there another FS that can be accessed by a Windows machine that is not much slower than ext4? -- Haines Brown ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On 07/08/2020 16:46, Haines Brown wrote: On Fri, Aug 07, 2020 at 03:58:40PM +0100, Rowland penny via Dng wrote: Do you use the USB drive on Windows, if not, just reformat it to ext4, ntfs-3g is a FUSE system, it isn't a fast as you would like. Thanks Roland. I left the drive NTFS because I wanted easy access to the drive for folks (granschildren) who do not run Linux. Othersie I prefer ext4. When you say NTFS is slower, to you mean three times slower (which I am experiencing) or a bit slower? When my mount command in script encounters an already mounted device formatted ext4 it complains but also proceeds. If the defive is formattted NTFS it complains but also and hangs. That is another reason to prefer ext4, but I wonder if the # mount -F would avoid the NTFS hang. That is, does NTFS mount exclusively by deault, while ext4 does not? It is extremely slow, but I am unsure just how slow, but 3-4 times slower sounds about right. If the drive is never plugged into a Windows machine, then there is no point in it being formatted as NTFS. If your clients are connecting over the wire via your Linux OS to the USB drive, then it doesn't matter what it is formatted, but it would be better formatted with ext4 or another Linux filesystem. Rowland ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On Fri, Aug 07, 2020 at 03:58:40PM +0100, Rowland penny via Dng wrote: > Do you use the USB drive on Windows, if not, just reformat it to ext4, > ntfs-3g is a FUSE system, it isn't a fast as you would like. Thanks Roland. I left the drive NTFS because I wanted easy access to the drive for folks (granschildren) who do not run Linux. Othersie I prefer ext4. When you say NTFS is slower, to you mean three times slower (which I am experiencing) or a bit slower? When my mount command in script encounters an already mounted device formatted ext4 it complains but also proceeds. If the defive is formattted NTFS it complains but also and hangs. That is another reason to prefer ext4, but I wonder if the # mount -F would avoid the NTFS hang. That is, does NTFS mount exclusively by deault, while ext4 does not? -- Haines Brown ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] How to mount NTFS
On 07/08/2020 15:47, Haines Brown wrote: Cron automatiically backs up some partitions on my HD by means of a script. Not sure of the size of thse backupos, but perhaps 300 Mb. I have been doing the backups to an external WD USB drive, and they took around 3 hours. However, I became nervous about the condition of the drive which is quite old, and so bought a 2 Tb replacement. Now the back up takes 10 hours. The only thing that I can think of that might account for its being slow is that my old WD drive was formatted ext4, but I thought best to leave my new drive with NTFS. This causes a problem in that if the backup drive happens to be mounted, the mount command in my script no longer just tells me so and proceeds with the backup, but instead hangs. The other problem may be that for some reason the disk being NTFS drastically slows the backup. So it occurred to me to make the command in the script to mount the drive: mount -t ntfs /mnt/backup (I have the drive's UUID in fstab). But when I check /proc/filesystems, ntfs apparently is not recognized by the kernel. However, my impression is that my having the ntfs-3g rw driver installed should enable me to mount a NTFS partion wtihout problem or need for the -t ntfs option. I checked my CPU instuctions/second. The services started at bootime have not changed. The # top command does not show any problems. $ free suggests I'm not demanding too much of my RAM. # iotop shows that my backup process I/O demand on the kernel runs 50-100%. The kworker flush can be 100%. My guess is that these figures are to be expected. I run the backup at a time when no other significant processes are running. Do you use the USB drive on Windows, if not, just reformat it to ext4, ntfs-3g is a FUSE system, it isn't a fast as you would like. Rowland ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
[DNG] How to mount NTFS
Cron automatiically backs up some partitions on my HD by means of a script. Not sure of the size of thse backupos, but perhaps 300 Mb. I have been doing the backups to an external WD USB drive, and they took around 3 hours. However, I became nervous about the condition of the drive which is quite old, and so bought a 2 Tb replacement. Now the back up takes 10 hours. The only thing that I can think of that might account for its being slow is that my old WD drive was formatted ext4, but I thought best to leave my new drive with NTFS. This causes a problem in that if the backup drive happens to be mounted, the mount command in my script no longer just tells me so and proceeds with the backup, but instead hangs. The other problem may be that for some reason the disk being NTFS drastically slows the backup. So it occurred to me to make the command in the script to mount the drive: mount -t ntfs /mnt/backup (I have the drive's UUID in fstab). But when I check /proc/filesystems, ntfs apparently is not recognized by the kernel. However, my impression is that my having the ntfs-3g rw driver installed should enable me to mount a NTFS partion wtihout problem or need for the -t ntfs option. I checked my CPU instuctions/second. The services started at bootime have not changed. The # top command does not show any problems. $ free suggests I'm not demanding too much of my RAM. # iotop shows that my backup process I/O demand on the kernel runs 50-100%. The kworker flush can be 100%. My guess is that these figures are to be expected. I run the backup at a time when no other significant processes are running. -- Haines Brown ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
