Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Mario Marietto via rsync]

oh no. I'm on FreeBSD.

Il giorno dom 28 nov 2021 alle ore 21:54 Kevin Korb  ha
scritto:

> I was assuming gnu cp not bsd.
>
> On 11/28/21 15:53, Mario Marietto wrote:
> > root@marietto:/mnt/da3p2/bhyve/Ubuntu # cp -au
> > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* .
> > cp: illegal option -- u
> >
> >
> >
> > Il giorno dom 28 nov 2021 alle ore 21:40 Kevin Korb  > > ha scritto:
> >
> > rsync will not resume a transfer on a local copy.  It forces
> > --whole-file.
> >
> > On 11/28/21 15:32, Mario Marietto wrote:
> >  > ok. I know how to resume a transfer with rsync,but I don't know
> > how to
> >  > do that using cp. Which parameter should I use? 10x. On the next
> > file I
> >  > will use cp and I'm curious to compare both the speeds.
> >  >
> >  > Il giorno dom 28 nov 2021 alle ore 21:25 Kevin Korb
> > mailto:k...@sanitarium.net>
> >  > >> ha
> scritto:
> >  >
> >  > rsync will delete the file it is making if you abort it.
> > Even if you
> >  > had told it to not do that cp and rsync would both just start
> > over
> >  > anyway.
> >  >
> >  > On 11/28/21 15:22, Mario Marietto wrote:
> >  >  > Hello. What happens now if I stop the transfer ? I imagine
> > that I
> >  > can't
> >  >  > resume it. Do you think that it is a good idea to stop now
> > (I've
> >  > copied
> >  >  > 70 mb over 200) and to restart the transfer using cp -au ?
> >  >  >
> >  >  > Il giorno dom 28 nov 2021 alle ore 21:14 Kevin Korb
> >  > mailto:k...@sanitarium.net>
> > >
> >  >  > 
> >  scritto:
> >  >  >
> >  >  > cp -au is pretty much the same as rsync -au.  I doubt
> you
> >  > need any of
> >  >  > that other stuff you were using.  Especially the one
> > that is
> >  > a default.
> >  >  >
> >  >  > On 11/28/21 15:11, Mario Marietto wrote:
> >  >  >  > Hello. thanks. Can you tell me the most appropriate
> >  > parameters to
> >  >  > use
> >  >  >  > with cp ? U will save me a lot of time. Thanks very
> > much.
> >  >  >  >
> >  >  >  > Il giorno dom 28 nov 2021 alle ore 20:43 Kevin Korb
> > via rsync
> >  >  >  >  >   > >
> >  > 
> > >>
> >  >  >  >   > >
> >  > 
> >  ha
> >  >  > scritto:
> >  >  >  >
> >  >  >  > rsync is terribly slow at local copies.  Also,
> it
> >  > doesn't do
> >  >  > its normal
> >  >  >  > optimizing (see --whole-file).  Just use cp.
> >  >  >  >
> >  >  >  > On 11/28/21 13:38, Mario Marietto via rsync
> wrote:
> >  >  >  >  > Hello to everyone.
> >  >  >  >  >
> >  >  >  >  > I'm copying a large file from a NTFS
> > formatted disk
> >  > to another
> >  >  >  >  > one,UFS/FreeBSD disk,both are removable disks
> >  > attached to
> >  >  > the USB 3
> >  >  >  >  > port. The file is 200 GB large and it is
> > copied very
> >  >  > slowly. Why
> >  >  >  > it is
> >  >  >  >  > so slow ? I don't know where to store my
> virtual
> >  > machines. I
> >  >  >  > tried to
> >  >  >  >  > save them on the ext4 disk because I wanted
> to
> >  > share them
> >  >  > easily
> >  >  >  > between
> >  >  >  >  > Linux and FreeBSD but I've realized that
> when I
> >  > mount the
> >  >  > disk in
> >  >  >  >  > FreeBSD after some time it corrupts. I tried
> to
> >  > store it
> >  >  > on the NTFS
> >  >  >  >  > disk but it happens the same. So,now I'm on
> > FreeBSD
> >  > and I'm
> >  >  >  > copying them
> >  >  >  >  > to a dedicated UFS/FreeBSD style disk,but as
> > I said,the
> >  >  > speed is
> >  >  >  > very
> >  

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Mario Marietto via rsync]

Is OpenZFS compatible with Windows 10 / 11 ? I haven't had a chance to try
it yet. Should I reinstall the whole OS or I can convert in some way ufs2
to openzfs ?

Il giorno dom 28 nov 2021 alle ore 23:23 Mike Hodson  ha
scritto:

> Perhaps OpenZFS could be shared between both operating systems ? Works
> wonderfully for me on Linux (for over a decade) and also very well on fbsd.
>
>
> On Sun, Nov 28, 2021, 15:21 Mario Marietto via rsync <
> rsync@lists.samba.org> wrote:
>
>> I think that I will fire up a bhyve vm where I will attach the folder
>> where is stored the file to copy to the ufs disk and then when the vm will
>> be ready (I think I will boot windows 11) I will install apache web server
>> and I will copy the file to the proper apache folder. So,from the host I
>> will download and save the file to the ufs disk.
>>
>> Il giorno dom 28 nov 2021 alle ore 23:10 Harry Mangalam via rsync <
>> rsync@lists.samba.org> ha scritto:
>>
>>> Ok, thanks for that explanation.
>>> H
>>>
>>> On Sun, Nov 28, 2021, 1:59 PM Kevin Korb  wrote:
>>>
 Rsync is designed to reduce the amount of data transmitted over the
 network.  If rsync isn't networking it can't do that.  However, it
 still
 uses the same code so it is still using a sender and a receiver rather
 than simply reading and writing as cp does.  Also, rsync forces
 --whole-file because using rsync's algorithm to delta-copy is slower
 than just re-copying a file (especially if one of the local paths is
 really a network mount and double especially if that is the writing
 end).

 On 11/28/21 16:44, Harry Mangalam wrote:
 > Can you elaborate on why this is?
 >
 > I wrote a parallel rsync wrapper that works very well over networks
 but
 > is similarly very slow over local disks. I thought it was a bug in my
 > code but didn't get around to tracking it down since my use cases
 were
 > all network/ parallel file systems.
 > Harry
 >
 > On Sun, Nov 28, 2021, 11:43 AM Kevin Korb via rsync
 > mailto:rsync@lists.samba.org>> wrote:
 >
 > rsync is terribly slow at local copies.  Also, it doesn't do its
 normal
 > optimizing (see --whole-file).  Just use cp.
 >
 > On 11/28/21 13:38, Mario Marietto via rsync wrote:
 >  > Hello to everyone.
 >  >
 >  > I'm copying a large file from a NTFS formatted disk to another
 >  > one,UFS/FreeBSD disk,both are removable disks attached to the
 USB 3
 >  > port. The file is 200 GB large and it is copied very slowly.
 Why
 > it is
 >  > so slow ? I don't know where to store my virtual machines. I
 > tried to
 >  > save them on the ext4 disk because I wanted to share them
 easily
 > between
 >  > Linux and FreeBSD but I've realized that when I mount the disk
 in
 >  > FreeBSD after some time it corrupts. I tried to store it on
 the NTFS
 >  > disk but it happens the same. So,now I'm on FreeBSD and I'm
 > copying them
 >  > to a dedicated UFS/FreeBSD style disk,but as I said,the speed
 is
 > very
 >  > slow. How can I increase the speed ?. Actually I'm using this
 >  > command,because I want to resume the uploading if it breaks at
 > some point :
 >  >
 >  >
 >  > root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh
 >  > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress
 > --info=progress2
 >  >
 >  > sending incremental file list
 >  > impish-cuda-11-4-nvidia-470.img
 >  >
 >  > 2.13M 0% 9.49kB/s 6284:55:38
 >  >
 >  >
 >  > and : where do you save large files ? what's the procedure that
 > you use
 >  > to copy large files with a decent speed ? Unfortunately under
 > Linux is
 >  > not safe to use a RW ufs disk access. So,I'm out of solutions.
 >  >
 >  > -
 >  > Mario.
 >  >
 >
 > --
 >
  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
 >  Kevin Korb  Phone:(407) 252-6853
 >  Systems Administrator   Internet:
 >  FutureQuest, Inc.   ke...@futurequest.net
 (work)
 >  Orlando, Florida k...@sanitarium.net
 >  (personal)
 >  Web page: https://sanitarium.net/ <
 https://sanitarium.net/>
 >  PGP public key available on web site.
 >
  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
 >
 > --
 > Please use reply-all for most replies to avoid omitting the
 mailing
 > list.
 > To unsubscribe or change options:
 > https://lists.samba.org/mailman/listinfo/rsync
 >

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Mario Marietto via rsync]

I think that I will fire up a bhyve vm where I will attach the folder where
is stored the file to copy to the ufs disk and then when the vm will be
ready (I think I will boot windows 11) I will install apache web server and
I will copy the file to the proper apache folder. So,from the host I will
download and save the file to the ufs disk.

Il giorno dom 28 nov 2021 alle ore 23:10 Harry Mangalam via rsync <
rsync@lists.samba.org> ha scritto:

> Ok, thanks for that explanation.
> H
>
> On Sun, Nov 28, 2021, 1:59 PM Kevin Korb  wrote:
>
>> Rsync is designed to reduce the amount of data transmitted over the
>> network.  If rsync isn't networking it can't do that.  However, it still
>> uses the same code so it is still using a sender and a receiver rather
>> than simply reading and writing as cp does.  Also, rsync forces
>> --whole-file because using rsync's algorithm to delta-copy is slower
>> than just re-copying a file (especially if one of the local paths is
>> really a network mount and double especially if that is the writing end).
>>
>> On 11/28/21 16:44, Harry Mangalam wrote:
>> > Can you elaborate on why this is?
>> >
>> > I wrote a parallel rsync wrapper that works very well over networks but
>> > is similarly very slow over local disks. I thought it was a bug in my
>> > code but didn't get around to tracking it down since my use cases were
>> > all network/ parallel file systems.
>> > Harry
>> >
>> > On Sun, Nov 28, 2021, 11:43 AM Kevin Korb via rsync
>> > mailto:rsync@lists.samba.org>> wrote:
>> >
>> > rsync is terribly slow at local copies.  Also, it doesn't do its
>> normal
>> > optimizing (see --whole-file).  Just use cp.
>> >
>> > On 11/28/21 13:38, Mario Marietto via rsync wrote:
>> >  > Hello to everyone.
>> >  >
>> >  > I'm copying a large file from a NTFS formatted disk to another
>> >  > one,UFS/FreeBSD disk,both are removable disks attached to the
>> USB 3
>> >  > port. The file is 200 GB large and it is copied very slowly. Why
>> > it is
>> >  > so slow ? I don't know where to store my virtual machines. I
>> > tried to
>> >  > save them on the ext4 disk because I wanted to share them easily
>> > between
>> >  > Linux and FreeBSD but I've realized that when I mount the disk in
>> >  > FreeBSD after some time it corrupts. I tried to store it on the
>> NTFS
>> >  > disk but it happens the same. So,now I'm on FreeBSD and I'm
>> > copying them
>> >  > to a dedicated UFS/FreeBSD style disk,but as I said,the speed is
>> > very
>> >  > slow. How can I increase the speed ?. Actually I'm using this
>> >  > command,because I want to resume the uploading if it breaks at
>> > some point :
>> >  >
>> >  >
>> >  > root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh
>> >  > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress
>> > --info=progress2
>> >  >
>> >  > sending incremental file list
>> >  > impish-cuda-11-4-nvidia-470.img
>> >  >
>> >  > 2.13M 0% 9.49kB/s 6284:55:38
>> >  >
>> >  >
>> >  > and : where do you save large files ? what's the procedure that
>> > you use
>> >  > to copy large files with a decent speed ? Unfortunately under
>> > Linux is
>> >  > not safe to use a RW ufs disk access. So,I'm out of solutions.
>> >  >
>> >  > -
>> >  > Mario.
>> >  >
>> >
>> > --
>> >
>>  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
>> >  Kevin Korb  Phone:(407) 252-6853
>> >  Systems Administrator   Internet:
>> >  FutureQuest, Inc.   ke...@futurequest.net
>> (work)
>> >  Orlando, Florida k...@sanitarium.net
>> >  (personal)
>> >  Web page: https://sanitarium.net/ > >
>> >  PGP public key available on web site.
>> >
>>  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
>> >
>> > --
>> > Please use reply-all for most replies to avoid omitting the mailing
>> > list.
>> > To unsubscribe or change options:
>> > https://lists.samba.org/mailman/listinfo/rsync
>> > 
>> > Before posting, read:
>> > http://www.catb.org/~esr/faqs/smart-questions.html
>> > 
>> >
>>
>> --
>> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
>> Kevin Korb  Phone:(407) 252-6853
>> Systems Administrator   Internet:
>> FutureQuest, Inc.   ke...@futurequest.net  (work)
>> Orlando, Floridak...@sanitarium.net (personal)
>> Web page:   https://sanitarium.net/
>> PGP public key available on web site.
>> 

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Harry Mangalam via rsync]

Ok, thanks for that explanation.
H

On Sun, Nov 28, 2021, 1:59 PM Kevin Korb  wrote:

> Rsync is designed to reduce the amount of data transmitted over the
> network.  If rsync isn't networking it can't do that.  However, it still
> uses the same code so it is still using a sender and a receiver rather
> than simply reading and writing as cp does.  Also, rsync forces
> --whole-file because using rsync's algorithm to delta-copy is slower
> than just re-copying a file (especially if one of the local paths is
> really a network mount and double especially if that is the writing end).
>
> On 11/28/21 16:44, Harry Mangalam wrote:
> > Can you elaborate on why this is?
> >
> > I wrote a parallel rsync wrapper that works very well over networks but
> > is similarly very slow over local disks. I thought it was a bug in my
> > code but didn't get around to tracking it down since my use cases were
> > all network/ parallel file systems.
> > Harry
> >
> > On Sun, Nov 28, 2021, 11:43 AM Kevin Korb via rsync
> > mailto:rsync@lists.samba.org>> wrote:
> >
> > rsync is terribly slow at local copies.  Also, it doesn't do its
> normal
> > optimizing (see --whole-file).  Just use cp.
> >
> > On 11/28/21 13:38, Mario Marietto via rsync wrote:
> >  > Hello to everyone.
> >  >
> >  > I'm copying a large file from a NTFS formatted disk to another
> >  > one,UFS/FreeBSD disk,both are removable disks attached to the USB
> 3
> >  > port. The file is 200 GB large and it is copied very slowly. Why
> > it is
> >  > so slow ? I don't know where to store my virtual machines. I
> > tried to
> >  > save them on the ext4 disk because I wanted to share them easily
> > between
> >  > Linux and FreeBSD but I've realized that when I mount the disk in
> >  > FreeBSD after some time it corrupts. I tried to store it on the
> NTFS
> >  > disk but it happens the same. So,now I'm on FreeBSD and I'm
> > copying them
> >  > to a dedicated UFS/FreeBSD style disk,but as I said,the speed is
> > very
> >  > slow. How can I increase the speed ?. Actually I'm using this
> >  > command,because I want to resume the uploading if it breaks at
> > some point :
> >  >
> >  >
> >  > root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh
> >  > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress
> > --info=progress2
> >  >
> >  > sending incremental file list
> >  > impish-cuda-11-4-nvidia-470.img
> >  >
> >  > 2.13M 0% 9.49kB/s 6284:55:38
> >  >
> >  >
> >  > and : where do you save large files ? what's the procedure that
> > you use
> >  > to copy large files with a decent speed ? Unfortunately under
> > Linux is
> >  > not safe to use a RW ufs disk access. So,I'm out of solutions.
> >  >
> >  > -
> >  > Mario.
> >  >
> >
> > --
> >
>  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> >  Kevin Korb  Phone:(407) 252-6853
> >  Systems Administrator   Internet:
> >  FutureQuest, Inc.   ke...@futurequest.net
> (work)
> >  Orlando, Florida k...@sanitarium.net
> >  (personal)
> >  Web page: https://sanitarium.net/ 
> >  PGP public key available on web site.
> >
>  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> >
> > --
> > Please use reply-all for most replies to avoid omitting the mailing
> > list.
> > To unsubscribe or change options:
> > https://lists.samba.org/mailman/listinfo/rsync
> > 
> > Before posting, read:
> > http://www.catb.org/~esr/faqs/smart-questions.html
> > 
> >
>
> --
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> Kevin Korb  Phone:(407) 252-6853
> Systems Administrator   Internet:
> FutureQuest, Inc.   ke...@futurequest.net  (work)
> Orlando, Floridak...@sanitarium.net (personal)
> Web page:   https://sanitarium.net/
> PGP public key available on web site.
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
>
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Kevin Korb via rsync]

Rsync is designed to reduce the amount of data transmitted over the 
network.  If rsync isn't networking it can't do that.  However, it still 
uses the same code so it is still using a sender and a receiver rather 
than simply reading and writing as cp does.  Also, rsync forces 
--whole-file because using rsync's algorithm to delta-copy is slower 
than just re-copying a file (especially if one of the local paths is 
really a network mount and double especially if that is the writing end).


On 11/28/21 16:44, Harry Mangalam wrote:

Can you elaborate on why this is?

I wrote a parallel rsync wrapper that works very well over networks but 
is similarly very slow over local disks. I thought it was a bug in my 
code but didn't get around to tracking it down since my use cases were 
all network/ parallel file systems.

Harry

On Sun, Nov 28, 2021, 11:43 AM Kevin Korb via rsync 
mailto:rsync@lists.samba.org>> wrote:


rsync is terribly slow at local copies.  Also, it doesn't do its normal
optimizing (see --whole-file).  Just use cp.

On 11/28/21 13:38, Mario Marietto via rsync wrote:
 > Hello to everyone.
 >
 > I'm copying a large file from a NTFS formatted disk to another
 > one,UFS/FreeBSD disk,both are removable disks attached to the USB 3
 > port. The file is 200 GB large and it is copied very slowly. Why
it is
 > so slow ? I don't know where to store my virtual machines. I
tried to
 > save them on the ext4 disk because I wanted to share them easily
between
 > Linux and FreeBSD but I've realized that when I mount the disk in
 > FreeBSD after some time it corrupts. I tried to store it on the NTFS
 > disk but it happens the same. So,now I'm on FreeBSD and I'm
copying them
 > to a dedicated UFS/FreeBSD style disk,but as I said,the speed is
very
 > slow. How can I increase the speed ?. Actually I'm using this
 > command,because I want to resume the uploading if it breaks at
some point :
 >
 >
 > root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh
 > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress
--info=progress2
 >
 > sending incremental file list
 > impish-cuda-11-4-nvidia-470.img
 >
 > 2.13M 0% 9.49kB/s 6284:55:38
 >
 >
 > and : where do you save large files ? what's the procedure that
you use
 > to copy large files with a decent speed ? Unfortunately under
Linux is
 > not safe to use a RW ufs disk access. So,I'm out of solutions.
 >
 > -
 > Mario.
 >

-- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,

         Kevin Korb                      Phone:    (407) 252-6853
         Systems Administrator           Internet:
         FutureQuest, Inc.               ke...@futurequest.net  (work)
         Orlando, Florida k...@sanitarium.net
 (personal)
         Web page: https://sanitarium.net/ 
         PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,

-- 
Please use reply-all for most replies to avoid omitting the mailing

list.
To unsubscribe or change options:
https://lists.samba.org/mailman/listinfo/rsync

Before posting, read:
http://www.catb.org/~esr/faqs/smart-questions.html




--
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
Kevin Korb  Phone:(407) 252-6853
Systems Administrator   Internet:
FutureQuest, Inc.   ke...@futurequest.net  (work)
Orlando, Floridak...@sanitarium.net (personal)
Web page:   https://sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[James Moe via rsync]

On 2021-11-28 13:22, Mario Marietto via rsync wrote:

> What happens now if I stop the transfer ?
>
  The partial output file is deleted.

> I imagine that I can't resume it. 
>
  True.

> Do you think that it is a good idea to stop now
> (I've copied 70 mb over 200) and to restart the transfer
> using cp -au ?
>
  What does "70 mb over 200" mean?
(nit: mb = milli-bit; MB = mega-byte)
  The "u" option only means "update," not resume.
  "man cp" is your friend.

-- 
James Moe
moe dot james at sohnen-moe dot com
520.743.3936
Think.

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Harry Mangalam via rsync]

Can you elaborate on why this is?

I wrote a parallel rsync wrapper that works very well over networks but is
similarly very slow over local disks. I thought it was a bug in my code but
didn't get around to tracking it down since my use cases were all network/
parallel file systems.
Harry

On Sun, Nov 28, 2021, 11:43 AM Kevin Korb via rsync 
wrote:

> rsync is terribly slow at local copies.  Also, it doesn't do its normal
> optimizing (see --whole-file).  Just use cp.
>
> On 11/28/21 13:38, Mario Marietto via rsync wrote:
> > Hello to everyone.
> >
> > I'm copying a large file from a NTFS formatted disk to another
> > one,UFS/FreeBSD disk,both are removable disks attached to the USB 3
> > port. The file is 200 GB large and it is copied very slowly. Why it is
> > so slow ? I don't know where to store my virtual machines. I tried to
> > save them on the ext4 disk because I wanted to share them easily between
> > Linux and FreeBSD but I've realized that when I mount the disk in
> > FreeBSD after some time it corrupts. I tried to store it on the NTFS
> > disk but it happens the same. So,now I'm on FreeBSD and I'm copying them
> > to a dedicated UFS/FreeBSD style disk,but as I said,the speed is very
> > slow. How can I increase the speed ?. Actually I'm using this
> > command,because I want to resume the uploading if it breaks at some
> point :
> >
> >
> > root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh
> > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress --info=progress2
> >
> > sending incremental file list
> > impish-cuda-11-4-nvidia-470.img
> >
> > 2.13M 0% 9.49kB/s 6284:55:38
> >
> >
> > and : where do you save large files ? what's the procedure that you use
> > to copy large files with a decent speed ? Unfortunately under Linux is
> > not safe to use a RW ufs disk access. So,I'm out of solutions.
> >
> > -
> > Mario.
> >
>
> --
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> Kevin Korb  Phone:(407) 252-6853
> Systems Administrator   Internet:
> FutureQuest, Inc.   ke...@futurequest.net  (work)
> Orlando, Floridak...@sanitarium.net (personal)
> Web page:   https://sanitarium.net/
> PGP public key available on web site.
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
>
> --
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
>
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Mario Marietto via rsync]

root@marietto:/mnt/da3p2/bhyve/Ubuntu # cp -au
/mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* .
cp: illegal option -- u



Il giorno dom 28 nov 2021 alle ore 21:40 Kevin Korb  ha
scritto:

> rsync will not resume a transfer on a local copy.  It forces --whole-file.
>
> On 11/28/21 15:32, Mario Marietto wrote:
> > ok. I know how to resume a transfer with rsync,but I don't know how to
> > do that using cp. Which parameter should I use? 10x. On the next file I
> > will use cp and I'm curious to compare both the speeds.
> >
> > Il giorno dom 28 nov 2021 alle ore 21:25 Kevin Korb  > > ha scritto:
> >
> > rsync will delete the file it is making if you abort it.  Even if you
> > had told it to not do that cp and rsync would both just start over
> > anyway.
> >
> > On 11/28/21 15:22, Mario Marietto wrote:
> >  > Hello. What happens now if I stop the transfer ? I imagine that I
> > can't
> >  > resume it. Do you think that it is a good idea to stop now (I've
> > copied
> >  > 70 mb over 200) and to restart the transfer using cp -au ?
> >  >
> >  > Il giorno dom 28 nov 2021 alle ore 21:14 Kevin Korb
> > mailto:k...@sanitarium.net>
> >  > >> ha
> scritto:
> >  >
> >  > cp -au is pretty much the same as rsync -au.  I doubt you
> > need any of
> >  > that other stuff you were using.  Especially the one that is
> > a default.
> >  >
> >  > On 11/28/21 15:11, Mario Marietto wrote:
> >  >  > Hello. thanks. Can you tell me the most appropriate
> > parameters to
> >  > use
> >  >  > with cp ? U will save me a lot of time. Thanks very much.
> >  >  >
> >  >  > Il giorno dom 28 nov 2021 alle ore 20:43 Kevin Korb via
> rsync
> >  >  > mailto:rsync@lists.samba.org>
> > >
> >  > 
> >  >  > scritto:
> >  >  >
> >  >  > rsync is terribly slow at local copies.  Also, it
> > doesn't do
> >  > its normal
> >  >  > optimizing (see --whole-file).  Just use cp.
> >  >  >
> >  >  > On 11/28/21 13:38, Mario Marietto via rsync wrote:
> >  >  >  > Hello to everyone.
> >  >  >  >
> >  >  >  > I'm copying a large file from a NTFS formatted disk
> > to another
> >  >  >  > one,UFS/FreeBSD disk,both are removable disks
> > attached to
> >  > the USB 3
> >  >  >  > port. The file is 200 GB large and it is copied very
> >  > slowly. Why
> >  >  > it is
> >  >  >  > so slow ? I don't know where to store my virtual
> > machines. I
> >  >  > tried to
> >  >  >  > save them on the ext4 disk because I wanted to
> > share them
> >  > easily
> >  >  > between
> >  >  >  > Linux and FreeBSD but I've realized that when I
> > mount the
> >  > disk in
> >  >  >  > FreeBSD after some time it corrupts. I tried to
> > store it
> >  > on the NTFS
> >  >  >  > disk but it happens the same. So,now I'm on FreeBSD
> > and I'm
> >  >  > copying them
> >  >  >  > to a dedicated UFS/FreeBSD style disk,but as I
> said,the
> >  > speed is
> >  >  > very
> >  >  >  > slow. How can I increase the speed ?. Actually I'm
> > using this
> >  >  >  > command,because I want to resume the uploading if
> > it breaks at
> >  >  > some point :
> >  >  >  >
> >  >  >  >
> >  >  >  > root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync
> > -avAXEWSlHh
> >  >  >  > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* .
> --no-compress
> >  >  > --info=progress2
> >  >  >  >
> >  >  >  > sending incremental file list
> >  >  >  > impish-cuda-11-4-nvidia-470.img
> >  >  >  >
> >  >  >  > 2.13M 0% 9.49kB/s 6284:55:38
> >  >  >  >
> >  >  >  >
> >  >  >  > and : where do you save large files ? what's the
> > procedure
> >  > that
> >  >  > you use
> >  >  >  > to copy large files with a decent speed ?
> > Unfortunately under
> >  >  > Linux is
> >  >  >  > not safe to use a RW ufs disk access. So,I'm out of
> > solutions.
> >  >  >  >
> >  >  >  > -
> >  >  >  > Mario.
> >  >  >  >
> >  >  >
> >  >  > --
> >  >  >
> >  >
> >
>  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> >  > 

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Mario Marietto via rsync]

ok. I know how to resume a transfer with rsync,but I don't know how to do
that using cp. Which parameter should I use? 10x. On the next file I will
use cp and I'm curious to compare both the speeds.

Il giorno dom 28 nov 2021 alle ore 21:25 Kevin Korb  ha
scritto:

> rsync will delete the file it is making if you abort it.  Even if you
> had told it to not do that cp and rsync would both just start over anyway.
>
> On 11/28/21 15:22, Mario Marietto wrote:
> > Hello. What happens now if I stop the transfer ? I imagine that I can't
> > resume it. Do you think that it is a good idea to stop now (I've copied
> > 70 mb over 200) and to restart the transfer using cp -au ?
> >
> > Il giorno dom 28 nov 2021 alle ore 21:14 Kevin Korb  > > ha scritto:
> >
> > cp -au is pretty much the same as rsync -au.  I doubt you need any of
> > that other stuff you were using.  Especially the one that is a
> default.
> >
> > On 11/28/21 15:11, Mario Marietto wrote:
> >  > Hello. thanks. Can you tell me the most appropriate parameters to
> > use
> >  > with cp ? U will save me a lot of time. Thanks very much.
> >  >
> >  > Il giorno dom 28 nov 2021 alle ore 20:43 Kevin Korb via rsync
> >  > mailto:rsync@lists.samba.org>
> > >> ha
> > scritto:
> >  >
> >  > rsync is terribly slow at local copies.  Also, it doesn't do
> > its normal
> >  > optimizing (see --whole-file).  Just use cp.
> >  >
> >  > On 11/28/21 13:38, Mario Marietto via rsync wrote:
> >  >  > Hello to everyone.
> >  >  >
> >  >  > I'm copying a large file from a NTFS formatted disk to
> another
> >  >  > one,UFS/FreeBSD disk,both are removable disks attached to
> > the USB 3
> >  >  > port. The file is 200 GB large and it is copied very
> > slowly. Why
> >  > it is
> >  >  > so slow ? I don't know where to store my virtual machines.
> I
> >  > tried to
> >  >  > save them on the ext4 disk because I wanted to share them
> > easily
> >  > between
> >  >  > Linux and FreeBSD but I've realized that when I mount the
> > disk in
> >  >  > FreeBSD after some time it corrupts. I tried to store it
> > on the NTFS
> >  >  > disk but it happens the same. So,now I'm on FreeBSD and I'm
> >  > copying them
> >  >  > to a dedicated UFS/FreeBSD style disk,but as I said,the
> > speed is
> >  > very
> >  >  > slow. How can I increase the speed ?. Actually I'm using
> this
> >  >  > command,because I want to resume the uploading if it
> breaks at
> >  > some point :
> >  >  >
> >  >  >
> >  >  > root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh
> >  >  > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress
> >  > --info=progress2
> >  >  >
> >  >  > sending incremental file list
> >  >  > impish-cuda-11-4-nvidia-470.img
> >  >  >
> >  >  > 2.13M 0% 9.49kB/s 6284:55:38
> >  >  >
> >  >  >
> >  >  > and : where do you save large files ? what's the procedure
> > that
> >  > you use
> >  >  > to copy large files with a decent speed ? Unfortunately
> under
> >  > Linux is
> >  >  > not safe to use a RW ufs disk access. So,I'm out of
> solutions.
> >  >  >
> >  >  > -
> >  >  > Mario.
> >  >  >
> >  >
> >  > --
> >  >
> >
>  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> >  >  Kevin Korb  Phone:(407)
> 252-6853
> >  >  Systems Administrator   Internet:
> >  >  FutureQuest, Inc.
> >   ke...@futurequest.net  (work)
> >  >  Orlando, Florida k...@sanitarium.net
> > 
> >  > >
> > (personal)
> >  >  Web page: https://sanitarium.net/
> >   > >
> >  >  PGP public key available on web site.
> >  >
> >
>  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> >  >
> >  > --
> >  > Please use reply-all for most replies to avoid omitting the
> > mailing
> >  > list.
> >  > To unsubscribe or change options:
> >  > https://lists.samba.org/mailman/listinfo/rsync
> > 
> >  >  > >
> >  > Before posting, read:
> >  > http://www.catb.org/~esr/faqs/smart-questions.html
> > 

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Mario Marietto via rsync]

Hello. What happens now if I stop the transfer ? I imagine that I can't
resume it. Do you think that it is a good idea to stop now (I've copied 70
mb over 200) and to restart the transfer using cp -au ?

Il giorno dom 28 nov 2021 alle ore 21:14 Kevin Korb  ha
scritto:

> cp -au is pretty much the same as rsync -au.  I doubt you need any of
> that other stuff you were using.  Especially the one that is a default.
>
> On 11/28/21 15:11, Mario Marietto wrote:
> > Hello. thanks. Can you tell me the most appropriate parameters to use
> > with cp ? U will save me a lot of time. Thanks very much.
> >
> > Il giorno dom 28 nov 2021 alle ore 20:43 Kevin Korb via rsync
> > mailto:rsync@lists.samba.org>> ha scritto:
> >
> > rsync is terribly slow at local copies.  Also, it doesn't do its
> normal
> > optimizing (see --whole-file).  Just use cp.
> >
> > On 11/28/21 13:38, Mario Marietto via rsync wrote:
> >  > Hello to everyone.
> >  >
> >  > I'm copying a large file from a NTFS formatted disk to another
> >  > one,UFS/FreeBSD disk,both are removable disks attached to the USB
> 3
> >  > port. The file is 200 GB large and it is copied very slowly. Why
> > it is
> >  > so slow ? I don't know where to store my virtual machines. I
> > tried to
> >  > save them on the ext4 disk because I wanted to share them easily
> > between
> >  > Linux and FreeBSD but I've realized that when I mount the disk in
> >  > FreeBSD after some time it corrupts. I tried to store it on the
> NTFS
> >  > disk but it happens the same. So,now I'm on FreeBSD and I'm
> > copying them
> >  > to a dedicated UFS/FreeBSD style disk,but as I said,the speed is
> > very
> >  > slow. How can I increase the speed ?. Actually I'm using this
> >  > command,because I want to resume the uploading if it breaks at
> > some point :
> >  >
> >  >
> >  > root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh
> >  > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress
> > --info=progress2
> >  >
> >  > sending incremental file list
> >  > impish-cuda-11-4-nvidia-470.img
> >  >
> >  > 2.13M 0% 9.49kB/s 6284:55:38
> >  >
> >  >
> >  > and : where do you save large files ? what's the procedure that
> > you use
> >  > to copy large files with a decent speed ? Unfortunately under
> > Linux is
> >  > not safe to use a RW ufs disk access. So,I'm out of solutions.
> >  >
> >  > -
> >  > Mario.
> >  >
> >
> > --
> >
>  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> >  Kevin Korb  Phone:(407) 252-6853
> >  Systems Administrator   Internet:
> >  FutureQuest, Inc.   ke...@futurequest.net
> (work)
> >  Orlando, Florida k...@sanitarium.net
> >  (personal)
> >  Web page: https://sanitarium.net/ 
> >  PGP public key available on web site.
> >
>  ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> >
> > --
> > Please use reply-all for most replies to avoid omitting the mailing
> > list.
> > To unsubscribe or change options:
> > https://lists.samba.org/mailman/listinfo/rsync
> > 
> > Before posting, read:
> > http://www.catb.org/~esr/faqs/smart-questions.html
> > 
> >
> >
> >
> > --
> > Mario.
>
> --
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> Kevin Korb  Phone:(407) 252-6853
> Systems Administrator   Internet:
> FutureQuest, Inc.   ke...@futurequest.net  (work)
> Orlando, Floridak...@sanitarium.net (personal)
> Web page:   https://sanitarium.net/
> PGP public key available on web site.
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
>


-- 
Mario.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Mario Marietto via rsync]

Hello. thanks. Can you tell me the most appropriate parameters to use with
cp ? U will save me a lot of time. Thanks very much.

Il giorno dom 28 nov 2021 alle ore 20:43 Kevin Korb via rsync <
rsync@lists.samba.org> ha scritto:

> rsync is terribly slow at local copies.  Also, it doesn't do its normal
> optimizing (see --whole-file).  Just use cp.
>
> On 11/28/21 13:38, Mario Marietto via rsync wrote:
> > Hello to everyone.
> >
> > I'm copying a large file from a NTFS formatted disk to another
> > one,UFS/FreeBSD disk,both are removable disks attached to the USB 3
> > port. The file is 200 GB large and it is copied very slowly. Why it is
> > so slow ? I don't know where to store my virtual machines. I tried to
> > save them on the ext4 disk because I wanted to share them easily between
> > Linux and FreeBSD but I've realized that when I mount the disk in
> > FreeBSD after some time it corrupts. I tried to store it on the NTFS
> > disk but it happens the same. So,now I'm on FreeBSD and I'm copying them
> > to a dedicated UFS/FreeBSD style disk,but as I said,the speed is very
> > slow. How can I increase the speed ?. Actually I'm using this
> > command,because I want to resume the uploading if it breaks at some
> point :
> >
> >
> > root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh
> > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress --info=progress2
> >
> > sending incremental file list
> > impish-cuda-11-4-nvidia-470.img
> >
> > 2.13M 0% 9.49kB/s 6284:55:38
> >
> >
> > and : where do you save large files ? what's the procedure that you use
> > to copy large files with a decent speed ? Unfortunately under Linux is
> > not safe to use a RW ufs disk access. So,I'm out of solutions.
> >
> > -
> > Mario.
> >
>
> --
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> Kevin Korb  Phone:(407) 252-6853
> Systems Administrator   Internet:
> FutureQuest, Inc.   ke...@futurequest.net  (work)
> Orlando, Floridak...@sanitarium.net (personal)
> Web page:   https://sanitarium.net/
> PGP public key available on web site.
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
>
> --
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
>


-- 
Mario.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Kevin Korb via rsync]

rsync is terribly slow at local copies.  Also, it doesn't do its normal 
optimizing (see --whole-file).  Just use cp.


On 11/28/21 13:38, Mario Marietto via rsync wrote:

Hello to everyone.

I'm copying a large file from a NTFS formatted disk to another 
one,UFS/FreeBSD disk,both are removable disks attached to the USB 3 
port. The file is 200 GB large and it is copied very slowly. Why it is 
so slow ? I don't know where to store my virtual machines. I tried to 
save them on the ext4 disk because I wanted to share them easily between 
Linux and FreeBSD but I've realized that when I mount the disk in 
FreeBSD after some time it corrupts. I tried to store it on the NTFS 
disk but it happens the same. So,now I'm on FreeBSD and I'm copying them 
to a dedicated UFS/FreeBSD style disk,but as I said,the speed is very 
slow. How can I increase the speed ?. Actually I'm using this 
command,because I want to resume the uploading if it breaks at some point :



root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh 
/mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress --info=progress2


sending incremental file list
impish-cuda-11-4-nvidia-470.img

2.13M 0% 9.49kB/s 6284:55:38


and : where do you save large files ? what's the procedure that you use 
to copy large files with a decent speed ? Unfortunately under Linux is 
not safe to use a RW ufs disk access. So,I'm out of solutions.


-
Mario.



--
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
Kevin Korb  Phone:(407) 252-6853
Systems Administrator   Internet:
FutureQuest, Inc.   ke...@futurequest.net  (work)
Orlando, Floridak...@sanitarium.net (personal)
Web page:   https://sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Mario Marietto via rsync]

yes,but it is on the same PC where I have installed freebsd. Can you give a
look at the rsync parameters ? Are they optimized ? Can I change some
parameters to improve the speed ?

Il giorno dom 28 nov 2021 alle ore 19:54 Franklin M. Siler 
ha scritto:

> Do you have a windows machine? Could you just copy it with SCP, NFS, or
> SMB?
>
> On Sun, Nov 28, 2021 at 12:39 Mario Marietto via rsync <
> rsync@lists.samba.org> wrote:
>
>> Hello to everyone.
>>
>> I'm copying a large file from a NTFS formatted disk to another
>> one,UFS/FreeBSD disk,both are removable disks attached to the USB 3 port.
>> The file is 200 GB large and it is copied very slowly. Why it is so slow ?
>> I don't know where to store my virtual machines. I tried to save them on
>> the ext4 disk because I wanted to share them easily between Linux and
>> FreeBSD but I've realized that when I mount the disk in FreeBSD after some
>> time it corrupts. I tried to store it on the NTFS disk but it happens the
>> same. So,now I'm on FreeBSD and I'm copying them to a dedicated UFS/FreeBSD
>> style disk,but as I said,the speed is very slow. How can I increase the
>> speed ?. Actually I'm using this command,because I want to resume the
>> uploading if it breaks at some point :
>>
>>
>> root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh
>> /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress --info=progress2
>>
>> sending incremental file list
>> impish-cuda-11-4-nvidia-470.img
>>
>> 2.13M 0% 9.49kB/s 6284:55:38
>>
>>
>> and : where do you save large files ? what's the procedure that you use
>> to copy large files with a decent speed ? Unfortunately under Linux is not
>> safe to use a RW ufs disk access. So,I'm out of solutions.
>>
>> -
>> Mario.
>>
>> --
>> Please use reply-all for most replies to avoid omitting the mailing list.
>> To unsubscribe or change options:
>> https://lists.samba.org/mailman/listinfo/rsync
>> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
>>
> --
> I sent this from my phone, so please pardon typos and brevity.
>


-- 
Mario.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....

[Mario Marietto via rsync]

Hello to everyone.

I'm copying a large file from a NTFS formatted disk to another
one,UFS/FreeBSD disk,both are removable disks attached to the USB 3 port.
The file is 200 GB large and it is copied very slowly. Why it is so slow ?
I don't know where to store my virtual machines. I tried to save them on
the ext4 disk because I wanted to share them easily between Linux and
FreeBSD but I've realized that when I mount the disk in FreeBSD after some
time it corrupts. I tried to store it on the NTFS disk but it happens the
same. So,now I'm on FreeBSD and I'm copying them to a dedicated UFS/FreeBSD
style disk,but as I said,the speed is very slow. How can I increase the
speed ?. Actually I'm using this command,because I want to resume the
uploading if it breaks at some point :


root@marietto:/mnt/da3p2/bhyve/Ubuntu # rsync -avAXEWSlHh
/mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . --no-compress --info=progress2

sending incremental file list
impish-cuda-11-4-nvidia-470.img

2.13M 0% 9.49kB/s 6284:55:38


and : where do you save large files ? what's the procedure that you use to
copy large files with a decent speed ? Unfortunately under Linux is not
safe to use a RW ufs disk access. So,I'm out of solutions.

-
Mario.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html