Re: restore(8) to USB key: terrible slow

2010-11-17 Thread Matthias Apitz
El día Wednesday, November 17, 2010 a las 01:52:59PM +, Alexander Best 
escribió:

> > > Thanks; I have to build a kernel for this ...
> > > 
> > > When I write the key just with dd(1) it performs normal with big blocks:
> > > 
> > > # dd if=/home/guru/usb9root.dmp of=/dev/da0 bs=1m count=100
> > > 100+0 records in
> > > 100+0 records out
> > > 104857600 bytes transferred in 16.650550 secs (6297546 bytes/sec)
> > > 
> > > and slow with 512 byte blocks:
> > > 
> > > # dd if=/home/guru/usb9root.dmp of=/dev/da0 count=100
> > > 100+0 records in
> > > 100+0 records out
> > > 51200 bytes transferred in 1.997130 secs (25637 bytes/sec)
> > > 
> > > any idea or do we need the debug output?
> > > 
> > >   matthias
> > 
> > What block size does the dump utility use?
> 
> dump(8) says 10k.

The -b of dump(8) is for the output device (which in my case was a plain
file, and the 3 GByte was dumped in ~10 minutes). I think it does not
influence the write performance of restore(8).

Interestingly, after the above write with dd(1) over sector 0 (...) and
after recreating the FreeBSD layout on the key (fdisk(8),
bsdlabel(8), newfs(8)), the restore(8) now works much faster.

There are a lot of small files (a complete /usr/src/sys after SVN checkout
with all SVN control files) and a complete FreeBSD live system in this
dump(8).

The dump(8) and restore(8) is only to make from a 16 GByte bootable USB key
with a lot of free space on it a smaller 4 GByte key to give it away to
some FreeBSD lovers in Cuba so that they can distribute it there, not
needing such a big 16 GByte USB key. Any other idea to shrink a 16 GB
file system to 4 GB on a 2nd key?

matthias
-- 
Matthias Apitz
t +49-89-61308 351 - f +49-89-61308 399 - m +49-170-4527211
e  - w http://www.unixarea.de/
___
freebsd-usb@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-usb
To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"


Re: restore(8) to USB key: terrible slow

2010-11-17 Thread Alexander Best
On Wed Nov 17 10, Hans Petter Selasky wrote:
> On Wednesday 17 November 2010 14:39:14 Matthias Apitz wrote:
> > El día Wednesday, November 17, 2010 a las 01:14:19PM +0100, Hans Petter 
> Selasky escribió:
> > > > after around 90 minutes of restore the taget file system says 19 MByte
> > > > used (i.e restored):
> > > > 
> > > > $ df -kh /mnt
> > > > Filesystem SizeUsed   Avail Capacity  Mounted on
> > > > /dev/da0s1a3.6G 19M3.3G 1%/mnt
> > > > 
> > > > What is wrong with this? If this does matter: 8-CURRENT.
> > > > 
> > > > Thanks
> > > > 
> > > > matthias
> > > 
> > > Hi,
> > > 
> > > Maybe you get some answers from:
> > > 
> > > sysctl hw.usb.umass.debug=-1
> > > 
> > > Kernel needs to be compiled with:
> > > 
> > > options USB_DEBUG
> > 
> > Thanks; I have to build a kernel for this ...
> > 
> > When I write the key just with dd(1) it performs normal with big blocks:
> > 
> > # dd if=/home/guru/usb9root.dmp of=/dev/da0 bs=1m count=100
> > 100+0 records in
> > 100+0 records out
> > 104857600 bytes transferred in 16.650550 secs (6297546 bytes/sec)
> > 
> > and slow with 512 byte blocks:
> > 
> > # dd if=/home/guru/usb9root.dmp of=/dev/da0 count=100
> > 100+0 records in
> > 100+0 records out
> > 51200 bytes transferred in 1.997130 secs (25637 bytes/sec)
> > 
> > any idea or do we need the debug output?
> > 
> > matthias
> 
> What block size does the dump utility use?

dump(8) says 10k.

> 
> --HPS

-- 
a13x
___
freebsd-usb@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-usb
To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"


Re: restore(8) to USB key: terrible slow

2010-11-17 Thread Hans Petter Selasky
> any idea or do we need the debug output?

restore -b 65536

?

--HPS
___
freebsd-usb@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-usb
To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"


Re: restore(8) to USB key: terrible slow

2010-11-17 Thread Hans Petter Selasky
On Wednesday 17 November 2010 14:39:14 Matthias Apitz wrote:
> El día Wednesday, November 17, 2010 a las 01:14:19PM +0100, Hans Petter 
Selasky escribió:
> > > after around 90 minutes of restore the taget file system says 19 MByte
> > > used (i.e restored):
> > > 
> > > $ df -kh /mnt
> > > Filesystem SizeUsed   Avail Capacity  Mounted on
> > > /dev/da0s1a3.6G 19M3.3G 1%/mnt
> > > 
> > > What is wrong with this? If this does matter: 8-CURRENT.
> > > 
> > > Thanks
> > > 
> > >   matthias
> > 
> > Hi,
> > 
> > Maybe you get some answers from:
> > 
> > sysctl hw.usb.umass.debug=-1
> > 
> > Kernel needs to be compiled with:
> > 
> > options USB_DEBUG
> 
> Thanks; I have to build a kernel for this ...
> 
> When I write the key just with dd(1) it performs normal with big blocks:
> 
> # dd if=/home/guru/usb9root.dmp of=/dev/da0 bs=1m count=100
> 100+0 records in
> 100+0 records out
> 104857600 bytes transferred in 16.650550 secs (6297546 bytes/sec)
> 
> and slow with 512 byte blocks:
> 
> # dd if=/home/guru/usb9root.dmp of=/dev/da0 count=100
> 100+0 records in
> 100+0 records out
> 51200 bytes transferred in 1.997130 secs (25637 bytes/sec)
> 
> any idea or do we need the debug output?
> 
>   matthias

What block size does the dump utility use?

--HPS
___
freebsd-usb@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-usb
To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"


Re: restore(8) to USB key: terrible slow

2010-11-17 Thread Matthias Apitz
El día Wednesday, November 17, 2010 a las 01:14:19PM +0100, Hans Petter Selasky 
escribió:

> > after around 90 minutes of restore the taget file system says 19 MByte
> > used (i.e restored):
> > 
> > $ df -kh /mnt
> > Filesystem SizeUsed   Avail Capacity  Mounted on
> > /dev/da0s1a3.6G 19M3.3G 1%/mnt
> > 
> > What is wrong with this? If this does matter: 8-CURRENT.
> > 
> > Thanks
> > 
> > matthias
> 
> Hi,
> 
> Maybe you get some answers from:
> 
> sysctl hw.usb.umass.debug=-1
> 
> Kernel needs to be compiled with:
> 
> options USB_DEBUG

Thanks; I have to build a kernel for this ...

When I write the key just with dd(1) it performs normal with big blocks:

# dd if=/home/guru/usb9root.dmp of=/dev/da0 bs=1m count=100
100+0 records in
100+0 records out
104857600 bytes transferred in 16.650550 secs (6297546 bytes/sec)

and slow with 512 byte blocks:

# dd if=/home/guru/usb9root.dmp of=/dev/da0 count=100
100+0 records in
100+0 records out
51200 bytes transferred in 1.997130 secs (25637 bytes/sec)

any idea or do we need the debug output?

matthias
-- 
Matthias Apitz
t +49-89-61308 351 - f +49-89-61308 399 - m +49-170-4527211
e  - w http://www.unixarea.de/
___
freebsd-usb@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-usb
To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"


Re: restore(8) to USB key: terrible slow

2010-11-17 Thread Hans Petter Selasky
On Wednesday 17 November 2010 13:08:52 Matthias Apitz wrote:
> Hello,
> 
> I've a dump(8) created from another USB key of ~3 GByte size and I'm
> restoring it into a new created file system on a key which says on
> attach:
> 
> ugen7.2:  at usbus7
> umass0:  2.00/1.00, addr 2> on usbus7
> umass0:  SCSI over Bulk-Only; quirks = 0x
> umass0:3:0:-1: Attached to scbus3
> da0 at umass-sim0 bus 0 target 0 lun 0
> da0:  Removable Direct Access SCSI-2 device
> da0: 40.000MB/s transfers
> da0: 3853MB (7892087 512 byte sectors: 255H 63S/T 491C)
> 
> after around 90 minutes of restore the taget file system says 19 MByte
> used (i.e restored):
> 
> $ df -kh /mnt
> Filesystem SizeUsed   Avail Capacity  Mounted on
> /dev/da0s1a3.6G 19M3.3G 1%/mnt
> 
> What is wrong with this? If this does matter: 8-CURRENT.
> 
> Thanks
> 
>   matthias

Hi,

Maybe you get some answers from:

sysctl hw.usb.umass.debug=-1

Kernel needs to be compiled with:

options USB_DEBUG

--HPS
___
freebsd-usb@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-usb
To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"


restore(8) to USB key: terrible slow

2010-11-17 Thread Matthias Apitz

Hello,

I've a dump(8) created from another USB key of ~3 GByte size and I'm
restoring it into a new created file system on a key which says on
attach:

ugen7.2:  at usbus7
umass0:  on usbus7
umass0:  SCSI over Bulk-Only; quirks = 0x
umass0:3:0:-1: Attached to scbus3
da0 at umass-sim0 bus 0 target 0 lun 0
da0:  Removable Direct Access SCSI-2 device 
da0: 40.000MB/s transfers
da0: 3853MB (7892087 512 byte sectors: 255H 63S/T 491C)

after around 90 minutes of restore the taget file system says 19 MByte
used (i.e restored):

$ df -kh /mnt
Filesystem SizeUsed   Avail Capacity  Mounted on
/dev/da0s1a3.6G 19M3.3G 1%/mnt

What is wrong with this? If this does matter: 8-CURRENT.

Thanks

matthias

-- 
Matthias Apitz
t +49-89-61308 351 - f +49-89-61308 399 - m +49-170-4527211
e  - w http://www.unixarea.de/
___
freebsd-usb@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-usb
To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"