Re: restore(8) to USB key: terrible slow
El día Wednesday, November 17, 2010 a las 01:52:59PM +, Alexander Best escribió: > > > Thanks; I have to build a kernel for this ... > > > > > > When I write the key just with dd(1) it performs normal with big blocks: > > > > > > # dd if=/home/guru/usb9root.dmp of=/dev/da0 bs=1m count=100 > > > 100+0 records in > > > 100+0 records out > > > 104857600 bytes transferred in 16.650550 secs (6297546 bytes/sec) > > > > > > and slow with 512 byte blocks: > > > > > > # dd if=/home/guru/usb9root.dmp of=/dev/da0 count=100 > > > 100+0 records in > > > 100+0 records out > > > 51200 bytes transferred in 1.997130 secs (25637 bytes/sec) > > > > > > any idea or do we need the debug output? > > > > > > matthias > > > > What block size does the dump utility use? > > dump(8) says 10k. The -b of dump(8) is for the output device (which in my case was a plain file, and the 3 GByte was dumped in ~10 minutes). I think it does not influence the write performance of restore(8). Interestingly, after the above write with dd(1) over sector 0 (...) and after recreating the FreeBSD layout on the key (fdisk(8), bsdlabel(8), newfs(8)), the restore(8) now works much faster. There are a lot of small files (a complete /usr/src/sys after SVN checkout with all SVN control files) and a complete FreeBSD live system in this dump(8). The dump(8) and restore(8) is only to make from a 16 GByte bootable USB key with a lot of free space on it a smaller 4 GByte key to give it away to some FreeBSD lovers in Cuba so that they can distribute it there, not needing such a big 16 GByte USB key. Any other idea to shrink a 16 GB file system to 4 GB on a 2nd key? matthias -- Matthias Apitz t +49-89-61308 351 - f +49-89-61308 399 - m +49-170-4527211 e - w http://www.unixarea.de/ ___ freebsd-usb@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-usb To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"
Re: restore(8) to USB key: terrible slow
On Wed Nov 17 10, Hans Petter Selasky wrote: > On Wednesday 17 November 2010 14:39:14 Matthias Apitz wrote: > > El día Wednesday, November 17, 2010 a las 01:14:19PM +0100, Hans Petter > Selasky escribió: > > > > after around 90 minutes of restore the taget file system says 19 MByte > > > > used (i.e restored): > > > > > > > > $ df -kh /mnt > > > > Filesystem SizeUsed Avail Capacity Mounted on > > > > /dev/da0s1a3.6G 19M3.3G 1%/mnt > > > > > > > > What is wrong with this? If this does matter: 8-CURRENT. > > > > > > > > Thanks > > > > > > > > matthias > > > > > > Hi, > > > > > > Maybe you get some answers from: > > > > > > sysctl hw.usb.umass.debug=-1 > > > > > > Kernel needs to be compiled with: > > > > > > options USB_DEBUG > > > > Thanks; I have to build a kernel for this ... > > > > When I write the key just with dd(1) it performs normal with big blocks: > > > > # dd if=/home/guru/usb9root.dmp of=/dev/da0 bs=1m count=100 > > 100+0 records in > > 100+0 records out > > 104857600 bytes transferred in 16.650550 secs (6297546 bytes/sec) > > > > and slow with 512 byte blocks: > > > > # dd if=/home/guru/usb9root.dmp of=/dev/da0 count=100 > > 100+0 records in > > 100+0 records out > > 51200 bytes transferred in 1.997130 secs (25637 bytes/sec) > > > > any idea or do we need the debug output? > > > > matthias > > What block size does the dump utility use? dump(8) says 10k. > > --HPS -- a13x ___ freebsd-usb@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-usb To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"
Re: restore(8) to USB key: terrible slow
> any idea or do we need the debug output? restore -b 65536 ? --HPS ___ freebsd-usb@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-usb To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"
Re: restore(8) to USB key: terrible slow
On Wednesday 17 November 2010 14:39:14 Matthias Apitz wrote: > El día Wednesday, November 17, 2010 a las 01:14:19PM +0100, Hans Petter Selasky escribió: > > > after around 90 minutes of restore the taget file system says 19 MByte > > > used (i.e restored): > > > > > > $ df -kh /mnt > > > Filesystem SizeUsed Avail Capacity Mounted on > > > /dev/da0s1a3.6G 19M3.3G 1%/mnt > > > > > > What is wrong with this? If this does matter: 8-CURRENT. > > > > > > Thanks > > > > > > matthias > > > > Hi, > > > > Maybe you get some answers from: > > > > sysctl hw.usb.umass.debug=-1 > > > > Kernel needs to be compiled with: > > > > options USB_DEBUG > > Thanks; I have to build a kernel for this ... > > When I write the key just with dd(1) it performs normal with big blocks: > > # dd if=/home/guru/usb9root.dmp of=/dev/da0 bs=1m count=100 > 100+0 records in > 100+0 records out > 104857600 bytes transferred in 16.650550 secs (6297546 bytes/sec) > > and slow with 512 byte blocks: > > # dd if=/home/guru/usb9root.dmp of=/dev/da0 count=100 > 100+0 records in > 100+0 records out > 51200 bytes transferred in 1.997130 secs (25637 bytes/sec) > > any idea or do we need the debug output? > > matthias What block size does the dump utility use? --HPS ___ freebsd-usb@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-usb To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"
Re: restore(8) to USB key: terrible slow
El día Wednesday, November 17, 2010 a las 01:14:19PM +0100, Hans Petter Selasky escribió: > > after around 90 minutes of restore the taget file system says 19 MByte > > used (i.e restored): > > > > $ df -kh /mnt > > Filesystem SizeUsed Avail Capacity Mounted on > > /dev/da0s1a3.6G 19M3.3G 1%/mnt > > > > What is wrong with this? If this does matter: 8-CURRENT. > > > > Thanks > > > > matthias > > Hi, > > Maybe you get some answers from: > > sysctl hw.usb.umass.debug=-1 > > Kernel needs to be compiled with: > > options USB_DEBUG Thanks; I have to build a kernel for this ... When I write the key just with dd(1) it performs normal with big blocks: # dd if=/home/guru/usb9root.dmp of=/dev/da0 bs=1m count=100 100+0 records in 100+0 records out 104857600 bytes transferred in 16.650550 secs (6297546 bytes/sec) and slow with 512 byte blocks: # dd if=/home/guru/usb9root.dmp of=/dev/da0 count=100 100+0 records in 100+0 records out 51200 bytes transferred in 1.997130 secs (25637 bytes/sec) any idea or do we need the debug output? matthias -- Matthias Apitz t +49-89-61308 351 - f +49-89-61308 399 - m +49-170-4527211 e - w http://www.unixarea.de/ ___ freebsd-usb@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-usb To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"
Re: restore(8) to USB key: terrible slow
On Wednesday 17 November 2010 13:08:52 Matthias Apitz wrote: > Hello, > > I've a dump(8) created from another USB key of ~3 GByte size and I'm > restoring it into a new created file system on a key which says on > attach: > > ugen7.2: at usbus7 > umass0: 2.00/1.00, addr 2> on usbus7 > umass0: SCSI over Bulk-Only; quirks = 0x > umass0:3:0:-1: Attached to scbus3 > da0 at umass-sim0 bus 0 target 0 lun 0 > da0: Removable Direct Access SCSI-2 device > da0: 40.000MB/s transfers > da0: 3853MB (7892087 512 byte sectors: 255H 63S/T 491C) > > after around 90 minutes of restore the taget file system says 19 MByte > used (i.e restored): > > $ df -kh /mnt > Filesystem SizeUsed Avail Capacity Mounted on > /dev/da0s1a3.6G 19M3.3G 1%/mnt > > What is wrong with this? If this does matter: 8-CURRENT. > > Thanks > > matthias Hi, Maybe you get some answers from: sysctl hw.usb.umass.debug=-1 Kernel needs to be compiled with: options USB_DEBUG --HPS ___ freebsd-usb@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-usb To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"
restore(8) to USB key: terrible slow
Hello, I've a dump(8) created from another USB key of ~3 GByte size and I'm restoring it into a new created file system on a key which says on attach: ugen7.2: at usbus7 umass0: on usbus7 umass0: SCSI over Bulk-Only; quirks = 0x umass0:3:0:-1: Attached to scbus3 da0 at umass-sim0 bus 0 target 0 lun 0 da0: Removable Direct Access SCSI-2 device da0: 40.000MB/s transfers da0: 3853MB (7892087 512 byte sectors: 255H 63S/T 491C) after around 90 minutes of restore the taget file system says 19 MByte used (i.e restored): $ df -kh /mnt Filesystem SizeUsed Avail Capacity Mounted on /dev/da0s1a3.6G 19M3.3G 1%/mnt What is wrong with this? If this does matter: 8-CURRENT. Thanks matthias -- Matthias Apitz t +49-89-61308 351 - f +49-89-61308 399 - m +49-170-4527211 e - w http://www.unixarea.de/ ___ freebsd-usb@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-usb To unsubscribe, send any mail to "freebsd-usb-unsubscr...@freebsd.org"