Re: Burning DVD with files4GB from console
David Kelly pisze: On Thu, Dec 04, 2008 at 10:48:54AM +0100, Bartosz Stec wrote: My backup script split filesystem dumps to files with size of 4,37 GB (4 588 544 kB). It's just an optimal size to fill out DVDs. At this moment I have to burn them from windows via smb-link becuase I didn't manage to do this task from FreeBSD console due to 2GB/4GB filesize restrictions (growisofs). Since when did FreeBSD (or growisofs) have a 2GB/4GB filesize limit? I have burned 4.3GB DVDs several times. Just look, here is example: fbsd# growisofs -Z /dev/cd0 -R -J -udf -iso-level 3 -dry-run somefile Executing 'mkisofs -R -J -udf -iso-level 3 somefile | builtin_dd of=/dev/pass0 obs=32k seek=0' mkisofs: Value too large to be stored in data type. File somefile is too large - ignoring I'm not talking about restriction of DVD size, but restriction to filesize wchich I want to place on DVD: fbsd# cat somefile | split -b 2G fbsd# rm somefile fbsd# ls -lh total 4590848 -rw-r--r-- 1 root operator 2,0G 5 gru 09:18 xaa -rw-r--r-- 1 root operator 2,0G 5 gru 09:24 xab -rw-r--r-- 1 root operator 385M 5 gru 09:26 xac fbsd# growisofs -v -Z /dev/cd0 -R -J -udf -dry-run ./ Executing 'mkisofs -v -R -J -udf ./ | builtin_dd of=/dev/pass0 obs=32k seek=0' mkisofs 2.01 (i386-unknown-freebsd7.0) Scanning ./ Writing: Initial PadblockStart Block 0 Done with: Initial PadblockBlock(s)16 Writing: Primary Volume Descriptor Start Block 16 Done with: Primary Volume Descriptor Block(s)1 Writing: Joliet Volume DescriptorStart Block 17 Done with: Joliet Volume DescriptorBlock(s)1 Writing: End Volume Descriptor Start Block 18 Done with: End Volume Descriptor Block(s)1 Writing: UDF volume recognition area Start Block 19 Done with: UDF volume recognition area Block(s)3 Writing: Version block Start Block 22 Done with: Version block Block(s)1 Writing: UDF pad to sector 32Start Block 23 Done with: UDF pad to sector 32Block(s)9 Writing: UDF main seqStart Block 32 When I split that file there are no errors and DVD is 4,3GB size. -- Bartosz Stec ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
David Kelly pisze: On Thu, Dec 04, 2008 at 12:44:14PM -0500, Steve Polyack wrote: Not too say you're .iso images can't be 2GB/4GB, but I'm pretty sure the ISO9660 standard is limited to a 2GB maximum file size (for files within the .iso). You must use UDF to burn files of greater size. mkisofs(8) seems to support this, if only in alpha/hybrid stage: -udf Include UDF support in the generated filesystem image. UDF sup- port is currently in alpha status and for this reason, it is not possible to create UDF only images. It would seem then that the O.P. who is already splitting his backup into 4.3GB chunks should split backups into sub-2GB chunks. 4,700,000,000 is the standard DVD size, I'd shoot for chunks of 4.5E9/3 so as to have about 200MB of headroom per DVD. growisofs will write 3 files to the DVD just as easily as one. The magic of growisofs is that it invokes mkisofs on the fly. And also that cdrecord had obnoxious (and broken) licensing in years past when I last tried it. Yes, I know that. My reasons for keeping one file on DVD are just for making my life easier. If I want to restore some files from filesystem backup (they are made via pipeline dump | gunzip | split) I have to copy all files from DVDs wchich includes needed filesystem and then I type: cat file1 file2 file3 ... fileN | gunzip | restore -if - And yes, I know that tapes are much better for tasks like this but for now I just have to use DVDs :) Now imagine backup placed on 10 DVDs. With single file on DVD I have 10 files to manage, not 30. I know there're workarounds but with more files I probably will need some script to restore files rather than do it manually. That's the reason I asked if there's a possibility to burn it this way from FreeBSD. -- Bartosz Stec ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
Stephen Montgomery-Smith pisze: David Kelly wrote: On Thu, Dec 04, 2008 at 10:48:54AM +0100, Bartosz Stec wrote: My backup script split filesystem dumps to files with size of 4,37 GB (4 588 544 kB). It's just an optimal size to fill out DVDs. At this moment I have to burn them from windows via smb-link becuase I didn't manage to do this task from FreeBSD console due to 2GB/4GB filesize restrictions (growisofs). Since when did FreeBSD (or growisofs) have a 2GB/4GB filesize limit? I have burned 4.3GB DVDs several times. I never had a problem writing huge files. But I did have a problem subsequently reading it with Windows XP. Maybe the file size restriction is a Windows thing. Nope. I am burning my backups from Windows, and they're readable both from Windows and FreeBSD. FreeBSD just doesn't let me burn them directly :) -- Bartosz Stec ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
Steve Polyack pisze: Not too say you're .iso images can't be 2GB/4GB, but I'm pretty sure the ISO9660 standard is limited to a 2GB maximum file size (for files within the .iso). You must use UDF to burn files of greater size. mkisofs(8) seems to support this, if only in alpha/hybrid stage: -udf Include UDF support in the generated filesystem image. UDF sup- port is currently in alpha status and for this reason, it is not possible to create UDF only images. Indeed. I'm using -udf switch, no success. -- Bartosz Stec ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
Bob Johnson pisze: On 12/4/08, Bartosz Stec [EMAIL PROTECTED] wrote: Philipp Ost pisze: Hi, Bartosz Stec wrote: [...] Is there *any* way to burn DVDs with files4GB from FreeBSD console? I succesfully used growisofs for exactly this task ;-) What I did is (for DL-DVDs): # growisofs -dvd-compat -Z /dev/cd0=$file.iso -speed=2 I had to limit the speed, else it wouldn't do anything. If I burn normal DVDs I don't need the speed limit. HTH, Philipp But doesn't that command expecting file.iso being already premastered ISO image? OK, that's *some* way, but to be clear - I want to avoid preparing ISO images too ;) Some thoughts that might be useful: 1) I expect the problem is with mkisofs version 2.01 that is used in FreeBSD (at least in 7.0), but I haven't attempted to confirm this. Growisofs is supposed to handle large files, and so are recent versions of mkisofs. The author of mkisofs considers 2.01 to be obsolete. Perhaps installing a newer mkisofs is the solution (e.g. sysutils/cdrtools-devel appears to be fairly recent)? 2) Perhaps you could do what I do and write tar files directly to DVD with no filesystem. I use burncd to write the file to the DVD, but I don't remember if I've tried to exceed 4 GiB per file. You might need growisofs in premastered image mode instead of burncd. To read the file later use something like 'tar -xf /dev/cd0'. Might have a problem with this in Windows, but maybe that's not really a problem? 3) You could modify your script to use mkisofs to create the ISO image as part of the process of splitting your files into (smaller) chunks. Then use growisofs in premastered image mode, as already suggested. If you want to do this, look at the -stream-media-size option in mkisofs. 4) The 4 GiB limit on file size is built into the ISO 9660 filesystem prior to Level 3. Level 3 allows larger files by allowing files to have multiple extents (each extent must still be 4 GiB). You may need to explicitly specify ISO Level 3 to get the correct behavior (i.e. use the '-iso-level 3' option with growisofs or mkisofs). -- Bob Johnson [EMAIL PROTECTED] ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED] Thanks a lot! Upgrading to sysutils/cdrtools-devel solves my problem! :) -- Bartosz Stec ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
My backup script split filesystem dumps to files with size of 4,37 GB (4 588 544 kB). It's just an optimal size to fill out DVDs. At this moment I have to burn them from windows via smb-link becuase I didn't manage to do this task from FreeBSD console due to 2GB/4GB filesize restrictions (growisofs). I'm using freeware CDBurnerXP to burn my backups What limitations are you thinking of? Growisofs is based on mkisofs which is part of cdrtools. Mkisofs supports large files since a long time (~ 8 years). I never had a problem writing huge files. But I did have a problem subsequently reading it with Windows XP. Maybe the file size restriction is a Windows thing. From the information I have, MS-WIN handles large files correctly. What problems do you have? Not too say you're .iso images can't be 2GB/4GB, but I'm pretty sure the ISO9660 standard is limited to a 2GB maximum file size (for files within the .iso). You must use UDF to burn files of greater size. mkisofs(8) seems to support this, if only in alpha/hybrid stage: The ISO-9660 standard is limited to 8 TB for the max. filesystem size as well as for the size of a single file. Mkisofs supports single files up to 4 GB since ~ Y2000 and it suppports files up to 8 TB since 2 years. growisofs will write 3 files to the DVD just as easily as one. The magic of growisofs is that it invokes mkisofs on the fly. And also that cdrecord had obnoxious (and broken) licensing in years past when I last tried it. Cdrecord alwas had and still has a free license. There is nothing broken with cdrtools/cdrecord. There is however a big social problem with the anti-social habbit and propaganda from Debian. Fortunately, cdrtools is not related to Debian, so where is your problem? Growisofs depends on mkisofs and mkisofs is part of cdrtools, so you need cdrtools anyway. 1) I expect the problem is with mkisofs version 2.01 that is used in FreeBSD (at least in 7.0), but I haven't attempted to confirm this. Growisofs is supposed to handle large files, and so are recent versions of mkisofs. The author of mkisofs considers 2.01 to be obsolete. Perhaps installing a newer mkisofs is the solution (e.g. sysutils/cdrtools-devel appears to be fairly recent)? mkisofs-2.01 is more than 4 years old. It is not just obsolete but extremely outdated. Since mkisofs-2.01 30-50% of the code has been replaced or added. Cdrtools is only a few weeks from the next major release and it would be silly not to use a recent version. Jörg -- EMail:[EMAIL PROTECTED] (home) Jörg Schilling D-13353 Berlin [EMAIL PROTECTED](uni) [EMAIL PROTECTED] (work) Blog: http://schily.blogspot.com/ URL: http://cdrecord.berlios.de/private/ ftp://ftp.berlios.de/pub/schily ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Burning DVD with files4GB from console
My backup script split filesystem dumps to files with size of 4,37 GB (4 588 544 kB). It's just an optimal size to fill out DVDs. At this moment I have to burn them from windows via smb-link becuase I didn't manage to do this task from FreeBSD console due to 2GB/4GB filesize restrictions (growisofs). I'm using freeware CDBurnerXP to burn my backups (ISO9660/UDF/Joliet), and they mount without problems on my FreeBSD BOX, files are fully readable too. However, burning gigabytes of data via slow (about 3.5MB/s) SMB network is just annoing. Is there *any* way to burn DVDs with files4GB from FreeBSD console? cheers! -- Bartosz Stec ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
On Thu, 04 Dec 2008 10:48:54 +0100 Bartosz Stec [EMAIL PROTECTED] wrote: My backup script split filesystem dumps to files with size of 4,37 GB (4 588 544 kB). It's just an optimal size to fill out DVDs. At this moment I have to burn them from windows via smb-link becuase I didn't manage to do this task from FreeBSD console due to 2GB/4GB filesize restrictions (growisofs). I'm using freeware CDBurnerXP to burn my backups (ISO9660/UDF/Joliet), and they mount without problems on my FreeBSD BOX, files are fully readable too. However, burning gigabytes of data via slow (about 3.5MB/s) SMB network is just annoing. Is there *any* way to burn DVDs with files4GB from FreeBSD console? As a work around you could simply tell your backup script to spilt the data at about 1GB and burn 4 files to one DVD. Andreas -- GnuPG key : 0x2A573565|http://www.gnupg.org/howtos/de/ Fingerprint: 925D 2089 0BF9 8DE5 9166 33BB F0FD CD37 2A57 3565 pgpTKatMIIJUC.pgp Description: PGP signature
Re: Burning DVD with files4GB from console
Philipp Ost pisze: Hi, Bartosz Stec wrote: [...] Is there *any* way to burn DVDs with files4GB from FreeBSD console? I succesfully used growisofs for exactly this task ;-) What I did is (for DL-DVDs): # growisofs -dvd-compat -Z /dev/cd0=$file.iso -speed=2 I had to limit the speed, else it wouldn't do anything. If I burn normal DVDs I don't need the speed limit. HTH, Philipp But doesn't that command expecting file.iso being already premastered ISO image? OK, that's *some* way, but to be clear - I want to avoid preparing ISO images too ;) -- Bartosz Stec ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
Hi, Bartosz Stec wrote: [...] Is there *any* way to burn DVDs with files4GB from FreeBSD console? I succesfully used growisofs for exactly this task ;-) What I did is (for DL-DVDs): # growisofs -dvd-compat -Z /dev/cd0=$file.iso -speed=2 I had to limit the speed, else it wouldn't do anything. If I burn normal DVDs I don't need the speed limit. HTH, Philipp ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
On Thu, Dec 04, 2008 at 10:48:54AM +0100, Bartosz Stec wrote: My backup script split filesystem dumps to files with size of 4,37 GB (4 588 544 kB). It's just an optimal size to fill out DVDs. At this moment I have to burn them from windows via smb-link becuase I didn't manage to do this task from FreeBSD console due to 2GB/4GB filesize restrictions (growisofs). Since when did FreeBSD (or growisofs) have a 2GB/4GB filesize limit? I have burned 4.3GB DVDs several times. -- David Kelly N4HHE, [EMAIL PROTECTED] Whom computers would destroy, they must first drive mad. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
David Kelly wrote: On Thu, Dec 04, 2008 at 10:48:54AM +0100, Bartosz Stec wrote: My backup script split filesystem dumps to files with size of 4,37 GB (4 588 544 kB). It's just an optimal size to fill out DVDs. At this moment I have to burn them from windows via smb-link becuase I didn't manage to do this task from FreeBSD console due to 2GB/4GB filesize restrictions (growisofs). Since when did FreeBSD (or growisofs) have a 2GB/4GB filesize limit? I have burned 4.3GB DVDs several times. I never had a problem writing huge files. But I did have a problem subsequently reading it with Windows XP. Maybe the file size restriction is a Windows thing. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
Not too say you're .iso images can't be 2GB/4GB, but I'm pretty sure the ISO9660 standard is limited to a 2GB maximum file size (for files within the .iso). You must use UDF to burn files of greater size. mkisofs(8) seems to support this, if only in alpha/hybrid stage: -udf Include UDF support in the generated filesystem image. UDF sup- port is currently in alpha status and for this reason, it is not possible to create UDF only images. Stephen Montgomery-Smith wrote: David Kelly wrote: On Thu, Dec 04, 2008 at 10:48:54AM +0100, Bartosz Stec wrote: My backup script split filesystem dumps to files with size of 4,37 GB (4 588 544 kB). It's just an optimal size to fill out DVDs. At this moment I have to burn them from windows via smb-link becuase I didn't manage to do this task from FreeBSD console due to 2GB/4GB filesize restrictions (growisofs). Since when did FreeBSD (or growisofs) have a 2GB/4GB filesize limit? I have burned 4.3GB DVDs several times. I never had a problem writing huge files. But I did have a problem subsequently reading it with Windows XP. Maybe the file size restriction is a Windows thing. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED] ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
On Thu, Dec 04, 2008 at 12:44:14PM -0500, Steve Polyack wrote: Not too say you're .iso images can't be 2GB/4GB, but I'm pretty sure the ISO9660 standard is limited to a 2GB maximum file size (for files within the .iso). You must use UDF to burn files of greater size. mkisofs(8) seems to support this, if only in alpha/hybrid stage: -udf Include UDF support in the generated filesystem image. UDF sup- port is currently in alpha status and for this reason, it is not possible to create UDF only images. It would seem then that the O.P. who is already splitting his backup into 4.3GB chunks should split backups into sub-2GB chunks. 4,700,000,000 is the standard DVD size, I'd shoot for chunks of 4.5E9/3 so as to have about 200MB of headroom per DVD. growisofs will write 3 files to the DVD just as easily as one. The magic of growisofs is that it invokes mkisofs on the fly. And also that cdrecord had obnoxious (and broken) licensing in years past when I last tried it. -- David Kelly N4HHE, [EMAIL PROTECTED] Whom computers would destroy, they must first drive mad. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Burning DVD with files4GB from console
On 12/4/08, Bartosz Stec [EMAIL PROTECTED] wrote: Philipp Ost pisze: Hi, Bartosz Stec wrote: [...] Is there *any* way to burn DVDs with files4GB from FreeBSD console? I succesfully used growisofs for exactly this task ;-) What I did is (for DL-DVDs): # growisofs -dvd-compat -Z /dev/cd0=$file.iso -speed=2 I had to limit the speed, else it wouldn't do anything. If I burn normal DVDs I don't need the speed limit. HTH, Philipp But doesn't that command expecting file.iso being already premastered ISO image? OK, that's *some* way, but to be clear - I want to avoid preparing ISO images too ;) Some thoughts that might be useful: 1) I expect the problem is with mkisofs version 2.01 that is used in FreeBSD (at least in 7.0), but I haven't attempted to confirm this. Growisofs is supposed to handle large files, and so are recent versions of mkisofs. The author of mkisofs considers 2.01 to be obsolete. Perhaps installing a newer mkisofs is the solution (e.g. sysutils/cdrtools-devel appears to be fairly recent)? 2) Perhaps you could do what I do and write tar files directly to DVD with no filesystem. I use burncd to write the file to the DVD, but I don't remember if I've tried to exceed 4 GiB per file. You might need growisofs in premastered image mode instead of burncd. To read the file later use something like 'tar -xf /dev/cd0'. Might have a problem with this in Windows, but maybe that's not really a problem? 3) You could modify your script to use mkisofs to create the ISO image as part of the process of splitting your files into (smaller) chunks. Then use growisofs in premastered image mode, as already suggested. If you want to do this, look at the -stream-media-size option in mkisofs. 4) The 4 GiB limit on file size is built into the ISO 9660 filesystem prior to Level 3. Level 3 allows larger files by allowing files to have multiple extents (each extent must still be 4 GiB). You may need to explicitly specify ISO Level 3 to get the correct behavior (i.e. use the '-iso-level 3' option with growisofs or mkisofs). -- Bob Johnson [EMAIL PROTECTED] ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
