RE: Dumping /usr to samba mounted drive
From: Mike Loiterman [mailto:[EMAIL PROTECTED] Sent: Friday, February 03, 2006 9:09 PM To: [EMAIL PROTECTED] Cc: freebsd-questions@freebsd.org Subject: RE: Dumping /usr to samba mounted drive Gayn Winters mailto:[EMAIL PROTECTED] wrote: From: Mike Loiterman [mailto:[EMAIL PROTECTED] Sent: Friday, February 03, 2006 12:46 PM To: [EMAIL PROTECTED]; freebsd-questions@freebsd.org Subject: RE: Dumping /usr to samba mounted drive Gayn Winters mailto:[EMAIL PROTECTED] wrote: [mailto:[EMAIL PROTECTED] On Behalf Of Mike Loiterman Sent: Friday, February 03, 2006 6:05 AM To: freebsd-questions@freebsd.org Subject: RE: Dumping /usr to samba mounted drive Mike Loiterman mailto:[EMAIL PROTECTED] wrote: I'm having trouble dumping /usr to a samba mounted drive. The process dies over processing 4 gigs worth of data. My other partitions dump fine, but they're all less than 4 gigs. This is the error I'm getting: DUMP: Date of this level 0 dump: Fri Feb 3 03:31:05 2006 DUMP: Date of last level 0 dump: the epoch DUMP: Dumping snapshot of /dev/ar0s1f (/usr) to /mnt/backup/usr-dump-l0 DUMP: mapping (Pass I) [regular files] DUMP: mapping (Pass II) [directories] DUMP: estimated 10943850 tape blocks. DUMP: dumping (Pass III) [directories] DUMP: dumping (Pass IV) [regular files] DUMP: 6.73% done, finished in 1:09 at Fri Feb 3 04:45:29 2006 DUMP: 14.92% done, finished in 0:57 at Fri Feb 3 04:38:12 2006 DUMP: 22.98% done, finished in 0:50 at Fri Feb 3 04:36:27 2006 DUMP: 31.37% done, finished in 0:43 at Fri Feb 3 04:34:56 2006 DUMP: write error 4194320 blocks into volume 1 The same thing happens, although I get different errors, if I use bzip2 or gunzip to compress the partition as it is being dumped. It obviously gets a lot further since it's compressed, but it still dies right around 4 gigs. How can I fix this? Is this a samba limitation? BTW, I'm running: FreeBSD 6.0-RELEASE Samba 2.2.12_2 And transfering to unix formated drived mounted under Mac OS X 10.4.4. Would upgrading to Samba 3.x help? -- Mike Loiterman Have you tried generating a file of size 4GB on your mac mini? http://www.freebsdforums.org/forums/showthread .php?p=203909#post203909 Changing the format of the drive to Mac OS Extended fixed the problem. UFS has a 4 gig file size limit. Mike, I'm glad you got it working. What was Apple ever thinking with a 4GB limit? -gayn Did Apple develop the UFS spec or just implement it? Mike, I think our very own M.K. McKusick is credited with inventing UFS for BSD 4.something. I'm sure others on this list know the history better than I do. In particular, I don't know the historical difference between FFS, UFS and UFS1. [If one of you history buffs can elucidate, please do so!] In any case, it looks like Apple chose an implementation at the low end of the range of possible implementations. Here is a chart that I find useful: http://www.mrsci.com/Computer-File-Systems/Comparison_of_file_systems.ph p Note the range of possible maximum file sizes on UFS1. Also note the 4GB limit on FFS. History aside, a 4GB limit for any modern file system seems somewhat backward, especially for an avant garde company like Apple. Maybe they got carried away with the mini in Mac mini! -gayn Bristol Systems Inc. 714/532-6776 www.bristolsystems.com ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
RE: Dumping /usr to samba mounted drive
Mike Loiterman mailto:[EMAIL PROTECTED] wrote: I'm having trouble dumping /usr to a samba mounted drive. The process dies over processing 4 gigs worth of data. My other partitions dump fine, but they're all less than 4 gigs. This is the error I'm getting: DUMP: Date of this level 0 dump: Fri Feb 3 03:31:05 2006 DUMP: Date of last level 0 dump: the epoch DUMP: Dumping snapshot of /dev/ar0s1f (/usr) to /mnt/backup/usr-dump-l0 DUMP: mapping (Pass I) [regular files] DUMP: mapping (Pass II) [directories] DUMP: estimated 10943850 tape blocks. DUMP: dumping (Pass III) [directories] DUMP: dumping (Pass IV) [regular files] DUMP: 6.73% done, finished in 1:09 at Fri Feb 3 04:45:29 2006 DUMP: 14.92% done, finished in 0:57 at Fri Feb 3 04:38:12 2006 DUMP: 22.98% done, finished in 0:50 at Fri Feb 3 04:36:27 2006 DUMP: 31.37% done, finished in 0:43 at Fri Feb 3 04:34:56 2006 DUMP: write error 4194320 blocks into volume 1 The same thing happens, although I get different errors, if I use bzip2 or gunzip to compress the partition as it is being dumped. It obviously gets a lot further since it's compressed, but it still dies right around 4 gigs. How can I fix this? Is this a samba limitation? -- Mike Loiterman grantADLER Tel: 630-302-4944 Fax: 773-442-0992 Email: [EMAIL PROTECTED] PGP Key: 0xD1B9D18E BTW, I'm running: FreeBSD 6.0-RELEASE Samba 2.2.12_2 And transfering to unix formated drived mounted under Mac OS X 10.4.4. Would upgrading to Samba 3.x help? -- Mike Loiterman grantADLER Tel: 630-302-4944 Fax: 773-442-0992 Email: [EMAIL PROTECTED] PGP Key: 0xD1B9D18E ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
RE: Dumping /usr to samba mounted drive
[mailto:[EMAIL PROTECTED] On Behalf Of Mike Loiterman Sent: Friday, February 03, 2006 6:05 AM To: freebsd-questions@freebsd.org Subject: RE: Dumping /usr to samba mounted drive Mike Loiterman mailto:[EMAIL PROTECTED] wrote: I'm having trouble dumping /usr to a samba mounted drive. The process dies over processing 4 gigs worth of data. My other partitions dump fine, but they're all less than 4 gigs. This is the error I'm getting: DUMP: Date of this level 0 dump: Fri Feb 3 03:31:05 2006 DUMP: Date of last level 0 dump: the epoch DUMP: Dumping snapshot of /dev/ar0s1f (/usr) to /mnt/backup/usr-dump-l0 DUMP: mapping (Pass I) [regular files] DUMP: mapping (Pass II) [directories] DUMP: estimated 10943850 tape blocks. DUMP: dumping (Pass III) [directories] DUMP: dumping (Pass IV) [regular files] DUMP: 6.73% done, finished in 1:09 at Fri Feb 3 04:45:29 2006 DUMP: 14.92% done, finished in 0:57 at Fri Feb 3 04:38:12 2006 DUMP: 22.98% done, finished in 0:50 at Fri Feb 3 04:36:27 2006 DUMP: 31.37% done, finished in 0:43 at Fri Feb 3 04:34:56 2006 DUMP: write error 4194320 blocks into volume 1 The same thing happens, although I get different errors, if I use bzip2 or gunzip to compress the partition as it is being dumped. It obviously gets a lot further since it's compressed, but it still dies right around 4 gigs. How can I fix this? Is this a samba limitation? BTW, I'm running: FreeBSD 6.0-RELEASE Samba 2.2.12_2 And transfering to unix formated drived mounted under Mac OS X 10.4.4. Would upgrading to Samba 3.x help? -- Mike Loiterman Have you tried generating a file of size 4GB on your mac mini? http://www.freebsdforums.org/forums/showthread.php?p=203909#post203909 -gayn Bristol Systems Inc. 714/532-6776 www.bristolsystems.com ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
RE: Dumping /usr to samba mounted drive
-Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Gayn Winters Sent: Friday, February 03, 2006 7:16 AM To: [EMAIL PROTECTED]; freebsd-questions@freebsd.org Subject: RE: Dumping /usr to samba mounted drive [mailto:[EMAIL PROTECTED] On Behalf Of Mike Loiterman Sent: Friday, February 03, 2006 6:05 AM To: freebsd-questions@freebsd.org Subject: RE: Dumping /usr to samba mounted drive Mike Loiterman mailto:[EMAIL PROTECTED] wrote: I'm having trouble dumping /usr to a samba mounted drive. The process dies over processing 4 gigs worth of data. My other partitions dump fine, but they're all less than 4 gigs. This is the error I'm getting: DUMP: Date of this level 0 dump: Fri Feb 3 03:31:05 2006 DUMP: Date of last level 0 dump: the epoch DUMP: Dumping snapshot of /dev/ar0s1f (/usr) to /mnt/backup/usr-dump-l0 DUMP: mapping (Pass I) [regular files] DUMP: mapping (Pass II) [directories] DUMP: estimated 10943850 tape blocks. DUMP: dumping (Pass III) [directories] DUMP: dumping (Pass IV) [regular files] DUMP: 6.73% done, finished in 1:09 at Fri Feb 3 04:45:29 2006 DUMP: 14.92% done, finished in 0:57 at Fri Feb 3 04:38:12 2006 DUMP: 22.98% done, finished in 0:50 at Fri Feb 3 04:36:27 2006 DUMP: 31.37% done, finished in 0:43 at Fri Feb 3 04:34:56 2006 DUMP: write error 4194320 blocks into volume 1 The same thing happens, although I get different errors, if I use bzip2 or gunzip to compress the partition as it is being dumped. It obviously gets a lot further since it's compressed, but it still dies right around 4 gigs. How can I fix this? Is this a samba limitation? BTW, I'm running: FreeBSD 6.0-RELEASE Samba 2.2.12_2 And transfering to unix formated drived mounted under Mac OS X 10.4.4. Would upgrading to Samba 3.x help? -- Mike Loiterman Have you tried generating a file of size 4GB on your mac mini? http://www.freebsdforums.org/forums/showthread.php?p=203909#post203909 And in theory ... http://docs.info.apple.com/jarticle.html?artnum=25557-en -gayn Bristol Systems Inc. 714/532-6776 www.bristolsystems.com ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
RE: Dumping /usr to samba mounted drive
Gayn Winters mailto:[EMAIL PROTECTED] wrote: [mailto:[EMAIL PROTECTED] On Behalf Of Mike Loiterman Sent: Friday, February 03, 2006 6:05 AM To: freebsd-questions@freebsd.org Subject: RE: Dumping /usr to samba mounted drive Mike Loiterman mailto:[EMAIL PROTECTED] wrote: I'm having trouble dumping /usr to a samba mounted drive. The process dies over processing 4 gigs worth of data. My other partitions dump fine, but they're all less than 4 gigs. This is the error I'm getting: DUMP: Date of this level 0 dump: Fri Feb 3 03:31:05 2006 DUMP: Date of last level 0 dump: the epoch DUMP: Dumping snapshot of /dev/ar0s1f (/usr) to /mnt/backup/usr-dump-l0 DUMP: mapping (Pass I) [regular files] DUMP: mapping (Pass II) [directories] DUMP: estimated 10943850 tape blocks. DUMP: dumping (Pass III) [directories] DUMP: dumping (Pass IV) [regular files] DUMP: 6.73% done, finished in 1:09 at Fri Feb 3 04:45:29 2006 DUMP: 14.92% done, finished in 0:57 at Fri Feb 3 04:38:12 2006 DUMP: 22.98% done, finished in 0:50 at Fri Feb 3 04:36:27 2006 DUMP: 31.37% done, finished in 0:43 at Fri Feb 3 04:34:56 2006 DUMP: write error 4194320 blocks into volume 1 The same thing happens, although I get different errors, if I use bzip2 or gunzip to compress the partition as it is being dumped. It obviously gets a lot further since it's compressed, but it still dies right around 4 gigs. How can I fix this? Is this a samba limitation? BTW, I'm running: FreeBSD 6.0-RELEASE Samba 2.2.12_2 And transfering to unix formated drived mounted under Mac OS X 10.4.4. Would upgrading to Samba 3.x help? -- Mike Loiterman Have you tried generating a file of size 4GB on your mac mini? http://www.freebsdforums.org/forums/showthread.php?p=203909#post203909 Changing the format of the drive to Mac OS Extended fixed the problem. UFS has a 4 gig file size limit. -- Mike Loiterman grantADLER Tel: 630-302-4944 Fax: 773-442-0992 Email: [EMAIL PROTECTED] PGP Key: 0xD1B9D18E ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
RE: Dumping /usr to samba mounted drive
Gayn Winters mailto:[EMAIL PROTECTED] wrote: From: Mike Loiterman [mailto:[EMAIL PROTECTED] Sent: Friday, February 03, 2006 12:46 PM To: [EMAIL PROTECTED]; freebsd-questions@freebsd.org Subject: RE: Dumping /usr to samba mounted drive Gayn Winters mailto:[EMAIL PROTECTED] wrote: [mailto:[EMAIL PROTECTED] On Behalf Of Mike Loiterman Sent: Friday, February 03, 2006 6:05 AM To: freebsd-questions@freebsd.org Subject: RE: Dumping /usr to samba mounted drive Mike Loiterman mailto:[EMAIL PROTECTED] wrote: I'm having trouble dumping /usr to a samba mounted drive. The process dies over processing 4 gigs worth of data. My other partitions dump fine, but they're all less than 4 gigs. This is the error I'm getting: DUMP: Date of this level 0 dump: Fri Feb 3 03:31:05 2006 DUMP: Date of last level 0 dump: the epoch DUMP: Dumping snapshot of /dev/ar0s1f (/usr) to /mnt/backup/usr-dump-l0 DUMP: mapping (Pass I) [regular files] DUMP: mapping (Pass II) [directories] DUMP: estimated 10943850 tape blocks. DUMP: dumping (Pass III) [directories] DUMP: dumping (Pass IV) [regular files] DUMP: 6.73% done, finished in 1:09 at Fri Feb 3 04:45:29 2006 DUMP: 14.92% done, finished in 0:57 at Fri Feb 3 04:38:12 2006 DUMP: 22.98% done, finished in 0:50 at Fri Feb 3 04:36:27 2006 DUMP: 31.37% done, finished in 0:43 at Fri Feb 3 04:34:56 2006 DUMP: write error 4194320 blocks into volume 1 The same thing happens, although I get different errors, if I use bzip2 or gunzip to compress the partition as it is being dumped. It obviously gets a lot further since it's compressed, but it still dies right around 4 gigs. How can I fix this? Is this a samba limitation? BTW, I'm running: FreeBSD 6.0-RELEASE Samba 2.2.12_2 And transfering to unix formated drived mounted under Mac OS X 10.4.4. Would upgrading to Samba 3.x help? -- Mike Loiterman Have you tried generating a file of size 4GB on your mac mini? http://www.freebsdforums.org/forums/showthread .php?p=203909#post203909 Changing the format of the drive to Mac OS Extended fixed the problem. UFS has a 4 gig file size limit. Mike, I'm glad you got it working. What was Apple ever thinking with a 4GB limit? -gayn Did Apple develop the UFS spec or just implement it? -- Mike Loiterman grantADLER Tel: 630-302-4944 Fax: 773-442-0992 Email: [EMAIL PROTECTED] PGP Key: 0xD1B9D18E ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dumping /usr to samba mounted drive
Mike Loiterman wrote: Gayn Winters mailto:[EMAIL PROTECTED] wrote: [ ... ] Changing the format of the drive to Mac OS Extended fixed the problem. UFS has a 4 gig file size limit. Mike, I'm glad you got it working. What was Apple ever thinking with a 4GB limit? -gayn Did Apple develop the UFS spec or just implement it? Apple's UFS implementation is a big-endian variant inherited from a mixture of Sun and NEXTSTEP code back in the late 80's and early 90's, later seasoned by BSD-4.4Lite. The tradeoffs between HFS+ and UFS are sufficiently complex that neither is a clear winner for general purpose uses, although UFS tends to do well for lots and lots of little files-- think a squid cache, maildir mail spool, tradspool INN layout of Usenet articles; HFS+ by contrast is Unicode-aware and thus supports international filenames sanely, and the B-tree data structure handles volume-wide operations more efficiently, with a lot less head motion, than the highly-recursive tree traversal that UFS mandates. If you're setting up very large filesystems, greater than 10 terabytes, the Xsan product is a solution that even a non-expert admin can get working without fighting too hard. I haven't had the hardware to try to configure a comparably large filesystem using UFS under FreeBSD, but anecdotes suggest that going above either 2TB or 4TB constitutes sailing into unknown waters... -- -Chuck ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
RE: Dumping /usr to samba mounted drive
Chuck Swiger mailto:[EMAIL PROTECTED] wrote: Mike Loiterman wrote: Gayn Winters mailto:[EMAIL PROTECTED] wrote: [ ... ] Changing the format of the drive to Mac OS Extended fixed the problem. UFS has a 4 gig file size limit. Mike, I'm glad you got it working. What was Apple ever thinking with a 4GB limit? -gayn Did Apple develop the UFS spec or just implement it? Apple's UFS implementation is a big-endian variant inherited from a mixture of Sun and NEXTSTEP code back in the late 80's and early 90's, later seasoned by BSD-4.4Lite. The tradeoffs between HFS+ and UFS are sufficiently complex that neither is a clear winner for general purpose uses, although UFS tends to do well for lots and lots of little files-- think a squid cache, maildir mail spool, tradspool INN layout of Usenet articles; HFS+ by contrast is Unicode-aware and thus supports international filenames sanely, and the B-tree data structure handles volume-wide operations more efficiently, with a lot less head motion, than the highly-recursive tree traversal that UFS mandates. If you're setting up very large filesystems, greater than 10 terabytes, the Xsan product is a solution that even a non-expert admin can get working without fighting too hard. I haven't had the hardware to try to configure a comparably large filesystem using UFS under FreeBSD, but anecdotes suggest that going above either 2TB or 4TB constitutes sailing into unknown waters... My setup is just a 160 Gig firewire drive I'm using as a backup for my server. I hate dealing with tapes, so this is a good solution for me. It's nothing near as complex as what you're describing. The regular Mac OS Extended filesystem seems to work just fine and suuports files up to 16 exabytes, I believe. -- Mike Loiterman grantADLER Tel: 630-302-4944 Fax: 773-442-0992 Email: [EMAIL PROTECTED] PGP Key: 0xD1B9D18E ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
