On 06/ 3/10 06:52 AM, Albert Lee wrote:
On Wed, 02 Jun 2010 23:10:29 -0700, Shawn Walker<[email protected]>
wrote:
On 06/ 2/10 04:53 PM, Shawn Walker wrote:
Greetings,
Attached is the 3rd (final?) draft for the addition of an on-disk
format
to pkg(5). Any and all feedback is greatly appreciated by the end of
June 7th, 2010.
For those that read the second draft, you can find a webrev with
differences here:
http://cr.opensolaris.org/~swalker/pkg-ondisk-3/
Technically, the webrev has the attachment ;)
However, the draft is now attached.
Cheers,
-Shawn
Given the selection of container format, have you considered compression
algorithms for the whole container that meets your requirements? The
majority of popular compressors require an out-of-band index to facilitate
random access without additional seeking.
There are no plans to support compressed versions of these archives at
this time since the individual files in the archive are or can already
be compressed (that's that normal expectation for a repository).
One of the points mentioned in the document was:
- can be a container of compressed files, as opposed to a
compressed container of uncompressed files,
Although perhaps I should have worded that "is a container".
And yes, I'm aware that somewhat better compression might be achieved
across the entire archive if the individual files were uncompressed.
Minor inconsistency in the requirements:
The requirements for the on-disk archive format include:
- support for archives greater than 8GB in size,
- support for files in archive greater than 4GB in size,
...
The cpio format was rejected for the following reasons:
- The size of files in portable cpio archives is limited to
(8 * 2^30) bytes.
Pathname length would be another reason.
I should have made this explicit, but archive size support for cpio
archives varies greatly by implementation. It also depends on which
variant of cipo is being discussed:
* old binary format -- 2GB individual file size maximum; duplicates
data for hardlinks, and many utilities don't support archives larger
than 2-4GB for this format; 256 character pathname limit
* portable ascii format (SUSv2) -- 8GB file size limit; 256 character
pathname limit
* "new" ascii / crc formats -- 1023 character pathname limit
* cray / sco formats -- 9EB file size limit, but not portable
I'll slightly tweak this section, but it really doesn't affect the end
result.
Cheers,
-Shawn
_______________________________________________
pkg-discuss mailing list
[email protected]
http://mail.opensolaris.org/mailman/listinfo/pkg-discuss
