Re: [arch] GZIP.. Value too large for defined data type..
On Thu, Jan 25, 2007 at 12:55:37PM -0500, David Rosenstrauch wrote: Jürgen Hötzel wrote: On Wed, Jan 24, 2007 at 04:40:15PM -0500, joe henderson wrote: All, Is there a way to turn on gzips larger file size bit in the install? gzip needs to be patched to use O_LARGEFILE. Has anyone filed a bug for this yet? If not, please let me know and I'll file one. gzip 1.3.9 (Beta) has support for large files. Jürgen ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
Re: [arch] GZIP.. Value too large for defined data type..
Eli Heady wrote: On Wednesday 24 January 2007 16:40, joe henderson wrote: All, Is there a way to turn on gzips larger file size bit in the install? I have a few backup files that are 4+ GB.. I do not want to split the tars in multiple files to achieve this... Advise.. Joe This is not an answer to your question, but have you considered using bzip2 instead? It will create archives in excess of 4 Gb, and bzip2 (through bzip2recover) will get you closer to recovering data from corrupted archives. -eli No I have not considered this... Since all my backups are in shell scripts I can look into it... Thanks for the info about the bzip2recover option... Has anyone looked @ using pars for recovery since we are on the subject? TIA, Joe ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
Re: [arch] GZIP.. Value too large for defined data type..
Jürgen Hötzel wrote: On Wed, Jan 24, 2007 at 04:40:15PM -0500, joe henderson wrote: All, Is there a way to turn on gzips larger file size bit in the install? gzip needs to be patched to use O_LARGEFILE. Has anyone filed a bug for this yet? If not, please let me know and I'll file one. I just tested unzipping a 4GB tarball and found that gunzip is indeed barfing on it. BTW, bzip2 is NOT a solution here. It's *VERY* much slower than gzip. Workaround, using shell-redirection: gzip in.tar /tmp/out.tar.gz Jürgen Hmmm ... not sure I grok why this is different. Anyone want to hit me with a cluestick? DR ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
Re: [arch] GZIP.. Value too large for defined data type..
Is this an arch issue or is it gzip specific? i too do backups using gzip... but the files so far haven't exceeded the 4gb limit, and so far i've had no problems with extracting the contents of the files. Would be nice to know if there is a solution for this so i can change my backup scripts/patch gzip to fix it... And i do agree, dont really want to make my backuping slower by using bzip. / Fredrik Eriksson David Rosenstrauch wrote: Jürgen Hötzel wrote: On Wed, Jan 24, 2007 at 04:40:15PM -0500, joe henderson wrote: All, Is there a way to turn on gzips larger file size bit in the install? gzip needs to be patched to use O_LARGEFILE. Has anyone filed a bug for this yet? If not, please let me know and I'll file one. I just tested unzipping a 4GB tarball and found that gunzip is indeed barfing on it. BTW, bzip2 is NOT a solution here. It's *VERY* much slower than gzip. Workaround, using shell-redirection: gzip in.tar /tmp/out.tar.gz Jürgen Hmmm ... not sure I grok why this is different. Anyone want to hit me with a cluestick? DR ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
Re: [arch] GZIP.. Value too large for defined data type..
2007/1/25, David Rosenstrauch [EMAIL PROTECTED]: gzip in.tar /tmp/out.tar.gz Hmmm ... not sure I grok why this is different. Anyone want to hit me with a cluestick? I believe to understand that, using stdin, you bypass dimension check, since you are using a stream, for which size is unknown. After all, you just need a switch at compile time for large files, so it's not a technical limitation, and I think the gzip algo is a streaming one, so size is not a big issue. Maybe it's limited to comply with older filesystems that can't handle files that big. bardo ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
[arch] GZIP.. Value too large for defined data type..
All, Is there a way to turn on gzips larger file size bit in the install? I have a few backup files that are 4+ GB.. I do not want to split the tars in multiple files to achieve this... Advise.. Joe ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
Re: [arch] GZIP.. Value too large for defined data type..
On Wednesday 24 January 2007 16:40, joe henderson wrote: All, Is there a way to turn on gzips larger file size bit in the install? I have a few backup files that are 4+ GB.. I do not want to split the tars in multiple files to achieve this... Advise.. Joe This is not an answer to your question, but have you considered using bzip2 instead? It will create archives in excess of 4 Gb, and bzip2 (through bzip2recover) will get you closer to recovering data from corrupted archives. -eli ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
Re: [arch] GZIP.. Value too large for defined data type..
joe henderson wrote: All, Is there a way to turn on gzips larger file size bit in the install? I have a few backup files that are 4+ GB.. I do not want to split the tars in multiple files to achieve this... Advise.. Joe ? Is this actually a restriction with gzipped archives? I've been routinely making gzipped tarballs (which are currently exceeding 4GB) after each of my daily backups in order to put an additional copy on DVD, but haven't yet had need to unzip them. I've listed the contents (tar -tvzf) and that's seemed to work fine, but never had to actually unzip the thing. If this is an issue, I'd like to know. Anyone have any details on this limit? There's nothing in the gzip man page about it. TIA, DR ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
Re: [arch] GZIP.. Value too large for defined data type..
On Wed, Jan 24, 2007 at 04:40:15PM -0500, joe henderson wrote: All, Is there a way to turn on gzips larger file size bit in the install? gzip needs to be patched to use O_LARGEFILE. Workaround, using shell-redirection: gzip in.tar /tmp/out.tar.gz Jürgen pgpfxmYflaxQ2.pgp Description: PGP signature ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
Re: [arch] GZIP.. Value too large for defined data type..
Thursday 25 January 2007, Jürgen Hötzel wrote: | Workaround, using shell-redirection: | | gzip in.tar /tmp/out.tar.gz is using shell redirection not slower? (just wondering - don't have O_LARGEFILE patched gzip myself to compare) thanx + greetings, Damir -- dcop amarok player nowPlaying: Celia Cruz - Guantanamera pgpI6AizsHx9s.pgp Description: PGP signature ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
Re: [arch] GZIP.. Value too large for defined data type..
On Thu, Jan 25, 2007 at 12:46:42AM +0100, Damir Perisa wrote: Thursday 25 January 2007, Jürgen Hötzel wrote: | Workaround, using shell-redirection: | | gzip in.tar /tmp/out.tar.gz is using shell redirection not slower? (just wondering - don't have O_LARGEFILE patched gzip myself to compare) Its not slower: Files are just opened by shell and corresponding filedescriptors are duplicated to STDIN_FILENO/STDOUT_FILENO before executing gzip. Jürgen pgpxbwyDaA6GN.pgp Description: PGP signature ___ arch mailing list arch@archlinux.org http://www.archlinux.org/mailman/listinfo/arch
