untgz and double zipping (was Re: Re: [fd-dev] Enquiry: Update packs)
On Mon, 2 Dec 2002, tom ehlert wrote:
But this is tricky to unpack
No.
Depends :)
and needs more temp space.
Yes.
Not necessarily.
I recommend using TGZ in that case.
not available for DOS.
It is, see:
ftp://ftp.cs.pdx.edu/pub/elvis
It's called untar, but it really is untgz.
((Er, it's also the coolest editor around ;-
but only a monolithic TAR+GZ would avoid
the temp space problem
And if I'm not mistaken, this one is one.
BTW: I slightly remember that the INSTALLER already includes the UNZIP
source(s). When you do a UNZIP archive.ZIP, there is no need to seek
around within the file, no need to read the ZIP directory and stuff; so
the UNZIP loop might looks like the one in untar:
while(read a chunk from the ZIP file) {
if(new file header) {
create the file
open the file
} else {
decompress the block into the currently open file
}
}
Does somebody know about the memory consumption of the decompression
process and if two of them can exists in parallel simultaneously? Then and
if you know that you unpack a double-zipped archive in advance, it should
be easy to implement it. -- Where is the volunteer? ;-)
Bye,
--
Steffen Kaiser
--
list options/archives/etc.: http://www.topica.com/lists/fd-dev
unsubscribe: send blank email to: [EMAIL PROTECTED]
==^
This email was sent to: archive@mail-archive.com
EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2
Or send an email to: [EMAIL PROTECTED]
T O P I C A -- Register now to manage your mail!
http://www.topica.com/partner/tag02/register
==^
RE: untgz and double zipping (was Re: Re: [fd-dev] Enquiry: Update packs)
Steffen Kaiser Does somebody know about the memory consumption of the decompression process and if two of them can exists in parallel simultaneously? Then and if you know that you unpack a double-zipped archive in advance, it should be easy to implement it. -- Where is the volunteer? ;-) If you use the zlib uncompressor, you need a buffer of max 32K for good results. I don't know how much memory the zlib code would take since I have only used it for Windows progs. -- list options/archives/etc.: http://www.topica.com/lists/fd-dev unsubscribe: send blank email to: [EMAIL PROTECTED] ==^ This email was sent to: archive@mail-archive.com EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2 Or send an email to: [EMAIL PROTECTED] T O P I C A -- Register now to manage your mail! http://www.topica.com/partner/tag02/register ==^
Re: [fd-dev] Enquiry: Update packs
Eric Auer wrote: Hi Aitor, you did not get the point... when you zip 100 files that are the same, the zip will be 100 times some size. However, when you use an UNCOMPRESSED zip, then the file will basically contain 100 times the same data structure. TAR is in principle the same as an uncompressed zip, but it is more UNIX while zip is more DOS. Yes, I knew this. However, we are talking about the resident size it will take in your harddriver after it has been installed. I am not trying to discuss the reduced/full issue. Aitor -- list options/archives/etc.: http://www.topica.com/lists/fd-dev unsubscribe: send blank email to: [EMAIL PROTECTED] ==^ This email was sent to: archive@mail-archive.com EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2 Or send an email to: [EMAIL PROTECTED] T O P I C A -- Register now to manage your mail! http://www.topica.com/partner/tag02/register ==^
Re: [fd-dev] Enquiry: Update packs
X-Comment-To: Aitor Santamaria Merino Hi! 3-äÅË-2002 16:55 [EMAIL PROTECTED] (Aitor Santamaria Merino) wrote to [EMAIL PROTECTED]: ASM Well, the good point is that the code could be disposed after loading KEYB. Of course. ASM I haven't used these libraries, but I just wonder if one can decompress ASM parts of a file, if the layouts are all (or most) in a single ASM KEYBOARD.SYS file. Why not? Simply pack file by separate parts (for example, split file by 2k-16k blocks/pages). To speedup seek you may also keep tabe of offsets to each page. ASM In any case, I think I'll leave this for version 3.X, there's enough ASM stuff to keep me busy with 2.X already ;-) -- list options/archives/etc.: http://www.topica.com/lists/fd-dev unsubscribe: send blank email to: [EMAIL PROTECTED] ==^^=== This email was sent to: archive@mail-archive.com EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2 Or send an email to: [EMAIL PROTECTED] T O P I C A -- Register now to manage your mail! http://www.topica.com/partner/tag02/register ==^^===
re: Re: [fd-dev] Enquiry: Update packs
Hi, I think you are overdoing things. When MSN started ages ago, they started in dozens of countries with only 3 or 4 languages. I think it IS useful to have the reduced set on the install disks. The installer can then pick one of the language specific sets to copy to C:, as is currently done with CuteMouse, too. I think doublezipping is also overdoing things. The doublezipping works because when you FIRST zip with NO compression and THEN pack that zip into another zip, then you can compress archives with several similar files better. But this is tricky to unpack and needs more temp space. I recommend using TGZ in that case. There are at least TAR and GZIP for DOS, but only a monolithic TAR+GZ would avoid the temp space problem (with separate tools, you need space for the uncompressed inner zip...). And I think all this is too complicated for our installer! Only use it when the differences are really big. Eric. -- list options/archives/etc.: http://www.topica.com/lists/fd-dev unsubscribe: send blank email to: [EMAIL PROTECTED] ==^ This email was sent to: archive@mail-archive.com EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2 Or send an email to: [EMAIL PROTECTED] T O P I C A -- Register now to manage your mail! http://www.topica.com/partner/tag02/register ==^
Re: [fd-dev] Enquiry: Update packs
X-Comment-To: tom ehlert Hi! 2-äÅË-2002 21:01 [EMAIL PROTECTED] (tom ehlert) wrote to [EMAIL PROTECTED]: I recommend using TGZ in that case. te not available for DOS. __O\_/_\_/O__ UNTGZ/386 Decompression Utility 0.94 freeware version Copyright (c) 1996 Tillmann Steinbrecher. Aug 22 1996 USAGE: UNTGZ386 filename filespec to extract from TGZ/TAR archive UNTGZ386 -l filename filespec to list/test TGZ/TAR archive UNTGZ386 -t filename to test CRC of GZ/TGZ archive UNTGZ386 -d infile outfile to decompress GZ archive GZIP compressed, PKZIP compressed and uncompressed TAR archives are supported. This freeware program may be distributed according to the terms of the GNU general public license version 2. *** PLEASE NOTE *** If you frequently use this program, send email: [EMAIL PROTECTED] Just a short message like I'm using your program will seriously enhance the possiblity of updates being made. Thank you. _ O/~\ /~\O -- list options/archives/etc.: http://www.topica.com/lists/fd-dev unsubscribe: send blank email to: [EMAIL PROTECTED] ==^^=== This email was sent to: archive@mail-archive.com EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2 Or send an email to: [EMAIL PROTECTED] T O P I C A -- Register now to manage your mail! http://www.topica.com/partner/tag02/register ==^^===
Re: Re: [fd-dev] Enquiry: Update packs
is possible. the problem is with the installer, not with ZIP. pipes == temp space under DOS. So doesn't change much. I meant, that the problem is with the *permanent* space requirements. 233 Kb *temp* requirement is certainly available; at least if you have - a CDROM - some internet connection - some way to burn a CDROM - current assumed distro tom -- list options/archives/etc.: http://www.topica.com/lists/fd-dev unsubscribe: send blank email to: [EMAIL PROTECTED] ==^ This email was sent to: archive@mail-archive.com EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2 Or send an email to: [EMAIL PROTECTED] T O P I C A -- Register now to manage your mail! http://www.topica.com/partner/tag02/register ==^
re: Re: [fd-dev] Enquiry: Update packs
Hi Aitor, you did not get the point... when you zip 100 files that are the same, the zip will be 100 times some size. However, when you use an UNCOMPRESSED zip, then the file will basically contain 100 times the same data structure. TAR is in principle the same as an uncompressed zip, but it is more UNIX while zip is more DOS. The second step is to ZIP the uncompressed ZIP into ANOTHER zip, which can be quite small, as 100 times the same data structure can be nicely compressed. The positive part of this is the additional space saving. The negative part is that you must do: with TAR: TGZ=TAR.GZ - gunzip - TAR - (un)tar - files with ZIP: ZIP - unzip - uncompressed ZIP - files In Unix you can do this with pipes, but in DOS, even when you do it with pipes, you need temporary disk space for the TAR or the uncompressed ZIP file, and this is what the discussion is about. If people have enough RAM for a RAMDISK, then you can just as well use a 32bit combined DOS TGZ-files in one step program that avoids the need of a temp file. But the installer should work with 640k RAM in 16bit mode! By the way, the installer that is planned for beta 8 H 2 already localizes command.com and cutemouse, if your XKEYB would use the same language codes (or if we translate them, of course), localization of XKEYB can definitely be added. I think translation is best: if LANG=DE ... keyb is GR ... ... command.com is DE ... ... cutemouse is DE ... ... (It is common for keyb not to use the same values as LANG, so...) Of course you can ask Natasha about the features of her installer, I think they will be similar. Eric. -- list options/archives/etc.: http://www.topica.com/lists/fd-dev unsubscribe: send blank email to: [EMAIL PROTECTED] ==^ This email was sent to: archive@mail-archive.com EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2 Or send an email to: [EMAIL PROTECTED] T O P I C A -- Register now to manage your mail! http://www.topica.com/partner/tag02/register ==^
Re: [fd-dev] Enquiry: Update packs
X-Comment-To: Eric Auer Hi! 2-äÅË-2002 23:59 [EMAIL PROTECTED] (Eric Auer) wrote to [EMAIL PROTECTED]: EA UNTGZ needs more RAM than GUNZIP - tempfile - UNTAR, EA but I believe it should still be in range of what 16bit can EA handle, but ONLY if untgz internally pipes data around and EA does not gunzip the whole file into RAM before untarring it... Unlike unziping, which (may) require additional memory for internal structures, unTARing (should) not require additional memory at all: program should simply analyze result of unpacking each next buffer immediately after buffer is ready. Should I explain you what is coprocesses and how implement them? BTW, Modula-2 have primitives to support this very simple, but powerful feature. Some years ago as exercise I reimplement them in TP (and then use it in permutations generation algorithm). [Just to clarify for those, who not know: coprocesses is _not_ preemprive multitasking and _not_ require hardware depended code (switching by timer, for example) nor any additional memory (except memory for stack for each process).] EA Both parts must run at the same time and hand over parts of EA the gunzipped data right away, without excessive buffering. EA In Linux this is no problem, you can have an 8k real pipe buffer EA and run gunzip and tar -x in two different tasks, but as we know, EA DOS has no real tasks and therefore no real pipes. It just runs :( Many available resources deprave you (nothing personal!) and you forget (or not know) that there not required heavy tools like multitasking. This case may (and should!) be implemented in one program on any hardware [which have enough resources to perform unziping]. -- list options/archives/etc.: http://www.topica.com/lists/fd-dev unsubscribe: send blank email to: [EMAIL PROTECTED] ==^^=== This email was sent to: archive@mail-archive.com EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2 Or send an email to: [EMAIL PROTECTED] T O P I C A -- Register now to manage your mail! http://www.topica.com/partner/tag02/register ==^^===
RE: [fd-dev] Enquiry: Update packs
Hello! (1) Keep as it is now, and release driver's version merged with latest REDUCED pack, FULL to be downloaded optionally. (2) Do not merge any layout pack with the driver: let the user choose either REDUCED or FULL, even if s/he has to download neccessarily at least two files . (3) Create several distributions of the driver: one would be packed with the REDUCED (say a bootdisk distribution), and other with the FULL layout. I like third variant. Other suggestions/comments welcome. Suggestion for Henrique: Add Latvian (QWERTY) (lv-q.key) layout to reduced layouts pack because I don't know people who uses Latvian ergonomic (lv.key) layout. Kristaps -- list options/archives/etc.: http://www.topica.com/lists/fd-dev unsubscribe: send blank email to: [EMAIL PROTECTED] ==^ This email was sent to: archive@mail-archive.com EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2 Or send an email to: [EMAIL PROTECTED] T O P I C A -- Register now to manage your mail! http://www.topica.com/partner/tag02/register ==^
Re: [fd-dev] Enquiry: Update packs
Date: Mon, 2 Dec 2002 23:22:05 +0300 (MSK) From: Arkady V.Belousov [EMAIL PROTECTED] Hi, As Arkady stated, untgz is available for DOS. So I suggest that FreeDOS should use this technique. Reason: I don't care about FreeDOS CD-ROMs. They have 650 MB of space. I care about 1.44MB installation disks and about 56k download modems. So, including a limited set of keyboard files seems also ok for me if they are compressed this way. And, by the way, tgz is as much DOS as zip as there never was a zip/unzip program contained in (MS-)DOS. -- All thoughts are free, Who can ever guess them? Die Gedanken sind frei, Wer kann sie erraten? __ Schneller als andere! Die Blitz-SMS von WEB.DE FreeMail! http://freemail.web.de/features/?mc=021167 -- list options/archives/etc.: http://www.topica.com/lists/fd-dev unsubscribe: send blank email to: [EMAIL PROTECTED] ==^ This email was sent to: archive@mail-archive.com EASY UNSUBSCRIBE click here: http://topica.com/u/?bz8Rv5.bbRv4l.YXJjaGl2 Or send an email to: [EMAIL PROTECTED] T O P I C A -- Register now to manage your mail! http://www.topica.com/partner/tag02/register ==^
