Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-07-15 Thread Thomas Schmitt
Hi, i added to merge_debian_isos the capability to burn the resulting ISO 9660 filesystem directly to optical media and to write it directly to storage device files. This removes the need for having substantial free disk space beyond the capacity to store the original ISO images. While burning

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-27 Thread Thomas Schmitt
Hi, Zhang Boyang wrote: > All OK! Thank you again :) So as far as we two are concerned, it seems we have a candidate for release. Currently it only goes into the GNU xorriso tarball, which is not src of any Debian package. I could put it into the libisoburn tarball. But as it is specific to

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-27 Thread Zhang Boyang
Hi, On 2022/6/26 17:03, Thomas Schmitt wrote: New version: https://dev.lovelyhq.com/libburnia/libisoburn/commit/0e8227e76ae4c4f24097cfac2f415ef8e25ae4e7 Tested with: 1) Merge 17 DVDs, on Debian and Alpine Linux environment. 2) Merge 2 DLBDs, on Debian and Alpine Linux environment. 3)

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-26 Thread Thomas Schmitt
Hi, Zhang Boyang wrote: > Theoretically if both file is already sorted, we can use the `-m' option I like this idea. Just in case Debian grows to a million packages. But i understand that i would need two separate files for sorting. grep ' ./pool/' file1 fgrep -v ' ./pool/' file2 sort -k

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-26 Thread Zhang Boyang
Hi, On 2022/6/26 03:30, Thomas Schmitt wrote: Complexity-wise this replaces a slow O(n) algorithm by a faster O(n) and an additional O(n * log(n)) run. At some size of Debian the slow speed of the linear loop will be compensated by the sorting complexity. But there is still room: A sort of

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-25 Thread Thomas Schmitt
Hi, Zhang Boyang wrote: > These experiments all succeeded. Thank you very much! Good Job! :) Thank you for testing and challenging. I wrote: > > For now i decided to take the 50 seconds with dash. > if you really want to reduce runtime I would suggest using > `sort -s -u -k 2

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-25 Thread Zhang Boyang
Hi, Some good news, I tested: 1) Build my unofficial DVD set (17 DVDs), and merge them using the merge script on my Debian machine. 2) Build my unofficial DLBD set (2 DLBDs), and merge them using the merge script on my Debian machine. 3) Merge 2 DLBDs using the merge script under a Alpine

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-23 Thread Thomas Schmitt
Hi, i explored two ways to get a correct and complete md5sum.txt after merging and sorting: - Generating the whole md5sum.txt from the emerging ISO's file tree is possible by help of xorriso, although there is no file tree yet where all regular files of the ISO can be found for checksumming.

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-23 Thread Thomas Schmitt
Hi, i wrote: > > > md5sum.txt Zhang Boyang wrote: > I think maybe we should just create the md5sum from scratch? Well, not from scratch, because the paths would come from the merged md5sum.txt. But indeed the merged file needs polishing: - Some files are listed multiple times because they

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-23 Thread Zhang Boyang
Hi On 2022/6/21 04:17, Thomas Schmitt wrote: Hi, Thanks for the detailed explanation! I think we can ignore minor differences, since creating a bit-for-bit reproducible image seems too hard for us. md5sum.txt Ouch. My script sorts the merged lines by the MD5 fields rather than by the

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-20 Thread Thomas Schmitt
Hi, Zhang Boyang wrote: > 2) Create my own version of my-DLBD1.iso and my-DLBD2.iso from my private > mirror. This explains why a firmware package was missing which is in the official DLBD-1 but obviously on your my-DLBD2. With the new script version which merges /firmware trees: > This time

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-20 Thread Zhang Boyang
Hi, On 2022/6/19 17:23, Thomas Schmitt wrote: Hi, i tested merging of /firmware directories with barely sufficently complete debian-11.0.0-amd64-DLBD-[12].iso.tmp from aborted jigdo-lite runs. All files which are reported as being only in CUSTOM(all-in-one) by

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-19 Thread Thomas Schmitt
Hi, i tested merging of /firmware directories with barely sufficently complete debian-11.0.0-amd64-DLBD-[12].iso.tmp from aborted jigdo-lite runs. All files which are reported as being only in CUSTOM(all-in-one) by https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1011343#115 are listed by

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-18 Thread Thomas Schmitt
Hi, Zhang Boyang wrote: > I will definitely try it Meanwhile i got some insight into the riddle about diffs between merged.iso and CUSTOM-1.iso like Only in /groundtruth/firmware: arm-trusted-firmware-tools_2.4+dfsg-2_amd64.deb Only in /groundtruth/firmware:

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-18 Thread Zhang Boyang
Hello, Thanks for making this program! I will definitely try it as soon as I finished my current work! Thank you again :) Best Regards, Zhang Boyang On 2022/6/15 19:17, Thomas Schmitt wrote: Hi, although it was not the final solution of this bug report, i beefed up my merger script for

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-17 Thread Thomas Schmitt
Hi, i followed David's advise to consider the warnings of shellcheck, to drop the demand for bash, and to check early whether all needed programs are available. xorriso gets now checked for being young enough for the job of replaying the boot related commands as detected with input ISO 1. (1.3.2

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-15 Thread David
On Thu, 16 Jun 2022 at 06:33, Thomas Schmitt wrote: > i wrote: > > > https://dev.lovelyhq.com/libburnia/libisoburn/raw/branch/master/test/merge_debian_isos > Nevertheless, it should be tested independently of me whether it can be > tricked into destroying existing data on disk or leaving

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-15 Thread Thomas Schmitt
Hi, i wrote: > > https://dev.lovelyhq.com/libburnia/libisoburn/raw/branch/master/test/merge_debian_isos Steve McIntyre wrote: > That might be a useful thing to include in a package. What do you think? Best would be if debian-cd would take it, so that it can be adapted when the repository format

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-15 Thread Steve McIntyre
Hey Thomas! On Wed, Jun 15, 2022 at 01:17:31PM +0200, Thomas Schmitt wrote: >Hi, > >although it was not the final solution of this bug report, i beefed up >my merger script for Debian ISOs so that it can combine an arbitrary >number of ISOs (within the limits of /dev/loop* and mount(8)). >Maybe

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-06-15 Thread Thomas Schmitt
Hi, although it was not the final solution of this bug report, i beefed up my merger script for Debian ISOs so that it can combine an arbitrary number of ISOs (within the limits of /dev/loop* and mount(8)). Maybe it can serve as answer for the next time this wish comes up. The script is uploaded

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-28 Thread Zhang Boyang
Hello, Finally I set up my own mirror and I'm able to build my unofficial discs with debian-cd. Thanks Andy Cater and Linux-Fan for instructions! == ABOUT MIRROR == Currently I'm using the recommended ftpsync.tar.gz scripts to set up my

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-24 Thread Thomas Schmitt
Hi, for now it looks like the merged ISO works as fat DVD-1. I installed a Debian 11.2.0 system from the merged DVD-1+ DVD-2 ISO in a qemu VM via option -cdrom. Installation went smoothly. During reboot i aborted the VM to next deface the El Torito boot sector of the ISO. I removed the -net

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-23 Thread Thomas Schmitt
Hi, i uploaded the first version of my merger script as https://dev.lovelyhq.com/libburnia/libisoburn/raw/branch/master/test/merge_2_debian_isos Please download and give x-permission. The need for sudo can be avoided by already mounting the two ISOs at the chosen mount points before running

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-23 Thread sp...@caiway.net
On Tue, 24 May 2022 00:51:35 +1200 Mike Hosken wrote: > Hi Arne, > > Just fyi, archive.debian.org or a mirror site has a copy of the distros you > have lost a long with the rest of the official Debian releases. > > Mike Hosken > Sent via my iPhone Thanks alot Mike! Looks good! Soon I

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-23 Thread Mike Hosken
Hi Arne, Just fyi, archive.debian.org or a mirror site has a copy of the distros you have lost a long with the rest of the official Debian releases. Mike Hosken Sent via my iPhone > On 24/05/2022, at 00:09, sp...@caiway.net wrote: > > On Sat, 21 May 2022 13:33:02 +0800 > Zhang Boyang

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-23 Thread sp...@caiway.net
On Sat, 21 May 2022 13:33:02 +0800 Zhang Boyang wrote: > Hi, > > Indeed, I admit super-big-iso is a crazy idea, and a local mirror is > more useful in most cases. I think there is a few special cases that a > super-big-iso might be more useful. > > 1) Computers / Virtual Machines isolated

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-22 Thread Zhang Boyang
Hi, On 2022/5/23 01:18, Thomas Schmitt wrote: How can i verify that the resulting ISO properly announces all its packages ? (If i install it to a VM, what must i do to challenge its completeness ?) I came up with a idea. Maybe you can use 'debian-cd' to create a DLBD set, say disc A1 and A2,

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-22 Thread Thomas Schmitt
Hi, i wrote: > > I began to ponder about a shortcut in libisofs which would trust the > > checksum file (-checksum-list , -md5-list) enough to omit the reading of > > all the package files' content. Steve McIntyre wrote: > Cute idea (grin!), but it's a non-started - we wouldn't be able to >

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-22 Thread Steve McIntyre
Hey Thomas! On Sun, May 22, 2022 at 12:03:23PM +0200, Thomas Schmitt wrote: >Steve McIntyre wrote: >> youre initial guess is correct. We don't generate the .iso files >> at all for the larger images [1]. This means we also don't have >> torrent files for them [2]. > >I began to ponder about a

Re: OT: Setting up a local mirror [WAS Re: Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?]

2022-05-22 Thread Zhang Boyang
Hi, Thanks for this information :-) I will try it. Best Regards, Zhang Boyang > Quoting myself - which might be bad form > > http://flosslinuxblog.blogspot.com/2020/02/rebuilding-mirror-software-mirroring-of.html > > gives the full steps to set up a mirror by editing one script, more or

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-22 Thread Thomas Schmitt
Hi, Steve McIntyre wrote: > youre initial guess is correct. We don't generate the .iso files > at all for the larger images [1]. This means we also don't have > torrent files for them [2]. I began to ponder about a shortcut in libisofs which would trust the checksum file (-checksum-list ,

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Steve McIntyre
Hey folks, On Sat, May 21, 2022 at 04:59:27PM +0200, Thomas Schmitt wrote: >Andrew M.A. Cater wrote to debian-cd@lists.debian.org: > >> I don't actually know how long it take to create the .jigdo and .template >> files - I don't think it's as long as generating the full .iso files Whether you

OT: Setting up a local mirror [WAS Re: Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?]

2022-05-21 Thread Andrew M.A. Cater
[Here for anyone else that may need it - probably offtopic for this list after that.] On Sun, May 22, 2022 at 12:19:27AM +0800, Zhang Boyang wrote: > > On 2022/5/21 22:54, Linux-Fan wrote: > > > > I admit a local mirror is more suitable for large set of computers. > > > But for a small set of

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Thomas Schmitt
Hi, Zhang Boyang wrote: > I guess there is no ready tool can merge two ISOs together. Not directly. But xorriso can load the meta-data of an ISO, manipulate that loaded model, and write the result as new ISO with the same boot equipment as found in the loaded ISO. As said, that would be no

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Zhang Boyang
On 2022/5/21 22:59, Thomas Schmitt wrote: Is there documentation from which i could learn how the stuff in (i guess) /dists of DLBD-1 and DLBD-2 could be merged so that it properly describes a merged pool tree ? My rough idea would be: - mount both ISOs - derive merged /dists files - run

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Zhang Boyang
On 2022/5/21 22:54, Linux-Fan wrote: I admit a local mirror is more suitable for large set of computers. But for a small set of computers, for example, 1-5 computers, setting up a local mirror might be too heavy. Actually I think this may be a misconception. Setting up a mirror for

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Zhang Boyang
Hello Andy, Andrew M.A. Cater wrote: > If the original poster wants one huge .iso as one file to download from > cdimage.debian.org - then 2 x double layer Blu-Ray (say) as one file would be 100GB or so. Original poster here, IMO the iso needn't to be directly downloadable, officially signed

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Thomas Schmitt
Hi, i reply to 1011...@bugs.debian.org and zhangboyang...@gmail.com because of my question and sketch for a procedure to merge DLBD-1 and -2 after download into the desired ALL-IN-ONE ISO. Andrew M.A. Cater wrote to debian-cd@lists.debian.org: > If the original poster wants one huge .iso as one

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Linux-Fan
Zhang Boyang writes: Hi, On 2022/5/21 18:13, Andrew M.A. Cater wrote: On Sat, May 21, 2022 at 01:33:02PM +0800, Zhang Boyang wrote: Hi, Indeed, I admit super-big-iso is a crazy idea, and a local mirror is more useful in most cases. I think there is a few special cases that a [...]

Re: Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Andrew M.A. Cater
On Sat, May 21, 2022 at 01:57:59PM +0200, Thomas Schmitt wrote: Hi Thomas, > Hi, > > some technical nitpicking. > > Andrew M.A. Cater wrote: > > Also, keeping large files around on disk for a long > > time - there's some likelihood of data corruption. > > The .jigdo and .template files of the

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Zhang Boyang
Hi, On 2022/5/21 18:13, Andrew M.A. Cater wrote: On Sat, May 21, 2022 at 01:33:02PM +0800, Zhang Boyang wrote: Hi, Indeed, I admit super-big-iso is a crazy idea, and a local mirror is more useful in most cases. I think there is a few special cases that a super-big-iso might be more useful.

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Thomas Schmitt
Hi, some technical nitpicking. Andrew M.A. Cater wrote: > Also, keeping large files around on disk for a long > time - there's some likelihood of data corruption. The .jigdo and .template files of the DLBD ISOs are together smaller than a netinst CD ISO. (Less than 90 MiB, see

Re: Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-21 Thread Andrew M.A. Cater
On Sat, May 21, 2022 at 01:33:02PM +0800, Zhang Boyang wrote: > Hi, > > Indeed, I admit super-big-iso is a crazy idea, and a local mirror is more > useful in most cases. I think there is a few special cases that a > super-big-iso might be more useful. > > 1) Computers / Virtual Machines isolated

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-20 Thread Zhang Boyang
Hi, Indeed, I admit super-big-iso is a crazy idea, and a local mirror is more useful in most cases. I think there is a few special cases that a super-big-iso might be more useful. 1) Computers / Virtual Machines isolated from public internet or have no network at all. It is convenient to

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-20 Thread Andy Simpkins
On 20 May 2022 15:11:09 BST, Zhang Boyang wrote: >Package: debian-cd > >Hello, > >I suggest debian release a new variant of ISO images, the all-in-one images. >These all-in-one image contains ALL debian packages in a single ISO image >(possibly all source packages in another all-in-one ISO

Bug#1011343: WISHLIST: Offical ALL-IN-ONE images?

2022-05-20 Thread Zhang Boyang
Package: debian-cd Hello, I suggest debian release a new variant of ISO images, the all-in-one images. These all-in-one image contains ALL debian packages in a single ISO image (possibly all source packages in another all-in-one ISO image). Of course there is no such optical media can hold