Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Zac Medico
On 01/28/2018 02:00 PM, Andrew Barchuk wrote: >> To the contrary, that would not remain balanced, because your >> boundaries are entirely dependent on exactly what is in the tree at >> the moment you run your script. Now the package manager has to perform >> directory listing, sort and find the

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Gordon Pettey
On Sun, Jan 28, 2018 at 4:00 PM, Andrew Barchuk wrote: > I don't see a reason to organize distfiles in a > multi-level hierarchy: e.g. if the goal is to keep no more than 1000 > files in a folder than the limit of single level hierarchy is a million > which is more than enough

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Zac Medico
On 01/28/2018 12:16 PM, Michał Górny wrote: > W dniu nie, 28.01.2018 o godzinie 10∶09 -0800, użytkownik Zac Medico > napisał: >> On 01/28/2018 09:35 AM, Alec Warner wrote: >>> >>> >>> On Sun, Jan 28, 2018 at 9:51 AM, Zac Medico >> > wrote: >>> >>>

[gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2018-01-28 23:59 UTC

2018-01-28 Thread Robin H. Johnson
The attached list notes all of the packages that were added or removed from the tree, for the week ending 2018-01-28 23:59 UTC. Removals: app-crypt/nistp224 20180128-00:45 zlogeneb51aa320750 app-doc/linux-gazette 20180127-22:57 zlogeneeb20a9691bf app

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Zac Medico
On 01/28/2018 08:34 PM, Alec Warner wrote: > > > On Sun, Jan 28, 2018 at 8:10 PM, Zac Medico > wrote: > > On 01/28/2018 04:17 PM, Michael Orlitzky wrote: > > Since ::gentoo is the only repository governed by the PMS, can't we make > >

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Michał Górny
W dniu nie, 28.01.2018 o godzinie 21∶43 +0100, użytkownik Andrew Barchuk napisał: > [my apologies for posting the message to a wrong thread before] > > Hi everyone, > > > three possible solutions for splitting distfiles were listed: > > > > a. using initial portion of filename, > > > > b.

[gentoo-portage-dev] [PATCH v3] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Zac Medico
The --dynamic-deps=n default causes confusion for users that are accustomed to dynamic deps, therefore add a --changed-deps-report option that is enabled by default (if --usepkgonly is not enabled). The report is entirely suppressed if none of the packages with changed dependencies are in the

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Zac Medico
On 01/28/2018 09:49 PM, Zac Medico wrote: >> 3) Show a NOTE telling users about --changed-deps=y > > This is in the HINT section, which is displayed if both --changed-deps > and --dynamic-deps are disabled in PATCH v2. Actually, the whole report should be suppressed if either --changed-deps or

Re: [gentoo-dev] [News item review] Portage rsync tree verification (v4)

2018-01-28 Thread Robin H. Johnson
On Sun, Jan 28, 2018 at 09:30:31PM +0100, Andrew Barchuk wrote: > Hi everyone, > > > three possible solutions for splitting distfiles were listed: > There's another option to use character ranges for each directory > computed in a way to have the files distributed evenly. One way to do > that is

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Robin H. Johnson
On Sun, Jan 28, 2018 at 03:01:11PM +0800, Jason Zaman wrote: > Another thing im wondering is if we can just use the same dir layout as > the packages themselves. that would fix texlive since it has a whole lot > of separate packages. eg /usr/portage/distfiles/app-cat/pkg/pkg-1.0.tgz Texlive is

[gentoo-portage-dev] [PATCH v2] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Zac Medico
The --dynamic-deps=n default causes confusion for users that are accustomed to dynamic deps, therefore add a --changed-deps-report option that is enabled by default (if --usepkgonly is not enabled). The --quiet option will suppress the report if none of the packages having changed dependencies

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Alec Warner
On Sun, Jan 28, 2018 at 8:10 PM, Zac Medico wrote: > On 01/28/2018 04:17 PM, Michael Orlitzky wrote: > > Since ::gentoo is the only repository governed by the PMS, can't we make > > repoman do this? The problem with requiring "repoman --force" for an > > in-place dependency

[gentoo-portage-dev] [PATCH v4] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Zac Medico
The --dynamic-deps=n default causes confusion for users that are accustomed to dynamic deps, therefore add a --changed-deps-report option that is enabled by default (if --usepkgonly is not enabled). The report is entirely suppressed in the following cases in which the packages with changed

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Zac Medico
On 01/28/2018 04:17 PM, Michael Orlitzky wrote: > Since ::gentoo is the only repository governed by the PMS, can't we make > repoman do this? The problem with requiring "repoman --force" for an > in-place dependency change is that repoman generally won't have access > to the unedited ebuild; but

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Zac Medico
On 01/28/2018 10:47 AM, Alec Warner wrote: > > > On Sun, Jan 28, 2018 at 1:09 PM, Zac Medico > wrote: > > On 01/28/2018 09:35 AM, Alec Warner wrote: > > > > > > On Sun, Jan 28, 2018 at 9:51 AM, Zac Medico

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Andrew Barchuk
[my apologies for posting the message to a wrong thread before] Hi everyone, > three possible solutions for splitting distfiles were listed: > > a. using initial portion of filename, > > b. using initial portion of file hash, > > c. using initial portion of filename hash. > > The significant

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Andrew Barchuk
> To the contrary, that would not remain balanced, because your > boundaries are entirely dependent on exactly what is in the tree at > the moment you run your script. Now the package manager has to perform > directory listing, sort and find the file name that's closest, open > that directory,

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Michael Orlitzky
Since ::gentoo is the only repository governed by the PMS, can't we make repoman do this? The problem with requiring "repoman --force" for an in-place dependency change is that repoman generally won't have access to the unedited ebuild; but for ::gentoo, we can probably hack something together in

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Michał Górny
W dniu nie, 28.01.2018 o godzinie 10∶09 -0800, użytkownik Zac Medico napisał: > On 01/28/2018 09:35 AM, Alec Warner wrote: > > > > > > On Sun, Jan 28, 2018 at 9:51 AM, Zac Medico > > wrote: > > > > The --dynamic-deps=n default causes

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Gordon Pettey
On Sun, Jan 28, 2018 at 2:43 PM, Andrew Barchuk wrote: > There's another option to use character ranges for each directory > computed in a way to have the files distributed evenly. One way to do > that is to use filename prefix of dynamic length so that each range > holds the

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Andrew Barchuk
> In order to use that for distfiles mirrors, such that clients could know > where to fetch the files from, you'd need the mirror's http server to > redirect the request to the appropriate location (since the location > would not be predictable from the client side). That's not necessary: the

Re: [gentoo-dev] [News item review] Portage rsync tree verification (v4)

2018-01-28 Thread Andrew Barchuk
Hi everyone, > three possible solutions for splitting distfiles were listed: > > a. using initial portion of filename, > > b. using initial portion of file hash, > > c. using initial portion of filename hash. > > The significant advantage of the filename option was simplicity. With > that

Re: [gentoo-dev] [News item review] Portage rsync tree verification (v4)

2018-01-28 Thread Michał Górny
Hopefully the final version. --- Title: Portage rsync tree verification Author: Michał Górny Posted: 2018-01-xx Revision: 1 News-Item-Format: 2.0 Display-If-Installed: sys-apps/portage Starting with sys-apps/portage-2.3.22, Portage will verify the Gentoo repository after

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Michał Górny
W dniu nie, 28.01.2018 o godzinie 15∶01 +0800, użytkownik Jason Zaman napisał: > On Sat, Jan 27, 2018 at 12:24:39AM +0100, Michał Górny wrote: > > Migrating mirrors to the hashed structure > > - > > The hard link solution allows us to save space on the

Re: [gentoo-portage-dev] [PATCH v2] install-qa-check: New QA check/cleanup for empty directories

2018-01-28 Thread Michał Górny
W dniu nie, 28.01.2018 o godzinie 02∶22 -0800, użytkownik Zac Medico napisał: > On 01/28/2018 01:50 AM, Michał Górny wrote: > > Warn about empty directories installed to /var in install-qa-check phase > > (that were not "filled" using keepdir), to help developers stop relying > > upon Portage

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Michał Górny
W dniu nie, 28.01.2018 o godzinie 11∶14 +0100, użytkownik Ulrich Mueller napisał: > > > > > > On Sat, 27 Jan 2018, Michał Górny wrote: > > This specification currently defines one section: ``[structure]``. > > This section defines one or more repository structure definitions > > using sequential

[gentoo-portage-dev] [PATCH v2] install-qa-check: New QA check/cleanup for empty directories

2018-01-28 Thread Michał Górny
Warn about empty directories installed to /var in install-qa-check phase (that were not "filled" using keepdir), to help developers stop relying upon Portage preserving them. Those directories are rather unlikely to be false positives. Furthermore, remove all the empty directories if

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Ulrich Mueller
> On Sat, 27 Jan 2018, Michał Górny wrote: > This specification currently defines one section: ``[structure]``. > This section defines one or more repository structure definitions > using sequential integer keys. The definition keyed as ``0`` > is the most preferred structure. The package

Re: [gentoo-portage-dev] [PATCH v2] install-qa-check: New QA check/cleanup for empty directories

2018-01-28 Thread Zac Medico
On 01/28/2018 01:50 AM, Michał Górny wrote: > Warn about empty directories installed to /var in install-qa-check phase > (that were not "filled" using keepdir), to help developers stop relying > upon Portage preserving them. Those directories are rather unlikely to > be false positives. > >

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Ulrich Mueller
> On Sun, 28 Jan 2018, Michał Górny wrote: >> > This specification currently defines one section: ``[structure]``. >> > This section defines one or more repository structure definitions >> > using sequential integer keys. The definition keyed as ``0`` >> > is the most preferred structure.

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Michał Górny
W dniu nie, 28.01.2018 o godzinie 11∶22 +0100, użytkownik Ulrich Mueller napisał: > > > > > > On Sun, 28 Jan 2018, Michał Górny wrote: > > > > This specification currently defines one section: ``[structure]``. > > > > This section defines one or more repository structure definitions > > > > using

Re: [gentoo-dev] [pre-GLEP] Split distfile mirror directory structure

2018-01-28 Thread Ulrich Mueller
> On Sun, 28 Jan 2018, Michał Górny wrote: > How about this then: > | This specification currently defines one section: ``[structure]``. > | This section defines one or more repository structure definitions > | using non-negative sequential integer keys. The definition with > | the ``0``

[gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Zac Medico
The --dynamic-deps=n default causes confusion for users that are accustomed to dynamic deps, therefore add a --changed-deps-report option that is enabled by default (if --usepkgonly is not enabled). The --quiet option will suppress the report if none of the packages having changed dependencies

[gentoo-dev] Re: [News item review] Portage rsync tree verification (v4)

2018-01-28 Thread Duncan
Michał Górny posted on Sun, 28 Jan 2018 09:58:37 +0100 as excerpted: > The new verification is intended for users who are syncing via rsync. > Verification mechanisms for other methods of sync will be provided in > the future. > > This does not affect users syncing using git and other methods. >

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Alec Warner
On Sun, Jan 28, 2018 at 9:51 AM, Zac Medico wrote: > The --dynamic-deps=n default causes confusion for users that are > accustomed to dynamic deps, therefore add a --changed-deps-report > option that is enabled by default (if --usepkgonly is not enabled). > > The --quiet

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Zac Medico
On 01/28/2018 09:35 AM, Alec Warner wrote: > > > On Sun, Jan 28, 2018 at 9:51 AM, Zac Medico > wrote: > > The --dynamic-deps=n default causes confusion for users that are > accustomed to dynamic deps, therefore add a --changed-deps-report

Re: [gentoo-portage-dev] [PATCH] emerge: add --changed-deps-report option (bug 645780)

2018-01-28 Thread Alec Warner
On Sun, Jan 28, 2018 at 1:09 PM, Zac Medico wrote: > On 01/28/2018 09:35 AM, Alec Warner wrote: > > > > > > On Sun, Jan 28, 2018 at 9:51 AM, Zac Medico > > wrote: > > > > The --dynamic-deps=n default causes confusion for