Re: UDD/dmd: fails to load when debci data is missing

2020-06-01 Thread Andreas Tille
On Mon, May 25, 2020 at 04:56:47PM +0100, Rebecca N. Palmer wrote:
> 
> This suggests the real bug may be in debci ... or that there are two bugs.
> (Failing to load the entire page isn't a very helpful response to one
> package having missing data, even if it's a bug somewhere else that the data
> is missing.)

I have no idea whether this is related but there is another strange
issue in debci[1].  I'm working on some blends view on debci data and
worked around that issue in a recent commit[2].  I have not checked the
sql source for the dashboard yet (any hint where I can find the source
for the dashboard?)

Kind regards

Andreas.

[1] https://lists.debian.org/debian-ci/2020/05/msg00058.html 
[2] 
https://salsa.debian.org/blends-team/website/-/commit/6f3dfb33e55faa8804129990a0b61dd08ef7fb0b

-- 
http://fam-tille.de



Re: UDD/dmd: fails to load when debci data is missing

2020-05-27 Thread Bernd Zeimetz


> Thanks for pointing to the cause! It finally motivated me to look into
> this. I fixed the bug in DMD.

Thanks Lucas!

-- 
 Bernd ZeimetzDebian GNU/Linux Developer
 http://bzed.dehttp://www.debian.org
 GPG Fingerprint: ECA1 E3F2 8E11 2432 D485  DD95 EB36 171A 6FF9 435F



Re: UDD/dmd: fails to load when debci data is missing

2020-05-25 Thread Lucas Nussbaum
On 25/05/20 at 09:57 +0100, Rebecca N. Palmer wrote:
> Control: retitle -1 UDD/dmd: fails to load when debci data is missing
> 
> The problem isn't the number of packages, but some specific packages that
> can't be displayed even when they are the only package requested:
> https://udd.debian.org/dmd/?email1node-file-entry-cache==html#todo
> 
> These packages appear to be the ones that have a debci result (any result)
> in testing but no debci data in unstable:
> https://ci.debian.net/packages/n/node-file-entry-cache/

Hi,

Thanks for pointing to the cause! It finally motivated me to look into
this. I fixed the bug in DMD.

Lucas



Re: UDD/dmd: fails to load when debci data is missing

2020-05-25 Thread Rebecca N. Palmer

Johannes Schauer wrote:

In particular, in the "CI" column, look for those rows where the first line
shows exactly "✔-" -- those packages have to be excluded. Failures are fine and
even both missing is fine but a checkmark followed by a minus triggers that
bug.


Neutral/missing ("⛔-") is also bad; I don't have any examples of 
fail/missing ("fail-").


The other way round (missing/pass, e.g. libmessage-passing-perl) is OK.

Missing/missing seems to be fine, but I suspect most of those are 
"doesn't have autopkgtests", and don't know if that matters.


Looking at the raw debci data (e.g. 
https://ci.debian.net/data/autopkgtest/unstable/amd64/p/), the packages 
with "missing" debci data do actually have test logs, but relatively old 
ones.  (>~ 20-30 days old, but *not* a strict age threshold, e.g. 
parsley-clojure vs plastex.)


This suggests the real bug may be in debci ... or that there are two 
bugs.  (Failing to load the entire page isn't a very helpful response to 
one package having missing data, even if it's a bug somewhere else that 
the data is missing.)


It also suggests that

By going to https://ci.debian.net/user/ I can
schedule new tests for the affected packages for unstable on all architectures.

would need to be repeated about that often.



Re: UDD/dmd: fails to load when debci data is missing

2020-05-25 Thread Johannes Schauer
Hi all,

Quoting Johannes Schauer (2020-05-25 14:00:45)
> Quoting Rebecca N. Palmer (2020-05-25 10:57:02)
> > The problem isn't the number of packages, but some specific packages 
> > that can't be displayed even when they are the only package requested:
> > https://udd.debian.org/dmd/?email1node-file-entry-cache==html#todo
> > 
> > These packages appear to be the ones that have a debci result (any 
> > result) in testing but no debci data in unstable:
> > https://ci.debian.net/packages/n/node-file-entry-cache/
> > 
> > Known examples:
> > acpi-call node-housekeeping node-chainsaw node-file-entry-cache
> > 
> > As a workaround, you can exclude packages like this:
> > 
> > https://udd.debian.org/dmd/?email1=dr%40jones.dkeyes.js+node-eslint-plugin-node+node-eslint-plugin-requirejs++node-eslint-utils+node-esquery+node-ignore+node-leche+node-file-entry-cache+node-proxyquire+python-asynctest+pd-zexy+python-m2r+=html#todo
> 
> wow, that's awesome! Thank you for this hint! I was missing the UDD view on my
> packages for weeks already and now it's finally back for most of my packages!
> Thanks!!! :D
> 
> > These packages can be identified from the CI column of DDPO, which does work
> > for such package sets:
> > 
> > https://qa.debian.org/developer.php?email=dr%40jones.dk
> 
> In particular, in the "CI" column, look for those rows where the first line
> shows exactly "✔-" -- those packages have to be excluded. Failures are fine 
> and
> even both missing is fine but a checkmark followed by a minus triggers that
> bug.

after learning what causes this, there is an even better workaround than
excluding the affected packages. By going to https://ci.debian.net/user/ I can
schedule new tests for the affected packages for unstable on all architectures.
I did just that a few hours ago with one of the affected packages and I can
confirm that I don't have to exclude the package anymore and the UDD view works
fine with it.

I don't know of an automated way to find all packages without CI results on
unstable but with results on testing, but if somebody does, then maybe we can
just schedule tests for the affected packages and then none of us needs to
manually remove them to be able to use UDD again?

Thanks!

cheers, josch

signature.asc
Description: signature


Re: UDD/dmd: fails to load when debci data is missing

2020-05-25 Thread Johannes Schauer
Hi Rebecca,

Quoting Rebecca N. Palmer (2020-05-25 10:57:02)
> The problem isn't the number of packages, but some specific packages 
> that can't be displayed even when they are the only package requested:
> https://udd.debian.org/dmd/?email1node-file-entry-cache==html#todo
> 
> These packages appear to be the ones that have a debci result (any 
> result) in testing but no debci data in unstable:
> https://ci.debian.net/packages/n/node-file-entry-cache/
> 
> Known examples:
> acpi-call node-housekeeping node-chainsaw node-file-entry-cache
> 
> As a workaround, you can exclude packages like this:
> 
> https://udd.debian.org/dmd/?email1=dr%40jones.dkeyes.js+node-eslint-plugin-node+node-eslint-plugin-requirejs++node-eslint-utils+node-esquery+node-ignore+node-leche+node-file-entry-cache+node-proxyquire+python-asynctest+pd-zexy+python-m2r+=html#todo

wow, that's awesome! Thank you for this hint! I was missing the UDD view on my
packages for weeks already and now it's finally back for most of my packages!
Thanks!!! :D

> These packages can be identified from the CI column of DDPO, which does work
> for such package sets:
> 
> https://qa.debian.org/developer.php?email=dr%40jones.dk

In particular, in the "CI" column, look for those rows where the first line
shows exactly "✔-" -- those packages have to be excluded. Failures are fine and
even both missing is fine but a checkmark followed by a minus triggers that
bug.

Thanks again!

cheers, josch

signature.asc
Description: signature


Re: UDD/dmd: fails to load when debci data is missing

2020-05-25 Thread Jonas Smedegaard
Quoting Rebecca N. Palmer (2020-05-25 10:57:02)
> Control: retitle -1 UDD/dmd: fails to load when debci data is missing
> 
> The problem isn't the number of packages, but some specific packages 
> that can't be displayed even when they are the only package requested:
> https://udd.debian.org/dmd/?email1node-file-entry-cache==html#todo
> 
> These packages appear to be the ones that have a debci result (any 
> result) in testing but no debci data in unstable:
> https://ci.debian.net/packages/n/node-file-entry-cache/
> 
> Known examples:
> acpi-call node-housekeeping node-chainsaw node-file-entry-cache
> 
> As a workaround, you can exclude packages like this:
> 
> https://udd.debian.org/dmd/?email1=dr%40jones.dkeyes.js+node-eslint-plugin-node+node-eslint-plugin-requirejs++node-eslint-utils+node-esquery+node-ignore+node-leche+node-file-entry-cache+node-proxyquire+python-asynctest+pd-zexy+python-m2r+=html#todo
> 
> These packages can be identified from the CI column of DDPO, which does 
> work for such package sets:
> 
> https://qa.debian.org/developer.php?email=dr%40jones.dk

ThanksyouThankyouThankyou!

I hereby owe you a /virtual/real beverage of your choosing.


 - Jonas

-- 
 * Jonas Smedegaard - idealist & Internet-arkitekt
 * Tlf.: +45 40843136  Website: http://dr.jones.dk/

 [x] quote me freely  [ ] ask before reusing  [ ] keep private

signature.asc
Description: signature


UDD/dmd: fails to load when debci data is missing

2020-05-25 Thread Rebecca N. Palmer

Control: retitle -1 UDD/dmd: fails to load when debci data is missing

The problem isn't the number of packages, but some specific packages 
that can't be displayed even when they are the only package requested:

https://udd.debian.org/dmd/?email1node-file-entry-cache==html#todo

These packages appear to be the ones that have a debci result (any 
result) in testing but no debci data in unstable:

https://ci.debian.net/packages/n/node-file-entry-cache/

Known examples:
acpi-call node-housekeeping node-chainsaw node-file-entry-cache

As a workaround, you can exclude packages like this:

https://udd.debian.org/dmd/?email1=dr%40jones.dkeyes.js+node-eslint-plugin-node+node-eslint-plugin-requirejs++node-eslint-utils+node-esquery+node-ignore+node-leche+node-file-entry-cache+node-proxyquire+python-asynctest+pd-zexy+python-m2r+=html#todo

These packages can be identified from the CI column of DDPO, which does 
work for such package sets:


https://qa.debian.org/developer.php?email=dr%40jones.dk