Bug#1019380: UDD: import ports.d.o data to ports tables instead of derivatives tables
Control: close -1 On 24/12/22 at 16:58 +0800, Paul Wise wrote: > Control: reopen -1 > > On Sat, 2022-12-24 at 09:04 +0100, Lucas Nussbaum wrote: > > > OK, I imported ports to ports_* tables. > > Thanks, but they don't appear to have any data yet and > the derivatives tables still have ports data in them. > > https://qa.debian.org/cgi-bin/madison.cgi?package=chromium-bsu=ports===# > https://qa.debian.org/cgi-bin/madison.cgi?package=chromium-bsu=derivatives===# > > pabs@quantz:~$ PAGER=cat psql service=udd > psql (11.18 (Debian 11.18-0+deb10u1), server 13.9 (Debian 13.9-0+deb11u1)) > WARNING: psql major version 11, server major version 13. > Some psql features might not work. > SSL connection (protocol: TLSv1.3, cipher: TLS_AES_256_GCM_SHA384, bits: 256, > compression: off) > Type "help" for help. > > udd=> select * from ports_sources limit 1; > source | version | maintainer | maintainer_name | maintainer_email | format > | files | uploaders | bin | architecture | standards_version | homepage | > build_depends | build_depends_indep | build_conflicts | build_conflicts_indep > | priority | section | distribution | release | component | vcs_type | > vcs_url | vcs_browser | python_version | ruby_versions | checksums_sha1 | > checksums_sha256 | original_maintainer | dm_upload_allowed | testsuite | > autobuild | extra_source_only | build_depends_arch | build_conflicts_arch > +-++-+--++---+---+-+--+---+--+---+-+-+---+--+-+--+-+---+--+-+-++---++--+-+---+---+---+---++-- > (0 rows) > > > I'm closing this bug, assuming you will track the rmadison change in a > > separate one. > > I've added the ports table to madison.cgi: > > https://salsa.debian.org/qa/qa/commit/09765f3fa5b7a26c90c82f005593385afbe2220e > > Once the above issue is resolved I'll fix rmadison in devscripts. It's OK now (and I cleaned up derivatives_* as well). I was a bit too optimistic about the importer finishing, while it was stuck in a transactionn. Lucas
Bug#1019380: UDD: import ports.d.o data to ports tables instead of derivatives tables
Control: reopen -1 On Sat, 2022-12-24 at 09:04 +0100, Lucas Nussbaum wrote: > OK, I imported ports to ports_* tables. Thanks, but they don't appear to have any data yet and the derivatives tables still have ports data in them. https://qa.debian.org/cgi-bin/madison.cgi?package=chromium-bsu=ports===# https://qa.debian.org/cgi-bin/madison.cgi?package=chromium-bsu=derivatives===# pabs@quantz:~$ PAGER=cat psql service=udd psql (11.18 (Debian 11.18-0+deb10u1), server 13.9 (Debian 13.9-0+deb11u1)) WARNING: psql major version 11, server major version 13. Some psql features might not work. SSL connection (protocol: TLSv1.3, cipher: TLS_AES_256_GCM_SHA384, bits: 256, compression: off) Type "help" for help. udd=> select * from ports_sources limit 1; source | version | maintainer | maintainer_name | maintainer_email | format | files | uploaders | bin | architecture | standards_version | homepage | build_depends | build_depends_indep | build_conflicts | build_conflicts_indep | priority | section | distribution | release | component | vcs_type | vcs_url | vcs_browser | python_version | ruby_versions | checksums_sha1 | checksums_sha256 | original_maintainer | dm_upload_allowed | testsuite | autobuild | extra_source_only | build_depends_arch | build_conflicts_arch +-++-+--++---+---+-+--+---+--+---+-+-+---+--+-+--+-+---+--+-+-++---++--+-+---+---+---+---++-- (0 rows) > I'm closing this bug, assuming you will track the rmadison change in a > separate one. I've added the ports table to madison.cgi: https://salsa.debian.org/qa/qa/commit/09765f3fa5b7a26c90c82f005593385afbe2220e Once the above issue is resolved I'll fix rmadison in devscripts. -- bye, pabs https://wiki.debian.org/PaulWise signature.asc Description: This is a digitally signed message part
Bug#1019380: UDD: import ports.d.o data to ports tables instead of derivatives tables
On Thu, 2022-12-22 at 15:25 +0100, Lucas Nussbaum wrote: > 1/ looking into it, I noticed that the source for packages in unreleased > is not shipped. Is that expected? This is a long-standing issue with the ports mini-dak setup. The source packages are actually present in the archive but there are no Sources files referencing them, for example: https://deb.debian.org/debian-ports/pool-riscv64/main/g/grpc/ > 2/ Would you be OK with a set of tables named unofficial_sources, > unofficial_packages, etc? Then I would re-use the same set of tables to > import janitor's fresh-releases and fresh-snapshots suite. The ports are a lot more official than the janitor repos and I don't think it is a good idea to mix them both into the same set of tables. In addition the main reason I wanted this change is so that porters can use `rmadison -u ports` to get just ports package details and not get aptosid or other repositories that are not related to ports. For these reasons I think we should have separate tables for ports and other unofficial repos like the janitor ones. -- bye, pabs https://wiki.debian.org/PaulWise signature.asc Description: This is a digitally signed message part
Bug#1019380: UDD: import ports.d.o data to ports tables instead of derivatives tables
On 08/09/22 at 16:23 +0800, Paul Wise wrote: > Package: qa.debian.org > Severity: wishlist > User: qa.debian@packages.debian.org > Usertags: udd > X-Debbugs-CC: John Paul Adrian Glaubitz , Aurelien Jarno > > > Currently the unofficial Debian ports archive is imported in UDD tables > named 'derivatives', but these days it is more of a Debian subproject. > > The 'derivatives' table also receives (or did in the past) data from > aptosid and skolelinux, which are/were both derivatives of Debian. > > Therefore, I would like ports data to be imported into 'ports' tables > instead and make the new ports table available to the UDD madison cgi > and then add the ports UDD madison cgi to the default rmadison URL map. > > https://qa.debian.org/cgi-bin/madison.cgi?table=derivatives Hi, That sounds OK in principle. However, 1/ looking into it, I noticed that the source for packages in unreleased is not shipped. Is that expected? 2/ Would you be OK with a set of tables named unofficial_sources, unofficial_packages, etc? Then I would re-use the same set of tables to import janitor's fresh-releases and fresh-snapshots suite. Lucas
Bug#1019380: UDD: import ports.d.o data to ports tables instead of derivatives tables
Package: qa.debian.org Severity: wishlist User: qa.debian@packages.debian.org Usertags: udd X-Debbugs-CC: John Paul Adrian Glaubitz , Aurelien Jarno Currently the unofficial Debian ports archive is imported in UDD tables named 'derivatives', but these days it is more of a Debian subproject. The 'derivatives' table also receives (or did in the past) data from aptosid and skolelinux, which are/were both derivatives of Debian. Therefore, I would like ports data to be imported into 'ports' tables instead and make the new ports table available to the UDD madison cgi and then add the ports UDD madison cgi to the default rmadison URL map. https://qa.debian.org/cgi-bin/madison.cgi?table=derivatives -- bye, pabs https://wiki.debian.org/PaulWise signature.asc Description: This is a digitally signed message part
