masatana commented on PR #1298:
URL: https://github.com/apache/bigtop/pull/1298#issuecomment-2424231334
Our supported distros have python3-{setuptools,wheel,flake8} in their repo.
So we can use them.
I just tested to build Livy on Ubuntu 24.04 as we need
python3-{setuptools,wheel,flake8} to build Livy (#530, #625), and it works.
(if there are any problems to build on other distros, we can make a
follow-up PR.)
<details>
<summary>python3-{setuptools,wheel,flake8} on supported OS (Rocky8/9,
Debian12, openEuler22.03, Fedora40</summary>
* Rocky8 w/ CRB(powertools), EPEL
```
[root@7d9cca636e9e /]# cat /etc/os-release
NAME="Rocky Linux"
VERSION="8.9 (Green Obsidian)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="8.9"
PLATFORM_ID="platform:el8"
PRETTY_NAME="Rocky Linux 8.9 (Green Obsidian)"
ANSI_COLOR="0;32"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:rocky:rocky:8:GA"
HOME_URL="https://rockylinux.org/";
BUG_REPORT_URL="https://bugs.rockylinux.org/";
SUPPORT_END="2029-05-31"
ROCKY_SUPPORT_PRODUCT="Rocky-Linux-8"
ROCKY_SUPPORT_PRODUCT_VERSION="8.9"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="8.9"
[root@7d9cca636e9e /]# dnf search python3-flake8
Last metadata expiration check: 0:00:35 ago on Sat Oct 19 09:32:58 2024.
===========================================================================================================
Name Exactly Matched: python3-flake8
===========================================================================================================python3-flake8.noarch
: Python code checking using pyflakes, pycodestyle, and mccabe
===============================================================================================================
Name Matched: python3-flake8
===============================================================================================================python3-flake8-docstrings.noarch
: A plugin to flake8 to include checks provided by pep257
python3-flake8-polyfill.noarch : Polyfill package for Flake8 plugins
[root@7d9cca636e9e /]# dnf search python3-setuptools
Last metadata expiration check: 0:00:43 ago on Sat Oct 19 09:32:58 2024.
=========================================================================================================
Name Exactly Matched: python3-setuptools
=========================================================================================================
python3-setuptools.noarch : Easily build and distribute Python 3 packages
=============================================================================================================
Name Matched: python3-setuptools
=============================================================================================================
python3-setuptools-gettext.noarch : Setuptools gettext extension plugin
python3-setuptools-wheel.noarch : The setuptools wheel
python3-setuptools_scm.noarch : Blessed package to manage your versions by
scm tags
python3-setuptools_scm_git_archive.noarch : A setuptools_scm plugin that
adds support for git archives
[root@7d9cca636e9e /]# dnf search python3-wheel
Last metadata expiration check: 0:00:48 ago on Sat Oct 19 09:32:58 2024.
===========================================================================================================
Name Exactly Matched: python3-wheel
============================================================================================================python3-wheel.noarch
: Built-package format for Python
===============================================================================================================
Name Matched: python3-wheel
================================================================================================================python3-wheel-wheel.noarch
: The Python wheel module packaged as a wheel
[root@7d9cca636e9e /]#
```
* Rocky9 w/ CRB, EPEL
```
[root@cb63f973d598 /]# cat /etc/os-release
NAME="Rocky Linux"
VERSION="9.3 (Blue Onyx)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="9.3"
PLATFORM_ID="platform:el9"
PRETTY_NAME="Rocky Linux 9.3 (Blue Onyx)"
ANSI_COLOR="0;32"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:rocky:rocky:9::baseos"
HOME_URL="https://rockylinux.org/";
BUG_REPORT_URL="https://bugs.rockylinux.org/";
SUPPORT_END="2032-05-31"
ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9"
ROCKY_SUPPORT_PRODUCT_VERSION="9.3"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="9.3"
[root@cb63f973d598 /]# dnf search python3-setuptools
Last metadata expiration check: 0:00:35 ago on Sat Oct 19 09:35:35 2024.
=========================================================================================================
Name Exactly Matched: python3-setuptools
=========================================================================================================python3-setuptools.noarch
: Easily build and distribute Python 3 packages
========================================================================================================
Name & Summary Matched: python3-setuptools
========================================================================================================python3-setuptools_scm+toml.noarch
: Metapackage for python3-setuptools_scm: toml extras
=============================================================================================================
Name Matched: python3-setuptools
=============================================================================================================python3-setuptools-gettext.noarch
: Setuptools gettext extension plugin
python3-setuptools-git-versioning.noarch : Support for physical quantities
with units, based on numpy
python3-setuptools-wheel.noarch : The setuptools wheel
python3-setuptools_scm.noarch : Blessed package to manage your versions by
SCM tags
python3-setuptools_scm_git_archive.noarch : A setuptools_scm plugin that
adds support for git archives
[root@cb63f973d598 /]# dnf search python3-wheel
Last metadata expiration check: 0:00:39 ago on Sat Oct 19 09:35:35 2024.
===========================================================================================================
Name Exactly Matched: python3-wheel
============================================================================================================python3-wheel.noarch
: Built-package format for Python
===============================================================================================================
Name Matched: python3-wheel
================================================================================================================python3-wheel-wheel.noarch
: The Python wheel module packaged as a wheel
[root@cb63f973d598 /]# dnf search python3-flake8
Last metadata expiration check: 0:01:06 ago on Sat Oct 19 09:35:35 2024.
===========================================================================================================
Name Exactly Matched: python3-flake8
===========================================================================================================
python3-flake8.noarch : Python code checking using pyflakes, pycodestyle,
and mccabe
===============================================================================================================
Name Matched: python3-flake8
===============================================================================================================python3-flake8-blind-except.noarch
: A flake8 extension that checks for catch-all except statements
python3-flake8-builtins.noarch : Check for python builtins being used as
variables or parameters
python3-flake8-class-newline.noarch : Flake8 extension to check for new
lines after class definitions
python3-flake8-comprehensions.noarch : Flake8 plugin that helps you write
better list/set/dict comprehensions
python3-flake8-deprecated.noarch : Flake8 plugin that warns about deprecated
method calls
python3-flake8-docstrings.noarch : A plugin to flake8 to include checks
provided by pep257
python3-flake8-import-order.noarch : Flake8 plugin for checking order of
imports in Python code
python3-flake8-quotes.noarch : Flake8 extension for checking quotes in python
```
* openEuler 24.03
```
[root@85e3d1002e6f /]# dnf search python3-flake8
OS
1.3 MB/s | 3.4
MB 00:02
everything
6.2 MB/s | 17
MB 00:02
EPOL
3.0 MB/s | 4.7
MB 00:01
debuginfo
2.5 MB/s | 4.1
MB 00:01
source
1.3 MB/s | 1.8
MB 00:01
update
21 kB/s | 14
MB 11:17
update-source
930 kB/s | 1.8
MB 00:02
===========================================================================================================
Name Exactly Matched: python3-flake8
===========================================================================================================python3-flake8.noarch
: the modular source code checker: pep8 pyflakes and co
===============================================================================================================
Name Matched: python3-flake8
===============================================================================================================python3-flake8-import-order.noarch
: Flake8 and pylama plugin that checks the ordering of import statements.
[root@85e3d1002e6f /]# dnf search python3-wheel
Last metadata expiration check: 0:33:01 ago on Sat Oct 19 10:26:12 2024.
===========================================================================================================
Name Exactly Matched: python3-wheel
============================================================================================================python3-wheel.noarch
: Built-package format for Python
[root@85e3d1002e6f /]# dnf search python3-setuptools
Last metadata expiration check: 0:33:07 ago on Sat Oct 19 10:26:12 2024.
=========================================================================================================
Name Exactly Matched: python3-setuptools
=========================================================================================================python3-setuptools.noarch
: Easily build and distribute Python 3 packages
=============================================================================================================
Name Matched: python3-setuptools
=============================================================================================================python3-setuptools-rust.noarch
: Setuptools Rust extension plugin
python3-setuptools_git.noarch : Plugin for integrating Git into setuptools
python3-setuptools_scm.noarch : the blessed package to manage your versions
by scm tags
[root@85e3d1002e6f /]# cat /etc/os-release
NAME="openEuler"
VERSION="22.03 (LTS-SP4)"
ID="openEuler"
VERSION_ID="22.03"
PRETTY_NAME="openEuler 22.03 (LTS-SP4)"
ANSI_COLOR="0;31"
```
* debian 12
```
root@9e44f828a472:/# cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
NAME="Debian GNU/Linux"
VERSION_ID="12"
VERSION="12 (bookworm)"
VERSION_CODENAME=bookworm
ID=debian
HOME_URL="https://www.debian.org/";
SUPPORT_URL="https://www.debian.org/support";
BUG_REPORT_URL="https://bugs.debian.org/";
root@9e44f828a472:/# apt list python3-setuptools
Listing... Done
python3-setuptools/stable 66.1.1-1 all
root@9e44f828a472:/# apt list python3-wheel
Listing... Done
python3-wheel/stable 0.38.4-2 all
root@9e44f828a472:/# apt list python3-flake8
Listing... Done
python3-flake8/stable 5.0.4-4 all
```
* fedora 40
```
[root@2a0cfc380cc9 /]# cat /etc/os-release
NAME="Fedora Linux"
VERSION="40 (Container Image)"
ID=fedora
VERSION_ID=40
VERSION_CODENAME=""
PLATFORM_ID="platform:f40"
PRETTY_NAME="Fedora Linux 40 (Container Image)"
ANSI_COLOR="0;38;2;60;110;180"
LOGO=fedora-logo-icon
CPE_NAME="cpe:/o:fedoraproject:fedora:40"
DEFAULT_HOSTNAME="fedora"
HOME_URL="https://fedoraproject.org/";
DOCUMENTATION_URL="https://docs.fedoraproject.org/en-US/fedora/f40/system-administrators-guide/";
SUPPORT_URL="https://ask.fedoraproject.org/";
BUG_REPORT_URL="https://bugzilla.redhat.com/";
REDHAT_BUGZILLA_PRODUCT="Fedora"
REDHAT_BUGZILLA_PRODUCT_VERSION=40
REDHAT_SUPPORT_PRODUCT="Fedora"
REDHAT_SUPPORT_PRODUCT_VERSION=40
SUPPORT_END=2025-05-13
VARIANT="Container Image"
VARIANT_ID=container
[root@2a0cfc380cc9 /]# dnf search python3-flake8
Fedora 40 - x86_64
3.7 MB/s | 20
MB 00:05
Fedora 40 openh264 (From Cisco) - x86_64
889 B/s | 1.4
kB 00:01
Fedora 40 - x86_64 - Updates
9.3 MB/s | 11
MB 00:01
===========================================================================================================
Name Exactly Matched: python3-flake8
===========================================================================================================python3-flake8.noarch
: Python code checking using pyflakes, pycodestyle, and mccabe
===============================================================================================================
Name Matched: python3-flake8
===============================================================================================================python3-flake8-blind-except.noarch
: A flake8 extension that checks for catch-all except statements
python3-flake8-builtins.noarch : Check for python builtins being used as
variables or parameters
python3-flake8-class-newline.noarch : Flake8 extension to check for new
lines after class definitions
python3-flake8-comprehensions.noarch : Flake8 plugin that helps you write
better list/set/dict comprehensions
python3-flake8-deprecated.noarch : Flake8 plugin that warns about deprecated
method calls
python3-flake8-docstrings.noarch : A plugin to flake8 to include checks
provided by pep257
python3-flake8-import-order.noarch : Flake8 plugin for checking order of
imports in Python code
python3-flake8-polyfill.noarch : Polyfill package for Flake8 plugins
python3-flake8-quotes.noarch : Flake8 extension for checking quotes in python
[root@2a0cfc380cc9 /]# dnf search python3-wheel
Last metadata expiration check: 0:00:10 ago on Sat Oct 19 11:14:47 2024.
===========================================================================================================
Name Exactly Matched: python3-wheel
============================================================================================================python3-wheel.noarch
: Built-package format for Python
===============================================================================================================
Name Matched: python3-wheel
================================================================================================================mingw32-python3-wheel.noarch
: MinGW Windows Python3 wheel library
mingw64-python3-wheel.noarch : MinGW Windows Python3 wheel library
[root@2a0cfc380cc9 /]# dnf search python3-setuptools
Last metadata expiration check: 0:00:19 ago on Sat Oct 19 11:14:47 2024.
=========================================================================================================
Name Exactly Matched: python3-setuptools
=========================================================================================================python3-setuptools.noarch
: Easily build and distribute Python 3 packages
========================================================================================================
Name & Summary Matched: python3-setuptools
========================================================================================================python3-setuptools_scm+rich.noarch
: Metapackage for python3-setuptools_scm: rich extras
python3-setuptools_scm+toml.noarch : Metapackage for python3-setuptools_scm:
toml extras
=============================================================================================================
Name Matched: python3-setuptools
=============================================================================================================mingw32-python3-setuptools.noarch
: MinGW Windows Python3 setuptools library
mingw64-python3-setuptools.noarch : MinGW Windows Python3 setuptools library
python3-setuptools-gettext.noarch : Setuptools gettext extension plugin
python3-setuptools-git-versioning.noarch : Support for physical quantities
with units, based on numpy
python3-setuptools-rust.noarch : Setuptools Rust extension plugin
python3-setuptools_git.noarch : Setuptools revision control system plugin
for Git
python3-setuptools_scm.noarch : Blessed package to manage your versions by
SCM tags
python3-setuptools_scm_git_archive.noarch : A setuptools_scm plugin that
adds support for git archives
[root@2a0cfc380cc9 /]#
```
</details>
<details>
<summary>Livy build results on Ubuntu 24.04</summary>
```
$ ./gradlew allclean livy-pkg
(...snip...)
Finished running lintian.
BUILD SUCCESSFUL in 14m 5s
41 actionable tasks: 41 executed
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
