[
https://issues.apache.org/jira/browse/HADOOP-17902?focusedWorklogId=649658&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-649658
]
ASF GitHub Bot logged work on HADOOP-17902:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 12/Sep/21 05:55
Start Date: 12/Sep/21 05:55
Worklog Time Spent: 10m
Work Description: GauthamBanasandra commented on a change in pull request
#3408:
URL: https://github.com/apache/hadoop/pull/3408#discussion_r706766840
##########
File path: dev-support/docker/Dockerfile_debian_10
##########
@@ -54,6 +49,20 @@ RUN apt-get -q update \
&& apt-get clean \
&& rm -rf /var/lib/apt/lists/*
+#####
+# For installing the latest packages
+#####
+RUN echo 'deb http://deb.debian.org/debian testing main' >>
/etc/apt/sources.list
Review comment:
@goiri If I set this at the beginning, everytime the CI creates the
Debian 10 build environment, it pulls the latest packages from Debian testing.
This is broken currently - i.e. when it tries to install python3, it fails in
installing a dependency -
```
[2021-09-08T00:21:22.744Z] #13 11.28 Preparing to unpack
.../libc6_2.31-17_amd64.deb ...
[2021-09-08T00:21:23.260Z] #13 11.46 Checking for services that may need to
be restarted...
[2021-09-08T00:21:23.260Z] #13 11.48 Checking init scripts...
[2021-09-08T00:21:23.260Z] #13 11.50 Unpacking libc6:amd64 (2.31-17) over
(2.28-10) ...
[2021-09-08T00:21:26.290Z] #13 14.38 Setting up libc6:amd64 (2.31-17) ...
[2021-09-08T00:21:26.290Z] #13 14.42 /usr/bin/perl: error while loading
shared libraries: libcrypt.so.1: cannot open shared object file: No such file
or directory
[2021-09-08T00:21:26.290Z] #13 14.42 dpkg: error processing package
libc6:amd64 (--configure):
[2021-09-08T00:21:26.290Z] #13 14.42 installed libc6:amd64 package
post-installation script subprocess returned error exit status 127
[2021-09-08T00:21:26.291Z] #13 14.43 Errors were encountered while
processing:
[2021-09-08T00:21:26.291Z] #13 14.43 libc6:amd64
[2021-09-08T00:21:26.291Z] #13 14.46 E: Sub-process /usr/bin/dpkg returned
an error code (1)
[2021-09-08T00:21:27.867Z] #13 ERROR: executor failed running [/bin/bash -o
pipefail -c apt-get -q update && apt-get -q install -y
--no-install-recommends python3 && apt-get -q install -y
--no-install-recommends $(pkg-resolver/resolve.py debian:10) && apt-get
clean && rm -rf /var/lib/apt/lists/*]: exit code: 100
```
Hence, I'm adding the Debian testing as the source only for installing GCC
10. Let me see if I can pin the Debian testing packages to an older date so
that we don't have to deal with this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 649658)
Time Spent: 3h (was: 2h 50m)
> Fix Hadoop build on Debian 10
> -----------------------------
>
> Key: HADOOP-17902
> URL: https://issues.apache.org/jira/browse/HADOOP-17902
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 3.4.0
> Reporter: Gautham Banasandra
> Assignee: Gautham Banasandra
> Priority: Blocker
> Labels: pull-request-available
> Time Spent: 3h
> Remaining Estimate: 0h
>
> We're using *Debian testing* as one of the package sources to get the latest
> packages. It seems to be broken at the moment. The CI fails to create the
> build environment for the Debian 10 platform -
> {code}
> [2021-09-08T00:21:11.596Z] #13 [ 8/14] RUN apt-get -q update && apt-get
> -q install -y --no-install-recommends python3 && apt-get -q install -y
> --no-install-recommends $(pkg-resolver/resolve.py debian:10) && apt-get
> clean && rm -rf /var/lib/apt/lists/*
> ...
> [2021-09-08T00:21:22.744Z] #13 11.28 Preparing to unpack
> .../libc6_2.31-17_amd64.deb ...
> [2021-09-08T00:21:23.260Z] #13 11.46 Checking for services that may need to
> be restarted...
> [2021-09-08T00:21:23.260Z] #13 11.48 Checking init scripts...
> [2021-09-08T00:21:23.260Z] #13 11.50 Unpacking libc6:amd64 (2.31-17) over
> (2.28-10) ...
> [2021-09-08T00:21:26.290Z] #13 14.38 Setting up libc6:amd64 (2.31-17) ...
> [2021-09-08T00:21:26.290Z] #13 14.42 /usr/bin/perl: error while loading
> shared libraries: libcrypt.so.1: cannot open shared object file: No such file
> or directory
> [2021-09-08T00:21:26.290Z] #13 14.42 dpkg: error processing package
> libc6:amd64 (--configure):
> [2021-09-08T00:21:26.290Z] #13 14.42 installed libc6:amd64 package
> post-installation script subprocess returned error exit status 127
> [2021-09-08T00:21:26.291Z] #13 14.43 Errors were encountered while processing:
> [2021-09-08T00:21:26.291Z] #13 14.43 libc6:amd64
> [2021-09-08T00:21:26.291Z] #13 14.46 E: Sub-process /usr/bin/dpkg returned an
> error code (1)
> [2021-09-08T00:21:27.867Z] #13 ERROR: executor failed running [/bin/bash -o
> pipefail -c apt-get -q update && apt-get -q install -y
> --no-install-recommends python3 && apt-get -q install -y
> --no-install-recommends $(pkg-resolver/resolve.py debian:10) && apt-get
> clean && rm -rf /var/lib/apt/lists/*]: exit code: 100
> [2021-09-08T00:21:27.867Z] ------
> [2021-09-08T00:21:27.867Z] > [ 8/14] RUN apt-get -q update && apt-get -q
> install -y --no-install-recommends python3 && apt-get -q install -y
> --no-install-recommends $(pkg-resolver/resolve.py debian:10) && apt-get
> clean && rm -rf /var/lib/apt/lists/*:
> [2021-09-08T00:21:27.867Z] ------
> [2021-09-08T00:21:27.867Z] executor failed running [/bin/bash -o pipefail -c
> apt-get -q update && apt-get -q install -y --no-install-recommends
> python3 && apt-get -q install -y --no-install-recommends
> $(pkg-resolver/resolve.py debian:10) && apt-get clean && rm -rf
> /var/lib/apt/lists/*]: exit code: 100
> [2021-09-08T00:21:27.867Z] ERROR: Docker failed to build
> yetus/hadoop:ef5dbc7283a.
> [2021-09-08T00:21:27.867Z]
> {code}
> The above log lines are copied from -
> https://ci-hadoop.apache.org/blue/organizations/jenkins/hadoop-multibranch/detail/PR-3388/3/pipeline
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]