[
https://issues.apache.org/jira/browse/IMPALA-13558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899973#comment-17899973
]
ASF subversion and git services commented on IMPALA-13558:
----------------------------------------------------------
Commit 8dd935a98f1ee758bd8f2a03f9bd778a8a2f433e in impala's branch
refs/heads/master from Joe McDonnell
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=8dd935a98 ]
IMPALA-13558: Workaround Python 2 tarfile issue by patching tarfile.py
Ubuntu 20.04 introduced a bug in their Python 2.7's tarfile
functionality with 2.7.18-1~20.04.5. See
https://bugs.launchpad.net/ubuntu/+source/python2.7/+bug/2089071
This breaks the Impala build with a message like
"tarfile.ReadError: invalid header".
The bug has an attached tarfile.py with a workaround for the
issue. This change bootstrap_system.sh and boostrap_build.sh to
detect the bad tarfile.py and replace it with the patched tarfile.py.
Since this is comparing the hash, this will become a no-op once
Ubuntu fixes the issue.
Testing:
- Ran a build on Ubuntu 20.04
Change-Id: I1d0691611cf53ae6dd1099b97f0aa15b450e0996
Reviewed-on: http://gerrit.cloudera.org:8080/22088
Reviewed-by: Quanlong Huang <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Work around bad Ubuntu 20.04 python 2.7 update
> ----------------------------------------------
>
> Key: IMPALA-13558
> URL: https://issues.apache.org/jira/browse/IMPALA-13558
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 4.5.0
> Reporter: Joe McDonnell
> Priority: Blocker
>
> Ubuntu 20.04 introduced a bug in their Python 2.7's tarfile functionality
> with 2.7.18-1~20.04.5 (see
> [https://bugs.launchpad.net/ubuntu/+source/python2.7/+bug/2089071] ). This
> breaks Impala builds with a message like this:
> {noformat}
> Traceback (most recent call last):
> File "bin/../infra/python/bootstrap_virtualenv.py", line 521, in <module>
> setup_virtualenv_if_not_exists(venv_dir, options.python3)
> File "bin/../infra/python/bootstrap_virtualenv.py", line 482, in
> setup_virtualenv_if_not_exists
> create_virtualenv(venv_dir, is_py3)
> File "bin/../infra/python/bootstrap_virtualenv.py", line 138, in
> create_virtualenv
> file = tarfile.open(virtualenv_tarball, "r:gz")
> File "/usr/lib/python2.7/tarfile.py", line 1708, in open
> return func(name, filemode, fileobj, **kwargs)
> File "/usr/lib/python2.7/tarfile.py", line 1762, in gzopen
> t = cls.taropen(name, mode, fileobj, **kwargs)
> File "/usr/lib/python2.7/tarfile.py", line 1738, in taropen
> return cls(name, mode, fileobj, **kwargs)
> File "/usr/lib/python2.7/tarfile.py", line 1602, in __init__
> self.firstmember = self.next()
> File "/usr/lib/python2.7/tarfile.py", line 2385, in next
> raise ReadError(str(e))
> tarfile.ReadError: invalid header{noformat}
> We need to work around this issue to unblock precommit. On the Ubuntu bug
> listed above, there is a workaround tarfile.py that could be copied into
> place.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
