[
https://issues.apache.org/jira/browse/BEAM-5873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16695282#comment-16695282
]
Valentyn Tymofieiev commented on BEAM-5873:
-------------------------------------------
The failing Python container image from the snapshot appears to be missing
around 100M of content in /usr/lib compared to a healthy container image.
In particular /usr/lib/python2.7 takes up 60M on a healthy image, and 160 K on
unhealthy image, where a bunch of files are empty. Empty files in the failing
container image are not necessarily python-related, for example:
/usr/lib/x86_64-linux-gnu/libc.a is empty on the broken image.
I suspect either a worker VM ran out of disk space while while pulling a Python
container that was not cached in the VM, or we have some other docker-related
corruption when we were pulling the missing Python container image.
Looking further.
> Python test failure: "ImportError: No module named pip._internal"
> -----------------------------------------------------------------
>
> Key: BEAM-5873
> URL: https://issues.apache.org/jira/browse/BEAM-5873
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Henning Rohde
> Assignee: Valentyn Tymofieiev
> Priority: Major
>
> https://scans.gradle.com/s/r55ln7mdibu2w/console-log?task=:beam-sdks-python:postCommitITTests#L163
> Logs:
> https://pantheon.corp.google.com/logs/viewer?resource=dataflow_step%2Fjob_id%2F2018-10-26_06_46_26-13501822612780835073&logName=projects%2Fapache-beam-testing%2Flogs%2Fdataflow.googleapis.com%252Fworker-startup&interval=NO_LIMIT&project=apache-beam-testing&minLogLevel=0&expandAll=false×tamp=2018-10-26T20:01:54.773000000Z&customFacets=&limitCustomFacetWidth=true&scrollTimestamp=2018-10-26T13:49:18.405228000Z
> Executing: /usr/local/bin/pip install
> /var/opt/google/dataflow/dataflow_python_sdk.tar[gcp]
> Debug: delayed tasks complete
> Debug: download complete
> Traceback (most recent call last):
> File "/usr/local/bin/pip", line 7, in <module>
> from pip._internal import main
> ImportError
> :
> No module named pip._internal
> /usr/local/bin/pip failed with exit status 1
> Maybe a flake?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
