[
https://issues.apache.org/jira/browse/BEAM-4249?focusedWorklogId=102351&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-102351
]
ASF GitHub Bot logged work on BEAM-4249:
----------------------------------------
Author: ASF GitHub Bot
Created on: 15/May/18 23:34
Start Date: 15/May/18 23:34
Worklog Time Spent: 10m
Work Description: pabloem closed pull request #5375: [BEAM-4249] Fix
failing validates container test
URL: https://github.com/apache/beam/pull/5375
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git
a/.test-infra/jenkins/job_PostCommit_Python_ValidatesContainer_Dataflow.groovy
b/.test-infra/jenkins/job_PostCommit_Python_ValidatesContainer_Dataflow.groovy
index 90344107b13..d37a63eba19 100644
---
a/.test-infra/jenkins/job_PostCommit_Python_ValidatesContainer_Dataflow.groovy
+++
b/.test-infra/jenkins/job_PostCommit_Python_ValidatesContainer_Dataflow.groovy
@@ -20,7 +20,7 @@ import common_job_properties
// This job runs the suite of Python ValidatesContainer tests against the
// Dataflow runner.
-job('beam_PostCommit_Python_ValidatesContainer_Dataflow') {
+job('beam_PostCommit_Py_ValCont') {
description('Runs Python ValidatesContainer suite on the Dataflow runner.')
// Set common parameters.
diff --git a/sdks/python/container/Dockerfile b/sdks/python/container/Dockerfile
index 0e95dbe8247..7da26cfa987 100644
--- a/sdks/python/container/Dockerfile
+++ b/sdks/python/container/Dockerfile
@@ -64,7 +64,7 @@ RUN \
pip install "google-cloud-pubsub == 0.26.0" && \
pip install "google-cloud-bigquery == 0.25.0" && \
# Optional packages
- pip install "cython == 0.27.2" && \
+ pip install "cython == 0.28.1" && \
pip install "guppy == 0.1.10" && \
pip install "python-snappy == 0.5.1" && \
# These are additional packages likely to be used by customers.
diff --git a/sdks/python/container/run_validatescontainer.sh
b/sdks/python/container/run_validatescontainer.sh
index a1e11bcba6c..de99535d8bc 100755
--- a/sdks/python/container/run_validatescontainer.sh
+++ b/sdks/python/container/run_validatescontainer.sh
@@ -28,9 +28,6 @@
set -e
set -v
-# pip install --user installation location.
-LOCAL_PATH=$HOME/.local/bin/
-
# Where to store integration test outputs.
GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
@@ -46,21 +43,6 @@ command -v gcloud
docker -v
gcloud -v
-# ensure gcloud is version 186 or above
-TMPDIR=$(mktemp -d)
-gcloud_ver=$(gcloud -v | head -1 | awk '{print $4}')
-if [[ "$gcloud_ver" < "186" ]]
-then
- pushd $TMPDIR
- curl
https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-sdk-186.0.0-linux-x86_64.tar.gz
--output gcloud.tar.gz
- tar xf gcloud.tar.gz
- ./google-cloud-sdk/install.sh --quiet
- . ./google-cloud-sdk/path.bash.inc
- popd
- gcloud components update --quiet || echo 'gcloud components update failed'
- gcloud -v
-fi
-
# Build the container
TAG=$(date +%Y%m%d-%H%M%S)
CONTAINER=us.gcr.io/$PROJECT/$USER/python
@@ -73,11 +55,8 @@ docker images | grep $TAG
# Push the container
gcloud docker -- push $CONTAINER
-# INFRA does not install virtualenv
-pip install virtualenv --user
-
# Virtualenv for the rest of the script to run setup & e2e test
-${LOCAL_PATH}/virtualenv sdks/python/container
+virtualenv sdks/python/container
. sdks/python/container/bin/activate
cd sdks/python
pip install -e .[gcp,test]
@@ -107,7 +86,4 @@ python setup.py nosetests \
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
-# Clean up tempdir
-rm -rf $TMPDIR
-
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 102351)
Time Spent: 3h 10m (was: 3h)
> beam_PostCommit_Python_ValidatesContainer_Dataflow red for a few days
> ---------------------------------------------------------------------
>
> Key: BEAM-4249
> URL: https://issues.apache.org/jira/browse/BEAM-4249
> Project: Beam
> Issue Type: Bug
> Components: build-system
> Affects Versions: 2.5.0
> Reporter: Alan Myrvold
> Assignee: Alan Myrvold
> Priority: Major
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PostCommit_Python_ValidatesContainer_Dataflow/
> Installing collected packages: protobuf, futures, grpcio, grpcio-tools
> Could not install packages due to an EnvironmentError: [Errno 13] Permission
> denied:
> '/usr/local/lib/python2.7/dist-packages/protobuf-3.5.2.post1-py2.7-nspkg.pth'
> Consider using the `--user` option or check the permissions.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
