[
https://issues.apache.org/jira/browse/BEAM-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000292#comment-17000292
]
Brian Hulette commented on BEAM-7405:
-------------------------------------
This happened again in
[https://builds.apache.org/job/beam_PostCommit_Python2/1258/]
Gradle build scan: [https://scans.gradle.com/s/wejnwzveleuxu]
{code}
:sdks:python:test-suites:direct:py2:hdfsIntegrationTest FAILED
++ dirname
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/hdfs_integration_test.sh
+
TEST_DIR=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test
+
ROOT_DIR=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../..
+
CONTEXT_DIR=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration
+ rm -r
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration
rm: cannot remove
'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration'
: No such file or directory
+ true
+ mkdir -p
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/sdks
+ cp
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/docker-compose.yml
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/Dockerfile
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/hdfscli.cfg
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/hdfs_integration_test.sh
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/
+ cp -r
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../../sdks/python
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/sdks/
+ cp -r
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../../model
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/
++ echo hdfs_IT-jenkins-beam_PostCommit_Python2-1258
+ PROJECT_NAME=hdfs_IT-jenkins-beam_PostCommit_Python2-1258
+ '[' -z jenkins-beam_PostCommit_Python2-1258 ']'
+ COLOR_OPT=--no-ansi
+ COMPOSE_OPT='-p hdfs_IT-jenkins-beam_PostCommit_Python2-1258 --no-ansi'
+ cd
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python2/src/sdks/python/apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration
+ docker network prune --force
+ trap finally EXIT
+ docker-compose -p hdfs_IT-jenkins-beam_PostCommit_Python2-1258 --no-ansi
build --build-arg BASE_IMAGE=python:2
namenode uses an image, skipping
datanode uses an image, skipping
Building test
[15171] Failed to execute script docker-compose
Traceback (most recent call last):
File "bin/docker-compose", line 6, in <module>
File "compose/cli/main.py", line 71, in main
File "compose/cli/main.py", line 127, in perform_command
File "compose/cli/main.py", line 287, in build
File "compose/project.py", line 386, in build
File "compose/project.py", line 368, in build_service
File "compose/service.py", line 1084, in build
File "site-packages/docker/api/build.py", line 260, in build
File "site-packages/docker/api/build.py", line 307, in _set_auth_headers
File "site-packages/docker/auth.py", line 310, in get_all_credentials
File "site-packages/docker/auth.py", line 262, in
_resolve_authconfig_credstore
File "site-packages/docker/auth.py", line 287, in _get_store_instance
File "site-packages/dockerpycreds/store.py", line 25, in __init__
dockerpycreds.errors.InitializationError: docker-credential-gcloud not
installed or not available in PATH
+ finally
+ docker-compose -p hdfs_IT-jenkins-beam_PostCommit_Python2-1258 --no-ansi down
Removing network hdfs_it-jenkins-beam_postcommit_python2-1258_test_net
Network hdfs_it-jenkins-beam_postcommit_python2-1258_test_net not found.
real 0m0.789s
user 0m0.629s
sys 0m0.133s
{code}
> Task :sdks:python:hdfsIntegrationTest is failing in Python PostCommits -
> docker-credential-gcloud not installed
> ---------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-7405
> URL: https://issues.apache.org/jira/browse/BEAM-7405
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Valentyn Tymofieiev
> Assignee: Yifan Zou
> Priority: Major
> Fix For: 2.14.0
>
> Time Spent: 3h
> Remaining Estimate: 0h
>
> This failure happened on apache-beam-jenkins-14.
> {noformat}
> 18:47:03 > Task :sdks:python:hdfsIntegrationTest
> 18:47:03 ++ dirname
> ./apache_beam/io/hdfs_integration_test/hdfs_integration_test.sh
> 18:47:03 + TEST_DIR=./apache_beam/io/hdfs_integration_test
> 18:47:03 + ROOT_DIR=./apache_beam/io/hdfs_integration_test/../../../../..
> 18:47:03 +
> CONTEXT_DIR=./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration
> 18:47:03 + rm -r
> ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration
> 18:47:03 rm: cannot remove
> './apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration':
> No such file or directory
> 18:47:03 + true
> 18:47:03 + mkdir -p
> ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/sdks
> 18:47:03 + cp ./apache_beam/io/hdfs_integration_test/docker-compose.yml
> ./apache_beam/io/hdfs_integration_test/Dockerfile
> ./apache_beam/io/hdfs_integration_test/hdfscli.cfg
> ./apache_beam/io/hdfs_integration_test/hdfs_integration_test.sh
> ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/
> 18:47:03 + cp -r
> ./apache_beam/io/hdfs_integration_test/../../../../../sdks/python
> ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/sdks/
> 18:47:03 + cp -r ./apache_beam/io/hdfs_integration_test/../../../../../model
> ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/
> 18:47:03 ++ echo hdfs_IT-jenkins-beam_PostCommit_Python_Verify_PR-714
> 18:47:03 + PROJECT_NAME=hdfs_IT-jenkins-beam_PostCommit_Python_Verify_PR-714
> 18:47:03 + '[' -z jenkins-beam_PostCommit_Python_Verify_PR-714 ']'
> 18:47:03 + COLOR_OPT=--no-ansi
> 18:47:03 + COMPOSE_OPT='-p
> hdfs_IT-jenkins-beam_PostCommit_Python_Verify_PR-714 --no-ansi'
> 18:47:03 + cd
> ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration
> 18:47:03 + docker network prune --force
> 18:47:03 + trap finally EXIT
> 18:47:03 + docker-compose -p
> hdfs_IT-jenkins-beam_PostCommit_Python_Verify_PR-714 --no-ansi build
> 18:47:03 namenode uses an image, skipping
> 18:47:03 datanode uses an image, skipping
> 18:47:03 Building test
> 18:47:03 [29234] Failed to execute script docker-compose
> 18:47:03 Traceback (most recent call last):
> 18:47:03 File "bin/docker-compose", line 6, in <module>
> 18:47:03 File "compose/cli/main.py", line 71, in main
> 18:47:03 File "compose/cli/main.py", line 127, in perform_command
> 18:47:03 File "compose/cli/main.py", line 287, in build
> 18:47:03 File "compose/project.py", line 386, in build
> 18:47:03 File "compose/project.py", line 368, in build_service
> 18:47:03 File "compose/service.py", line 1084, in build
> 18:47:03 File "site-packages/docker/api/build.py", line 260, in build
> 18:47:03 File "site-packages/docker/api/build.py", line 307, in
> _set_auth_headers
> 18:47:03 File "site-packages/docker/auth.py", line 310, in
> get_all_credentials
> 18:47:03 File "site-packages/docker/auth.py", line 262, in
> _resolve_authconfig_credstore
> 18:47:03 File "site-packages/docker/auth.py", line 287, in
> _get_store_instance
> 18:47:03 File "site-packages/dockerpycreds/store.py", line 25, in __init__
> 18:47:03 dockerpycreds.errors.InitializationError: docker-credential-gcloud
> not installed or not available in PATH
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)