[
https://issues.apache.org/jira/browse/BEAM-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900445#comment-16900445
]
Mark Liu commented on BEAM-7899:
--------------------------------
This error caused tests in two Python2 suites (batch and streaming) failed.
After further investigation, I think it's related to
https://github.com/apache/beam/pull/9183. When moved dataflow tests to
test-suite/dataflow/py2, the pipeline still use default value
`build/apache-beam.tar.gz` for sdk_location which should be
${project.buildDir}/apache-beam.tar.gz instead. Will come out a fix soon.
> beam_PostCommit_Py_VR_Dataflow failure: build/apache-beam.tar.gz cannot be
> found
> --------------------------------------------------------------------------------
>
> Key: BEAM-7899
> URL: https://issues.apache.org/jira/browse/BEAM-7899
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Udi Meiri
> Assignee: Mark Liu
> Priority: Major
>
> Lots of tests consistently failing with errors like:
> {code}
> 09:56:15
> ======================================================================
> 09:56:15 ERROR: test_as_list_twice
> (apache_beam.transforms.sideinputs_test.SideInputsTest)
> 09:56:15
> ----------------------------------------------------------------------
> 09:56:15 Traceback (most recent call last):
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/transforms/sideinputs_test.py",
> line 274, in test_as_list_twice
> 09:56:15 pipeline.run()
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/testing/test_pipeline.py",
> line 107, in run
> 09:56:15 else test_runner_api))
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/pipeline.py",
> line 406, in run
> 09:56:15 self._options).run(False)
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/pipeline.py",
> line 419, in run
> 09:56:15 return self.runner.run_pipeline(self, self._options)
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",
> line 53, in run_pipeline
> 09:56:15 pipeline, options)
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",
> line 484, in run_pipeline
> 09:56:15 self.dataflow_client.create_job(self.job), self)
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/utils/retry.py",
> line 206, in wrapper
> 09:56:15 return fun(*args, **kwargs)
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py",
> line 530, in create_job
> 09:56:15 self.create_job_description(job)
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py",
> line 560, in create_job_description
> 09:56:15 resources = self._stage_resources(job.options)
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py",
> line 490, in _stage_resources
> 09:56:15 staging_location=google_cloud_options.staging_location)
> 09:56:15 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/portability/stager.py",
> line 273, in stage_job_resources
> 09:56:15 'the --sdk_location command-line option.' % sdk_path)
> 09:56:15 RuntimeError: The file "build/apache-beam.tar.gz" cannot be found.
> Its location was specified by the --sdk_location command-line option.
> {code}
> https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/4207/console
> [~markflyhigh]
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
