[
https://issues.apache.org/jira/browse/BEAM-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010936#comment-17010936
]
Valentyn Tymofieiev edited comment on BEAM-8968 at 1/8/20 6:58 PM:
-------------------------------------------------------------------
Removing project.installGcpTest.mustRunAfter project.configurations.distTarBall
is not related to the failure, but the failure is still caused by
https://github.com/apache/beam/pull/10378. In particular, as [~ibzib] pointed
out, failing run looks for the job_server in
./build/gradleenv/2022703441/lib/runners/flink/1.9/job-server/build/libs/beam-runners-flink-1.9-job-server-2.19.0-SNAPSHOT.jar
while passing run looks for the jar in
./runners/flink/1.9/job-server/build/libs/beam-runners-flink-1.9-job-server-2.19.0-SNAPSHOT.jar
PR also changes the task tree from
{noformat}
+--- :sdks:python:test-suites:portable:py37:portableWordCountFlinkRunnerBatch
| \--- :sdks:python:test-suites:portable:py37:installGcpTest
| \--- :sdks:python:test-suites:portable:py37:setupVirtualenv
{noformat}
to
{noformat}
+--- :sdks:python:test-suites:portable:py37:portableWordCountFlinkRunnerBatch
| \--- :sdks:python:test-suites:portable:py37:installGcpTest
| +--- :sdks:python:sdist
| | \--- :sdks:python:setupVirtualenv
| \--- :sdks:python:test-suites:portable:py37:setupVirtualenv
{noformat}
Task tree can be printed via gradlew
:sdks:python:test-suites:portable:py37:postCommitPy37 taskTree.
Given that the error is specific to a PR we can close this, if version tags
cause a similar issue, the rootcause will be different.
was (Author: tvalentyn):
Removing project.installGcpTest.mustRunAfter project.configurations.distTarBall
is not related to the failure, but the failure is still caused by
https://github.com/apache/beam/pull/10378. In particular, as [~ibzib] pointed
out, failing run looks for the job_server in
./build/gradleenv/2022703441/lib/runners/flink/1.9/job-server/build/libs/beam-runners-flink-1.9-job-server-2.19.0-SNAPSHOT.jar
while passing run looks for the jar in
./runners/flink/1.9/job-server/build/libs/beam-runners-flink-1.9-job-server-2.19.0-SNAPSHOT.jar
PR also changes the task tree from
+--- :sdks:python:test-suites:portable:py37:portableWordCountFlinkRunnerBatch
| \--- :sdks:python:test-suites:portable:py37:installGcpTest
| \--- :sdks:python:test-suites:portable:py37:setupVirtualenv
to
+--- :sdks:python:test-suites:portable:py37:portableWordCountFlinkRunnerBatch
| \--- :sdks:python:test-suites:portable:py37:installGcpTest
| +--- :sdks:python:sdist
| | \--- :sdks:python:setupVirtualenv
| \--- :sdks:python:test-suites:portable:py37:setupVirtualenv
Task tree can be printed via gradlew
:sdks:python:test-suites:portable:py37:postCommitPy37 taskTree.
Given that the error is specific to a PR we can close this, if version tags
cause a similar issue, the rootcause will be different.
> portableWordCount test for Spark/Flink failing: jar not found
> -------------------------------------------------------------
>
> Key: BEAM-8968
> URL: https://issues.apache.org/jira/browse/BEAM-8968
> Project: Beam
> Issue Type: Bug
> Components: runner-flink, runner-spark
> Reporter: Kyle Weaver
> Assignee: Valentyn Tymofieiev
> Priority: Major
> Labels: currently-failing, portability-flink, portability-spark,
> test-failure
> Fix For: Not applicable
>
>
> This affects portableWordCountSparkRunnerBatch,
> portableWordCountFlinkRunnerBatch, and portableWordCountFlinkRunnerStreaming.
> 22:43:23 RuntimeError:
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/2022703441/lib/runners/flink/1.9/job-server/build/libs/beam-runners-flink-1.9-job-server-2.19.0-SNAPSHOT.jar
> not found. Please build the server with
> 22:43:23 cd
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/2022703441/lib;
> ./gradlew runners:flink:1.9:job-server:shadowJar
> Note: the error was obeserved on pull/10378, and not on master.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
