[
https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983039#comment-16983039
]
Kyle Weaver commented on BEAM-8512:
-----------------------------------
I set up tests, but I am getting a couple errors with FlinkUberJarJobServer
(the other code path works fine, which is expected because we are already
testing it in PostCommits).
1) With MiniCluster, I get error "Resource BEAM-PIPELINE/pipeline-manifest.json
not found on classpath" (even though the pipeline manifest is in the submitted
jar as it should be, looks like the ClassLoader is not finding it).
https://github.com/apache/beam/blob/4f4c7c646fc1e931491029e1f6f28762ed0cd36f/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/jobsubmission/PortablePipelineJarUtils.java#L88
2) When I point the test to a local Flink cluster instead of the MiniCluster, I
run into BEAM-8835
https://github.com/ibzib/beam/commit/0e4fd57ea1334d9dcd0916a65394621d36cc3fc3
> Add integration tests for Python "flink_runner.py"
> --------------------------------------------------
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
> Reporter: Maximilian Michels
> Assignee: Kyle Weaver
> Priority: Major
> Fix For: Not applicable
>
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
