[jira] [Commented] (BEAM-4465) Enable Flink runner to run IOITs
[ https://issues.apache.org/jira/browse/BEAM-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16718749#comment-16718749 ] Lukasz Gajowy commented on BEAM-4465: - Unless we want to run the tests on an in memory flink runner we still need kubernetes scripts for Flink cluster that could be set up before actually running the test and torn down after. > Enable Flink runner to run IOITs > > > Key: BEAM-4465 > URL: https://issues.apache.org/jira/browse/BEAM-4465 > Project: Beam > Issue Type: New Feature > Components: runner-flink, testing >Reporter: Lukasz Gajowy >Priority: Major > Fix For: 2.9.0 > > > Flink runner should be able to run IOITs the same way as Dataflow or Direct > runner. > For more details on how the tests are run see the documentation: > [https://beam.apache.org/documentation/io/testing/#i-o-transform-integration-tests] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-4465) Enable Flink runner to run IOITs
[
https://issues.apache.org/jira/browse/BEAM-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16718746#comment-16718746
]
Lukasz Gajowy commented on BEAM-4465:
-
I believe this should be resolved. A test can be run using a command like this
(example for TextIOIT):
{code:java}
./gradlew clean integrationTest -p sdks/java/io/file-based-io-tests/
-DintegrationTestPipelineOptions='["--numberOfRecords=1000",
"--filenamePrefix=PREFIX", "--runner=TestFlinkRunner", "--tempLocation=/tmp/"]'
-DintegrationTestRunner=flink --tests org.apache.beam.sdk.io.text.TextIOIT{code}
So the Flink runner is now able to execute the test pipelines.
> Enable Flink runner to run IOITs
>
>
> Key: BEAM-4465
> URL: https://issues.apache.org/jira/browse/BEAM-4465
> Project: Beam
> Issue Type: New Feature
> Components: runner-flink, testing
>Reporter: Lukasz Gajowy
>Priority: Major
> Fix For: 2.9.0
>
>
> Flink runner should be able to run IOITs the same way as Dataflow or Direct
> runner.
> For more details on how the tests are run see the documentation:
> [https://beam.apache.org/documentation/io/testing/#i-o-transform-integration-tests]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (BEAM-4465) Enable Flink runner to run IOITs
[ https://issues.apache.org/jira/browse/BEAM-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717601#comment-16717601 ] Maximilian Michels commented on BEAM-4465: -- What is the state here? > Enable Flink runner to run IOITs > > > Key: BEAM-4465 > URL: https://issues.apache.org/jira/browse/BEAM-4465 > Project: Beam > Issue Type: New Feature > Components: runner-flink, testing >Reporter: Lukasz Gajowy >Priority: Major > > Flink runner should be able to run IOITs the same way as Dataflow or Direct > runner. > For more details on how the tests are run see the documentation: > [https://beam.apache.org/documentation/io/testing/#i-o-transform-integration-tests] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
