[
https://issues.apache.org/jira/browse/BEAM-6638?focusedWorklogId=203787&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-203787
]
ASF GitHub Bot logged work on BEAM-6638:
----------------------------------------
Author: ASF GitHub Bot
Created on: 25/Feb/19 17:44
Start Date: 25/Feb/19 17:44
Worklog Time Spent: 10m
Work Description: tweise commented on pull request #7792: [BEAM-6638]
Python ExternalTransform output mismatched
URL: https://github.com/apache/beam/pull/7792#discussion_r259940396
##########
File path: sdks/python/build.gradle
##########
@@ -197,13 +197,13 @@ task directRunnerIT(dependsOn: 'installGcpTest') {
// ./gradlew :beam-sdks-python:portableWordCount
-PjobEndpoint=localhost:8099
//
task portableWordCount {
- dependsOn portableWordCountTask('portableWordCountExample',
project.hasProperty("streaming"))
+ dependsOn portableWordCountTask('portableWordCountExample',
project.hasProperty("streaming"), project.hasProperty("crossLanguage"))
}
-def portableWordCountTask(name, streaming) {
+def portableWordCountTask(name, streaming, crossLanguage) {
tasks.create(name) {
dependsOn = ['installGcpTest']
- mustRunAfter = [':beam-runners-flink_2.11-job-server-container:docker',
':beam-sdks-python-container:docker']
+ mustRunAfter = [':beam-runners-flink_2.11-job-server-container:docker',
':beam-sdks-python-container:docker', ':beam-sdks-java-container:docker',
':beam-runners-core-construction-java:buildTestExpansionServiceJar']
Review comment:
For Flink it would also be better to run the Java expansion service as part
of the job server and have the ability to discover expansion service address
via the job service endpoint to cut down on the bits and pieces a user is
exposed to.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 203787)
Time Spent: 3h 20m (was: 3h 10m)
> Python ExternalTransform output mismatched
> ------------------------------------------
>
> Key: BEAM-6638
> URL: https://issues.apache.org/jira/browse/BEAM-6638
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Heejong Lee
> Assignee: Heejong Lee
> Priority: Major
> Fix For: 2.11.0
>
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> Java PipelineValidator prints out the error that an expanded external
> transform points to unknown output PCollection.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
