[
https://issues.apache.org/jira/browse/BEAM-7738?focusedWorklogId=304550&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-304550
]
ASF GitHub Bot logged work on BEAM-7738:
----------------------------------------
Author: ASF GitHub Bot
Created on: 30/Aug/19 19:38
Start Date: 30/Aug/19 19:38
Worklog Time Spent: 10m
Work Description: chadrik commented on issue #9268: [BEAM-7738] Add
external transform support to PubsubIO
URL: https://github.com/apache/beam/pull/9268#issuecomment-526723440
PubsubIO is officially working on Flink!
Some notes:
- In order for this to work from python, this PR needs to be merged:
https://github.com/apache/beam/pull/9426
- This PR is _not_ based on my pending "user-friendly external transform"
PR: https://github.com/apache/beam/pull/9098. There are still some issues that
I need to work out with @mxm on that one, so I think this should go first and
I'll update that one afterward.
There's one giant caveat: this actually does not work unless you have this
special commit:
https://github.com/chadrik/beam/commit/d12b99084809ec34fcf0be616e94301d3aca4870.
It turns out the same is currently true for KafkaIO external transform
support, which came as quite a surprise. The Jira issue for this problem is
here: https://jira.apache.org/jira/browse/BEAM-7870. I'd love to see some
movement on this. Happy to help where I can!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 304550)
Time Spent: 2.5h (was: 2h 20m)
> Support PubSubIO to be configured externally for use with other SDKs
> --------------------------------------------------------------------
>
> Key: BEAM-7738
> URL: https://issues.apache.org/jira/browse/BEAM-7738
> Project: Beam
> Issue Type: New Feature
> Components: io-java-gcp, runner-flink, sdk-py-core
> Reporter: Chad Dombrova
> Assignee: Chad Dombrova
> Priority: Major
> Labels: portability
> Time Spent: 2.5h
> Remaining Estimate: 0h
>
> Now that KafkaIO is supported via the external transform API (BEAM-7029) we
> should add support for PubSub.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
