[
https://issues.apache.org/jira/browse/BEAM-7336?focusedWorklogId=393186&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393186
]
ASF GitHub Bot logged work on BEAM-7336:
----------------------------------------
Author: ASF GitHub Bot
Created on: 26/Feb/20 05:24
Start Date: 26/Feb/20 05:24
Worklog Time Spent: 10m
Work Description: iemejia commented on pull request #10966:
[WIP][BEAM-7336] Add schema inferring for KafkaIO when reading Avro values
URL: https://github.com/apache/beam/pull/10966#discussion_r384125158
##########
File path: sdks/java/io/kafka/build.gradle
##########
@@ -48,6 +48,7 @@ dependencies {
}
testCompile project(path: ":sdks:java:core", configuration: "shadowTest")
testCompile project(":sdks:java:io:synthetic")
+ testCompile project(":sdks:java:extensions:sql")
Review comment:
Please remove this import, and use better for the test a Schema-based
`PTransform` like
[Filter](https://github.com/apache/beam/blob/c2f0d282337f3ae0196a7717712396a5a41fdde1/sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/transforms/Filter.java#L83)
to not have extra dependencies. Notice that a part of the argument for this is
the fact that `sdks/java/extensions/sql` depends on `sdks/java/io/kafka` so
better to avoid the possible circular dependency. also the SQL extension has
too many dependencies so risk of classpath collissions increase.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 393186)
Time Spent: 50m (was: 40m)
> KafkaIO should support inferring schemas when reading Avro
> ----------------------------------------------------------
>
> Key: BEAM-7336
> URL: https://issues.apache.org/jira/browse/BEAM-7336
> Project: Beam
> Issue Type: Sub-task
> Components: io-java-kafka
> Reporter: Reuven Lax
> Assignee: Alexey Romanenko
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> PubSubIO already supports this.
> It would also be nice to be able to look up Avro schemas in the Kafka schema
> registry.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
