[
https://issues.apache.org/jira/browse/BEAM-7003?focusedWorklogId=518877&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-518877
]
ASF GitHub Bot logged work on BEAM-7003:
----------------------------------------
Author: ASF GitHub Bot
Created on: 02/Dec/20 08:52
Start Date: 02/Dec/20 08:52
Worklog Time Spent: 10m
Work Description: piotr-szuberski edited a comment on pull request #13026:
URL: https://github.com/apache/beam/pull/13026#issuecomment-737083007
> @piotr-szuberski @aromanenko-dev @iemejia
>
> This broke the Spark postcommit:
[BEAM-11375](https://issues.apache.org/jira/browse/BEAM-11375)
>
> It looks like the cause is the mismatch between `kafka_2.11` (2.4.1) and
`kafka-clients` (2.6.0). Kafka 2.5.0 deprecated support for Scala 2.11, so I'm
guessing we can't bring it up to date until upgrading Spark to Scala 2.12?
Sorry for that, I didn't take it into account. I'll try to either update the
scala version of Kafka dependency (not sure if it's that easy if Spark doesn't
support Scala 2.12) or simply downgrade kafka client to 2.4.1
Scala update PR: https://github.com/apache/beam/pull/13458
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 518877)
Time Spent: 14h 20m (was: 14h 10m)
> Test KafkaIO against different versions of Kafka
> ------------------------------------------------
>
> Key: BEAM-7003
> URL: https://issues.apache.org/jira/browse/BEAM-7003
> Project: Beam
> Issue Type: Improvement
> Components: io-java-kafka
> Reporter: Ismaël Mejía
> Assignee: Piotr Szuberski
> Priority: P3
> Fix For: 2.27.0
>
> Time Spent: 14h 20m
> Remaining Estimate: 0h
>
> KafkaIO is supposed to support multiple versions of Kafka (> 0.9) but our
> current test infrastructure only validates this against the version 1.0.0. We
> should find a mecanism to parametrize KafkaIO tests with different versions
> of Kafka to ensure that multi-version support works as expected.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
