[
https://issues.apache.org/jira/browse/BEAM-12114?focusedWorklogId=581429&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-581429
]
ASF GitHub Bot logged work on BEAM-12114:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 12/Apr/21 23:00
Start Date: 12/Apr/21 23:00
Worklog Time Spent: 10m
Work Description: boyuanzz edited a comment on pull request #14419:
URL: https://github.com/apache/beam/pull/14419#issuecomment-818296826
I got build errors from :sdks:java:testing:tpcds module as:
```
14:50:07 * What went wrong:
14:50:07 Execution failed for task ':sdks:java:testing:tpcds:compileJava'.
14:50:07 > Could not resolve all files for configuration
':sdks:java:testing:tpcds:compileClasspath'.
14:50:07 > Could not find io.confluent:kafka-avro-serializer:5.3.2.
14:50:07 Searched in the following locations:
14:50:07 -
https://repo.maven.apache.org/maven2/io/confluent/kafka-avro-serializer/5.3.2/kafka-avro-serializer-5.3.2.pom
14:50:07 If the artifact you are trying to retrieve can be found in the
repository but without metadata in 'Maven POM' format, you need to adjust the
'metadataSources { ... }' of the repository declaration.
14:50:07 Required by:
14:50:07 project :sdks:java:testing:tpcds > project
:runners:google-cloud-dataflow-java > project :sdks:java:io:kafka
14:50:07 > Could not find io.confluent:kafka-schema-registry-client:5.3.2.
14:50:07 Searched in the following locations:
14:50:07 -
https://repo.maven.apache.org/maven2/io/confluent/kafka-schema-registry-client/5.3.2/kafka-schema-registry-client-5.3.2.pom
14:50:07 If the artifact you are trying to retrieve can be found in the
repository but without metadata in 'Maven POM' format, you need to adjust the
'metadataSources { ... }' of the repository declaration.
14:50:07 Required by:
14:50:07 project :sdks:java:testing:tpcds > project
:runners:google-cloud-dataflow-java > project :sdks:java:io:kafka
```
It seems like if I change :sdks:java:testing:tpcds to apply
`applyJavaNature`, this error will be gone but more complaint from the
sdks:java:testing:tpcds code.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 581429)
Time Spent: 1h 50m (was: 1h 40m)
> Eliminate beam_fn_api from KafkaIO expansion
> --------------------------------------------
>
> Key: BEAM-12114
> URL: https://issues.apache.org/jira/browse/BEAM-12114
> Project: Beam
> Issue Type: Improvement
> Components: io-java-kafka
> Reporter: Boyuan Zhang
> Assignee: Boyuan Zhang
> Priority: P2
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> We are going to use Splittable DoFn expansion by default for KafkaIO without
> looking into beam_fn_api flag. But KafkaIO provides overrides for runners
> that decides to not use such expansion. Pipieline author can also use
> beam_fn_api_use_deprecated_read to swich to the old expansion.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
