dawidwys opened a new pull request #13940:
URL: https://github.com/apache/flink/pull/13940
## What is the purpose of the change
The PR updates the Confluent Schema Registry client version to 5.5.2.
## Brief change log
1. The PR changes the packaging of flink-avro-confluent-registry module. We
do no longer ship a fat-jar. Instead users should build the fat-jar themselves.
It is because the upgraded version of registry client accesses fields from Avro
of Jackson types. Because of the fact we can either bundle and shade both Avro
and Jackson, or not shade Jackson. I decided it will be best not to ship a
fat-jar and leave that decision to users.
2. On the other hand for the sql-client it is better to provide fat-jars,
however because of 1. I added a separate flink-sql-avro-confluent-registry
module that builds a fat-jar (including Avro, and shaded jackson).
## Verifying this change
* The existing tests pass, especially the
`test_confluent_schema_registry.sh` e2e test.
* I tested manually the `flink-sql-avro-confluent-registry` with sql-client
with both java 1.8 and java 1.11. The test I performed was:
1. Create a table
```
CREATE TABLE user_behavior (
user_id BIGINT,
item_id BIGINT,
category_id BIGINT,
behavior STRING,
ts TIMESTAMP(3)
) WITH (
'connector' = 'kafka',
'properties.bootstrap.servers' = 'localhost:9092',
'scan.startup.mode'='earliest-offset',
'topic' = 'user_behavior',
'format' = 'avro-confluent',
'avro-confluent.schema-registry.url' = 'http://localhost:8082',
'avro-confluent.schema-registry.subject' = 'user_behavior'
)
```
2. Insert into the table
3. Query the table
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (**yes** / no)
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: (yes / **no**)
- The serializers: (yes / **no** / don't know)
- The runtime per-record code paths (performance sensitive): (yes / **no**
/ don't know)
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Kubernetes/Yarn/Mesos, ZooKeeper: (yes / **no** /
don't know)
- The S3 file system connector: (yes / **no** / don't know)
## Documentation
- Does this pull request introduce a new feature? (yes / **no**)
- If yes, how is the feature documented? (**not applicable** / docs /
JavaDocs / not documented)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
