[
https://issues.apache.org/jira/browse/FLINK-8354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613528#comment-16613528
]
ASF GitHub Bot commented on FLINK-8354:
---------------------------------------
alexeyt820 commented on issue #6615: [FLINK-8354] [flink-connectors] Add
ability to access and provider Kafka headers
URL: https://github.com/apache/flink/pull/6615#issuecomment-421014612
@tzulitai, using ```Record``` wrapping Kafka ```ConsumerRecord``` allows to
add for example timestamp from PR #6105 w/o need to change client code, so it
looks like more extensible approach. Not sure how it makes hard to reuse some
already existing deserialization formats such as
```AvroDeserializationSchema```, at least not harder then now -
```AvroDeserializationSchema``` will be wrapped via
```KeyedDeserializationSchemaWrapper``` in exactly same way as know. Also
```KeyedDeserializationSchemaWrapper``` calls only ```Record.value()```, so it
doesn't ties deserialization of byte with access to other metadata, not in
terms of execution path (in logical terms it is always tied because underlying
level - Kafka ```ConsumerRecord``` contains key, value and metadata)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Flink Kafka connector ignores Kafka message headers
> -----------------------------------------------------
>
> Key: FLINK-8354
> URL: https://issues.apache.org/jira/browse/FLINK-8354
> Project: Flink
> Issue Type: Bug
> Components: Kafka Connector
> Environment: Kafka 0.11.0.0
> Flink 1.4.0
> flink-connector-kafka-0.11_2.11
> Reporter: Mohammad Abareghi
> Assignee: Aegeaner
> Priority: Major
> Labels: pull-request-available
>
> Kafka has introduced notion of Header for messages in version 0.11.0.0
> https://issues.apache.org/jira/browse/KAFKA-4208.
> But flink-connector-kafka-0.11_2.11 which supports kafka 0.11.0.0 ignores
> headers when consuming kafka messages.
> It would be useful in some scenarios, such as distributed log tracing, to
> support message headers to FlinkKafkaConsumer011 and FlinkKafkaProducer011.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
