[
https://issues.apache.org/jira/browse/FLINK-26617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505359#comment-17505359
]
Fil Karnicki commented on FLINK-26617:
--------------------------------------
I started thinking about the steps I'd have to take to get this done, but I
could use some ideas on how to achieve this from people in the know
I was thinking maybe
* Allow RoutableKafkaIngressDeserializer to include
ConsumerRecord#{*}headers{*} in the AutoRoutable's payload_bytes, based on some
new spec config field
* Deal with the headers on the remote side (for java, python, js and go?) How?
* Add a headers field(string map?) to proto KafkaProducerRecord
* Pass the headers from the protobuf into the ProducerRecord in
GenericKafkaEgressSerializer
> Pass Kafka headers to remote functions and egresses
> ---------------------------------------------------
>
> Key: FLINK-26617
> URL: https://issues.apache.org/jira/browse/FLINK-26617
> Project: Flink
> Issue Type: Improvement
> Components: Stateful Functions
> Reporter: Fil Karnicki
> Priority: Minor
>
> Typically OpenTelemetry (FLINK-22390) tracing spans get passed in kafka
> headers. We could be passing not only the Kafka ConsumerRecord value, but
> also the headers to remote functions, if the user configures their kafka
> ingress to do so
> Similarly, kafka egresses could be configurable so that headers get passed on
> via the KafkaProducerRecord proto to kafka
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
