PDGGK commented on issue #27033:
URL: https://github.com/apache/beam/issues/27033#issuecomment-3822498617
Hi, I'd like to work on this issue.
I've analyzed the current implementation:
- Python `WriteToKafka` is an `ExternalTransform` wrapper (kafka.py:270)
- Uses URN `beam:transform:org.apache.beam:kafka_write:v1`
- Java side maps KV → ProducerRecord without headers support
- Headers need per-record support via Row schema input
My plan:
1. Extend Java `KafkaIO.Write` to accept Row input with `{key, value,
headers[]}` schema
2. Update Python wrapper to support Row-based input
3. Add cross-language integration tests
Estimated: ~300-500 lines across Python + Java + tests.
I'm an existing contributor with merged PRs (#37298).
.take-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
