dongjinleekr commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-474430215 @HeartSaVioR @zsxwing Sorry for the late reply. I have been working on adding `includeHeader` option with turning `kafkaSchema` into a method. It seems like I can complete it by this weekend. But I have a question: **does it require submitting a SPIP document?** In Kafka project, making some API change must be [submitted as a proposal](https://cwiki.apache.org/confluence/display/KAFKA/KIP-372%3A+Naming+Repartition+Topics+for+Joins+and+Grouping) and [get a community's approval](https://lists.apache.org/thread.html/15c3a02b36edac7e1497f27afacb4c800f1eca4a9c6605cdd92b85ba@%3Cdev.kafka.apache.org%3E). Since this feature now introduces a new option, I wonder it also requires a similar process. Thanks again for your great feedback!
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
