dongjinleekr commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-475280370 @srowen @dongjoon-hyun @zsxwing @tdas @dbtsai Dear committers, Sorry to bother you, but there's something you need to know. In short, it seems obvious to add a new configuration, `includeHeaders`, is needed to support this feature without breaking the schema. (i.e., `kafkaSchema`) I wonder this issue requires a [SPIP](https://spark.apache.org/improvement-proposals.html) - as @srowen [wrote in mailing list earlier](https://lists.apache.org/thread.html/d54ff8ce22c11d2a458d0a09ef89f28431b442ce024d475af27eca5d@%3Cdev.spark.apache.org%3E), this feature is not a trivial improvement. I hope to receive your opinion. If needed, I will submit the SPIP as soon as possible. Thanks for reading!
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
