Github user HeartSaVioR commented on a diff in the pull request:
https://github.com/apache/spark/pull/22282#discussion_r214646749
--- Diff:
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchSourceSuite.scala
---
@@ -1254,6 +1254,9 @@ abstract class KafkaSourceSuiteBase extends
KafkaSourceTest {
.option("startingOffsets", s"earliest")
.option("subscribe", topic)
.load()
+ .selectExpr(
--- End diff --
I just indicated your comment that without `selectExpr` the test failed. Is
it related to the addition of header field? I guess we should make sure it also
works without `selectExpr` so that we can check also `headers` with memory sink.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
