This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 9c481c7 [SPARK-26360] remove redundant validateQuery call
9c481c7 is described below
commit 9c481c7a6b8019c569a08b2645bf9c19ff84a9e5
Author: jasonwayne <[email protected]>
AuthorDate: Fri Dec 14 10:47:58 2018 +0800
[SPARK-26360] remove redundant validateQuery call
## What changes were proposed in this pull request?
remove a redundant `KafkaWriter.validateQuery` call in `KafkaSourceProvider
`
## How was this patch tested?
Just removing duplicate codes, so I just build and run unit tests.
Closes #23309 from JasonWayne/SPARK-26360.
Authored-by: jasonwayne <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
---
.../main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala | 2 --
1 file changed, 2 deletions(-)
diff --git
a/external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
b/external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
index 6a0c208..4b8b5c0 100644
---
a/external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
+++
b/external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
@@ -266,8 +266,6 @@ private[kafka010] class KafkaSourceProvider extends
DataSourceRegister
// We convert the options argument from V2 -> Java map -> scala mutable ->
scala immutable.
val producerParams = kafkaParamsForProducer(options.asMap.asScala.toMap)
- KafkaWriter.validateQuery(schema.toAttributes, producerParams, topic)
-
new KafkaStreamingWriteSupport(topic, producerParams, schema)
}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
