间:2021年11月22日(星期一) 22:08
收件人:user
主 题:Spark - ElasticSearch Integration
Hi All,
I want to write a Spark Streaming Job from Kafka to Elasticsearch. Here I want
to detect the schema dynamically while reading it from Kafka.
Can you help me to do that.?
I know, this can be done in Spark Batch
Hi All,
I want to write a Spark Streaming Job from Kafka to Elasticsearch. Here I
want to detect the schema dynamically while reading it from Kafka.
Can you help me to do that.?
I know, this can be done in Spark Batch Processing via the below line.
val schema =
spark.read.json(dfKafkaPayload.se