option("kafka.bootstrap.servers", "host1:port1,host2:port2") \
>> .option("topic", "topic1") \
>> .option("checkpointLocation", "/path/to/HDFS/dir") \
>> .start()
>>
>> Described here:
>>
>> https://databricks.com/blog/2017/04/26/processing-data-in-apache-kafka-with-structured-streaming-in-apache-spark-2-2.html
>>
>>
>>
>> On 19 May 2017 at 10:45, <kanth...@gmail.com> wrote:
>>
>>> Is there a Kafka sink for Spark Structured Streaming ?
>>>
>>> Sent from my iPhone
>>>
>>
>>
>
ot;to_json(struct(*)) AS
>>> value") \
>>> .writeStream \
>>> .format("kafka") \
>>> .option("kafka.bootstrap.servers", "host1:port1,host2:port2") \
>>> .option("topic", "topic1"
.option("topic", "topic1") \
>> .option("checkpointLocation", "/path/to/HDFS/dir") \
>> .start()
>>
>> Described here:
>>
>> https://databricks.com/blog/2017/04/26/processing-data-in-apache-kafka-with-structured-streaming-in-apache-spark-2-2.html
>>
>>
>>
>> On 19 May 2017 at 10:45, <kanth...@gmail.com> wrote:
>>
>>> Is there a Kafka sink for Spark Structured Streaming ?
>>>
>>> Sent from my iPhone
>>>
>>
>>
>
quot;host1:port1,host2:port2") \
> .option("topic", "topic1") \
> .option("checkpointLocation", "/path/to/HDFS/dir") \
> .start()
>
> Described here:
>
> https://databricks.com/blog/2017/04/26/processing-data-in-apache-kafka-with-s
> .option("checkpointLocation", "/path/to/HDFS/dir") \
> .start()
> Described here:
> https://databricks.com/blog/2017/04/26/processing-data-in-apache-kafka-with-structured-streaming-in-apache-spark-2-2.html
>
>
>> On 19 May 2017 at 10:45, <kanth...@gmail.com> wrote:
>> Is there a Kafka sink for Spark Structured Streaming ?
>>
>> Sent from my iPhone
>
-2-2.html
On 19 May 2017 at 10:45, <kanth...@gmail.com> wrote:
> Is there a Kafka sink for Spark Structured Streaming ?
>
> Sent from my iPhone
>
Is there a Kafka sink for Spark Structured Streaming ?
Sent from my iPhone