lized the
messages into kafka.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/unable-to-stream-kafka-messages-tp28537p29107.html
Sent from the Apache Spark User List mailing list archive at Nabbl
.option("kafka.bootstrap.servers",
>>>>>>> bootstrapServers)
>>>>>>> .option(subscribeType, topics)
>>>>>>> .load()
>>>>>>> .as(Encoders.bean(Tweet.clas
gt;>>>>>
>>>>>> streams.createOrReplaceTempView("streamsData");
>>>>>>
>>>>>>String sql = "SELECT location, COUNT(*) as count
>>>>>> FROM streamsData
>>>>>> GROUP BY location";
>>&
;> StreamingQuery query =
>>>>> countsByLocation.writeStream()
>>>>> .outputMode("complete")
>>>>> .format("console")
>>>>> .start();
>>>>>
&g
query.awaitTermination();
>>>>
>>>> --
>>>>
>>>> *Tweet *
>>>>
>>>> Tweet.java - has public constructor and getter / setter methods
>>>>
>
ents Serializable{
>>>
>>> private String tweetId;
>>> private String tweetText;
>>> private String location;
>>> private String timestamp;
>>>
>>> public Tweet(){
>>>
>>> }
>>> ...
t; org.apache.spark
>> spark-core_2.10
>> 2.1.0
>>
>>
>> org.apache.spark
>> spark-streaming_2.10
>> 2.1.0
>>
>>
>> org.apache.spark
>> spark-streaming-ka
>> fka-0-8_2.10
>> 2.1.0
>>
>>
>> org.apache.spark
>> spark-sql_2.10
>> 2.1.0
>>
>>
>> org.apache.spark
>> spark-sql-kafka-0-10_2.10
>> 2.1.0
>>
>>
>>
>>
>>
>>
>> --
>> View this message in context: http://apache-spark-user-list.
>> 1001560.n3.nabble.com/unable-to-stream-kafka-messages-tp28537.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> -
>> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
>>
>>
>
> 2.1.0
>
>
> org.apache.spark
> spark-streaming_2.10
> 2.1.0
>
>
> org.apache.spark
>
org.apache.spark
spark-sql-kafka-0-10_2.10
2.1.0
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/unable-to-stream-kafka-messages-tp28537.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
