Here you go:
JavaDStream<String> textStream =
ssc.textFileStream("/home/akhld/sigmoid/");
textStream.foreachRDD(new Function<JavaRDD<String>,Void>() {
@Override
public Void call(JavaRDD<String> rdd) throws Exception {
// TODO Auto-generated method stub
rdd.foreach(new VoidFunction<String>(){
@Override
public void call(String stringData) throws Exception {
// Use this data!
System.out.println("W00t!! Data :" + stringData);
}
});
return null;
}
});
Thanks
Best Regards
On Sun, Feb 1, 2015 at 9:08 PM, sachin Singh <sachin.sha...@gmail.com>
wrote:
> Hi I want to send streaming data to kafka topic,
> I am having RDD data which I converted in JavaDStream ,now I want to send
> it
> to kafka topic, I don't want kafka sending code, just I need foreachRDD
> implementation, my code is look like as
> public void publishtoKafka(ITblStream t)
> {
> MyTopicProducer MTP =
> ProducerFactory.createProducer(hostname+":"+port);
> JavaDStream<?> rdd = (JavaDStream<?>) t.getRDD();
>
> rdd.foreachRDD(new Function<String, String>() {
> @Override
> public Void call(JavaRDD<String> rdd) throws Exception {
> KafkaUtils.sendDataAsString(MTP,topicName, "String RDDData");
> return null;
> }
> });
> log.debug("------------------------sent to kafka:
> ------------------");
>
> }
>
> here myTopicproducer will create producer which is working fine
> KafkaUtils.sendDataAsString is method which will publish data to kafka
> topic
> is also working fine,
>
> I have only one problem I am not able to convert JavaDStream rdd as string
> using foreach or foreachRDD finally I need String message from rdds, kindly
> suggest java code only and I dont want to use anonymous classes, Please
> send
> me only the part to send JavaDStream RDD using foreachRDD using Function
> Call
>
> Thanks in advance,
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/how-to-send-JavaDStream-RDD-using-foreachRDD-using-Java-tp21456.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>
