Hi,

Can I build two sliding windows in parallel from the same Dstream ? Will
these two window streams run in parallel and process the same data? I wish
to do two different functions (aggregration on one window and storage for
the other window) across the same original dstream data though the same
window sizes.

        JavaPairReceiverInputDStream<String, String> messages =
                KafkaUtils.createStream(jssc, args[0], args[1], topicMap);

        Duration windowLength = new Duration(30000);
        Duration slideInterval = new Duration(30000);
        JavaPairDStream<String,String> windowMessages1 =
messages.window(windowLength,slideInterval);
        JavaPairDStream<String,String> windowMessages2 =
messages.window(windowLength,slideInterval);


Thanks,
Josh

Reply via email to