Hi, Can I build two sliding windows in parallel from the same Dstream ? Will these two window streams run in parallel and process the same data? I wish to do two different functions (aggregration on one window and storage for the other window) across the same original dstream data though the same window sizes.
JavaPairReceiverInputDStream<String, String> messages = KafkaUtils.createStream(jssc, args[0], args[1], topicMap); Duration windowLength = new Duration(30000); Duration slideInterval = new Duration(30000); JavaPairDStream<String,String> windowMessages1 = messages.window(windowLength,slideInterval); JavaPairDStream<String,String> windowMessages2 = messages.window(windowLength,slideInterval); Thanks, Josh