Mao, Wei created SPARK-15480: -------------------------------- Summary: Some InputInfo missed with window operation applied Key: SPARK-15480 URL: https://issues.apache.org/jira/browse/SPARK-15480 Project: Spark Issue Type: Bug Components: Web UI Reporter: Mao, Wei Priority: Minor
It's a bug in Streaming UI. If BatchDuration is changed by window operation, InputInfo on time with no output ops will not be shown in streaming UI. Here is a simple example to reproduce: ```scala val inputDStream = KafkaUtils.createDirectStream[String, String, StringDecoder, StringDecoder](ssc, kafkaParam, topic) val matchedDStream = inputDStream.window(batchInteval*2, batchInteval*2) matchedDStream.foreachRDD(rdd => { val count = rdd.count() println(s"2 count number: ${count}") }) ``` -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org