[
https://issues.apache.org/jira/browse/SPARK-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu closed SPARK-15480.
--------------------------------
Resolution: Duplicate
> Some InputInfo missed with window operation applied
> ---------------------------------------------------
>
> Key: SPARK-15480
> URL: https://issues.apache.org/jira/browse/SPARK-15480
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Reporter: Mao, Wei
> Priority: Minor
>
> It's a bug in Streaming UI. If BatchDuration is changed by window operation,
> InputInfo on time with no output ops will not be shown in streaming UI.
> Here is a simple example to reproduce:
> ```scala
> val inputDStream = KafkaUtils.createDirectStream[String, String,
> StringDecoder, StringDecoder](ssc, kafkaParam, topic)
> val matchedDStream = inputDStream.window(batchInteval*2, batchInteval*2)
> matchedDStream.foreachRDD(rdd => {
> val count = rdd.count()
> println(s"2 count number: ${count}")
> })
> ```
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
