Dibyendu Bhattacharya created SPARK-8080:
--------------------------------------------
Summary: Custom Receiver.store with Iterator type do not give
correct count at Spark UI
Key: SPARK-8080
URL: https://issues.apache.org/jira/browse/SPARK-8080
Project: Spark
Issue Type: Bug
Components: Streaming
Affects Versions: 1.2.0
Reporter: Dibyendu Bhattacharya
Fix For: 1.4.0
In Custom receiver if I call store with Iterator type (store(dataIterator:
Iterator[T]): Unit ) , Spark UI does not show the correct count of records in
block which leads to wrong value for Input Rate, Scheduling Delay and Input
SIze.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
