Shixiong Zhu created SPARK-6766:
-----------------------------------
Summary: StreamingListenerBatchSubmitted isn't sent and
StreamingListenerBatchStarted.batchInfo.processingStartTime is a wrong value
Key: SPARK-6766
URL: https://issues.apache.org/jira/browse/SPARK-6766
Project: Spark
Issue Type: Bug
Components: Streaming
Affects Versions: 1.3.0, 1.2.1, 1.1.1, 1.0.2
Reporter: Shixiong Zhu
1. Now there is no place posting StreamingListenerBatchSubmitted. It should be
post when JobSet is submitted.
2. Call JobSet.handleJobStart before posting StreamingListenerBatchStarted will
set StreamingListenerBatchStarted.batchInfo.processingStartTime to None, which
should have been set to a correct value.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
