Github user mariobriggs commented on a diff in the pull request:
https://github.com/apache/spark/pull/12357#discussion_r59700324
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/scheduler/StreamingListener.scala
---
@@ -30,6 +30,12 @@ import org.apache.spark.util.Distribution
sealed trait StreamingListenerEvent
@DeveloperApi
+case class StreamingListenerBatchGenerateStarted(time: Long) extends
StreamingListenerEvent
+
+@DeveloperApi
+case class StreamingListenerBatchGenerateCompleted(time: Long) extends
StreamingListenerEvent
--- End diff --
you probably want the StreamingListenerBatchGenerateStarted &
StreamingListenerBatchGenerateCompleted classes to have a BatchGenerateInfo
class that has following fields & methods
batchTime
processingStartTime
processingEndTime
def processingDelay() : Long
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
