Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/3009#discussion_r20665136
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala ---
@@ -40,9 +40,22 @@ private[jobs] object UIData {
class JobUIData(
var jobId: Int = -1,
+ var startTime: Option[Long] = None,
+ var endTime: Option[Long] = None,
var stageIds: Seq[Int] = Seq.empty,
var jobGroup: Option[String] = None,
- var status: JobExecutionStatus = JobExecutionStatus.UNKNOWN
+ var status: JobExecutionStatus = JobExecutionStatus.UNKNOWN,
+ /* Tasks */
+ // `numTasks` is a potential underestimate of the true number of tasks
that this job will run
+ // see https://github.com/apache/spark/pull/3009 for an extensive
discussion of this
--- End diff --
as in above, is it possible to provide a 1-line quick summary of why that
is the case, and if the reader wants to dig deeper then they can follow the
link?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
