paul mackles created SPARK-23088:
------------------------------------
Summary: History server not showing incomplete/running applications
Key: SPARK-23088
URL: https://issues.apache.org/jira/browse/SPARK-23088
Project: Spark
Issue Type: Bug
Components: Spark Core, Web UI
Affects Versions: 2.2.1, 2.1.2
Reporter: paul mackles
History server not showing incomplete/running applications when
_spark.history.ui.maxApplications_ property is set to a value that is smaller
than the total number of applications.
I believe this is because any applications where completed=false wind up at the
end of the list of apps returned by the /applications endpoint and when
_spark.history.ui.maxApplications_ is set, that list gets truncated and the
running apps are never returned.
The fix I have in mind is to modify the history template to start passing the
_status_ parameter when calling the /applications endpoint (status=completed is
the default).
I am running Spark in a Mesos environment but I don't think that is relevant to
this issue
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
