Xia Hu created SPARK-6108:
-----------------------------
Summary: No application number limit in spark history server
Key: SPARK-6108
URL: https://issues.apache.org/jira/browse/SPARK-6108
Project: Spark
Issue Type: Wish
Affects Versions: 1.2.1
Reporter: Xia Hu
There isn't a limit for the application number in spark history server. The
only limit I found is "spark.history.retainedApplications", but this one only
controls how many apps could be stored in memory.
But I think a history application number limit is needed, for if it's number is
too big, it can be inconvenient for both HDFS and history server.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
