[
https://issues.apache.org/jira/browse/SPARK-25711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25711:
----------------------------------
Summary: Allow history server to show usage and remove deprecated options
(was: Allow history server to show usage)
> Allow history server to show usage and remove deprecated options
> ----------------------------------------------------------------
>
> Key: SPARK-25711
> URL: https://issues.apache.org/jira/browse/SPARK-25711
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.4.0
> Reporter: Gengliang Wang
> Priority: Minor
> Fix For: 3.0.0
>
>
> Currently, if we try run
> ```
> ./start-history-server.sh -h
> ```
> We will get such error
> ```
> java.io.FileNotFoundException: File -h does not exist
> ```
> This is not user friendly.
> After fix, we can get following output:
> ```
> Usage: ./sbin/start-history-server.sh [options]
> Options:
> DIR Deprecated; set spark.history.fs.logDirectory
> directly
> --dir DIR (-d DIR) Deprecated; set spark.history.fs.logDirectory
> directly
> --properties-file FILE Path to a custom Spark properties file.
> Default is conf/spark-defaults.conf.
> Configuration options can be set by setting the corresponding JVM system
> property.
> History Server options are always available; additional options depend on the
> provider.
> History Server options:
> spark.history.ui.port Port where server will listen for
> connections
> (default 18080)
> spark.history.acls.enable Whether to enable view acls for all
> applications
> (default false)
> spark.history.provider Name of history provider class (defaults
> to
> file system-based provider)
> spark.history.retainedApplications Max number of application UIs to keep
> loaded in memory
> (default 50)
> FsHistoryProvider options:
> spark.history.fs.logDirectory Directory where app logs are stored
> (default: file:/tmp/spark-events)
> spark.history.fs.updateInterval How often to reload log data from storage
> (in seconds, default: 10)
> ```
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
