[
https://issues.apache.org/jira/browse/SPARK-25516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Kugler resolved SPARK-25516.
------------------------------------
Resolution: Not A Problem
> spark-history and spark-shuffle-service scripts can not run in docker image
> ---------------------------------------------------------------------------
>
> Key: SPARK-25516
> URL: https://issues.apache.org/jira/browse/SPARK-25516
> Project: Spark
> Issue Type: Bug
> Components: Kubernetes
> Affects Versions: 2.3.1
> Environment: Docker 18.06
> Reporter: Richard Kugler
> Priority: Trivial
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> When attempting to run ./sbin/start-shuffle-service.sh the image errors with
> the following output:
> {noformat}
> ps: unrecognized option: p
> {noformat}
> Adding the {{procps}} package fixes this issue.
> After correcting the issue with {{ps}}, the code will then error with:
> {{}}
> {noformat}
> nohup: can't execute '--': No such file or directory{noformat}
> This is remedied with the inclusion of {{coreutils}} to the apk add statement.
>
>
> The ./sbin/start-history-server.sh also requires the added packages to
> successfully start.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
