[
https://issues.apache.org/jira/browse/LIVY-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gyorgy Gal updated LIVY-870:
----------------------------
Fix Version/s: 0.10.0
(was: 0.9.0)
This issue has been moved to the 0.10.0 release as part of a bulk update. If
you feel this is moved out inappropriately, feel free to provide justification
and reset the Fix Version to 0.9.0.
> Provide Spark config via --properties-file for Batch Jobs
> ---------------------------------------------------------
>
> Key: LIVY-870
> URL: https://issues.apache.org/jira/browse/LIVY-870
> Project: Livy
> Issue Type: Improvement
> Reporter: Akshat Bordia
> Priority: Major
> Fix For: 0.10.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Currently for batch jobs, individual Spark configs are added as --conf
> parameter in Spark submit command line. If there are many Spark
> configurations added in Livy APIs, it might increase the length of command
> line and in some cases might cause issues due to limit on command line length
> (Windows has 8191 character length limit on the command line length.).
>
> We can merge the configurations into a temporary properties file and add that
> as --properties-file opt in spark-submit command
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
