Jean-Baptiste Onofré created BEAM-2381:
------------------------------------------

             Summary: Extend the SparkContextOptions
                 Key: BEAM-2381
                 URL: https://issues.apache.org/jira/browse/BEAM-2381
             Project: Beam
          Issue Type: Improvement
          Components: runner-spark
            Reporter: Jean-Baptiste Onofré
            Assignee: Jean-Baptiste Onofré


Currently, it's possible to use the {{SparkContextOptions}} to "pass" a custom 
{{SparkContext}} to the Spark runner.

However, more than constructing a complete {{SparkContext}} outside of the 
runner, an user may want to "tweak" the context created internally by the 
runner.
We could "extend" the {{SparkContextOptions}} to pass additional options used 
to construct and populate the {{JavaSparkContext}} like security, dependencies 
management, additional properties.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to