Ismaël Mejía created BEAM-8384:

             Summary: Spark runner is not respecting spark.default.parallelism 
user defined configuration
                 Key: BEAM-8384
             Project: Beam
          Issue Type: Bug
          Components: runner-spark
    Affects Versions: 2.16.0
            Reporter: Ismaël Mejía
            Assignee: Ismaël Mejía

It was reported in [the mailing 
 that the Spark runner is not respecting the user defined Spark default 
parallelism configuration. We should investigate and if it is the case ensure 
that a user defined configuration is always respected. Runner optimizations 
should apply only for default (unconfigured) values otherwise we will confuse 
users and limit them from parametrizing Spark for their best convenience.

This message was sent by Atlassian Jira

Reply via email to