iemejia commented on a change in pull request #14409:
URL: https://github.com/apache/beam/pull/14409#discussion_r606216057
##########
File path:
runners/spark/src/main/java/org/apache/beam/runners/spark/SparkPipelineOptions.java
##########
@@ -34,18 +34,6 @@
*/
public interface SparkPipelineOptions extends SparkCommonPipelineOptions {
- @Description("Set it to true if event logs should be saved to Spark History
Server directory")
Review comment:
Historically we avoid at all costs to introduce variables that are
already resolved by Spark Configuration, so these variables should come from
the Spark configuration to avoid duplicated non synchronized configuration
changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
