iemejia commented on a change in pull request #14409:
URL: https://github.com/apache/beam/pull/14409#discussion_r606216057
##########
File path:
runners/spark/src/main/java/org/apache/beam/runners/spark/SparkPipelineOptions.java
##########
@@ -34,18 +34,6 @@
*/
public interface SparkPipelineOptions extends SparkCommonPipelineOptions {
- @Description("Set it to true if event logs should be saved to Spark History
Server directory")
Review comment:
Historically we avoid if possible to introduce variables that are
already defined as Spark Configurations, so these variables should come from
the Spark configuration to avoid duplicated non synchronized configuration
changes and confusion for end users.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
