[ https://issues.apache.org/jira/browse/SPARK-24003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16441328#comment-16441328 ]
Apache Spark commented on SPARK-24003: -------------------------------------- User 'devaraj-kavali' has created a pull request for this issue: https://github.com/apache/spark/pull/21088 > Add support to provide spark.executor.extraJavaOptions in terms of App Id > and/or Executor Id's > ---------------------------------------------------------------------------------------------- > > Key: SPARK-24003 > URL: https://issues.apache.org/jira/browse/SPARK-24003 > Project: Spark > Issue Type: Improvement > Components: Mesos, Spark Core, YARN > Affects Versions: 2.3.0 > Reporter: Devaraj K > Priority: Major > > Users may want to enable gc logging or heap dump for the executors, but there > is a chance of overwriting it by other executors since the paths cannot be > expressed dynamically. This improvement would enable to express the > spark.executor.extraJavaOptions paths in terms of App Id and Executor Id's to > avoid the overwriting by other executors. > There was a discussion about this in SPARK-3767, but it never fixed. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org