Hey, guys. Here's my problem: While using the standalone mode, I always use the following args for executor:
-XX:+PrintGCDetails -XX:+PrintGCDateStamps -verbose:gc -Xloggc:/tmp/spark.executor.gc.log But as we know, hotspot JVM does not support variable substitution on -Xloggc parameter, which will cause gc log be overwritten by other later executors. May I create a new path, which will add variable substitution before worker forks a new executor to avoid GC log overwriteen? First thoughts: configure the executor jvm args like this: -XX:+PrintGCDetails -XX:+PrintGCDateStamps -verbose:gc -Xloggc:/tmp/spark.executor.%applicationId%.gc.log and this will replace the %applicationId% with the current application ID and pass the final args into java command line We can support more variables such as executorId Thanks. -- haitao.yao
