Use spark.executor.extraJavaOptions
https://spark.apache.org/docs/latest/configuration.html#runtime-environment
On Thu, Oct 15, 2020 at 1:22 PM Akshat Bordia
wrote:
> Hi,
>
> We are trying to debug an issue with Spark and need to connect a remote
> debugger to the executors thread. The general
Hi,
We are trying to debug an issue with Spark and need to connect a remote
debugger to the executors thread. The general options with spark-submit (=-
agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5005) seems to
allow only debugging driver thread. Does anyone have any insight on ho
