Hey All, Where are python logs in PySpark supposed to go? My job is getting a org.apache.spark.SparkException: Python worker exited unexpectedly (crashed) but when I look at the stdout/stderr logs in the web UI, nothing interesting shows up (stdout is empty and stderr just has the spark executor command).
Is this the expected behavior? thanks in advance for any guidance, Sandy
