igreenfield commented on pull request #26624: URL: https://github.com/apache/spark/pull/26624#issuecomment-621606974
@Ngone51 To clarify: We have one single long-running spark application to which we continuously submit jobs which are non-related to one another. These jobs may be consecutive or run in parallel and we need to enhance our logs with job/context specific information for which Spark is logging so that we can easier troubleshoot from a single log file. At a later stage, we also use this information for splitting the logs and handle each job execution information. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org