AngersZhuuuu commented on a change in pull request #33934:
URL: https://github.com/apache/spark/pull/33934#discussion_r710998960
##########
File path: core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala
##########
@@ -96,11 +96,13 @@ object PythonRunner {
try {
val process = builder.start()
- new RedirectThread(process.getInputStream, System.out, "redirect
output").start()
+ val redirectOutput = new RedirectThreadAndCatchErrorMsg(
+ process.getInputStream, System.out, "redirect output", "Traceback")
Review comment:
> yeah, i thought to show the stderr as error message. I don't think
there's a claver way to extract Python exception cleanly.
In current code can satisfy this requirement, but can't keep stdout and
stderr all sync. Do you have any suggestion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
