grundprinzip commented on code in PR #40603:
URL: https://github.com/apache/spark/pull/40603#discussion_r1159502572
##########
connector/connect/server/src/main/scala/org/apache/spark/sql/connect/service/SparkConnectStreamHandler.scala:
##########
@@ -49,6 +50,16 @@ class SparkConnectStreamHandler(responseObserver:
StreamObserver[ExecutePlanResp
.getOrCreateIsolatedSession(v.getUserContext.getUserId, v.getSessionId)
.session
session.withActive {
+
+ // Add debug information to the query execution so that the jobs are
traceable.
+ val debugString = v.toString
Review Comment:
I think we need a filter for objects that we don't print. My guess is that
you're submitting a very large Python UDF that requires lots of heap space in
the string. Do you have more details there?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
