nija-at opened a new pull request, #47647:
URL: https://github.com/apache/spark/pull/47647

   ### What changes were proposed in this pull request?
   
   Spark Connect client produces a fair amount of logs but is incorrectly
   configured at INFO level. When clients set the global log level to INFO,
   a lot of debug level logs are produced.
   
   ### Why are the changes needed?
   
   Since we're using the Python logging utility, it's possible for clients and
   even other libraries to set the target log level.
   When this occurs, a lot of spurious debug log messages are emitted
   by the Spark Connect client.
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes. Spark Connect client logs level will now be produced at debug level
   and not info level.
   
   
   ### How was this patch tested?
   
   Manually by changing the log levels to see that the messages are emitted
   at the right level.
   
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   No.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to