JoshRosen commented on PR #37260: URL: https://github.com/apache/spark/pull/37260#issuecomment-1193263047
I just realized that the PR description is slightly inaccurate because I forgot to push the commit that refines the logging: > I also modified the logging so that we can detect when this case occurs. On reflection, though, I don't think we actually need to make any logging changes in order to detect when we've double-loaded the RocksDB loader: normally an executor would only emit the "RocksDB library loading thread started" once, so if we see it twice then we know that two different threads proceeded through the `exception == null` block (which implies that one of them was interrupted in `loadLibrary` call or otherwise exited it in an unusual manner). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
