chaoqin-li1123 commented on PR #48023: URL: https://github.com/apache/spark/pull/48023#issuecomment-2337077270
I find it hard to reproduce this situation, because this happens in the partitions() call of simple data source, which is not calling user code, but the code of the wrapper we implemented for python streaming data source. So we can't throw an error from the data source code like we did for other place where python source error is thrown. Error thrown here would be system error. @HyukjinKwon -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
