chaoqin-li1123 opened a new pull request, #45485: URL: https://github.com/apache/spark/pull/45485
### What changes were proposed in this pull request? Piggy back the PythonPartitionReaderFactory to implement reading a data partition for python streaming data source. Add test case to verify that python streaming data source can read and process data end to end. ### Why are the changes needed? This is part of the effort to support developing streaming data source in python interface. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Add integration test to verify data are read and metrics are emitted correctly. ### Was this patch authored or co-authored using generative AI tooling? No. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
