jerrypeng commented on PR #53448: URL: https://github.com/apache/spark/pull/53448#issuecomment-3708755120
@viirya thank you for the review. The issue with that is currently no RTM supported sources can be used in pyspark. There is no memory source equivalent in python and using Kafka would require us to start a kafka cluster via docker and I had limited success with at via: https://github.com/apache/spark/pull/53415 In my follow up PR to this I will probably convert the socket source to support RTM and use that to test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
