HeartSaVioR commented on pull request #34333: URL: https://github.com/apache/spark/pull/34333#issuecomment-947166060
cc. @zsxwing @viirya @xuanyuanking This data source helps to test out the performance aspect on adjusting options (POC yet) for RocksDB state store provider. Say, you can run the streaming query twice, with different options, and it's valid to compare the metrics of micro-batches between the two as they would have same inputs. Previously it has been only possible from Kafka data source with pre-ingesting data. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
