HeartSaVioR commented on issue #25911: [SPARK-29223][SQL][SS] Enable global timestamp per topic while specifying offset by timestamp in Kafka source URL: https://github.com/apache/spark/pull/25911#issuecomment-572821002 IMHO this patch or #23749 (ideal one) should be helpful to run interactive query against Kafka source; the needs on such use case is being proven by KSQL, but someone may not want to stick with the vendor lock-in solution, and Spark can still help them if we can manage to reduce down the complexity of usage. No one will want to provide partitions at all per interactive query. They don't want to code, they want to query. That's why I say #23749 is ideal one, but if we think #23749 is adding unacceptable complexity, this patch should be the one of alternative, less better than that though.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
