jose-torres commented on issue #23747: [SPARK-26848][SQL] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#issuecomment-476731072 Well, I don't think it would ever be strictly necessary to have different starting timestamps for different partitions; users can just choose the lowest and filter out timestamps in other partitions as needed. But I agree that, since we already have the capability to specify per-partition offsets in general, the additional API complexity is minimal and the potential user benefits outweigh it.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
