[GitHub] [hudi] vinothchandar commented on pull request #2485: [HUDI-1109] Support Spark Structured Streaming read from Hudi table

vinothchandar commented on pull request #2485: URL: https://github.com/apache/hudi/pull/2485#issuecomment-774528989 >how can we know the max commit_seq_no in the commit I think we should do what would be done for Kafka's case. or just use an accumulator to obtain this on each commit?

[GitHub] [hudi] vinothchandar commented on pull request #2485: [HUDI-1109] Support Spark Structured Streaming read from Hudi table

vinothchandar commented on pull request #2485: URL: https://github.com/apache/hudi/pull/2485#issuecomment-772797323 @pengzhiwei2018 I am planning to spend sometime on this as well. High level question. does the `offset` for the streaming read map to `_hoodie_commit_seq_no` in this i

[GitHub] [hudi] vinothchandar commented on pull request #2485: [HUDI-1109] Support Spark Structured Streaming read from Hudi table

vinothchandar commented on pull request #2485: URL: https://github.com/apache/hudi/pull/2485#issuecomment-766593559 cc @garyli1019 mind taking a first pass at this PR? :) This is an automated message from the Apache Git Serv

[GitHub] [hudi] vinothchandar commented on pull request #2485: [HUDI-1109] Support Spark Structured Streaming read from Hudi table

vinothchandar commented on pull request #2485: URL: https://github.com/apache/hudi/pull/2485#issuecomment-766593559 cc @garyli1019 mind taking a first pass at this PR? :) This is an automated message from the Apache Git Serv