taherk77 commented on issue #917: [HUDI-251] JDBC incremental load to HUDI with 
DeltaStreamer
URL: https://github.com/apache/incubator-hudi/pull/917#issuecomment-535381708
 
 
   Also can we write the incremental column along with the last_val to the 
checkpoint? I am saying this because let's say for run 1 we do incremental 
column as "contract_id" and let's say the max value written was 8, and then for 
run 2 I change the params to use incremental column as "contract_created_at" 
then the ppd query will be "select * from contract where contract_created_at > 
"8"" which is incorrect and will fail!. So if we write the column we first very 
the column and only then run or else we can straight away throw an exception 
and exit. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to