chinhvu1111 opened a new issue, #6946:
URL: https://github.com/apache/paimon/issues/6946

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   
   ### Paimon version
   
   1.3.1
   
   ### Compute Engine
   
   Spark 3.5.2
   
   ### Minimal reproduce step
   
   CREATE TABLE test_partial_lookup (
       id INT,
       name STRING,
       age INT
   ) TBLPROPERTIES (
       'merge-engine' = 'partial-update',
       'changelog-producer' = 'lookup',
       'primary-key' = 'id'
   );
   
   spark.sql("insert into test_partial_lookup values(1, "test", 20)").show(10, 
False)
   
   # only +I rowkind
   spark.sql("select * from `test_partial_lookup$audit_log`").show(10, False)
   # check compaction event
   spark.sql("select * from `test_partial_lookup$snapshots` order by 
snapshot_id desc").show(10, False)
   
   # update the available record to get the updated event
   spark.sql("update test_partial_lookup set name = 'test1' where id = 
1").show(10, False)
   
   # check updated record
   spark.sql("select * from test_partial_lookup").show(10, False)
   # only +I rowkind after updating
   spark.sql("select * from `test_partial_lookup$audit_log`").show(10, False)
   # check compaction event
   spark.sql("select * from `test_partial_lookup$snapshots` order by 
snapshot_id desc").show(10, False)
   
   ### What doesn't meet your expectations?
   
   Yes, I want to capture the updated event from the change log using spark
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to