thexiay opened a new issue, #1267:
URL: https://github.com/apache/incubator-paimon/issues/1267

   ### Search before asking
   
   - [X] I searched in the 
[issues](https://github.com/apache/incubator-paimon/issues) and found nothing 
similar.
   
   
   ### Motivation
   
   Currently paimon does not support the snapshot submission of the schema 
evolution type. There may be some problems with this. Currently, before the 
snapshot is submitted, the latest file under the schema is searched, and then 
it is used as the schema id of this snapshot.
   
   Maybe the instant of committing schema changes is not the time when you 
really want to make schema changes. This situation is especially obvious during 
the process of database table synchronization. for example:
   ```
   schema:
   (
       id int,
       name string,
       age int
   )
   ->
   (
       id int,
       name string
   )
   ```
   
   ```
   input data:
   (1, 'xixi', 20),
   (2, 'haha', 21),
   (3, 'ooo')
   ```
   In fact, schema evolution occurs between the second piece of data and the 
third piece of data, but the snapshot commit may occur at the end of the third 
piece of data, then the age field may have been able to be queried, but because 
the latest snapshot is used when submitting schema file, so the age field is 
hidden and cannot be queried.
   
   ### Solution
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to