陈磊 created FLINK-27384:
--------------------------

             Summary: In the Hive dimension table, when the data is changed on 
the original partition, the create_time configuration does not take effect
                 Key: FLINK-27384
                 URL: https://issues.apache.org/jira/browse/FLINK-27384
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Hive
    Affects Versions: 1.14.4
            Reporter: 陈磊
         Attachments: image-2022-04-25-15-46-01-833.png, 
image-2022-04-25-15-47-54-213.png

In the Hive dimension table, when the data is changed on the original 
partition, the create_time configuration does not take effect.

!image-2022-04-25-15-46-01-833.png!

The current table structure directory is as follows:

!image-2022-04-25-15-47-54-213.png!

>From the above figure, we can know that when hive is a dimension table, it 
>will load the data of dt=2021-04-22, hr=27.

If a new partition arrives now, the data of the latest partition can be read 
smoothly. However, if the data is modified on the original partition, 
theoretically, the data of the modified partition is read, because of the 
create_time and latest configuration, but this is not the case in practice. The 
data that was originally loaded is still read.

 



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to