BaoHuaWang commented on issue #11141:
URL: https://github.com/apache/paimon/issues/11141#issuecomment-6848850183

   Paimon version:
   1.4.2
   
   Compute Engine:
   Flink 1.19 (flink-sql)
   
   Minimal reproduce step:
   CREATE TABLE t (id INT, dt DATE) PARTITIONED BY (dt) WITH (
     'connector' = 'paimon',
     'path' = '...',
     'partition.expiration-time' = '7 d',
     'partition.expiration-check-interval' = '1 min'
   );
   INSERT INTO t VALUES (1, DATE '2020-01-01');
   -- wait for the expiration check
   
   What doesn't meet your expectations?
   The old partition is never expired. The JM/TM log shows:
   "Can't extract datetime from partition dt:18262."
   PartitionTimeExtractor stringifies the DATE partition value (days since 
epoch, e.g. 18262)
   and fails to parse it as a date, so `PartitionValuesTimePredicate#test` 
always returns false.
   Expected: DATE-typed partition fields should be recognized and expired 
correctly.
   
   Anything else?
   Also fails with 'partition.timestamp-pattern' = '$dt', and with
   'partition.timestamp-format.strict' = 'true' the write itself throws
   "Partition dt:18262 does not match the 'partition.timestamp-formatter'".


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to