plusplusjiajia opened a new pull request, #9455:
URL: https://github.com/apache/paimon/pull/9455

   ### Purpose
   IcebergDataField emits timestamp_ns for timestamp columns of precision 7 and 
above, but Paimon writes those columns as Parquet INT96, which Iceberg reads as 
a microsecond zoned timestamp. The metadata and the data files therefore 
disagree, and nothing reports it — an Iceberg reader silently returns wrong 
values.
   This refuses such a column while metadata.iceberg.storage is enabled, next 
to the existing geospatial rule in SchemaValidation, so it applies wherever a 
schema is validated: creating a table, altering one, and enabling Iceberg 
metadata on a table that already has such a column.
   This is a behaviour change: a table with a nanosecond timestamp column 
mirrors today, producing metadata no Iceberg reader can use. Lower the 
precision to 6, or disable metadata.iceberg.storage
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to