JunRuiLee commented on issue #7806:
URL: https://github.com/apache/paimon/issues/7806#issuecomment-4428621386
@JingsongLi Thanks for the question! Let me clarify.
> Can we use current time as a sequence field? Or is the core requirement of
your business to differentiate based on snapshots?
Unfortunately no. What we are building is essentially a git-like versioning
mechanism — **commit order** is the source of truth for resolving conflicts.
Using current time as `sequence.field` is evaluated at write time, not commit
time, so it cannot represent the actual commit order.
> I am more concerned about the modifications to DataFileMeta because it is
the most basic structure, unless we really introduce a major feature.
Thank you for raising this concern — I completely understand the caution
around modifying such a fundamental structure.
I've explored several alternatives (storing it in ManifestEntry, deriving
it at read time, using a separate mapping), but so far haven't found a cleaner
approach — mainly because the compaction pipeline operates entirely on
DataFileMeta, which makes it difficult to place this field elsewhere without
introducing more changes.
I'd really appreciate any suggestions if you see a better approach!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
