luoyuxia commented on PR #1350: URL: https://github.com/apache/fluss/pull/1350#issuecomment-3100291649
> -> The end goal is to encode the values in iceberg compatibal format, can you add more on this? We don't need to encode the values in iceberg compatibal format. We just need to make sure the bucket partition transform align with iceberg. Iceberg just bucket via literal value, without the encoding process which is different from paimon. Fluss need to encode for we need to align the process that fluss write rows, which will - step1: first encoding row into bytes - step2: hash(distribute) the **bytes** into a bucket. So, for iceberg, although we encode it, we still need to decode the bytes into the literal value(a int value, long value, etc), and use the iceberg bucket strategy. See `BucketInteger`, `BucketLong` in iceberg repo -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
