0dunay0 commented on PR #10673: URL: https://github.com/apache/paimon/pull/10673#issuecomment-6690476153
> Requirement fit: SUPPORTED. Implementation: FINDINGS. > > The direct-copy use case has end-to-end value. The earlier partition-order, transactional-source, partition-enumeration and hidden-directory fixes are present. Normal JDK 8/Flink 1 verification passed 12 focused extractor/schema and actual Hive/Flink clone cases. A further real SQL CALL with both new options also passes when awaited synchronously. Current CI is green. > > An actual Hive ORC clone exposes the target-reader compatibility gap below. A normal INSERT into the same positional-reader target works. The paired name-reader clone works, and disabling only positional evolution after copying recovers the correct row from the exact same file; re-enabling it returns the wrong columns. Live remote HDFS/OSS migration and production throughput were not rerun. > > All temporary reviewer test changes were removed; the three restored actual Hive clone integration cases pass with normal Maven checks, and the worktree is clean. Fixed in latest commit. The clone now rejects copying files into an ORC target with `orc.force.positional.evolution,` including one where the catalog sets it by default. While at it I also fixed Hive's default partition being stored as a string instead of null, other partitions being wiped when the target sets `dynamic-partition-overwrite=false`, partitions with another format than the table, and the upper case `TRANSACTIONAL` key. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
