szehon-ho commented on issue #11800: URL: https://github.com/apache/iceberg/issues/11800#issuecomment-2564342146
I think there are two 'not matched' here, 1 ) entries in A not matched in B 2) entries in B not matched in A. Case (1) is do-able. For case (2), it is harder because each of the replicate partitions only gets a partial view of the split side. Say: <pre> TableA(split) TableB (replicate) (1, a) (1, a) (2, b) (1, a) </pre> The second pair (2, b) vs (1, a) will wrongly calculate that TableB has a non-match with TableA and return (1,a). But actually it match in the first pair. Hope that makes sense. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
