[
https://issues.apache.org/jira/browse/TEZ-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223379#comment-14223379
]
Siddharth Seth commented on TEZ-1697:
-
Created TEZ-1798. Uploading a revised patch with
[
https://issues.apache.org/jira/browse/TEZ-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221724#comment-14221724
]
Hitesh Shah commented on TEZ-1697:
--
Sounds like we need to fix the overall handling in any
[
https://issues.apache.org/jira/browse/TEZ-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14219774#comment-14219774
]
Hitesh Shah commented on TEZ-1697:
--
[~sseth] Isn't this unsafe if we do not compare
[
https://issues.apache.org/jira/browse/TEZ-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14219792#comment-14219792
]
Rohini Palaniswamy commented on TEZ-1697:
-
+1.
[~hitesh],
In mapreduce, it
[
https://issues.apache.org/jira/browse/TEZ-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14219798#comment-14219798
]
Siddharth Seth commented on TEZ-1697:
-
bq. Siddharth Seth Isn't this unsafe if we do not
[
https://issues.apache.org/jira/browse/TEZ-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14220109#comment-14220109
]
Hitesh Shah commented on TEZ-1697:
--
Agreed that checksums are expensive. However, it seems
[
https://issues.apache.org/jira/browse/TEZ-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14220117#comment-14220117
]
Rohini Palaniswamy commented on TEZ-1697:
-
With Oozie and Pig you will always see a
[
https://issues.apache.org/jira/browse/TEZ-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14220129#comment-14220129
]
Rohini Palaniswamy commented on TEZ-1697:
-
Even now there are collisions. Pig always
[
https://issues.apache.org/jira/browse/TEZ-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183147#comment-14183147
]
Siddharth Seth commented on TEZ-1697:
-
In case of duplicates, especially ones added by