[
https://issues.apache.org/jira/browse/HADOOP-16255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919986#comment-16919986
]
Jungtaek Lim commented on HADOOP-16255:
---------------------------------------
Ah OK. Good to know that 2.7.x is EOL. Spark 3.0 is planning to support both
2.7.4 and 3.2.0, and upgrading Hadoop version could affect many things like
transitive dependency, compatibility between old Hadoop server (does Hadoop
client guarantee backward compatibility?), etc.
I haven't contributed Hadoop project so may need to take time to do it. I'll
see how I can contribute it, but you can also go ahead if I'm taking too much
time to do it.
> ChecksumFS.Make FileSystem.rename(path, path, options) doesn't rename checksum
> ------------------------------------------------------------------------------
>
> Key: HADOOP-16255
> URL: https://issues.apache.org/jira/browse/HADOOP-16255
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.8.5, 3.1.2
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
>
> ChecksumFS doesn't override FilterFS rename/3, so doesn't rename the checksum
> with the file.
> As a result, if a file is renamed over an existing file using rename(src,
> dest, OVERWRITE) the renamed file will be considered to have an invalid
> checksum -the old one is picked up instead.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
