[
https://issues.apache.org/jira/browse/HADOOP-12885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178338#comment-15178338
]
Chris Nauroth commented on HADOOP-12885:
----------------------------------------
Hello [~liushaohui]. There have been several recent bug fixes in this area.
Please see HADOOP-12634 and HADOOP-12780. If it looks like these address the
problem you saw, then would you please close this as a duplicate issue? Thank
you.
Cc [~gouravk], [~madhuch-ms], [~onpduo], [~dchickabasapa].
> An operation of atomic fold rename crashed in Wasb FileSystem
> -------------------------------------------------------------
>
> Key: HADOOP-12885
> URL: https://issues.apache.org/jira/browse/HADOOP-12885
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Liu Shaohui
> Priority: Critical
>
> An operation of atomic fold rename crashed in Wasb FileSystem
> {code}
> org.apache.hadoop.fs.azure.AzureException: Source blob
> hbase/azurtst-xiaomi/data/default/YCSBTest/5f882f5492c90b4c03a26561a2ee0a96/.regioninfo
> does not exist.
> at
> org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.rename(AzureNativeFileSystemStore.java:2405)
> at
> org.apache.hadoop.fs.azure.NativeAzureFileSystem$FolderRenamePending.execute(NativeAzureFileSystem.java:413)
> at
> org.apache.hadoop.fs.azure.NativeAzureFileSystem.rename(NativeAzureFileSystem.java:1997)
> {code}
> The problem is that there are duplicated file is the RenamePending.json.
> {code}
> "5f882f5492c90b4c03a26561a2ee0a96",
>
> "5f882f5492c90b4c03a26561a2ee0a96\/.regioninfo",
>
>
> "5f882f5492c90b4c03a26561a2ee0a96\/C\/8a2c08db432d447d9e0ed5266940b25e",
>
> "5f882f5492c90b4c03a26561a2ee0a96\/C\/9425c621073e41df9430e88f0ef61c01",
>
> "5f882f5492c90b4c03a26561a2ee0a96\/C\/f9fc55a94fa34efbb2d26be77c76187c",
>
> "5f882f5492c90b4c03a26561a2ee0a96\/.regioninfo",
>
> "5f882f5492c90b4c03a26561a2ee0a96\/.tmp",
>
> "5f882f5492c90b4c03a26561a2ee0a96\/C",
>
> "5f882f5492c90b4c03a26561a2ee0a96\/C\/8a2c08db432d447d9e0ed5266940b25e",
>
> "5f882f5492c90b4c03a26561a2ee0a96\/C\/9425c621073e41df9430e88f0ef61c01",
>
> "5f882f5492c90b4c03a26561a2ee0a96\/C\/f9fc55a94fa34efbb2d26be77c76187c",
>
> "5f882f5492c90b4c03a26561a2ee0a96\/recovered.edits",
> {code}
> Maybe there is a bug in the Listing of all the files in the folder in Wasb.
> Any suggestions?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
