[
https://issues.apache.org/jira/browse/HADOOP-17089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Marqardt updated HADOOP-17089:
-------------------------------------
Fix Version/s: 2.10.1
> WASB: Update azure-storage-java SDK
> -----------------------------------
>
> Key: HADOOP-17089
> URL: https://issues.apache.org/jira/browse/HADOOP-17089
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/azure
> Affects Versions: 2.7.0, 2.8.0, 2.9.0, 3.0.0, 3.1.0, 3.2.0
> Reporter: Thomas Marqardt
> Assignee: Thomas Marqardt
> Priority: Critical
> Fix For: 2.10.1, 3.3.1
>
>
> WASB depends on the Azure Storage Java SDK. There is a concurrency bug in
> the Azure Storage Java SDK that can cause the results of a list blobs
> operation to appear empty. This causes the Filesystem listStatus and similar
> APIs to return empty results. This has been seen in Spark work loads when
> jobs use more than one executor core.
> See [https://github.com/Azure/azure-storage-java/pull/546] for details on the
> bug in the Azure Storage SDK.
> This issue can cause data loss.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
