[
https://issues.apache.org/jira/browse/HADOOP-17089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Marqardt updated HADOOP-17089:
-------------------------------------
Description:
WASB depends on the Azure Storage Java SDK. There is a concurrency bug in the
Azure Storage Java SDK that can cause the results of a list blobs operation to
appear empty. This causes the Filesystem listStatus and similar APIs to return
empty results. This has been seen in Spark work loads when jobs use more than
one executor core.
See [https://github.com/Azure/azure-storage-java/pull/546] for details on the
bug in the Azure Storage SDK.
This issue can cause data loss.
was:
WASB depends on the Azure Storage Java SDK. There is a concurrency bug in the
Azure Storage Java SDK that can cause the results of a list blobs operation to
appear empty. This causes the Filesystem listStatus and similar APIs to return
empty results. This has been seen in Spark work loads when jobs use more than
one executor core.
See [https://github.com/Azure/azure-storage-java/pull/546] for details on the
bug in the Azure Storage SDK.
Priority: Critical (was: Major)
This issue can cause data loss.
> WASB: Update azure-storage-java SDK
> -----------------------------------
>
> Key: HADOOP-17089
> URL: https://issues.apache.org/jira/browse/HADOOP-17089
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/azure
> Affects Versions: 2.7.0, 2.8.0, 2.9.0, 3.0.0, 3.1.0, 3.2.0
> Reporter: Thomas Marqardt
> Assignee: Thomas Marqardt
> Priority: Critical
> Fix For: 3.3.1
>
>
> WASB depends on the Azure Storage Java SDK. There is a concurrency bug in
> the Azure Storage Java SDK that can cause the results of a list blobs
> operation to appear empty. This causes the Filesystem listStatus and similar
> APIs to return empty results. This has been seen in Spark work loads when
> jobs use more than one executor core.
> See [https://github.com/Azure/azure-storage-java/pull/546] for details on the
> bug in the Azure Storage SDK.
> This issue can cause data loss.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
