[
https://issues.apache.org/jira/browse/BEAM-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Igor Dvorzhak updated BEAM-6736:
--------------------------------
Description:
GCS IO 1.9.12-1.9.14 could send large number of GCS list requests (if there are
a 1000+ of files in the folder) in GoogleCloudStorageFileSystem#getFileInfo
method.
This issue is mitigated in GCS IO 1.9.15:
[https://github.com/GoogleCloudPlatform/bigdata-interop/releases/tag/v1.9.15]
was:
GCS IO 1.9.12-1.9.14 could send large number of GCS list requests (if there are
a 1000+ of files in the folder) in GoogleCloudStorage#getFileInfo method.
This issue is mitigated in GCS IO 1.9.15:
https://github.com/GoogleCloudPlatform/bigdata-interop/releases/tag/v1.9.15
> Upgrade gcsio dependency to 1.9.15
> ----------------------------------
>
> Key: BEAM-6736
> URL: https://issues.apache.org/jira/browse/BEAM-6736
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp, sdk-java-core
> Affects Versions: 2.10.0
> Reporter: Igor Dvorzhak
> Priority: Major
>
> GCS IO 1.9.12-1.9.14 could send large number of GCS list requests (if there
> are a 1000+ of files in the folder) in
> GoogleCloudStorageFileSystem#getFileInfo method.
> This issue is mitigated in GCS IO 1.9.15:
> [https://github.com/GoogleCloudPlatform/bigdata-interop/releases/tag/v1.9.15]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)