[
https://issues.apache.org/jira/browse/AIRFLOW-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Torkjel Hongve updated AIRFLOW-2575:
------------------------------------
Description: The `GoogleCloudStorageToGoogleCloudStorageOperator` should
use `GoogleCloudStorageHook.rewrite` instead of `GoogleCloudStorageHook.copy`,
otherwise it will fail on copying large (> 5TB) files. (was: The
`GoogleCloudStorageToGoogleCloudStorageOperator` should use
`GoogleCloudStorageHook.rewrite` instead of `GoogleCloudStorageHook.copy`,
otherwise it will fail on copying large (> 5GB) files. )
> gcs to gcs operator fails on large files.
> ------------------------------------------
>
> Key: AIRFLOW-2575
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2575
> Project: Apache Airflow
> Issue Type: Bug
> Components: gcp
> Affects Versions: 1.10
> Reporter: Torkjel Hongve
> Priority: Major
>
> The `GoogleCloudStorageToGoogleCloudStorageOperator` should use
> `GoogleCloudStorageHook.rewrite` instead of `GoogleCloudStorageHook.copy`,
> otherwise it will fail on copying large (> 5TB) files.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
