[
https://issues.apache.org/jira/browse/AIRFLOW-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506179#comment-16506179
]
ASF subversion and git services commented on AIRFLOW-2575:
----------------------------------------------------------
Commit ac5954d7f00a27ed41466b53f92cd37db426e38b in incubator-airflow's branch
refs/heads/master from [~torkjel]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=ac5954d ]
[AIRFLOW-2575] Make gcs to gcs operator work with large files
Use `GoogleCloudStorageHook.rewrite` instead of
`copy` so that it
works with files > 5TB
Closes #3472 from torkjel/AIRFLOW-2575-gcs-to-gcs-
operator-support-large-files
> gcs to gcs operator fails on large files.
> ------------------------------------------
>
> Key: AIRFLOW-2575
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2575
> Project: Apache Airflow
> Issue Type: Bug
> Components: gcp
> Affects Versions: 1.10
> Reporter: Torkjel Hongve
> Priority: Major
>
> The `GoogleCloudStorageToGoogleCloudStorageOperator` should use
> `GoogleCloudStorageHook.rewrite` instead of `GoogleCloudStorageHook.copy`,
> otherwise it will fail on copying large (> 5TB) files.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
