Gordon Ball created AIRFLOW-3205:
------------------------------------

             Summary: GCS: Support multipart upload
                 Key: AIRFLOW-3205
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3205
             Project: Apache Airflow
          Issue Type: Improvement
          Components: gcp
            Reporter: Gordon Ball


GoogleCloudStorageHook currently only provides support for uploading files in a 
single HTTP request. This means that loads fail with SSL errors for files 
larger than 2GiB (presumably a int32 overflow, might depend on which SSL 
library is being used). Multipart uploads should be supported to allow large 
uploads, and possibly increase reliability for smaller uploads.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to