[
https://issues.apache.org/jira/browse/AIRFLOW-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199748#comment-17199748
]
ASF GitHub Bot commented on AIRFLOW-2932:
-----------------------------------------
nikhil-mahajan-pcln commented on pull request #3893:
URL: https://github.com/apache/airflow/pull/3893#issuecomment-695781380
HI, is there a 2GB limit on the compressed .gz file that can be sent ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> GoogleCloudStorageHook - allow compression of file
> --------------------------------------------------
>
> Key: AIRFLOW-2932
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2932
> Project: Apache Airflow
> Issue Type: Improvement
> Affects Versions: 1.10.0
> Reporter: jack
> Assignee: neil90
> Priority: Major
> Fix For: 1.10.1
>
>
> The *upload*{color:#555555}({color}_bucket_{color:#555555},
> {color}_object_{color:#555555}, {color}_filename_{color:#555555},
> {color}_mime_type='application/octet-stream'_{color:#555555}){color} function
> allows to upload file from local disk.
> The google cloud support GZIP and BigQuery can read GZIP files. So, most
> people upload compressed files in order to save space.
> It would be nice if the upload function would be able to make the compression
> on it's own (if asked by the user). This will save the trouble of having to
> compress the file by ourselves.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
