[
https://issues.apache.org/jira/browse/AIRFLOW-4321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kaxil Naik updated AIRFLOW-4321:
--------------------------------
Description:
Many places in Airflow docs for GCS it is mentioned that "Google cloud storage
allows for files
to be a maximum of 4GB."
The limit is not 4GB it's 5TB:
https://cloud.google.com/storage/quotas
"There is a maximum size limit of 5 TB for individual objects stored in Cloud
Storage."
I think in general It's best not to mention it at all. The limits can change at
will. Airflow can't keep track of all size changes.
> Replace incorrect info related to Max allowed GCS Object Size
> -------------------------------------------------------------
>
> Key: AIRFLOW-4321
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4321
> Project: Apache Airflow
> Issue Type: Task
> Components: gcp
> Reporter: Kaxil Naik
> Assignee: Kaxil Naik
> Priority: Minor
> Fix For: 1.10.4
>
>
> Many places in Airflow docs for GCS it is mentioned that "Google cloud
> storage allows for files
> to be a maximum of 4GB."
> The limit is not 4GB it's 5TB:
> https://cloud.google.com/storage/quotas
> "There is a maximum size limit of 5 TB for individual objects stored in Cloud
> Storage."
> I think in general It's best not to mention it at all. The limits can change
> at will. Airflow can't keep track of all size changes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
