Pavlo Zhukov created BEAM-7411:
----------------------------------
Summary: Allow upload gzipped files via
apache_beam.io.gcp.gcsio.GcsIO with proper content-encoding
Key: BEAM-7411
URL: https://issues.apache.org/jira/browse/BEAM-7411
Project: Beam
Issue Type: Improvement
Components: io-python-gcp
Reporter: Pavlo Zhukov
To reduce the size of uploaded files we decided to gzip it before upload.
Unfortunately, we noticed that we don't have content-encoding 'gzip' in the
uploaded files metadata. I rechecked the code and noticed that there is no way
to pass gzip encoding on
{code}
apache_beam.io.gcp.gcsio.GcsIO.open(){code}
Also, I noticed that apache_beam.io.gcp.gcsio.GcsUploader doesn't support
uploading for gzipped files.
To resolve this problem we need to allow pass gzip_encoded option, which can be
passed to apitools.base.py.transfer on
{code}
GcsUploader.__init__()
{code}
Is there any possibility that you apply the required changes soon?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
