GitHub user katsiapis opened a pull request:
https://github.com/apache/incubator-beam/pull/1053
[BEAM-570] Title of the pull request
- Getting rid of CompressionTypes.ZLIB and CompressionTypes.NO_COMPRESSION.
- Introducing BZIP2 compression in analogy to Dataflow Java's BZIP2,
towards resolution of https://issues.apache.org/jira/browse/BEAM-570.
- Introducing SNAPPY codec support for AVRO conciseness and in order to
fully resolve https://issues.apache.org/jira/browse/BEAM-570.
- Moving avroio from compression_type to codec as per various discussions.
- A few cleanups in avroio.
- Making textio more DRY and doing a few cleanups.
- Raising exceptions when splitting is requested for compressed source
since that should never happen (guaranteed by the service for the supported
compression types).
- Using cStringIO instead of StringIO in various places as decided in some
other discussions.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/katsiapis/incubator-beam bz2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/1053.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1053
----
commit bd44e76b80e4edf4f922b9a26f7b359c4ede2008
Author: Gus Katsiapis <katsia...@katsiapis-linux.mtv.corp.google.com>
Date: 2016-10-05T02:41:07Z
Several enhancements to Dataflow (part 2 of 2).
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
