This is an automated email from the ASF dual-hosted git repository.
jkff pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 5e96d5f Merge pull request #5454: [BEAM-4354] Enforce ErrorProne
analysis in tika IO
add fd67c87 [BEAM-214] Add ParquetIO
add c9badee [BEAM-214] Add gradle build in ParquetIO
add 825da2d [BEAM-214] Refactore the reads to leverage FileIO
add 7c48802 [BEAM-214] Use Parquet 1.10.0 version in ParquetIO.Sink
add 030b714 [BEAM-214] Add ParquetIOIT
add c144cfb [BEAM-214] Update ReadFn to an non deprecated, newest Parquet
API
add 37720bf [BEAM-214] Simplify the IO by removing redundant PTransforms
add eb00d20 [BEAM-214] Implement writing slices of bytes in
BeamOutputStream
add a3a69ec [BEAM-214] Apply reviewer's suggestions
add fe73369 Merge pull request #5242: [BEAM-214] ParquetIO
No new revisions were added by this update.
Summary of changes:
.../job_PerformanceTests_FileBasedIO_IT.groovy | 12 +
sdks/java/io/file-based-io-tests/build.gradle | 1 +
sdks/java/io/file-based-io-tests/pom.xml | 5 +
.../beam/sdk/io/common/FileBasedIOITHelper.java | 1 +
.../AvroIOIT.java => parquet/ParquetIOIT.java} | 97 +++---
sdks/java/io/{kafka => parquet}/build.gradle | 19 +-
sdks/java/io/{amqp => parquet}/pom.xml | 98 +++---
.../org/apache/beam/sdk/io/parquet/ParquetIO.java | 386 +++++++++++++++++++++
.../apache/beam/sdk/io/parquet}/package-info.java | 4 +-
.../apache/beam/sdk/io/parquet/ParquetIOTest.java | 136 ++++++++
sdks/java/io/pom.xml | 1 +
settings.gradle | 2 +
12 files changed, 646 insertions(+), 116 deletions(-)
copy
sdks/java/io/file-based-io-tests/src/test/java/org/apache/beam/sdk/io/{avro/AvroIOIT.java
=> parquet/ParquetIOIT.java} (57%)
copy sdks/java/io/{kafka => parquet}/build.gradle (78%)
copy sdks/java/io/{amqp => parquet}/pom.xml (67%)
create mode 100644
sdks/java/io/parquet/src/main/java/org/apache/beam/sdk/io/parquet/ParquetIO.java
copy
{runners/gearpump/src/main/java/org/apache/beam/runners/gearpump/translators =>
sdks/java/io/parquet/src/main/java/org/apache/beam/sdk/io/parquet}/package-info.java
(89%)
create mode 100644
sdks/java/io/parquet/src/test/java/org/apache/beam/sdk/io/parquet/ParquetIOTest.java
--
To stop receiving notification emails like this one, please contact
[email protected].
