This is an automated email from the ASF dual-hosted git repository.
gabor pushed a change to branch encryption
in repository https://gitbox.apache.org/repos/asf/parquet-mr.git.
omit bd876bd PARQUET-1817: Crypto Properties Factory (#769)
omit 014b610 PARQUET-1818: Fix bloom/encryption collision in
format-structures (#771)
omit 8b306bf PARQUET-1286: Crypto package (#614)
omit b887d49 PARQUET-1228: Format Structures encryption (#613)
add d691928 PARQUET-1803 Could not find FilleInputSplit in
ParquetInputSplit (#761)
add ab65823 [PARQUET-1808]: Replacing multiple String Object creations
with StringBuilder (#766)
add 8e7dfde Add shangxinli to committers list (#767)
add 7ddfb4d PARQUET-1805: Refactor the configuration for bloom filters
(#763)
add 5d2bf27 PARQUET-1743: Add equals API to BloomFilter interface (#773)
add d00b2f1 PARQUET-1821: Add 'column-size' command to parquet-cli and
parquet-tools (#774)
add 49e8627 PARQUET-1599: Fix to-avro to respect the overwrite option
(#650)
add 2d7b63b PARQUET-1832: Travis fails with too long output (#777)
add 2affb36 PARQUET-1699: upgrade yetus to 0.12.0 (#786)
add 70d7f52 PARQUET-1844: Eliminate using commons-lang (#787)
new c68e688 PARQUET-1228: Format Structures encryption (#613)
new 01460a0 PARQUET-1286: Crypto package (#614)
new add2497 PARQUET-1818: Fix bloom/encryption collision in
format-structures (#771)
new 42827b1 PARQUET-1817: Crypto Properties Factory (#769)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (bd876bd)
\
N -- N -- N refs/heads/encryption (42827b1)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.travis.yml | 2 +-
dev/COMMITTERS.md | 1 +
.../src/main/resources/log4j.properties | 2 +-
.../apache/parquet/cascading/TupleReadSupport.java | 9 +-
parquet-cli/pom.xml | 5 +
.../java/org/apache/parquet/cli/BaseCommand.java | 24 +++-
.../src/main/java/org/apache/parquet/cli/Main.java | 2 +
.../parquet/cli/commands/ColumnSizeCommand.java | 137 +++++++++++++++++++++
.../cli/commands/ParquetMetadataCommand.java | 4 +-
.../apache/parquet/cli/commands/SchemaCommand.java | 11 +-
.../parquet/cli/commands/ShowPagesCommand.java | 4 +-
.../apache/parquet/cli/commands/ToAvroCommand.java | 15 +--
.../org/apache/parquet/cli/csv/CSVProperties.java | 17 ++-
.../apache/parquet/cli/commands/AvroFileTest.java | 23 ++--
.../cli/commands/ColumnSizeCommandTest.java | 91 ++++++++++++++
.../parquet/cli/commands/ParquetFileTest.java | 8 ++
.../parquet/cli/commands/SchemaCommandTest.java | 30 +++++
.../parquet/cli/commands/ToAvroCommandTest.java | 19 +++
.../apache/parquet/column/ParquetProperties.java | 84 ++++++++-----
.../parquet/column/impl/ColumnWriteStoreBase.java | 2 +-
.../parquet/column/impl/ColumnWriterBase.java | 23 ++--
.../values/bloomfilter/BlockSplitBloomFilter.java | 15 +++
.../column/values/bloomfilter/BloomFilter.java | 8 ++
.../parquet/example/data/simple/SimpleGroup.java | 38 +++---
.../org/apache/parquet/io/MessageColumnIO.java | 12 +-
.../bloomfilter/TestBlockSplitBloomFilter.java | 20 +++
.../parquet/io/ExpectationValidatingConverter.java | 14 +--
parquet-common/pom.xml | 2 +-
parquet-format-structures/pom.xml | 1 +
.../apache/parquet/hadoop/ParquetInputSplit.java | 8 +-
.../apache/parquet/hadoop/ParquetOutputFormat.java | 46 ++-----
.../org/apache/parquet/hadoop/ParquetWriter.java | 37 +++---
.../dictionarylevel/DictionaryFilterTest.java | 5 +-
.../apache/parquet/hadoop/TestBloomFiltering.java | 12 +-
.../org/apache/parquet/hadoop/TestInputFormat.java | 14 +--
.../apache/parquet/hadoop/TestParquetWriter.java | 2 +-
.../apache/parquet/statistics/TestStatistics.java | 9 --
parquet-hadoop/src/test/resources/log4j.properties | 4 +-
parquet-pig/src/test/resources/log4j.properties | 2 +-
.../src/test/resources/log4j.properties | 2 +-
.../parquet/tools/command/ColumnSizeCommand.java | 121 ++++++++++++++++++
.../org/apache/parquet/tools/command/Registry.java | 1 +
.../tools/command/TestColumnSizeCommand.java | 95 ++++++++++++++
pom.xml | 24 +++-
44 files changed, 794 insertions(+), 211 deletions(-)
create mode 100644
parquet-cli/src/main/java/org/apache/parquet/cli/commands/ColumnSizeCommand.java
create mode 100644
parquet-cli/src/test/java/org/apache/parquet/cli/commands/ColumnSizeCommandTest.java
create mode 100644
parquet-tools/src/main/java/org/apache/parquet/tools/command/ColumnSizeCommand.java
create mode 100644
parquet-tools/src/test/java/org/apache/parquet/tools/command/TestColumnSizeCommand.java
