This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/maven/protobuf.version-4.30.2
in repository https://gitbox.apache.org/repos/asf/parquet-java.git
omit 117256fb0 Bump protobuf.version from 3.25.6 to 4.30.2
add a24ea5cf4 Minor: Use logicaltypes constants in
ParquetMetadataConverter (#3186)
add 00b6bab59 GH-3188: Set the global configured column stats enable flag
to default (#3189)
add 66e0c4eec GH-3070: Add Variant logical type annotation to parquet-java
(#3072)
add c780ffa09 GH-3116: Implement the decoding of Variant values (#3197)
add 236ddb9e5 GH-3198: Allow specifying trusted classes by class name
(#3199)
add 8d6afa952 PARQUET-2417: Add `geometry` and `geography` logical type
annotations (#3200)
add 32a484a88 MINOR: Fix display of logicalTypeAnnotation for parquet cli
(#3184)
add 8c632d927 GH-3203: HadoopPositionOutputStream.close() to call
FSDataOutputStream.flush() (#3204)
add 142bff02b GH-3201: Implement a Variant builder to create Variant
values (#3202)
add 3c33fabf4 GH-3207: ParquetFileReader supports detachFileInputStream
(#3208)
add 5f079b98e GH-3205: Make HadoopPositionOutputStream.close() safe to
call even if closed (#3206)
add cdcea6d74 Bump com.github.luben:zstd-jni from 1.5.6-6 to 1.5.7-3
(#3209)
add 22a23d01e PARQUET-2417: Add statistics support to geometry logical
type (#2971)
add f3535a6a6 Bump com.github.siom79.japicmp:japicmp-maven-plugin (#3218)
add 1f1e07bbf GH-3211: Implement Variant parquet reader (#3212)
add eb6598733 MINOR: Update BoundingBox for Empty and Antimeridian
Handling (#3222)
add 13c4919dd Bump com.fasterxml.jackson.core:jackson-databind from 2.18.3
to 2.19.0 (#3225)
add 1cda24fea GH-3233: Parquet CLI supports version command (#3234)
add cc7522536 GH-3235: Row count limit for each row group (#3236)
add 030134720 Bump org.apache.commons:commons-text from 1.13.0 to 1.13.1
(#3240)
add 46595e286 Avro: Fix test configuration (#3244)
add 4aa2ea918 GH-3223: Implement Variant parquet writer (#3221)
add 0a86015cd GH-3249: Fix incorrect Bloom filter data when reading from
ByteArrayInputStream by using readFully() (#3250)
add e3257968d GH-3239: Improve ByteBufferReadable detection in
HadoopStream (#3259)
add 6ac9b29a5 Bump com.google.api.grpc:proto-google-common-protos (#3256)
add 5187eb193 GH-3263: Add DictionaryPage.decode to allow dictionary reuse
in the ColumnReaderBase ctor (#3264)
add 7f3613184 GH-3253: Apply ServicesResourceTransformer to
parquet-jackson (#3260)
add 6d2635b2a Minor: Cleanup some tests (#3265)
add 97321b831 GH-3141: Add constructor to `ParquetFileReader` to pass
parquet footer and expose setRequestedSchema that accepts
`List<ColumnDescriptor>` (#3262)
add da2bcd090 Bump actions/setup-java from 4 to 5 (#3276)
add 36a5f9cf8 Bump jackson.version from 2.19.0 to 2.19.2 (#3266)
add 299b0aea1 MINOR: Bump thrift to 0.22.0 (#3229)
add 0d25e13ff MINOR: Bump parquet-format to 2.12.0 (#3285)
add 7ef2f9149 bump parquet-plugins to 1.16.0 for release
add 1e3d70101 [maven-release-plugin] prepare release
apache-parquet-1.16.0-rc0
add 2d463ee12 [maven-release-plugin] prepare for next development iteration
add 4591ed38a GH-3290: Restore Snapshot versions for vector/benchmark
modules (#3288)
add 2a5830096 Add comparator for `UnknownLogicalType` (#3292)
add 4b6fbc1fb GH-3273: Add scoped chunk level statistics to avoid
unbounded output (#3274)
add ca5eb4682 GH-3294: Include optional profiles for release process
(#3297)
add 8be0dadae GH-2967: Support unified config options for convert
parquet-cli (#3283)
add a1d8412ce GH-3267: Add comprehensive assertions to TestMemPageStore
(#3268)
add 3065e8dbd GH-2961: Cycle detection in AvroSchemaConverter to prevent
infinite recursion (#3272)
add 4cfab6a6d MINOR: Bump version to 1.17.0-SNAPSHOT (#3293)
add 62a29b86d docs: Replace JIRA with GitHub Issues (#3303)
add a1ad19a3e MINOR: Post release of 1.16.0 (#3305)
add 181838015 GH-3286: Add support for Parquet-Protobuf in Parquet-cli
(#3287)
add 4f577a6b6 GH-3149: Enable ParquetAvroReader to handle decimal types
for int32/64 (#3306)
add 44cb94b83 GH-3310: Clean up JIRA references and move to GH issues
(#3309)
add c00232857 GH-3298: Support unified file based configurations for CLI
(#3304)
add 43c597678 GH-3300: add ParquetWriter and ParquetReader builders
constructor without params (#3301)
add 9db623654 GH-3224: Make ParquetProperties.valuesWriterFactory thread
safe (#3308)
add f50dd6cb4 GH-2972: Fix incomplete avro metadata on INT96 schema
converter (#3311)
add 6a5d0d0db GH-3312: Support uuid read converter for parquet thrift
(#3313)
add 8c84dd059 GH-2891: Include actual values in validation error messages
and improve logging (#3319)
add 4d2f1ee16 GH-3331: Track Column index page skip statistics during file
read (#3330)
add d5df8477b GH-3327: Bug fix incorrect compressed size reported by
DataPageV1 (#3326)
add 7e7a6585c GH-2836: Support reading pure parquet files with cat (#3332)
add 41f7359f2 GH-3317: Fix bytes written by VariantBuilder.appendFloat
(#3334)
add 68fa7310f GH-3320: Ensure parquet reader does not fail due to
incorrect statistics (#3325)
add 04e2f1952 GH-3316: Fix representation type for VariantBuilder decimal
(#3335)
add 9e231dca2 Allow bytestreamsplit available via Hadoop Configuration
(#3340)
add 0fea3e1e2 GH-3338: Support encrypted files for Parquet CLI commands
(#3339)
add 3b02e45a7 MINOR: Bump avro.version from 1.11.4 to 1.11.5 (#3348)
add 0756ddf4b Bump protobuf.version from 3.25.6 to 4.30.2
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (117256fb0)
\
N -- N -- N refs/heads/dependabot/maven/protobuf.version-4.30.2
(0756ddf4b)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/ci-hadoop3.yml | 2 +-
.github/workflows/vector-plugins.yml | 2 +-
README.md | 44 +-
dev/COMMITTERS.md | 66 -
dev/ci-before_install.sh | 2 +-
parquet-arrow/pom.xml | 2 +-
parquet-avro/README.md | 3 +-
parquet-avro/pom.xml | 18 +-
.../org/apache/parquet/avro/AvroConverters.java | 79 +-
.../parquet/avro/AvroIndexedRecordConverter.java | 7 +-
.../org/apache/parquet/avro/AvroParquetReader.java | 22 +
.../org/apache/parquet/avro/AvroReadSupport.java | 36 +-
.../apache/parquet/avro/AvroRecordConverter.java | 196 +-
.../parquet/avro/AvroRecordMaterializer.java | 5 +-
.../apache/parquet/avro/AvroSchemaConverter.java | 99 +-
.../apache/parquet/avro/AvroVariantConverter.java | 96 +
.../org/apache/parquet/avro/AvroWriteSupport.java | 79 +-
.../apache/parquet/avro/ReflectClassValidator.java | 94 +
.../apache/parquet/UntrustedStringableClass.java | 32 -
.../java/org/apache/parquet/avro/AvroTestUtil.java | 33 +
.../parquet/avro/TestAvroSchemaConverter.java | 109 +-
.../org/apache/parquet/avro/TestReadVariant.java | 2118 ++++++++++++++++++++
.../org/apache/parquet/avro/TestReadWrite.java | 79 +-
.../apache/parquet/avro/TestReflectReadWrite.java | 35 -
.../apache/parquet/avro/TestStringBehavior.java | 57 +-
.../org/apache/parquet/avro/TestWriteVariant.java | 612 ++++++
parquet-benchmarks/pom.xml | 2 +-
parquet-cli/README.md | 30 +-
parquet-cli/pom.xml | 26 +-
.../java/org/apache/parquet/cli/BaseCommand.java | 149 ++
.../src/main/java/org/apache/parquet/cli/Help.java | 6 +-
.../src/main/java/org/apache/parquet/cli/Main.java | 81 +-
.../apache/parquet/cli/commands/CatCommand.java | 109 +-
.../cli/commands/ParquetMetadataCommand.java | 46 +-
.../cli/commands/ShowBloomFilterCommand.java | 6 +-
...d.java => ShowGeospatialStatisticsCommand.java} | 48 +-
.../parquet/cli/commands/ShowPagesCommand.java | 56 +-
.../cli/commands/ShowSizeStatisticsCommand.java | 45 +-
.../parquet/cli/commands/ShowVersionCommand.java} | 37 +-
.../java/org/apache/parquet/cli/util/RawUtils.java | 27 +
.../java/org/apache/parquet/cli/util/Schemas.java | 3 +-
.../test/java/org/apache/parquet/cli/MainTest.java | 36 +
.../parquet/cli/commands/CatCommandTest.java | 102 +
.../cli/commands/ConvertCSVCommandTest.java | 15 +
.../parquet/cli/commands/ConvertCommandTest.java | 44 +
.../org/apache/parquet/cli/commands/FileTest.java | 25 +
.../cli/commands/ShowBloomFilterCommandTest.java | 154 ++
...va => ShowGeospatialStatisticsCommandTest.java} | 6 +-
.../commands/ShowSizeStatisticsCommandTest.java | 20 +
...ommandTest.java => ShowVersionCommandTest.java} | 29 +-
.../src/test/resources/test-config.properties | 5 +-
parquet-cli/src/test/resources/test-config.xml | 36 +
parquet-column/pom.xml | 8 +-
.../java/org/apache/parquet/CorruptStatistics.java | 4 +-
.../apache/parquet/column/ParquetProperties.java | 22 +-
.../parquet/column/impl/ColumnReaderBase.java | 14 +-
.../parquet/column/impl/ColumnValueCollector.java | 10 +
.../parquet/column/impl/ColumnWriterBase.java | 3 +
.../apache/parquet/column/impl/ColumnWriterV1.java | 3 +
.../apache/parquet/column/impl/ColumnWriterV2.java | 5 +-
.../apache/parquet/column/page/DictionaryPage.java | 14 +
.../org/apache/parquet/column/page/PageWriter.java | 58 +
.../column/schema/EdgeInterpolationAlgorithm.java | 64 +
.../column/statistics/geospatial/BoundingBox.java | 399 ++++
.../geospatial/GeospatialStatistics.java | 212 ++
.../statistics/geospatial/GeospatialTypes.java | 222 ++
.../parquet/filter2/predicate/FilterApi.java | 6 +-
.../predicate/SchemaCompatibilityValidator.java | 2 +-
.../parquet/filter2/predicate/ValidTypeMap.java | 2 +-
.../recordlevel/FilteringPrimitiveConverter.java | 2 +-
...crementallyUpdatedFilterPredicateEvaluator.java | 2 +-
.../filter2/columnindex/ColumnIndexFilter.java | 35 +-
.../parquet/schema/LogicalTypeAnnotation.java | 227 +++
.../apache/parquet/schema/MessageTypeParser.java | 34 +-
.../parquet/schema/PrimitiveStringifier.java | 18 +
.../org/apache/parquet/schema/PrimitiveType.java | 36 +
.../main/java/org/apache/parquet/schema/Types.java | 51 +-
.../column/ParquetPropertiesThreadSafetyTest.java | 46 +
.../parquet/column/impl/TestColumnReaderImpl.java | 70 +-
.../parquet/column/mem/TestMemPageStore.java | 33 +-
.../parquet/column/page/mem/MemPageWriter.java | 5 +-
.../statistics/geospatial/TestBoundingBox.java | 826 ++++++++
.../geospatial/TestGeospatialStatistics.java | 172 ++
.../statistics/geospatial/TestGeospatialTypes.java | 559 ++++++
.../apache/parquet/parser/TestParquetParser.java | 27 +
.../parquet/schema/TestPrimitiveComparator.java | 23 +
.../apache/parquet/schema/TestTypeBuilders.java | 144 ++
.../schema/TestTypeBuildersWithLogicalTypes.java | 55 +
parquet-common/pom.xml | 2 +-
parquet-encoding/pom.xml | 2 +-
parquet-format-structures/pom.xml | 2 +-
.../org/apache/parquet/format/LogicalTypes.java | 7 +
parquet-generator/pom.xml | 2 +-
parquet-hadoop-bundle/pom.xml | 2 +-
parquet-hadoop/README.md | 6 +-
parquet-hadoop/pom.xml | 8 +-
.../filter2/statisticslevel/StatisticsFilter.java | 2 +-
.../format/converter/ParquetMetadataConverter.java | 219 +-
.../org/apache/parquet/hadoop/CodecFactory.java | 2 +-
.../parquet/hadoop/ColumnChunkPageWriteStore.java | 24 +-
.../parquet/hadoop/ColumnIndexFilterUtils.java | 21 +-
.../hadoop/InternalParquetRecordWriter.java | 17 +-
.../apache/parquet/hadoop/ParquetFileReader.java | 91 +-
.../parquet/hadoop/ParquetFileReaderMetrics.java | 4 +-
.../apache/parquet/hadoop/ParquetFileWriter.java | 11 +-
.../apache/parquet/hadoop/ParquetOutputFormat.java | 24 +
.../org/apache/parquet/hadoop/ParquetReader.java | 28 +-
.../org/apache/parquet/hadoop/ParquetWriter.java | 32 +
.../hadoop/example/ExampleParquetWriter.java | 15 +
.../hadoop/metadata/ColumnChunkMetaData.java | 72 +-
.../parquet/hadoop/rewrite/ParquetRewriter.java | 3 +-
.../hadoop/util/HadoopPositionOutputStream.java | 7 +-
.../apache/parquet/hadoop/util/HadoopStreams.java | 13 +-
.../converter/TestParquetMetadataConverter.java | 323 +++
.../hadoop/TestByteStreamSplitConfiguration.java | 38 +-
.../hadoop/TestColumnChunkPageWriteStore.java | 1 +
.../parquet/hadoop/TestDataPageChecksums.java | 11 +-
.../parquet/hadoop/TestParquetFileWriter.java | 8 +-
.../apache/parquet/hadoop/TestParquetReader.java | 43 +
.../apache/parquet/hadoop/TestParquetWriter.java | 85 +-
.../statistics/TestGeometryTypeRoundTrip.java | 227 +++
parquet-jackson/pom.xml | 5 +-
parquet-plugins/parquet-encoding-vector/pom.xml | 2 +-
parquet-plugins/parquet-plugins-benchmarks/pom.xml | 2 +-
parquet-protobuf/pom.xml | 6 +-
parquet-thrift/pom.xml | 2 +-
.../parquet/thrift/ThriftRecordConverter.java | 21 +
.../thrift/TestUUIDRecordConverterFailure.java | 61 +
{parquet-arrow => parquet-variant}/pom.xml | 28 +-
.../apache/parquet/variant/ImmutableMetadata.java | 47 +
.../java/org/apache/parquet/variant/Metadata.java | 28 +
.../apache/parquet/variant/MetadataBuilder.java | 78 +
.../java/org/apache/parquet/variant/Variant.java | 346 ++++
.../parquet/variant/VariantArrayBuilder.java | 64 +
.../org/apache/parquet/variant/VariantBuilder.java | 699 +++++++
.../apache/parquet/variant/VariantConverters.java | 746 +++++++
.../parquet/variant/VariantObjectBuilder.java | 95 +
.../org/apache/parquet/variant/VariantUtil.java | 921 +++++++++
.../apache/parquet/variant/VariantValueWriter.java | 375 ++++
.../apache/parquet/variant/TestVariantArray.java | 183 ++
.../parquet/variant/TestVariantArrayBuilder.java | 293 +++
.../apache/parquet/variant/TestVariantObject.java | 344 ++++
.../parquet/variant/TestVariantObjectBuilder.java | 450 +++++
.../apache/parquet/variant/TestVariantScalar.java | 790 ++++++++
.../parquet/variant/TestVariantScalarBuilder.java | 504 +++++
.../apache/parquet/variant/VariantTestUtil.java | 105 +
pom.xml | 39 +-
147 files changed, 15445 insertions(+), 624 deletions(-)
delete mode 100644 dev/COMMITTERS.md
create mode 100644
parquet-avro/src/main/java/org/apache/parquet/avro/AvroVariantConverter.java
create mode 100644
parquet-avro/src/main/java/org/apache/parquet/avro/ReflectClassValidator.java
delete mode 100644
parquet-avro/src/test/java/org/apache/parquet/UntrustedStringableClass.java
create mode 100644
parquet-avro/src/test/java/org/apache/parquet/avro/TestReadVariant.java
create mode 100644
parquet-avro/src/test/java/org/apache/parquet/avro/TestWriteVariant.java
copy
parquet-cli/src/main/java/org/apache/parquet/cli/commands/{ShowSizeStatisticsCommand.java
=> ShowGeospatialStatisticsCommand.java} (61%)
copy
parquet-cli/src/{test/java/org/apache/parquet/cli/commands/CSVSchemaCommandTest.java
=> main/java/org/apache/parquet/cli/commands/ShowVersionCommand.java} (59%)
copy
parquet-cli/src/test/java/org/apache/parquet/cli/commands/{ShowSizeStatisticsCommandTest.java
=> ShowGeospatialStatisticsCommandTest.java} (83%)
copy
parquet-cli/src/test/java/org/apache/parquet/cli/commands/{ShowBloomFilterCommandTest.java
=> ShowVersionCommandTest.java} (60%)
copy .github/ISSUE_TEMPLATE/config.yaml =>
parquet-cli/src/test/resources/test-config.properties (86%)
create mode 100644 parquet-cli/src/test/resources/test-config.xml
create mode 100644
parquet-column/src/main/java/org/apache/parquet/column/schema/EdgeInterpolationAlgorithm.java
create mode 100644
parquet-column/src/main/java/org/apache/parquet/column/statistics/geospatial/BoundingBox.java
create mode 100644
parquet-column/src/main/java/org/apache/parquet/column/statistics/geospatial/GeospatialStatistics.java
create mode 100644
parquet-column/src/main/java/org/apache/parquet/column/statistics/geospatial/GeospatialTypes.java
create mode 100644
parquet-column/src/test/java/org/apache/parquet/column/ParquetPropertiesThreadSafetyTest.java
create mode 100644
parquet-column/src/test/java/org/apache/parquet/column/statistics/geospatial/TestBoundingBox.java
create mode 100644
parquet-column/src/test/java/org/apache/parquet/column/statistics/geospatial/TestGeospatialStatistics.java
create mode 100644
parquet-column/src/test/java/org/apache/parquet/column/statistics/geospatial/TestGeospatialTypes.java
copy
parquet-cli/src/test/java/org/apache/parquet/cli/commands/ShowFooterCommandTest.java
=>
parquet-hadoop/src/test/java/org/apache/parquet/hadoop/TestByteStreamSplitConfiguration.java
(50%)
create mode 100644
parquet-hadoop/src/test/java/org/apache/parquet/statistics/TestGeometryTypeRoundTrip.java
create mode 100644
parquet-thrift/src/test/java/org/apache/parquet/thrift/TestUUIDRecordConverterFailure.java
copy {parquet-arrow => parquet-variant}/pom.xml (81%)
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/ImmutableMetadata.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/Metadata.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/MetadataBuilder.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/Variant.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/VariantArrayBuilder.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/VariantBuilder.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/VariantConverters.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/VariantObjectBuilder.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/VariantUtil.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/VariantValueWriter.java
create mode 100644
parquet-variant/src/test/java/org/apache/parquet/variant/TestVariantArray.java
create mode 100644
parquet-variant/src/test/java/org/apache/parquet/variant/TestVariantArrayBuilder.java
create mode 100644
parquet-variant/src/test/java/org/apache/parquet/variant/TestVariantObject.java
create mode 100644
parquet-variant/src/test/java/org/apache/parquet/variant/TestVariantObjectBuilder.java
create mode 100644
parquet-variant/src/test/java/org/apache/parquet/variant/TestVariantScalar.java
create mode 100644
parquet-variant/src/test/java/org/apache/parquet/variant/TestVariantScalarBuilder.java
create mode 100644
parquet-variant/src/test/java/org/apache/parquet/variant/VariantTestUtil.java
