This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/maven/org.apache.arrow-arrow-vector-18.3.0
in repository https://gitbox.apache.org/repos/asf/parquet-java.git
omit a6497ac49 Bump org.apache.arrow:arrow-vector from 17.0.0 to 18.3.0
add 22a23d01e PARQUET-2417: Add statistics support to geometry logical
type (#2971)
add f3535a6a6 Bump com.github.siom79.japicmp:japicmp-maven-plugin (#3218)
add 1f1e07bbf GH-3211: Implement Variant parquet reader (#3212)
add eb6598733 MINOR: Update BoundingBox for Empty and Antimeridian
Handling (#3222)
add 13c4919dd Bump com.fasterxml.jackson.core:jackson-databind from 2.18.3
to 2.19.0 (#3225)
add 1cda24fea GH-3233: Parquet CLI supports version command (#3234)
add cc7522536 GH-3235: Row count limit for each row group (#3236)
add 030134720 Bump org.apache.commons:commons-text from 1.13.0 to 1.13.1
(#3240)
add 46595e286 Avro: Fix test configuration (#3244)
add 4aa2ea918 GH-3223: Implement Variant parquet writer (#3221)
add 0a86015cd GH-3249: Fix incorrect Bloom filter data when reading from
ByteArrayInputStream by using readFully() (#3250)
add e3257968d GH-3239: Improve ByteBufferReadable detection in
HadoopStream (#3259)
add 6ac9b29a5 Bump com.google.api.grpc:proto-google-common-protos (#3256)
add 5187eb193 GH-3263: Add DictionaryPage.decode to allow dictionary reuse
in the ColumnReaderBase ctor (#3264)
add 7f3613184 GH-3253: Apply ServicesResourceTransformer to
parquet-jackson (#3260)
add 6d2635b2a Minor: Cleanup some tests (#3265)
add 97321b831 GH-3141: Add constructor to `ParquetFileReader` to pass
parquet footer and expose setRequestedSchema that accepts
`List<ColumnDescriptor>` (#3262)
add da2bcd090 Bump actions/setup-java from 4 to 5 (#3276)
add 36a5f9cf8 Bump jackson.version from 2.19.0 to 2.19.2 (#3266)
add 299b0aea1 MINOR: Bump thrift to 0.22.0 (#3229)
add 0d25e13ff MINOR: Bump parquet-format to 2.12.0 (#3285)
add 7ef2f9149 bump parquet-plugins to 1.16.0 for release
add 1e3d70101 [maven-release-plugin] prepare release
apache-parquet-1.16.0-rc0
add 2d463ee12 [maven-release-plugin] prepare for next development iteration
add 4591ed38a GH-3290: Restore Snapshot versions for vector/benchmark
modules (#3288)
add 2a5830096 Add comparator for `UnknownLogicalType` (#3292)
add 4b6fbc1fb GH-3273: Add scoped chunk level statistics to avoid
unbounded output (#3274)
add ca5eb4682 GH-3294: Include optional profiles for release process
(#3297)
add 8be0dadae GH-2967: Support unified config options for convert
parquet-cli (#3283)
add a1d8412ce GH-3267: Add comprehensive assertions to TestMemPageStore
(#3268)
add 3065e8dbd GH-2961: Cycle detection in AvroSchemaConverter to prevent
infinite recursion (#3272)
add 4cfab6a6d MINOR: Bump version to 1.17.0-SNAPSHOT (#3293)
add 62a29b86d docs: Replace JIRA with GitHub Issues (#3303)
add a1ad19a3e MINOR: Post release of 1.16.0 (#3305)
add 181838015 GH-3286: Add support for Parquet-Protobuf in Parquet-cli
(#3287)
add 4f577a6b6 GH-3149: Enable ParquetAvroReader to handle decimal types
for int32/64 (#3306)
add 44cb94b83 GH-3310: Clean up JIRA references and move to GH issues
(#3309)
add c00232857 GH-3298: Support unified file based configurations for CLI
(#3304)
add 43c597678 GH-3300: add ParquetWriter and ParquetReader builders
constructor without params (#3301)
add 9db623654 GH-3224: Make ParquetProperties.valuesWriterFactory thread
safe (#3308)
add f50dd6cb4 GH-2972: Fix incomplete avro metadata on INT96 schema
converter (#3311)
add 6a5d0d0db GH-3312: Support uuid read converter for parquet thrift
(#3313)
add 8c84dd059 GH-2891: Include actual values in validation error messages
and improve logging (#3319)
add 4d2f1ee16 GH-3331: Track Column index page skip statistics during file
read (#3330)
add d5df8477b GH-3327: Bug fix incorrect compressed size reported by
DataPageV1 (#3326)
add 7e7a6585c GH-2836: Support reading pure parquet files with cat (#3332)
add 41f7359f2 GH-3317: Fix bytes written by VariantBuilder.appendFloat
(#3334)
add 68fa7310f GH-3320: Ensure parquet reader does not fail due to
incorrect statistics (#3325)
add 04e2f1952 GH-3316: Fix representation type for VariantBuilder decimal
(#3335)
add 9e231dca2 Allow bytestreamsplit available via Hadoop Configuration
(#3340)
add 0fea3e1e2 GH-3338: Support encrypted files for Parquet CLI commands
(#3339)
add 3b02e45a7 MINOR: Bump avro.version from 1.11.4 to 1.11.5 (#3348)
add 44701aae0 Remove unused test dependencies (#3324)
add 2bcd2bde7 GH-3350: Avoid flushing data to cloud when exception is
thrown (#3351)
add dfc025e17 GH-3213: Add the configuration for ByteStreamSplit encoding
(#3214)
add 8e740f07c GH-3315: Variant binary read does not take length into
account (#3333)
add a6bad6a8e GH-3175: support protobuf library version 4 (#3352)
add 313a1f34b Bump to Java 11 (#3314)
add c920cd5ef Bump org.apache.arrow:arrow-vector from 17.0.0 to 18.3.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a6497ac49)
\
N -- N -- N
refs/heads/dependabot/maven/org.apache.arrow-arrow-vector-18.3.0 (c920cd5ef)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/ci-hadoop3.yml | 4 +-
.github/workflows/vector-plugins.yml | 2 +-
README.md | 44 +-
dev/COMMITTERS.md | 66 -
dev/ci-before_install.sh | 2 +-
parquet-arrow/pom.xml | 2 +-
parquet-avro/pom.xml | 18 +-
.../org/apache/parquet/avro/AvroConverters.java | 35 +
.../parquet/avro/AvroIndexedRecordConverter.java | 7 +-
.../apache/parquet/avro/AvroRecordConverter.java | 21 +-
.../apache/parquet/avro/AvroSchemaConverter.java | 99 +-
.../apache/parquet/avro/AvroVariantConverter.java | 96 +
.../org/apache/parquet/avro/AvroWriteSupport.java | 79 +-
.../java/org/apache/parquet/avro/AvroTestUtil.java | 33 +
.../parquet/avro/TestAvroSchemaConverter.java | 109 +-
.../org/apache/parquet/avro/TestReadVariant.java | 2118 ++++++++++++++++++++
.../org/apache/parquet/avro/TestReadWrite.java | 79 +-
.../org/apache/parquet/avro/TestWriteVariant.java | 612 ++++++
parquet-benchmarks/pom.xml | 2 +-
parquet-cli/README.md | 30 +-
parquet-cli/pom.xml | 26 +-
.../java/org/apache/parquet/cli/BaseCommand.java | 149 ++
.../src/main/java/org/apache/parquet/cli/Help.java | 6 +-
.../src/main/java/org/apache/parquet/cli/Main.java | 81 +-
.../apache/parquet/cli/commands/CatCommand.java | 109 +-
.../cli/commands/ParquetMetadataCommand.java | 46 +-
.../cli/commands/ShowBloomFilterCommand.java | 6 +-
...d.java => ShowGeospatialStatisticsCommand.java} | 48 +-
.../parquet/cli/commands/ShowPagesCommand.java | 56 +-
.../cli/commands/ShowSizeStatisticsCommand.java | 45 +-
.../parquet/cli/commands/ShowVersionCommand.java} | 37 +-
.../java/org/apache/parquet/cli/util/Schemas.java | 3 +-
.../test/java/org/apache/parquet/cli/MainTest.java | 36 +
.../parquet/cli/commands/CatCommandTest.java | 102 +
.../cli/commands/ConvertCSVCommandTest.java | 15 +
.../parquet/cli/commands/ConvertCommandTest.java | 44 +
.../org/apache/parquet/cli/commands/FileTest.java | 25 +
.../cli/commands/ShowBloomFilterCommandTest.java | 154 ++
...va => ShowGeospatialStatisticsCommandTest.java} | 6 +-
.../commands/ShowSizeStatisticsCommandTest.java | 20 +
...ommandTest.java => ShowVersionCommandTest.java} | 29 +-
.../src/test/resources/test-config.properties | 5 +-
parquet-cli/src/test/resources/test-config.xml | 36 +
parquet-column/pom.xml | 20 +-
.../java/org/apache/parquet/CorruptStatistics.java | 4 +-
.../apache/parquet/column/ParquetProperties.java | 21 +-
.../parquet/column/impl/ColumnReaderBase.java | 14 +-
.../parquet/column/impl/ColumnValueCollector.java | 10 +
.../parquet/column/impl/ColumnWriterBase.java | 3 +
.../apache/parquet/column/impl/ColumnWriterV1.java | 3 +
.../apache/parquet/column/impl/ColumnWriterV2.java | 5 +-
.../apache/parquet/column/page/DictionaryPage.java | 14 +
.../org/apache/parquet/column/page/PageWriter.java | 58 +
.../column/statistics/geospatial/BoundingBox.java | 399 ++++
.../geospatial/GeospatialStatistics.java | 212 ++
.../statistics/geospatial/GeospatialTypes.java | 222 ++
.../parquet/filter2/predicate/FilterApi.java | 6 +-
.../predicate/SchemaCompatibilityValidator.java | 2 +-
.../parquet/filter2/predicate/ValidTypeMap.java | 2 +-
.../recordlevel/FilteringPrimitiveConverter.java | 2 +-
...crementallyUpdatedFilterPredicateEvaluator.java | 2 +-
.../filter2/columnindex/ColumnIndexFilter.java | 35 +-
.../org/apache/parquet/schema/PrimitiveType.java | 24 +
.../main/java/org/apache/parquet/schema/Types.java | 39 +-
.../column/ParquetPropertiesThreadSafetyTest.java | 46 +
.../parquet/column/impl/TestColumnReaderImpl.java | 70 +-
.../parquet/column/mem/TestMemPageStore.java | 33 +-
.../parquet/column/page/mem/MemPageWriter.java | 5 +-
.../statistics/geospatial/TestBoundingBox.java | 826 ++++++++
.../geospatial/TestGeospatialStatistics.java | 172 ++
.../statistics/geospatial/TestGeospatialTypes.java | 559 ++++++
.../parquet/schema/TestPrimitiveComparator.java | 23 +
parquet-common/pom.xml | 2 +-
parquet-encoding/pom.xml | 2 +-
parquet-format-structures/pom.xml | 6 +-
parquet-generator/pom.xml | 2 +-
parquet-hadoop-bundle/pom.xml | 2 +-
parquet-hadoop/README.md | 6 +-
parquet-hadoop/pom.xml | 8 +-
.../filter2/statisticslevel/StatisticsFilter.java | 2 +-
.../format/converter/ParquetMetadataConverter.java | 119 +-
.../org/apache/parquet/hadoop/CodecFactory.java | 2 +-
.../parquet/hadoop/ColumnChunkPageWriteStore.java | 24 +-
.../parquet/hadoop/ColumnIndexFilterUtils.java | 21 +-
.../hadoop/InternalParquetRecordWriter.java | 21 +-
.../apache/parquet/hadoop/ParquetFileReader.java | 81 +-
.../parquet/hadoop/ParquetFileReaderMetrics.java | 4 +-
.../apache/parquet/hadoop/ParquetFileWriter.java | 866 ++++----
.../apache/parquet/hadoop/ParquetOutputFormat.java | 24 +
.../org/apache/parquet/hadoop/ParquetReader.java | 28 +-
.../org/apache/parquet/hadoop/ParquetWriter.java | 37 +
.../hadoop/example/ExampleParquetWriter.java | 15 +
.../hadoop/metadata/ColumnChunkMetaData.java | 72 +-
.../parquet/hadoop/rewrite/ParquetRewriter.java | 3 +-
.../apache/parquet/hadoop/util/HadoopStreams.java | 13 +-
.../converter/TestParquetMetadataConverter.java | 160 ++
.../hadoop/TestByteStreamSplitConfiguration.java | 38 +-
.../hadoop/TestColumnChunkPageWriteStore.java | 1 +
.../parquet/hadoop/TestDataPageChecksums.java | 11 +-
.../parquet/hadoop/TestParquetFileWriter.java | 8 +-
.../apache/parquet/hadoop/TestParquetReader.java | 43 +
.../apache/parquet/hadoop/TestParquetWriter.java | 156 +-
.../statistics/TestGeometryTypeRoundTrip.java | 227 +++
parquet-jackson/pom.xml | 5 +-
parquet-plugins/parquet-encoding-vector/pom.xml | 31 +-
parquet-plugins/parquet-plugins-benchmarks/pom.xml | 2 +-
parquet-protobuf/pom.xml | 4 +-
.../apache/parquet/proto/ProtoWriteSupport.java | 11 +-
parquet-thrift/pom.xml | 2 +-
.../parquet/thrift/ThriftRecordConverter.java | 21 +
.../thrift/TestUUIDRecordConverterFailure.java | 61 +
parquet-variant/pom.xml | 12 +-
.../apache/parquet/variant/ImmutableMetadata.java | 47 +
.../java/org/apache/parquet/variant/Metadata.java | 28 +
.../apache/parquet/variant/MetadataBuilder.java | 78 +
.../java/org/apache/parquet/variant/Variant.java | 49 +-
.../parquet/variant/VariantArrayBuilder.java | 16 +-
.../org/apache/parquet/variant/VariantBuilder.java | 178 +-
.../apache/parquet/variant/VariantConverters.java | 746 +++++++
.../parquet/variant/VariantObjectBuilder.java | 26 +-
.../org/apache/parquet/variant/VariantUtil.java | 117 +-
.../apache/parquet/variant/VariantValueWriter.java | 375 ++++
.../parquet/variant/TestVariantObjectBuilder.java | 36 +
.../parquet/variant/TestVariantScalarBuilder.java | 74 +
.../apache/parquet/variant/VariantTestUtil.java | 11 +-
pom.xml | 53 +-
126 files changed, 10414 insertions(+), 946 deletions(-)
delete mode 100644 dev/COMMITTERS.md
create mode 100644
parquet-avro/src/main/java/org/apache/parquet/avro/AvroVariantConverter.java
create mode 100644
parquet-avro/src/test/java/org/apache/parquet/avro/TestReadVariant.java
create mode 100644
parquet-avro/src/test/java/org/apache/parquet/avro/TestWriteVariant.java
copy
parquet-cli/src/main/java/org/apache/parquet/cli/commands/{ShowSizeStatisticsCommand.java
=> ShowGeospatialStatisticsCommand.java} (61%)
copy
parquet-cli/src/{test/java/org/apache/parquet/cli/commands/CSVSchemaCommandTest.java
=> main/java/org/apache/parquet/cli/commands/ShowVersionCommand.java} (59%)
copy
parquet-cli/src/test/java/org/apache/parquet/cli/commands/{ShowPagesCommandTest.java
=> ShowGeospatialStatisticsCommandTest.java} (83%)
copy
parquet-cli/src/test/java/org/apache/parquet/cli/commands/{ShowBloomFilterCommandTest.java
=> ShowVersionCommandTest.java} (60%)
copy .github/ISSUE_TEMPLATE/config.yaml =>
parquet-cli/src/test/resources/test-config.properties (86%)
create mode 100644 parquet-cli/src/test/resources/test-config.xml
create mode 100644
parquet-column/src/main/java/org/apache/parquet/column/statistics/geospatial/BoundingBox.java
create mode 100644
parquet-column/src/main/java/org/apache/parquet/column/statistics/geospatial/GeospatialStatistics.java
create mode 100644
parquet-column/src/main/java/org/apache/parquet/column/statistics/geospatial/GeospatialTypes.java
create mode 100644
parquet-column/src/test/java/org/apache/parquet/column/ParquetPropertiesThreadSafetyTest.java
create mode 100644
parquet-column/src/test/java/org/apache/parquet/column/statistics/geospatial/TestBoundingBox.java
create mode 100644
parquet-column/src/test/java/org/apache/parquet/column/statistics/geospatial/TestGeospatialStatistics.java
create mode 100644
parquet-column/src/test/java/org/apache/parquet/column/statistics/geospatial/TestGeospatialTypes.java
copy
parquet-cli/src/test/java/org/apache/parquet/cli/commands/ShowFooterCommandTest.java
=>
parquet-hadoop/src/test/java/org/apache/parquet/hadoop/TestByteStreamSplitConfiguration.java
(50%)
create mode 100644
parquet-hadoop/src/test/java/org/apache/parquet/statistics/TestGeometryTypeRoundTrip.java
create mode 100644
parquet-thrift/src/test/java/org/apache/parquet/thrift/TestUUIDRecordConverterFailure.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/ImmutableMetadata.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/Metadata.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/MetadataBuilder.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/VariantConverters.java
create mode 100644
parquet-variant/src/main/java/org/apache/parquet/variant/VariantValueWriter.java
