This is an automated email from the ASF dual-hosted git repository.
alamb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
The following commit(s) were added to refs/heads/master by this push:
new 065c7b8f9 Prepare for 53.1.0 release (CHANGELOG and version) (#6501)
065c7b8f9 is described below
commit 065c7b8f94264eeb6a1ca23a92795fc4e0d31d51
Author: Andrew Lamb <[email protected]>
AuthorDate: Wed Oct 2 16:44:23 2024 -0400
Prepare for 53.1.0 release (CHANGELOG and version) (#6501)
* Update version to 53.0.0
* CHANGELOG
* Update changelog
* Updates
---
CHANGELOG-old.md | 285 +++++++++++++++++++++++++++++++++++++++
CHANGELOG.md | 239 ++++++++++++++------------------
Cargo.toml | 32 ++---
dev/release/update_change_log.sh | 4 +-
4 files changed, 403 insertions(+), 157 deletions(-)
diff --git a/CHANGELOG-old.md b/CHANGELOG-old.md
index 4808cde70..b42c2be80 100644
--- a/CHANGELOG-old.md
+++ b/CHANGELOG-old.md
@@ -19,6 +19,291 @@
# Historical Changelog
+- Support writing `UTC adjusted time` arrow array to parquet
[\#6277](https://github.com/apache/arrow-rs/issues/6277)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- A better way to resize the buffer for the snappy encode/decode
[\#6276](https://github.com/apache/arrow-rs/issues/6276)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- parquet\_derive: support reading selected columns from parquet file
[\#6268](https://github.com/apache/arrow-rs/issues/6268)
+- Tests for invalid parquet files
[\#6261](https://github.com/apache/arrow-rs/issues/6261)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Implement `date_part` for `Duration`
[\#6245](https://github.com/apache/arrow-rs/issues/6245)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Avoid unnecessary null buffer construction when converting arrays to a
different type [\#6243](https://github.com/apache/arrow-rs/issues/6243)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add `parquet_opendal` in related projects
[\#6235](https://github.com/apache/arrow-rs/issues/6235)
+- Look into optimizing reading FixedSizeBinary arrays from parquet
[\#6219](https://github.com/apache/arrow-rs/issues/6219)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add benchmarks for `BYTE_STREAM_SPLIT` encoded Parquet
`FIXED_LEN_BYTE_ARRAY` data
[\#6203](https://github.com/apache/arrow-rs/issues/6203)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Make it easy to write parquet to object\_store -- Implement
`AsyncFileWriter` for a type that implements `obj_store::MultipartUpload` for
`AsyncArrowWriter` [\#6200](https://github.com/apache/arrow-rs/issues/6200)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Remove test duplication in parquet statistics tets
[\#6185](https://github.com/apache/arrow-rs/issues/6185)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Support BinaryView Types in C Schema FFI
[\#6170](https://github.com/apache/arrow-rs/issues/6170)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- speedup take\_byte\_view kernel
[\#6167](https://github.com/apache/arrow-rs/issues/6167)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add support for `StringView` and `BinaryView` statistics in
`StatisticsConverter` [\#6164](https://github.com/apache/arrow-rs/issues/6164)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Support casting `BinaryView` --\> `Utf8` and `LargeUtf8`
[\#6162](https://github.com/apache/arrow-rs/issues/6162)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Implement `filter` kernel specially for `FixedSizeByteArray`
[\#6153](https://github.com/apache/arrow-rs/issues/6153)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Use `LevelHistogram` throughout Parquet metadata
[\#6134](https://github.com/apache/arrow-rs/issues/6134)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Support DoPutStatementIngest from Arrow Flight SQL 17.0
[\#6124](https://github.com/apache/arrow-rs/issues/6124)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- ColumnMetaData should no longer be written inline with data
[\#6115](https://github.com/apache/arrow-rs/issues/6115)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Implement date\_part for `Interval`
[\#6113](https://github.com/apache/arrow-rs/issues/6113)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Implement `Into<Arc<dyn Array>>` for `ArrayData`
[\#6104](https://github.com/apache/arrow-rs/issues/6104)
+- Allow flushing or non-buffered writes from
`arrow::ipc::writer::StreamWriter`
[\#6099](https://github.com/apache/arrow-rs/issues/6099)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Default block\_size for `StringViewArray`
[\#6094](https://github.com/apache/arrow-rs/issues/6094)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Remove `Statistics::has_min_max_set` and `ValueStatistics::has_min_max_set`
and use `Option` instead
[\#6093](https://github.com/apache/arrow-rs/issues/6093)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Upgrade arrow-flight to tonic 0.12
[\#6072](https://github.com/apache/arrow-rs/issues/6072)
+- Improve speed of row converter by skipping utf8 checks
[\#6058](https://github.com/apache/arrow-rs/issues/6058)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Extend support for BYTE\_STREAM\_SPLIT to FIXED\_LEN\_BYTE\_ARRAY, INT32,
and INT64 primitive types
[\#6048](https://github.com/apache/arrow-rs/issues/6048)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Release arrow-rs / parquet minor version `52.2.0` \(August 2024\)
[\#5998](https://github.com/apache/arrow-rs/issues/5998)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+
+**Fixed bugs:**
+
+- Invalid `ColumnIndex` written in parquet
[\#6310](https://github.com/apache/arrow-rs/issues/6310)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- comparison\_kernels benchmarks panic
[\#6283](https://github.com/apache/arrow-rs/issues/6283)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Printing schema metadata includes possibly incorrect compression level
[\#6270](https://github.com/apache/arrow-rs/issues/6270)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Don't panic when creating `Field` from `FFI_ArrowSchema` with no name
[\#6251](https://github.com/apache/arrow-rs/issues/6251)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- lexsort\_to\_indices should not fallback to non-lexical sort if the datatype
is not supported [\#6226](https://github.com/apache/arrow-rs/issues/6226)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Parquet Statistics null\_count does not distinguish between `0` and not
specified [\#6215](https://github.com/apache/arrow-rs/issues/6215)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Using a take kernel on a dense union can result in reaching "unreachable"
code [\#6206](https://github.com/apache/arrow-rs/issues/6206)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Adding sub day seconds to Date64 is ignored.
[\#6198](https://github.com/apache/arrow-rs/issues/6198)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- mismatch between parquet type `is_optional` codes and comment
[\#6191](https://github.com/apache/arrow-rs/issues/6191)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+
+**Documentation updates:**
+
+- Minor: improve filter documentation
[\#6317](https://github.com/apache/arrow-rs/pull/6317)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: Improve comments on GenericByteViewArray::bytes\_iter\(\),
prefix\_iter\(\) and suffix\_iter\(\)
[\#6306](https://github.com/apache/arrow-rs/pull/6306)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: improve `RowFilter` and `ArrowPredicate` docs
[\#6301](https://github.com/apache/arrow-rs/pull/6301)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Improve documentation for `MutableArrayData`
[\#6272](https://github.com/apache/arrow-rs/pull/6272)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Add examples to `StringViewBuilder` and `BinaryViewBuilder`
[\#6240](https://github.com/apache/arrow-rs/pull/6240)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- minor: enhance document for ParquetField
[\#6239](https://github.com/apache/arrow-rs/pull/6239)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([mapleFU](https://github.com/mapleFU))
+- Minor: Improve Type documentation
[\#6224](https://github.com/apache/arrow-rs/pull/6224)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: Update `DateType::Date64` docs
[\#6223](https://github.com/apache/arrow-rs/pull/6223)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Add \(more\) Parquet Metadata Documentation
[\#6184](https://github.com/apache/arrow-rs/pull/6184)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Add additional documentation and examples to `ArrayAccessor`
[\#6141](https://github.com/apache/arrow-rs/pull/6141)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: improve comments in temporal.rs tests
[\#6140](https://github.com/apache/arrow-rs/pull/6140)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: Update release schedule in README
[\#6125](https://github.com/apache/arrow-rs/pull/6125)
([alamb](https://github.com/alamb))
+
+**Closed issues:**
+
+- Simplify take octokit workflow
[\#6279](https://github.com/apache/arrow-rs/issues/6279)
+- Make the bearer token visible in FlightSqlServiceClient
[\#6253](https://github.com/apache/arrow-rs/issues/6253)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- Port `take` workflow to use `oktokit`
[\#6242](https://github.com/apache/arrow-rs/issues/6242)
+- Remove `SchemaBuilder` dependency from `StructArray` constructors
[\#6138](https://github.com/apache/arrow-rs/issues/6138)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+
+**Merged pull requests:**
+
+- Derive PartialEq and Eq for parquet::arrow::ProjectionMask
[\#6330](https://github.com/apache/arrow-rs/pull/6330)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([thinkharderdev](https://github.com/thinkharderdev))
+- Support zero column `RecordBatch`es in pyarrow integration \(use
RecordBatchOptions when converting a pyarrow RecordBatch\)
[\#6320](https://github.com/apache/arrow-rs/pull/6320)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Michael-J-Ward](https://github.com/Michael-J-Ward))
+- Fix writing of invalid Parquet ColumnIndex when row group contains null
pages [\#6319](https://github.com/apache/arrow-rs/pull/6319)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([adriangb](https://github.com/adriangb))
+- Pass empty vectors as min/max for all null pages when building ColumnIndex
[\#6316](https://github.com/apache/arrow-rs/pull/6316)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Update tonic-build requirement from =0.12.0 to =0.12.2
[\#6314](https://github.com/apache/arrow-rs/pull/6314)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Parquet: add `union` method to `RowSelection`
[\#6308](https://github.com/apache/arrow-rs/pull/6308)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([sdd](https://github.com/sdd))
+- Specialize filter for structs and sparse unions
[\#6304](https://github.com/apache/arrow-rs/pull/6304)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
+- Err on `try_from_le_slice`
[\#6295](https://github.com/apache/arrow-rs/pull/6295)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([samuelcolvin](https://github.com/samuelcolvin))
+- fix reference in doctest to size\_of which is not imported by default
[\#6286](https://github.com/apache/arrow-rs/pull/6286)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([rtyler](https://github.com/rtyler))
+- Support writing UTC adjusted time arrays to parquet
[\#6278](https://github.com/apache/arrow-rs/pull/6278)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([aykut-bozkurt](https://github.com/aykut-bozkurt))
+- Minor: `pub use ByteView` in arrow and improve documentation
[\#6275](https://github.com/apache/arrow-rs/pull/6275)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Fix accessing name from ffi schema
[\#6273](https://github.com/apache/arrow-rs/pull/6273)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kylebarron](https://github.com/kylebarron))
+- Do not print compression level in schema printer
[\#6271](https://github.com/apache/arrow-rs/pull/6271)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([ttencate](https://github.com/ttencate))
+- ci: use octokit to add assignee
[\#6267](https://github.com/apache/arrow-rs/pull/6267)
([dsgibbons](https://github.com/dsgibbons))
+- Add tests for bad parquet files
[\#6262](https://github.com/apache/arrow-rs/pull/6262)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Add `Statistics::distinct_count_opt` and deprecate
`Statistics::distinct_count`
[\#6259](https://github.com/apache/arrow-rs/pull/6259)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Minor: move `FallibleRequestStream` and `FallibleTonicResponseStream` to a
module [\#6258](https://github.com/apache/arrow-rs/pull/6258)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alamb](https://github.com/alamb))
+- Make the bearer token visible in FlightSqlServiceClient
[\#6254](https://github.com/apache/arrow-rs/pull/6254)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([ccciudatu](https://github.com/ccciudatu))
+- Use `unary()` for array conversion in Parquet array readers, speed up
`Decimal128`, `Decimal256` and `Float16`
[\#6252](https://github.com/apache/arrow-rs/pull/6252)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([etseidl](https://github.com/etseidl))
+- Update tower requirement from 0.4.13 to 0.5.0
[\#6250](https://github.com/apache/arrow-rs/pull/6250)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Implement date\_part for durations
[\#6246](https://github.com/apache/arrow-rs/pull/6246)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([nrc](https://github.com/nrc))
+- Remove unnecessary null buffer construction when converting arrays to a
different type [\#6244](https://github.com/apache/arrow-rs/pull/6244)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([etseidl](https://github.com/etseidl))
+- Implement PartialEq for GenericByteViewArray
[\#6241](https://github.com/apache/arrow-rs/pull/6241)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: Remove non standard footer from LICENSE.txt / reference to Apache
Aurora [\#6237](https://github.com/apache/arrow-rs/pull/6237)
([alamb](https://github.com/alamb))
+- docs: Add parquet\_opendal in related projects
[\#6236](https://github.com/apache/arrow-rs/pull/6236)
([Xuanwo](https://github.com/Xuanwo))
+- Avoid infinite loop in bad parquet by checking the number of rep levels
[\#6232](https://github.com/apache/arrow-rs/pull/6232)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([jp0317](https://github.com/jp0317))
+- Specialize Prefix/Suffix Match for `Like/ILike` between Array and Scalar for
StringViewArray [\#6231](https://github.com/apache/arrow-rs/pull/6231)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([xinlifoobar](https://github.com/xinlifoobar))
+- fix: lexsort\_to\_indices should not fallback to non-lexical sort if the
datatype is not supported
[\#6225](https://github.com/apache/arrow-rs/pull/6225)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Modest improvement to FixedLenByteArray BYTE\_STREAM\_SPLIT arrow decoder
[\#6222](https://github.com/apache/arrow-rs/pull/6222)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Improve performance of `FixedLengthBinary` decoding
[\#6220](https://github.com/apache/arrow-rs/pull/6220)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Update documentation for Parquet BYTE\_STREAM\_SPLIT encoding
[\#6212](https://github.com/apache/arrow-rs/pull/6212)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Improve interval parsing
[\#6211](https://github.com/apache/arrow-rs/pull/6211)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- minor: Suggest take on interleave docs
[\#6210](https://github.com/apache/arrow-rs/pull/6210)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
+- fix: Correctly handle take on dense union of a single selected type
[\#6209](https://github.com/apache/arrow-rs/pull/6209)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
+- Add time dictionary coercions
[\#6208](https://github.com/apache/arrow-rs/pull/6208)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([adriangb](https://github.com/adriangb))
+- fix\(arrow\): restrict the range of temporal values produced via `data_gen`
[\#6205](https://github.com/apache/arrow-rs/pull/6205)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kyle-mccarthy](https://github.com/kyle-mccarthy))
+- Add benchmarks for `BYTE_STREAM_SPLIT` encoded Parquet
`FIXED_LEN_BYTE_ARRAY` data
[\#6204](https://github.com/apache/arrow-rs/pull/6204)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Move `ParquetMetadataWriter` to its own module, update documentation
[\#6202](https://github.com/apache/arrow-rs/pull/6202)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Add `ThriftMetadataWriter` for writing Parquet metadata
[\#6197](https://github.com/apache/arrow-rs/pull/6197)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([adriangb](https://github.com/adriangb))
+- Update zstd-sys requirement from \>=2.0.0, \<2.0.13 to \>=2.0.0, \<2.0.14
[\#6196](https://github.com/apache/arrow-rs/pull/6196)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- fix parquet type `is_optional` comments
[\#6192](https://github.com/apache/arrow-rs/pull/6192)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([jp0317](https://github.com/jp0317))
+- Remove duplicated statistics tests in parquet
[\#6190](https://github.com/apache/arrow-rs/pull/6190)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Kev1n8](https://github.com/Kev1n8))
+- Benchmarks for `bool_and`
[\#6189](https://github.com/apache/arrow-rs/pull/6189)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([simonvandel](https://github.com/simonvandel))
+- Fix typo in documentation of Float64Array
[\#6188](https://github.com/apache/arrow-rs/pull/6188)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([mesejo](https://github.com/mesejo))
+- Make it clear that `StatisticsConverter` can not panic
[\#6187](https://github.com/apache/arrow-rs/pull/6187)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- add filter benchmark for `FixedSizeBinaryArray`
[\#6186](https://github.com/apache/arrow-rs/pull/6186)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([chloro-pn](https://github.com/chloro-pn))
+- Update sysinfo requirement from 0.30.12 to 0.31.2
[\#6182](https://github.com/apache/arrow-rs/pull/6182)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Add support for `StringView` and `BinaryView` statistics in
`StatisticsConverter` [\#6181](https://github.com/apache/arrow-rs/pull/6181)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Kev1n8](https://github.com/Kev1n8))
+- Support casting between BinaryView \<--\> Utf8 and LargeUtf8
[\#6180](https://github.com/apache/arrow-rs/pull/6180)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([xinlifoobar](https://github.com/xinlifoobar))
+- Implement specialized filter kernel for `FixedSizeByteArray`
[\#6178](https://github.com/apache/arrow-rs/pull/6178)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([chloro-pn](https://github.com/chloro-pn))
+- Support `StringView` and `BinaryView` in CDataInterface
[\#6171](https://github.com/apache/arrow-rs/pull/6171)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([a10y](https://github.com/a10y))
+- Optimize `take` kernel for `BinaryViewArray` and `StringViewArray`
[\#6168](https://github.com/apache/arrow-rs/pull/6168)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([a10y](https://github.com/a10y))
+- Support Parquet `BYTE_STREAM_SPLIT` for INT32, INT64, and
FIXED\_LEN\_BYTE\_ARRAY primitive types
[\#6159](https://github.com/apache/arrow-rs/pull/6159)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Fix comparison kernel benchmarks
[\#6147](https://github.com/apache/arrow-rs/pull/6147)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- improve `LIKE` regex performance up to 12x
[\#6145](https://github.com/apache/arrow-rs/pull/6145)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- Optimize `min_boolean` and `bool_and`
[\#6144](https://github.com/apache/arrow-rs/pull/6144)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([simonvandel](https://github.com/simonvandel))
+- Reduce bounds check in `RowIter`, add `unsafe Rows::row_unchecked`
[\#6142](https://github.com/apache/arrow-rs/pull/6142)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([XiangpengHao](https://github.com/XiangpengHao))
+- Minor: Simplify `StructArray` constructors
[\#6139](https://github.com/apache/arrow-rs/pull/6139)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Rafferty97](https://github.com/Rafferty97))
+- Implement exponential block size growing strategy for `StringViewBuilder`
[\#6136](https://github.com/apache/arrow-rs/pull/6136)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([XiangpengHao](https://github.com/XiangpengHao))
+- Use `LevelHistogram` in `PageIndex`
[\#6135](https://github.com/apache/arrow-rs/pull/6135)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Add ArrowError::ArithmeticError
[\#6130](https://github.com/apache/arrow-rs/pull/6130)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([andygrove](https://github.com/andygrove))
+- Improve `LIKE` performance for "contains" style queries
[\#6128](https://github.com/apache/arrow-rs/pull/6128)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- Add `BooleanArray::new_from_packed` and `BooleanArray::new_from_u8`
[\#6127](https://github.com/apache/arrow-rs/pull/6127)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([chloro-pn](https://github.com/chloro-pn))
+- improvements to `(i)starts_with` and `(i)ends_with` performance
[\#6118](https://github.com/apache/arrow-rs/pull/6118)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- Fix Clippy for the Rust 1.80 release
[\#6116](https://github.com/apache/arrow-rs/pull/6116)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alamb](https://github.com/alamb))
+## [53.0.0](https://github.com/apache/arrow-rs/tree/53.0.0) (2024-08-31)
+
+[Full Changelog](https://github.com/apache/arrow-rs/compare/52.2.0...53.0.0)
+
+**Breaking changes:**
+
+- parquet\_derive: Match fields by name, support reading selected fields
rather than all [\#6269](https://github.com/apache/arrow-rs/pull/6269)
([double-free](https://github.com/double-free))
+- Update parquet object\_store dependency to 0.11.0
[\#6264](https://github.com/apache/arrow-rs/pull/6264)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- parquet Statistics - deprecate `has_*` APIs and add `_opt` functions that
return `Option<T>` [\#6216](https://github.com/apache/arrow-rs/pull/6216)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Michael-J-Ward](https://github.com/Michael-J-Ward))
+- Expose bulk ingest in flight sql client and server
[\#6201](https://github.com/apache/arrow-rs/pull/6201)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([djanderson](https://github.com/djanderson))
+- Upgrade protobuf definitions to flightsql 17.0 \(\#6133\)
[\#6169](https://github.com/apache/arrow-rs/pull/6169)
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alamb](https://github.com/alamb))
+- Remove automatic buffering in `ipc::reader::FileReader` for for consistent
buffering [\#6132](https://github.com/apache/arrow-rs/pull/6132)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([V0ldek](https://github.com/V0ldek))
+- No longer write Parquet column metadata after column chunks \*and\* in the
footer [\#6117](https://github.com/apache/arrow-rs/pull/6117)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Remove `impl<T: AsRef<[u8]>> From<T> for Buffer` that easily accidentally
copies data [\#6043](https://github.com/apache/arrow-rs/pull/6043)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([XiangpengHao](https://github.com/XiangpengHao))
+
+**Implemented enhancements:**
+
+- Derive `PartialEq` and `Eq` for `parquet::arrow::ProjectionMask`
[\#6329](https://github.com/apache/arrow-rs/issues/6329)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Allow converting empty `pyarrow.RecordBatch` to `arrow::RecordBatch`
[\#6318](https://github.com/apache/arrow-rs/issues/6318)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Parquet writer should not write any min/max data to ColumnIndex when all
values are null [\#6315](https://github.com/apache/arrow-rs/issues/6315)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Parquet: Add `union` method to `RowSelection`
[\#6307](https://github.com/apache/arrow-rs/issues/6307)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Support writing `UTC adjusted time` arrow array to parquet
[\#6277](https://github.com/apache/arrow-rs/issues/6277)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- A better way to resize the buffer for the snappy encode/decode
[\#6276](https://github.com/apache/arrow-rs/issues/6276)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- parquet\_derive: support reading selected columns from parquet file
[\#6268](https://github.com/apache/arrow-rs/issues/6268)
+- Tests for invalid parquet files
[\#6261](https://github.com/apache/arrow-rs/issues/6261)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Implement `date_part` for `Duration`
[\#6245](https://github.com/apache/arrow-rs/issues/6245)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Avoid unnecessary null buffer construction when converting arrays to a
different type [\#6243](https://github.com/apache/arrow-rs/issues/6243)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add `parquet_opendal` in related projects
[\#6235](https://github.com/apache/arrow-rs/issues/6235)
+- Look into optimizing reading FixedSizeBinary arrays from parquet
[\#6219](https://github.com/apache/arrow-rs/issues/6219)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add benchmarks for `BYTE_STREAM_SPLIT` encoded Parquet
`FIXED_LEN_BYTE_ARRAY` data
[\#6203](https://github.com/apache/arrow-rs/issues/6203)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Make it easy to write parquet to object\_store -- Implement
`AsyncFileWriter` for a type that implements `obj_store::MultipartUpload` for
`AsyncArrowWriter` [\#6200](https://github.com/apache/arrow-rs/issues/6200)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Remove test duplication in parquet statistics tets
[\#6185](https://github.com/apache/arrow-rs/issues/6185)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Support BinaryView Types in C Schema FFI
[\#6170](https://github.com/apache/arrow-rs/issues/6170)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- speedup take\_byte\_view kernel
[\#6167](https://github.com/apache/arrow-rs/issues/6167)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add support for `StringView` and `BinaryView` statistics in
`StatisticsConverter` [\#6164](https://github.com/apache/arrow-rs/issues/6164)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Support casting `BinaryView` --\> `Utf8` and `LargeUtf8`
[\#6162](https://github.com/apache/arrow-rs/issues/6162)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Implement `filter` kernel specially for `FixedSizeByteArray`
[\#6153](https://github.com/apache/arrow-rs/issues/6153)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Use `LevelHistogram` throughout Parquet metadata
[\#6134](https://github.com/apache/arrow-rs/issues/6134)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Support DoPutStatementIngest from Arrow Flight SQL 17.0
[\#6124](https://github.com/apache/arrow-rs/issues/6124)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- ColumnMetaData should no longer be written inline with data
[\#6115](https://github.com/apache/arrow-rs/issues/6115)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Implement date\_part for `Interval`
[\#6113](https://github.com/apache/arrow-rs/issues/6113)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Implement `Into<Arc<dyn Array>>` for `ArrayData`
[\#6104](https://github.com/apache/arrow-rs/issues/6104)
+- Allow flushing or non-buffered writes from
`arrow::ipc::writer::StreamWriter`
[\#6099](https://github.com/apache/arrow-rs/issues/6099)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Default block\_size for `StringViewArray`
[\#6094](https://github.com/apache/arrow-rs/issues/6094)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Remove `Statistics::has_min_max_set` and `ValueStatistics::has_min_max_set`
and use `Option` instead
[\#6093](https://github.com/apache/arrow-rs/issues/6093)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Upgrade arrow-flight to tonic 0.12
[\#6072](https://github.com/apache/arrow-rs/issues/6072)
+- Improve speed of row converter by skipping utf8 checks
[\#6058](https://github.com/apache/arrow-rs/issues/6058)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Extend support for BYTE\_STREAM\_SPLIT to FIXED\_LEN\_BYTE\_ARRAY, INT32,
and INT64 primitive types
[\#6048](https://github.com/apache/arrow-rs/issues/6048)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Release arrow-rs / parquet minor version `52.2.0` \(August 2024\)
[\#5998](https://github.com/apache/arrow-rs/issues/5998)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+
+**Fixed bugs:**
+
+- Invalid `ColumnIndex` written in parquet
[\#6310](https://github.com/apache/arrow-rs/issues/6310)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- comparison\_kernels benchmarks panic
[\#6283](https://github.com/apache/arrow-rs/issues/6283)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Printing schema metadata includes possibly incorrect compression level
[\#6270](https://github.com/apache/arrow-rs/issues/6270)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Don't panic when creating `Field` from `FFI_ArrowSchema` with no name
[\#6251](https://github.com/apache/arrow-rs/issues/6251)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- lexsort\_to\_indices should not fallback to non-lexical sort if the datatype
is not supported [\#6226](https://github.com/apache/arrow-rs/issues/6226)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Parquet Statistics null\_count does not distinguish between `0` and not
specified [\#6215](https://github.com/apache/arrow-rs/issues/6215)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Using a take kernel on a dense union can result in reaching "unreachable"
code [\#6206](https://github.com/apache/arrow-rs/issues/6206)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Adding sub day seconds to Date64 is ignored.
[\#6198](https://github.com/apache/arrow-rs/issues/6198)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- mismatch between parquet type `is_optional` codes and comment
[\#6191](https://github.com/apache/arrow-rs/issues/6191)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+
+**Documentation updates:**
+
+- Minor: improve filter documentation
[\#6317](https://github.com/apache/arrow-rs/pull/6317)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: Improve comments on GenericByteViewArray::bytes\_iter\(\),
prefix\_iter\(\) and suffix\_iter\(\)
[\#6306](https://github.com/apache/arrow-rs/pull/6306)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: improve `RowFilter` and `ArrowPredicate` docs
[\#6301](https://github.com/apache/arrow-rs/pull/6301)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Improve documentation for `MutableArrayData`
[\#6272](https://github.com/apache/arrow-rs/pull/6272)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Add examples to `StringViewBuilder` and `BinaryViewBuilder`
[\#6240](https://github.com/apache/arrow-rs/pull/6240)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- minor: enhance document for ParquetField
[\#6239](https://github.com/apache/arrow-rs/pull/6239)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([mapleFU](https://github.com/mapleFU))
+- Minor: Improve Type documentation
[\#6224](https://github.com/apache/arrow-rs/pull/6224)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: Update `DateType::Date64` docs
[\#6223](https://github.com/apache/arrow-rs/pull/6223)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Add \(more\) Parquet Metadata Documentation
[\#6184](https://github.com/apache/arrow-rs/pull/6184)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Add additional documentation and examples to `ArrayAccessor`
[\#6141](https://github.com/apache/arrow-rs/pull/6141)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: improve comments in temporal.rs tests
[\#6140](https://github.com/apache/arrow-rs/pull/6140)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: Update release schedule in README
[\#6125](https://github.com/apache/arrow-rs/pull/6125)
([alamb](https://github.com/alamb))
+
+**Closed issues:**
+
+- Simplify take octokit workflow
[\#6279](https://github.com/apache/arrow-rs/issues/6279)
+- Make the bearer token visible in FlightSqlServiceClient
[\#6253](https://github.com/apache/arrow-rs/issues/6253)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- Port `take` workflow to use `oktokit`
[\#6242](https://github.com/apache/arrow-rs/issues/6242)
+- Remove `SchemaBuilder` dependency from `StructArray` constructors
[\#6138](https://github.com/apache/arrow-rs/issues/6138)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+
+**Merged pull requests:**
+
+- Derive PartialEq and Eq for parquet::arrow::ProjectionMask
[\#6330](https://github.com/apache/arrow-rs/pull/6330)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([thinkharderdev](https://github.com/thinkharderdev))
+- Support zero column `RecordBatch`es in pyarrow integration \(use
RecordBatchOptions when converting a pyarrow RecordBatch\)
[\#6320](https://github.com/apache/arrow-rs/pull/6320)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Michael-J-Ward](https://github.com/Michael-J-Ward))
+- Fix writing of invalid Parquet ColumnIndex when row group contains null
pages [\#6319](https://github.com/apache/arrow-rs/pull/6319)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([adriangb](https://github.com/adriangb))
+- Pass empty vectors as min/max for all null pages when building ColumnIndex
[\#6316](https://github.com/apache/arrow-rs/pull/6316)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Update tonic-build requirement from =0.12.0 to =0.12.2
[\#6314](https://github.com/apache/arrow-rs/pull/6314)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Parquet: add `union` method to `RowSelection`
[\#6308](https://github.com/apache/arrow-rs/pull/6308)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([sdd](https://github.com/sdd))
+- Specialize filter for structs and sparse unions
[\#6304](https://github.com/apache/arrow-rs/pull/6304)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
+- Err on `try_from_le_slice`
[\#6295](https://github.com/apache/arrow-rs/pull/6295)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([samuelcolvin](https://github.com/samuelcolvin))
+- fix reference in doctest to size\_of which is not imported by default
[\#6286](https://github.com/apache/arrow-rs/pull/6286)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([rtyler](https://github.com/rtyler))
+- Support writing UTC adjusted time arrays to parquet
[\#6278](https://github.com/apache/arrow-rs/pull/6278)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([aykut-bozkurt](https://github.com/aykut-bozkurt))
+- Minor: `pub use ByteView` in arrow and improve documentation
[\#6275](https://github.com/apache/arrow-rs/pull/6275)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Fix accessing name from ffi schema
[\#6273](https://github.com/apache/arrow-rs/pull/6273)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kylebarron](https://github.com/kylebarron))
+- Do not print compression level in schema printer
[\#6271](https://github.com/apache/arrow-rs/pull/6271)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([ttencate](https://github.com/ttencate))
+- ci: use octokit to add assignee
[\#6267](https://github.com/apache/arrow-rs/pull/6267)
([dsgibbons](https://github.com/dsgibbons))
+- Add tests for bad parquet files
[\#6262](https://github.com/apache/arrow-rs/pull/6262)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Add `Statistics::distinct_count_opt` and deprecate
`Statistics::distinct_count`
[\#6259](https://github.com/apache/arrow-rs/pull/6259)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Minor: move `FallibleRequestStream` and `FallibleTonicResponseStream` to a
module [\#6258](https://github.com/apache/arrow-rs/pull/6258)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alamb](https://github.com/alamb))
+- Make the bearer token visible in FlightSqlServiceClient
[\#6254](https://github.com/apache/arrow-rs/pull/6254)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([ccciudatu](https://github.com/ccciudatu))
+- Use `unary()` for array conversion in Parquet array readers, speed up
`Decimal128`, `Decimal256` and `Float16`
[\#6252](https://github.com/apache/arrow-rs/pull/6252)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([etseidl](https://github.com/etseidl))
+- Update tower requirement from 0.4.13 to 0.5.0
[\#6250](https://github.com/apache/arrow-rs/pull/6250)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Implement date\_part for durations
[\#6246](https://github.com/apache/arrow-rs/pull/6246)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([nrc](https://github.com/nrc))
+- Remove unnecessary null buffer construction when converting arrays to a
different type [\#6244](https://github.com/apache/arrow-rs/pull/6244)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([etseidl](https://github.com/etseidl))
+- Implement PartialEq for GenericByteViewArray
[\#6241](https://github.com/apache/arrow-rs/pull/6241)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Minor: Remove non standard footer from LICENSE.txt / reference to Apache
Aurora [\#6237](https://github.com/apache/arrow-rs/pull/6237)
([alamb](https://github.com/alamb))
+- docs: Add parquet\_opendal in related projects
[\#6236](https://github.com/apache/arrow-rs/pull/6236)
([Xuanwo](https://github.com/Xuanwo))
+- Avoid infinite loop in bad parquet by checking the number of rep levels
[\#6232](https://github.com/apache/arrow-rs/pull/6232)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([jp0317](https://github.com/jp0317))
+- Specialize Prefix/Suffix Match for `Like/ILike` between Array and Scalar for
StringViewArray [\#6231](https://github.com/apache/arrow-rs/pull/6231)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([xinlifoobar](https://github.com/xinlifoobar))
+- fix: lexsort\_to\_indices should not fallback to non-lexical sort if the
datatype is not supported
[\#6225](https://github.com/apache/arrow-rs/pull/6225)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Modest improvement to FixedLenByteArray BYTE\_STREAM\_SPLIT arrow decoder
[\#6222](https://github.com/apache/arrow-rs/pull/6222)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Improve performance of `FixedLengthBinary` decoding
[\#6220](https://github.com/apache/arrow-rs/pull/6220)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Update documentation for Parquet BYTE\_STREAM\_SPLIT encoding
[\#6212](https://github.com/apache/arrow-rs/pull/6212)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Improve interval parsing
[\#6211](https://github.com/apache/arrow-rs/pull/6211)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- minor: Suggest take on interleave docs
[\#6210](https://github.com/apache/arrow-rs/pull/6210)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
+- fix: Correctly handle take on dense union of a single selected type
[\#6209](https://github.com/apache/arrow-rs/pull/6209)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
+- Add time dictionary coercions
[\#6208](https://github.com/apache/arrow-rs/pull/6208)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([adriangb](https://github.com/adriangb))
+- fix\(arrow\): restrict the range of temporal values produced via `data_gen`
[\#6205](https://github.com/apache/arrow-rs/pull/6205)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kyle-mccarthy](https://github.com/kyle-mccarthy))
+- Add benchmarks for `BYTE_STREAM_SPLIT` encoded Parquet
`FIXED_LEN_BYTE_ARRAY` data
[\#6204](https://github.com/apache/arrow-rs/pull/6204)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Move `ParquetMetadataWriter` to its own module, update documentation
[\#6202](https://github.com/apache/arrow-rs/pull/6202)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Add `ThriftMetadataWriter` for writing Parquet metadata
[\#6197](https://github.com/apache/arrow-rs/pull/6197)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([adriangb](https://github.com/adriangb))
+- Update zstd-sys requirement from \>=2.0.0, \<2.0.13 to \>=2.0.0, \<2.0.14
[\#6196](https://github.com/apache/arrow-rs/pull/6196)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- fix parquet type `is_optional` comments
[\#6192](https://github.com/apache/arrow-rs/pull/6192)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([jp0317](https://github.com/jp0317))
+- Remove duplicated statistics tests in parquet
[\#6190](https://github.com/apache/arrow-rs/pull/6190)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Kev1n8](https://github.com/Kev1n8))
+- Benchmarks for `bool_and`
[\#6189](https://github.com/apache/arrow-rs/pull/6189)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([simonvandel](https://github.com/simonvandel))
+- Fix typo in documentation of Float64Array
[\#6188](https://github.com/apache/arrow-rs/pull/6188)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([mesejo](https://github.com/mesejo))
+- Make it clear that `StatisticsConverter` can not panic
[\#6187](https://github.com/apache/arrow-rs/pull/6187)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- add filter benchmark for `FixedSizeBinaryArray`
[\#6186](https://github.com/apache/arrow-rs/pull/6186)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([chloro-pn](https://github.com/chloro-pn))
+- Update sysinfo requirement from 0.30.12 to 0.31.2
[\#6182](https://github.com/apache/arrow-rs/pull/6182)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Add support for `StringView` and `BinaryView` statistics in
`StatisticsConverter` [\#6181](https://github.com/apache/arrow-rs/pull/6181)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Kev1n8](https://github.com/Kev1n8))
+- Support casting between BinaryView \<--\> Utf8 and LargeUtf8
[\#6180](https://github.com/apache/arrow-rs/pull/6180)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([xinlifoobar](https://github.com/xinlifoobar))
+- Implement specialized filter kernel for `FixedSizeByteArray`
[\#6178](https://github.com/apache/arrow-rs/pull/6178)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([chloro-pn](https://github.com/chloro-pn))
+- Support `StringView` and `BinaryView` in CDataInterface
[\#6171](https://github.com/apache/arrow-rs/pull/6171)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([a10y](https://github.com/a10y))
+- Optimize `take` kernel for `BinaryViewArray` and `StringViewArray`
[\#6168](https://github.com/apache/arrow-rs/pull/6168)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([a10y](https://github.com/a10y))
+- Support Parquet `BYTE_STREAM_SPLIT` for INT32, INT64, and
FIXED\_LEN\_BYTE\_ARRAY primitive types
[\#6159](https://github.com/apache/arrow-rs/pull/6159)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Fix comparison kernel benchmarks
[\#6147](https://github.com/apache/arrow-rs/pull/6147)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- improve `LIKE` regex performance up to 12x
[\#6145](https://github.com/apache/arrow-rs/pull/6145)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- Optimize `min_boolean` and `bool_and`
[\#6144](https://github.com/apache/arrow-rs/pull/6144)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([simonvandel](https://github.com/simonvandel))
+- Reduce bounds check in `RowIter`, add `unsafe Rows::row_unchecked`
[\#6142](https://github.com/apache/arrow-rs/pull/6142)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([XiangpengHao](https://github.com/XiangpengHao))
+- Minor: Simplify `StructArray` constructors
[\#6139](https://github.com/apache/arrow-rs/pull/6139)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Rafferty97](https://github.com/Rafferty97))
+- Implement exponential block size growing strategy for `StringViewBuilder`
[\#6136](https://github.com/apache/arrow-rs/pull/6136)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([XiangpengHao](https://github.com/XiangpengHao))
+- Use `LevelHistogram` in `PageIndex`
[\#6135](https://github.com/apache/arrow-rs/pull/6135)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Add ArrowError::ArithmeticError
[\#6130](https://github.com/apache/arrow-rs/pull/6130)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([andygrove](https://github.com/andygrove))
+- Improve `LIKE` performance for "contains" style queries
[\#6128](https://github.com/apache/arrow-rs/pull/6128)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- Add `BooleanArray::new_from_packed` and `BooleanArray::new_from_u8`
[\#6127](https://github.com/apache/arrow-rs/pull/6127)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([chloro-pn](https://github.com/chloro-pn))
+- improvements to `(i)starts_with` and `(i)ends_with` performance
[\#6118](https://github.com/apache/arrow-rs/pull/6118)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- Fix Clippy for the Rust 1.80 release
[\#6116](https://github.com/apache/arrow-rs/pull/6116)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alamb](https://github.com/alamb))
+- added a flush method to IPC writers
[\#6108](https://github.com/apache/arrow-rs/pull/6108)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([V0ldek](https://github.com/V0ldek))
+- Add support for level histograms added in PARQUET-2261 to `ParquetMetaData`
[\#6105](https://github.com/apache/arrow-rs/pull/6105)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Implement date\_part for intervals
[\#6071](https://github.com/apache/arrow-rs/pull/6071)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([nrc](https://github.com/nrc))
+- feat\(parquet\): Implement AsyncFileWriter for
`object_store::buffered::BufWriter`
[\#6013](https://github.com/apache/arrow-rs/pull/6013)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Xuanwo](https://github.com/Xuanwo))
## [52.2.0](https://github.com/apache/arrow-rs/tree/52.2.0) (2024-07-24)
[Full Changelog](https://github.com/apache/arrow-rs/compare/52.1.0...52.2.0)
diff --git a/CHANGELOG.md b/CHANGELOG.md
index 20c13ffeb..60c44732b 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -19,161 +19,122 @@
# Changelog
-## [53.0.0](https://github.com/apache/arrow-rs/tree/53.0.0) (2024-08-31)
+## [53.1.0](https://github.com/apache/arrow-rs/tree/53.1.0) (2024-10-02)
-[Full Changelog](https://github.com/apache/arrow-rs/compare/52.2.0...53.0.0)
-
-**Breaking changes:**
-
-- parquet\_derive: Match fields by name, support reading selected fields
rather than all [\#6269](https://github.com/apache/arrow-rs/pull/6269)
([double-free](https://github.com/double-free))
-- Update parquet object\_store dependency to 0.11.0
[\#6264](https://github.com/apache/arrow-rs/pull/6264)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
-- parquet Statistics - deprecate `has_*` APIs and add `_opt` functions that
return `Option<T>` [\#6216](https://github.com/apache/arrow-rs/pull/6216)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Michael-J-Ward](https://github.com/Michael-J-Ward))
-- Expose bulk ingest in flight sql client and server
[\#6201](https://github.com/apache/arrow-rs/pull/6201)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([djanderson](https://github.com/djanderson))
-- Upgrade protobuf definitions to flightsql 17.0 \(\#6133\)
[\#6169](https://github.com/apache/arrow-rs/pull/6169)
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alamb](https://github.com/alamb))
-- Remove automatic buffering in `ipc::reader::FileReader` for for consistent
buffering [\#6132](https://github.com/apache/arrow-rs/pull/6132)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([V0ldek](https://github.com/V0ldek))
-- No longer write Parquet column metadata after column chunks \*and\* in the
footer [\#6117](https://github.com/apache/arrow-rs/pull/6117)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
-- Remove `impl<T: AsRef<[u8]>> From<T> for Buffer` that easily accidentally
copies data [\#6043](https://github.com/apache/arrow-rs/pull/6043)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([XiangpengHao](https://github.com/XiangpengHao))
+[Full Changelog](https://github.com/apache/arrow-rs/compare/53.0.0...53.1.0)
**Implemented enhancements:**
-- Derive `PartialEq` and `Eq` for `parquet::arrow::ProjectionMask`
[\#6329](https://github.com/apache/arrow-rs/issues/6329)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Allow converting empty `pyarrow.RecordBatch` to `arrow::RecordBatch`
[\#6318](https://github.com/apache/arrow-rs/issues/6318)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Parquet writer should not write any min/max data to ColumnIndex when all
values are null [\#6315](https://github.com/apache/arrow-rs/issues/6315)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Parquet: Add `union` method to `RowSelection`
[\#6307](https://github.com/apache/arrow-rs/issues/6307)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Support writing `UTC adjusted time` arrow array to parquet
[\#6277](https://github.com/apache/arrow-rs/issues/6277)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- A better way to resize the buffer for the snappy encode/decode
[\#6276](https://github.com/apache/arrow-rs/issues/6276)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- parquet\_derive: support reading selected columns from parquet file
[\#6268](https://github.com/apache/arrow-rs/issues/6268)
-- Tests for invalid parquet files
[\#6261](https://github.com/apache/arrow-rs/issues/6261)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Implement `date_part` for `Duration`
[\#6245](https://github.com/apache/arrow-rs/issues/6245)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Avoid unnecessary null buffer construction when converting arrays to a
different type [\#6243](https://github.com/apache/arrow-rs/issues/6243)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Add `parquet_opendal` in related projects
[\#6235](https://github.com/apache/arrow-rs/issues/6235)
-- Look into optimizing reading FixedSizeBinary arrays from parquet
[\#6219](https://github.com/apache/arrow-rs/issues/6219)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Add benchmarks for `BYTE_STREAM_SPLIT` encoded Parquet
`FIXED_LEN_BYTE_ARRAY` data
[\#6203](https://github.com/apache/arrow-rs/issues/6203)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Make it easy to write parquet to object\_store -- Implement
`AsyncFileWriter` for a type that implements `obj_store::MultipartUpload` for
`AsyncArrowWriter` [\#6200](https://github.com/apache/arrow-rs/issues/6200)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Remove test duplication in parquet statistics tets
[\#6185](https://github.com/apache/arrow-rs/issues/6185)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Support BinaryView Types in C Schema FFI
[\#6170](https://github.com/apache/arrow-rs/issues/6170)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- speedup take\_byte\_view kernel
[\#6167](https://github.com/apache/arrow-rs/issues/6167)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Add support for `StringView` and `BinaryView` statistics in
`StatisticsConverter` [\#6164](https://github.com/apache/arrow-rs/issues/6164)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Support casting `BinaryView` --\> `Utf8` and `LargeUtf8`
[\#6162](https://github.com/apache/arrow-rs/issues/6162)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Implement `filter` kernel specially for `FixedSizeByteArray`
[\#6153](https://github.com/apache/arrow-rs/issues/6153)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Use `LevelHistogram` throughout Parquet metadata
[\#6134](https://github.com/apache/arrow-rs/issues/6134)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Support DoPutStatementIngest from Arrow Flight SQL 17.0
[\#6124](https://github.com/apache/arrow-rs/issues/6124)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
-- ColumnMetaData should no longer be written inline with data
[\#6115](https://github.com/apache/arrow-rs/issues/6115)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Implement date\_part for `Interval`
[\#6113](https://github.com/apache/arrow-rs/issues/6113)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Implement `Into<Arc<dyn Array>>` for `ArrayData`
[\#6104](https://github.com/apache/arrow-rs/issues/6104)
-- Allow flushing or non-buffered writes from
`arrow::ipc::writer::StreamWriter`
[\#6099](https://github.com/apache/arrow-rs/issues/6099)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Default block\_size for `StringViewArray`
[\#6094](https://github.com/apache/arrow-rs/issues/6094)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Remove `Statistics::has_min_max_set` and `ValueStatistics::has_min_max_set`
and use `Option` instead
[\#6093](https://github.com/apache/arrow-rs/issues/6093)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Upgrade arrow-flight to tonic 0.12
[\#6072](https://github.com/apache/arrow-rs/issues/6072)
-- Improve speed of row converter by skipping utf8 checks
[\#6058](https://github.com/apache/arrow-rs/issues/6058)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Extend support for BYTE\_STREAM\_SPLIT to FIXED\_LEN\_BYTE\_ARRAY, INT32,
and INT64 primitive types
[\#6048](https://github.com/apache/arrow-rs/issues/6048)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Release arrow-rs / parquet minor version `52.2.0` \(August 2024\)
[\#5998](https://github.com/apache/arrow-rs/issues/5998)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Write null counts in Parquet statistics when they are known to be zero
[\#6502](https://github.com/apache/arrow-rs/issues/6502)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Make it easier to find / work with `ByteView`
[\#6478](https://github.com/apache/arrow-rs/issues/6478)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Update lexical-core version due to soundness issues with current version
[\#6468](https://github.com/apache/arrow-rs/issues/6468)
+- Add builder style API for manipulating `ParquetMetaData`
[\#6465](https://github.com/apache/arrow-rs/issues/6465)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- `ArrayData.align_buffers` should support `Struct` data type / child data
[\#6461](https://github.com/apache/arrow-rs/issues/6461)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add a method to return the number of skipped rows in a `RowSelection`
[\#6428](https://github.com/apache/arrow-rs/issues/6428)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Bump lexical-core to 1.0
[\#6397](https://github.com/apache/arrow-rs/issues/6397)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add union\_extract kernel
[\#6386](https://github.com/apache/arrow-rs/issues/6386)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- implement `regexp_is_match_utf8` and `regexp_is_match_utf8_scalar` for
`StringViewArray` [\#6370](https://github.com/apache/arrow-rs/issues/6370)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add support for BinaryView in arrow\_string::length
[\#6358](https://github.com/apache/arrow-rs/issues/6358)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add `as_union` to `AsArray`
[\#6351](https://github.com/apache/arrow-rs/issues/6351)
+- Ability to append non contiguous strings to `StringBuilder`
[\#6347](https://github.com/apache/arrow-rs/issues/6347)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add Catalog DB Schema subcommands to `flight_sql_client`
[\#6331](https://github.com/apache/arrow-rs/issues/6331)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- Add support for Utf8View in arrow\_string::length
[\#6305](https://github.com/apache/arrow-rs/issues/6305)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Reading FIXED\_LEN\_BYTE\_ARRAY columns with nulls is inefficient
[\#6296](https://github.com/apache/arrow-rs/issues/6296)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Optionally verify 32-bit CRC checksum when decoding parquet pages
[\#6289](https://github.com/apache/arrow-rs/issues/6289)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Speed up `pad_nulls` for `FixedLenByteArrayBuffer`
[\#6297](https://github.com/apache/arrow-rs/pull/6297)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Improve performance of set\_bits by avoiding to set individual bits
[\#6288](https://github.com/apache/arrow-rs/pull/6288)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kazuyukitanimura](https://github.com/kazuyukitanimura))
**Fixed bugs:**
-- Invalid `ColumnIndex` written in parquet
[\#6310](https://github.com/apache/arrow-rs/issues/6310)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- comparison\_kernels benchmarks panic
[\#6283](https://github.com/apache/arrow-rs/issues/6283)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Printing schema metadata includes possibly incorrect compression level
[\#6270](https://github.com/apache/arrow-rs/issues/6270)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Don't panic when creating `Field` from `FFI_ArrowSchema` with no name
[\#6251](https://github.com/apache/arrow-rs/issues/6251)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- lexsort\_to\_indices should not fallback to non-lexical sort if the datatype
is not supported [\#6226](https://github.com/apache/arrow-rs/issues/6226)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Parquet Statistics null\_count does not distinguish between `0` and not
specified [\#6215](https://github.com/apache/arrow-rs/issues/6215)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Using a take kernel on a dense union can result in reaching "unreachable"
code [\#6206](https://github.com/apache/arrow-rs/issues/6206)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Adding sub day seconds to Date64 is ignored.
[\#6198](https://github.com/apache/arrow-rs/issues/6198)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- mismatch between parquet type `is_optional` codes and comment
[\#6191](https://github.com/apache/arrow-rs/issues/6191)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- BitIterator panics when retrieving length
[\#6480](https://github.com/apache/arrow-rs/issues/6480)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Flight data retrieved via Python client \(wrapping C++\) cannot be used by
Rust Arrow [\#6471](https://github.com/apache/arrow-rs/issues/6471)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- CI integration test failing: Archery test With other arrows
[\#6448](https://github.com/apache/arrow-rs/issues/6448)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- IPC not respecting not preserving dict ID
[\#6443](https://github.com/apache/arrow-rs/issues/6443)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- Failing CI: Prost requires Rust 1.71.1
[\#6436](https://github.com/apache/arrow-rs/issues/6436)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- Invalid struct arrays in IPC data causes panic during read
[\#6416](https://github.com/apache/arrow-rs/issues/6416)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- REE Dicts cannot be encoded/decoded with streaming IPC
[\#6398](https://github.com/apache/arrow-rs/issues/6398)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Reading json `map` with non-nullable value schema doesn't error if values
are actually null [\#6391](https://github.com/apache/arrow-rs/issues/6391)
+- StringViewBuilder with deduplication does not clear observed values
[\#6384](https://github.com/apache/arrow-rs/issues/6384)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Cast from Decimal\(p, s\) to dictionary-encoded Decimal\(p, s\) loses
precision and scale [\#6381](https://github.com/apache/arrow-rs/issues/6381)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- LocalFileSystem `list` operation returns objects in wrong order
[\#6375](https://github.com/apache/arrow-rs/issues/6375)
+- `compute::binary_mut` returns `Err(PrimitiveArray<T>)` only with certain
arrays [\#6374](https://github.com/apache/arrow-rs/issues/6374)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Exporting Binary/Utf8View from arrow-rs to pyarrow fails
[\#6366](https://github.com/apache/arrow-rs/issues/6366)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- warning: methods `as_any` and `next_batch` are never used in `parquet` crate
[\#6143](https://github.com/apache/arrow-rs/issues/6143)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
**Documentation updates:**
-- Minor: improve filter documentation
[\#6317](https://github.com/apache/arrow-rs/pull/6317)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Minor: Improve comments on GenericByteViewArray::bytes\_iter\(\),
prefix\_iter\(\) and suffix\_iter\(\)
[\#6306](https://github.com/apache/arrow-rs/pull/6306)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Minor: improve `RowFilter` and `ArrowPredicate` docs
[\#6301](https://github.com/apache/arrow-rs/pull/6301)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
-- Improve documentation for `MutableArrayData`
[\#6272](https://github.com/apache/arrow-rs/pull/6272)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Add examples to `StringViewBuilder` and `BinaryViewBuilder`
[\#6240](https://github.com/apache/arrow-rs/pull/6240)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- minor: enhance document for ParquetField
[\#6239](https://github.com/apache/arrow-rs/pull/6239)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([mapleFU](https://github.com/mapleFU))
-- Minor: Improve Type documentation
[\#6224](https://github.com/apache/arrow-rs/pull/6224)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Minor: Update `DateType::Date64` docs
[\#6223](https://github.com/apache/arrow-rs/pull/6223)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Add \(more\) Parquet Metadata Documentation
[\#6184](https://github.com/apache/arrow-rs/pull/6184)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
-- Add additional documentation and examples to `ArrayAccessor`
[\#6141](https://github.com/apache/arrow-rs/pull/6141)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Minor: improve comments in temporal.rs tests
[\#6140](https://github.com/apache/arrow-rs/pull/6140)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Minor: Update release schedule in README
[\#6125](https://github.com/apache/arrow-rs/pull/6125)
([alamb](https://github.com/alamb))
+- chore: add docs, part of \#37
[\#6496](https://github.com/apache/arrow-rs/pull/6496)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([ByteBaker](https://github.com/ByteBaker))
+- Minor: improve `ChunkedReader` docs
[\#6477](https://github.com/apache/arrow-rs/pull/6477)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Minor: Add some missing documentation to fix CI errors
[\#6445](https://github.com/apache/arrow-rs/pull/6445)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([etseidl](https://github.com/etseidl))
+- Fix doc "bit width" to "byte width"
[\#6434](https://github.com/apache/arrow-rs/pull/6434)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kylebarron](https://github.com/kylebarron))
+- chore: add docs, part of \#37
[\#6433](https://github.com/apache/arrow-rs/pull/6433)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([ByteBaker](https://github.com/ByteBaker))
+- chore: add docs, part of \#37
[\#6424](https://github.com/apache/arrow-rs/pull/6424)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([ByteBaker](https://github.com/ByteBaker))
+- Rephrase doc comment [\#6421](https://github.com/apache/arrow-rs/pull/6421)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([waynexia](https://github.com/waynexia))
+- Remove "NOT YET FULLY SUPPORTED" comment from DataType::Utf8View/BinaryView
[\#6380](https://github.com/apache/arrow-rs/pull/6380)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Improve `GenericStringBuilder` documentation
[\#6372](https://github.com/apache/arrow-rs/pull/6372)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
**Closed issues:**
-- Simplify take octokit workflow
[\#6279](https://github.com/apache/arrow-rs/issues/6279)
-- Make the bearer token visible in FlightSqlServiceClient
[\#6253](https://github.com/apache/arrow-rs/issues/6253)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
-- Port `take` workflow to use `oktokit`
[\#6242](https://github.com/apache/arrow-rs/issues/6242)
-- Remove `SchemaBuilder` dependency from `StructArray` constructors
[\#6138](https://github.com/apache/arrow-rs/issues/6138)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Columnar json writer for arrow-json
[\#6411](https://github.com/apache/arrow-rs/issues/6411)
+- Primitive `binary`/`unary` are not as fast as they could be
[\#6364](https://github.com/apache/arrow-rs/issues/6364)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Different numeric type may be able to compare
[\#6357](https://github.com/apache/arrow-rs/issues/6357)
**Merged pull requests:**
-- Derive PartialEq and Eq for parquet::arrow::ProjectionMask
[\#6330](https://github.com/apache/arrow-rs/pull/6330)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([thinkharderdev](https://github.com/thinkharderdev))
-- Support zero column `RecordBatch`es in pyarrow integration \(use
RecordBatchOptions when converting a pyarrow RecordBatch\)
[\#6320](https://github.com/apache/arrow-rs/pull/6320)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Michael-J-Ward](https://github.com/Michael-J-Ward))
-- Fix writing of invalid Parquet ColumnIndex when row group contains null
pages [\#6319](https://github.com/apache/arrow-rs/pull/6319)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([adriangb](https://github.com/adriangb))
-- Pass empty vectors as min/max for all null pages when building ColumnIndex
[\#6316](https://github.com/apache/arrow-rs/pull/6316)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
-- Update tonic-build requirement from =0.12.0 to =0.12.2
[\#6314](https://github.com/apache/arrow-rs/pull/6314)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
-- Parquet: add `union` method to `RowSelection`
[\#6308](https://github.com/apache/arrow-rs/pull/6308)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([sdd](https://github.com/sdd))
-- Specialize filter for structs and sparse unions
[\#6304](https://github.com/apache/arrow-rs/pull/6304)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
-- Err on `try_from_le_slice`
[\#6295](https://github.com/apache/arrow-rs/pull/6295)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([samuelcolvin](https://github.com/samuelcolvin))
-- fix reference in doctest to size\_of which is not imported by default
[\#6286](https://github.com/apache/arrow-rs/pull/6286)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([rtyler](https://github.com/rtyler))
-- Support writing UTC adjusted time arrays to parquet
[\#6278](https://github.com/apache/arrow-rs/pull/6278)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([aykut-bozkurt](https://github.com/aykut-bozkurt))
-- Minor: `pub use ByteView` in arrow and improve documentation
[\#6275](https://github.com/apache/arrow-rs/pull/6275)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Fix accessing name from ffi schema
[\#6273](https://github.com/apache/arrow-rs/pull/6273)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kylebarron](https://github.com/kylebarron))
-- Do not print compression level in schema printer
[\#6271](https://github.com/apache/arrow-rs/pull/6271)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([ttencate](https://github.com/ttencate))
-- ci: use octokit to add assignee
[\#6267](https://github.com/apache/arrow-rs/pull/6267)
([dsgibbons](https://github.com/dsgibbons))
-- Add tests for bad parquet files
[\#6262](https://github.com/apache/arrow-rs/pull/6262)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
-- Add `Statistics::distinct_count_opt` and deprecate
`Statistics::distinct_count`
[\#6259](https://github.com/apache/arrow-rs/pull/6259)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
-- Minor: move `FallibleRequestStream` and `FallibleTonicResponseStream` to a
module [\#6258](https://github.com/apache/arrow-rs/pull/6258)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alamb](https://github.com/alamb))
-- Make the bearer token visible in FlightSqlServiceClient
[\#6254](https://github.com/apache/arrow-rs/pull/6254)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([ccciudatu](https://github.com/ccciudatu))
-- Use `unary()` for array conversion in Parquet array readers, speed up
`Decimal128`, `Decimal256` and `Float16`
[\#6252](https://github.com/apache/arrow-rs/pull/6252)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([etseidl](https://github.com/etseidl))
-- Update tower requirement from 0.4.13 to 0.5.0
[\#6250](https://github.com/apache/arrow-rs/pull/6250)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
-- Implement date\_part for durations
[\#6246](https://github.com/apache/arrow-rs/pull/6246)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([nrc](https://github.com/nrc))
-- Remove unnecessary null buffer construction when converting arrays to a
different type [\#6244](https://github.com/apache/arrow-rs/pull/6244)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([etseidl](https://github.com/etseidl))
-- Implement PartialEq for GenericByteViewArray
[\#6241](https://github.com/apache/arrow-rs/pull/6241)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Minor: Remove non standard footer from LICENSE.txt / reference to Apache
Aurora [\#6237](https://github.com/apache/arrow-rs/pull/6237)
([alamb](https://github.com/alamb))
-- docs: Add parquet\_opendal in related projects
[\#6236](https://github.com/apache/arrow-rs/pull/6236)
([Xuanwo](https://github.com/Xuanwo))
-- Avoid infinite loop in bad parquet by checking the number of rep levels
[\#6232](https://github.com/apache/arrow-rs/pull/6232)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([jp0317](https://github.com/jp0317))
-- Specialize Prefix/Suffix Match for `Like/ILike` between Array and Scalar for
StringViewArray [\#6231](https://github.com/apache/arrow-rs/pull/6231)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([xinlifoobar](https://github.com/xinlifoobar))
-- fix: lexsort\_to\_indices should not fallback to non-lexical sort if the
datatype is not supported
[\#6225](https://github.com/apache/arrow-rs/pull/6225)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Modest improvement to FixedLenByteArray BYTE\_STREAM\_SPLIT arrow decoder
[\#6222](https://github.com/apache/arrow-rs/pull/6222)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
-- Improve performance of `FixedLengthBinary` decoding
[\#6220](https://github.com/apache/arrow-rs/pull/6220)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
-- Update documentation for Parquet BYTE\_STREAM\_SPLIT encoding
[\#6212](https://github.com/apache/arrow-rs/pull/6212)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
-- Improve interval parsing
[\#6211](https://github.com/apache/arrow-rs/pull/6211)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
-- minor: Suggest take on interleave docs
[\#6210](https://github.com/apache/arrow-rs/pull/6210)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
-- fix: Correctly handle take on dense union of a single selected type
[\#6209](https://github.com/apache/arrow-rs/pull/6209)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
-- Add time dictionary coercions
[\#6208](https://github.com/apache/arrow-rs/pull/6208)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([adriangb](https://github.com/adriangb))
-- fix\(arrow\): restrict the range of temporal values produced via `data_gen`
[\#6205](https://github.com/apache/arrow-rs/pull/6205)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kyle-mccarthy](https://github.com/kyle-mccarthy))
-- Add benchmarks for `BYTE_STREAM_SPLIT` encoded Parquet
`FIXED_LEN_BYTE_ARRAY` data
[\#6204](https://github.com/apache/arrow-rs/pull/6204)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
-- Move `ParquetMetadataWriter` to its own module, update documentation
[\#6202](https://github.com/apache/arrow-rs/pull/6202)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
-- Add `ThriftMetadataWriter` for writing Parquet metadata
[\#6197](https://github.com/apache/arrow-rs/pull/6197)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([adriangb](https://github.com/adriangb))
-- Update zstd-sys requirement from \>=2.0.0, \<2.0.13 to \>=2.0.0, \<2.0.14
[\#6196](https://github.com/apache/arrow-rs/pull/6196)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([dependabot[bot]](https://github.com/apps/dependabot))
-- fix parquet type `is_optional` comments
[\#6192](https://github.com/apache/arrow-rs/pull/6192)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([jp0317](https://github.com/jp0317))
-- Remove duplicated statistics tests in parquet
[\#6190](https://github.com/apache/arrow-rs/pull/6190)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Kev1n8](https://github.com/Kev1n8))
-- Benchmarks for `bool_and`
[\#6189](https://github.com/apache/arrow-rs/pull/6189)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([simonvandel](https://github.com/simonvandel))
-- Fix typo in documentation of Float64Array
[\#6188](https://github.com/apache/arrow-rs/pull/6188)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([mesejo](https://github.com/mesejo))
-- Make it clear that `StatisticsConverter` can not panic
[\#6187](https://github.com/apache/arrow-rs/pull/6187)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
-- add filter benchmark for `FixedSizeBinaryArray`
[\#6186](https://github.com/apache/arrow-rs/pull/6186)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([chloro-pn](https://github.com/chloro-pn))
-- Update sysinfo requirement from 0.30.12 to 0.31.2
[\#6182](https://github.com/apache/arrow-rs/pull/6182)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([dependabot[bot]](https://github.com/apps/dependabot))
-- Add support for `StringView` and `BinaryView` statistics in
`StatisticsConverter` [\#6181](https://github.com/apache/arrow-rs/pull/6181)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Kev1n8](https://github.com/Kev1n8))
-- Support casting between BinaryView \<--\> Utf8 and LargeUtf8
[\#6180](https://github.com/apache/arrow-rs/pull/6180)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([xinlifoobar](https://github.com/xinlifoobar))
-- Implement specialized filter kernel for `FixedSizeByteArray`
[\#6178](https://github.com/apache/arrow-rs/pull/6178)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([chloro-pn](https://github.com/chloro-pn))
-- Support `StringView` and `BinaryView` in CDataInterface
[\#6171](https://github.com/apache/arrow-rs/pull/6171)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([a10y](https://github.com/a10y))
-- Optimize `take` kernel for `BinaryViewArray` and `StringViewArray`
[\#6168](https://github.com/apache/arrow-rs/pull/6168)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([a10y](https://github.com/a10y))
-- Support Parquet `BYTE_STREAM_SPLIT` for INT32, INT64, and
FIXED\_LEN\_BYTE\_ARRAY primitive types
[\#6159](https://github.com/apache/arrow-rs/pull/6159)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
-- Fix comparison kernel benchmarks
[\#6147](https://github.com/apache/arrow-rs/pull/6147)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
-- improve `LIKE` regex performance up to 12x
[\#6145](https://github.com/apache/arrow-rs/pull/6145)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
-- Optimize `min_boolean` and `bool_and`
[\#6144](https://github.com/apache/arrow-rs/pull/6144)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([simonvandel](https://github.com/simonvandel))
-- Reduce bounds check in `RowIter`, add `unsafe Rows::row_unchecked`
[\#6142](https://github.com/apache/arrow-rs/pull/6142)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([XiangpengHao](https://github.com/XiangpengHao))
-- Minor: Simplify `StructArray` constructors
[\#6139](https://github.com/apache/arrow-rs/pull/6139)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Rafferty97](https://github.com/Rafferty97))
-- Implement exponential block size growing strategy for `StringViewBuilder`
[\#6136](https://github.com/apache/arrow-rs/pull/6136)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([XiangpengHao](https://github.com/XiangpengHao))
-- Use `LevelHistogram` in `PageIndex`
[\#6135](https://github.com/apache/arrow-rs/pull/6135)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
-- Add ArrowError::ArithmeticError
[\#6130](https://github.com/apache/arrow-rs/pull/6130)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([andygrove](https://github.com/andygrove))
-- Improve `LIKE` performance for "contains" style queries
[\#6128](https://github.com/apache/arrow-rs/pull/6128)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
-- Add `BooleanArray::new_from_packed` and `BooleanArray::new_from_u8`
[\#6127](https://github.com/apache/arrow-rs/pull/6127)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([chloro-pn](https://github.com/chloro-pn))
-- improvements to `(i)starts_with` and `(i)ends_with` performance
[\#6118](https://github.com/apache/arrow-rs/pull/6118)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
-- Fix Clippy for the Rust 1.80 release
[\#6116](https://github.com/apache/arrow-rs/pull/6116)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alamb](https://github.com/alamb))
-- added a flush method to IPC writers
[\#6108](https://github.com/apache/arrow-rs/pull/6108)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([V0ldek](https://github.com/V0ldek))
-- Add support for level histograms added in PARQUET-2261 to `ParquetMetaData`
[\#6105](https://github.com/apache/arrow-rs/pull/6105)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
-- Implement date\_part for intervals
[\#6071](https://github.com/apache/arrow-rs/pull/6071)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([nrc](https://github.com/nrc))
-- feat\(parquet\): Implement AsyncFileWriter for
`object_store::buffered::BufWriter`
[\#6013](https://github.com/apache/arrow-rs/pull/6013)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Xuanwo](https://github.com/Xuanwo))
+- fix: override `size_hint` for `BitIterator` to return the exact remaining
size [\#6495](https://github.com/apache/arrow-rs/pull/6495)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Beihao-Zhou](https://github.com/Beihao-Zhou))
+- Minor: Fix path in format command in CONTRIBUTING.md
[\#6494](https://github.com/apache/arrow-rs/pull/6494)
([etseidl](https://github.com/etseidl))
+- Write null counts in Parquet statistics when they are known
[\#6490](https://github.com/apache/arrow-rs/pull/6490)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Add configuration option to `StatisticsConverter` to control interpretation
of missing null counts in Parquet statistics
[\#6485](https://github.com/apache/arrow-rs/pull/6485)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- fix: check overflow numbers while inferring type for csv files
[\#6481](https://github.com/apache/arrow-rs/pull/6481)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([CookiePieWw](https://github.com/CookiePieWw))
+- Add better documentation, examples and builer-style API to `ByteView`
[\#6479](https://github.com/apache/arrow-rs/pull/6479)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Add take\_arrays util for getting entries from 2d arrays
[\#6475](https://github.com/apache/arrow-rs/pull/6475)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([akurmustafa](https://github.com/akurmustafa))
+- Deprecate `MetadataLoader`
[\#6474](https://github.com/apache/arrow-rs/pull/6474)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Update tonic-build requirement from =0.12.2 to =0.12.3
[\#6473](https://github.com/apache/arrow-rs/pull/6473)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Align buffers from Python \(FFI\)
[\#6472](https://github.com/apache/arrow-rs/pull/6472)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([EnricoMi](https://github.com/EnricoMi))
+- Add `ParquetMetaDataBuilder`
[\#6466](https://github.com/apache/arrow-rs/pull/6466)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
+- Make `ArrayData.align_buffers` align child data buffers recursively
[\#6462](https://github.com/apache/arrow-rs/pull/6462)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([EnricoMi](https://github.com/EnricoMi))
+- Minor: Silence compiler warnings for `parquet::file::metadata::reader`
[\#6457](https://github.com/apache/arrow-rs/pull/6457)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Minor: Error rather than panic for unsupported for dictionary `cast`ing
[\#6456](https://github.com/apache/arrow-rs/pull/6456)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([goldmedal](https://github.com/goldmedal))
+- Support cast between Durations + between Durations all numeric types
[\#6452](https://github.com/apache/arrow-rs/pull/6452)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tisonkun](https://github.com/tisonkun))
+- Deprecate methods from footer.rs in favor of `ParquetMetaDataReader`
[\#6451](https://github.com/apache/arrow-rs/pull/6451)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Workaround for missing Parquet page indexes in `ParquetMetadaReader`
[\#6450](https://github.com/apache/arrow-rs/pull/6450)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Fix CI by disabling newly failing rust \<\> nanoarrow integration test in CI
[\#6449](https://github.com/apache/arrow-rs/pull/6449)
([alamb](https://github.com/alamb))
+- Add `IpcSchemaEncoder`, deprecate ipc schema functions, Fix IPC not
respecting not preserving dict ID
[\#6444](https://github.com/apache/arrow-rs/pull/6444)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([brancz](https://github.com/brancz))
+- Add additional documentation and builder APIs to `SortOptions`
[\#6441](https://github.com/apache/arrow-rs/pull/6441)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Update prost-build requirement from =0.13.2 to =0.13.3
[\#6440](https://github.com/apache/arrow-rs/pull/6440)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump arrow-flight MSRV to 1.71.1
[\#6437](https://github.com/apache/arrow-rs/pull/6437)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([gstvg](https://github.com/gstvg))
+- Silence warnings that `as_any` and `next_batch` are never used
[\#6432](https://github.com/apache/arrow-rs/pull/6432)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Add `ParquetMetaDataReader`
[\#6431](https://github.com/apache/arrow-rs/pull/6431)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Add RowSelection::skipped\_row\_count
[\#6429](https://github.com/apache/arrow-rs/pull/6429)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([progval](https://github.com/progval))
+- perf: Faster decimal precision overflow checks
[\#6419](https://github.com/apache/arrow-rs/pull/6419)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([andygrove](https://github.com/andygrove))
+- fix: don't panic in IPC reader if struct child arrays have different lengths
[\#6417](https://github.com/apache/arrow-rs/pull/6417)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alexwilcoxson-rel](https://github.com/alexwilcoxson-rel))
+- Reduce integration test matrix
[\#6407](https://github.com/apache/arrow-rs/pull/6407)
([kou](https://github.com/kou))
+- Move lifetime of `take_iter` from iterator to its items
[\#6403](https://github.com/apache/arrow-rs/pull/6403)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dariocurr](https://github.com/dariocurr))
+- Update lexical-core requirement from 0.8 to 1.0 \(to resolve
RUSTSEC-2023-0086\) [\#6402](https://github.com/apache/arrow-rs/pull/6402)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dariocurr](https://github.com/dariocurr))
+- Fix encoding/decoding REE Dicts when using streaming IPC
[\#6399](https://github.com/apache/arrow-rs/pull/6399)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([brancz](https://github.com/brancz))
+- fix: binary\_mut should work if only one input array has null buffer
[\#6396](https://github.com/apache/arrow-rs/pull/6396)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Add `set_bits` fuzz test
[\#6394](https://github.com/apache/arrow-rs/pull/6394)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- impl `From<ScalarBuffer<T>>` for `Buffer`
[\#6389](https://github.com/apache/arrow-rs/pull/6389)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([mbrobbel](https://github.com/mbrobbel))
+- Add `union_extract` kernel
[\#6387](https://github.com/apache/arrow-rs/pull/6387)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
+- Clear string-tracking hash table when ByteView deduplication is enabled
[\#6385](https://github.com/apache/arrow-rs/pull/6385)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([shanesveller](https://github.com/shanesveller))
+- fix: Stop losing precision and scale when casting decimal to dictionary
[\#6383](https://github.com/apache/arrow-rs/pull/6383)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([andygrove](https://github.com/andygrove))
+- Add `ARROW_VERSION` const
[\#6379](https://github.com/apache/arrow-rs/pull/6379)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([samuelcolvin](https://github.com/samuelcolvin))
+- parquet writer: Raise an error when the row\_group\_index overflows i16
[\#6378](https://github.com/apache/arrow-rs/pull/6378)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([progval](https://github.com/progval))
+- Implement native support StringViewArray for `regexp_is_match` and
`regexp_is_match_scalar` function, deprecate `regexp_is_match_utf8` and
`regexp_is_match_utf8_scalar`
[\#6376](https://github.com/apache/arrow-rs/pull/6376)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tlm365](https://github.com/tlm365))
+- Update chrono-tz requirement from 0.9 to 0.10
[\#6371](https://github.com/apache/arrow-rs/pull/6371)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Support StringViewArray interop with python: fix lingering C Data Interface
issues for \*ViewArray [\#6368](https://github.com/apache/arrow-rs/pull/6368)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([a10y](https://github.com/a10y))
+- stop panic in `MetadataLoader` on invalid data
[\#6367](https://github.com/apache/arrow-rs/pull/6367)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([samuelcolvin](https://github.com/samuelcolvin))
+- Add support for BinaryView in arrow\_string::length
[\#6359](https://github.com/apache/arrow-rs/pull/6359)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Omega359](https://github.com/Omega359))
+- impl `From<Vec<T>>` for `Buffer`
[\#6355](https://github.com/apache/arrow-rs/pull/6355)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([mbrobbel](https://github.com/mbrobbel))
+- Add breaking change from \#6043 to `CHANGELOG`
[\#6354](https://github.com/apache/arrow-rs/pull/6354)
([mbrobbel](https://github.com/mbrobbel))
+- Benchmark for bit\_mask \(set\_bits\)
[\#6353](https://github.com/apache/arrow-rs/pull/6353)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kazuyukitanimura](https://github.com/kazuyukitanimura))
+- Update prost-build requirement from =0.13.1 to =0.13.2
[\#6350](https://github.com/apache/arrow-rs/pull/6350)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- fix: clippy warnings from nightly rust 1.82
[\#6348](https://github.com/apache/arrow-rs/pull/6348)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([waynexia](https://github.com/waynexia))
+- Add support for Utf8View in arrow\_string::length
[\#6345](https://github.com/apache/arrow-rs/pull/6345)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Omega359](https://github.com/Omega359))
+- feat: add catalog/schema subcommands to flight\_sql\_client.
[\#6332](https://github.com/apache/arrow-rs/pull/6332)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([nathanielc](https://github.com/nathanielc))
+- Manually run fmt on all files under parquet
[\#6328](https://github.com/apache/arrow-rs/pull/6328)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://github.com/etseidl))
+- Implement UnionArray logical\_nulls
[\#6303](https://github.com/apache/arrow-rs/pull/6303)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([gstvg](https://github.com/gstvg))
+- Parquet: Verify 32-bit CRC checksum when decoding pages
[\#6290](https://github.com/apache/arrow-rs/pull/6290)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([xmakro](https://github.com/xmakro))
diff --git a/Cargo.toml b/Cargo.toml
index 3b274d583..2f95b2e97 100644
--- a/Cargo.toml
+++ b/Cargo.toml
@@ -62,7 +62,7 @@ exclude = [
]
[workspace.package]
-version = "53.0.0"
+version = "53.1.0"
homepage = "https://github.com/apache/arrow-rs"
repository = "https://github.com/apache/arrow-rs"
authors = ["Apache Arrow <[email protected]>"]
@@ -77,20 +77,20 @@ edition = "2021"
rust-version = "1.62"
[workspace.dependencies]
-arrow = { version = "53.0.0", path = "./arrow", default-features = false }
-arrow-arith = { version = "53.0.0", path = "./arrow-arith" }
-arrow-array = { version = "53.0.0", path = "./arrow-array" }
-arrow-buffer = { version = "53.0.0", path = "./arrow-buffer" }
-arrow-cast = { version = "53.0.0", path = "./arrow-cast" }
-arrow-csv = { version = "53.0.0", path = "./arrow-csv" }
-arrow-data = { version = "53.0.0", path = "./arrow-data" }
-arrow-ipc = { version = "53.0.0", path = "./arrow-ipc" }
-arrow-json = { version = "53.0.0", path = "./arrow-json" }
-arrow-ord = { version = "53.0.0", path = "./arrow-ord" }
-arrow-row = { version = "53.0.0", path = "./arrow-row" }
-arrow-schema = { version = "53.0.0", path = "./arrow-schema" }
-arrow-select = { version = "53.0.0", path = "./arrow-select" }
-arrow-string = { version = "53.0.0", path = "./arrow-string" }
-parquet = { version = "53.0.0", path = "./parquet", default-features = false }
+arrow = { version = "53.1.0", path = "./arrow", default-features = false }
+arrow-arith = { version = "53.1.0", path = "./arrow-arith" }
+arrow-array = { version = "53.1.0", path = "./arrow-array" }
+arrow-buffer = { version = "53.1.0", path = "./arrow-buffer" }
+arrow-cast = { version = "53.1.0", path = "./arrow-cast" }
+arrow-csv = { version = "53.1.0", path = "./arrow-csv" }
+arrow-data = { version = "53.1.0", path = "./arrow-data" }
+arrow-ipc = { version = "53.1.0", path = "./arrow-ipc" }
+arrow-json = { version = "53.1.0", path = "./arrow-json" }
+arrow-ord = { version = "53.1.0", path = "./arrow-ord" }
+arrow-row = { version = "53.1.0", path = "./arrow-row" }
+arrow-schema = { version = "53.1.0", path = "./arrow-schema" }
+arrow-select = { version = "53.1.0", path = "./arrow-select" }
+arrow-string = { version = "53.1.0", path = "./arrow-string" }
+parquet = { version = "53.1.0", path = "./parquet", default-features = false }
chrono = { version = "0.4.34", default-features = false, features = ["clock"] }
diff --git a/dev/release/update_change_log.sh b/dev/release/update_change_log.sh
index 5c4fcb53a..bad80121b 100755
--- a/dev/release/update_change_log.sh
+++ b/dev/release/update_change_log.sh
@@ -29,8 +29,8 @@
set -e
-SINCE_TAG="52.2.0"
-FUTURE_RELEASE="53.0.0"
+SINCE_TAG="53.0.0"
+FUTURE_RELEASE="53.1.0"
SOURCE_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
SOURCE_TOP_DIR="$(cd "${SOURCE_DIR}/../../" && pwd)"