This is an automated email from the ASF dual-hosted git repository.
alamb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
The following commit(s) were added to refs/heads/master by this push:
new 6477db16c Prepare for `24.0.0` (#2808)
6477db16c is described below
commit 6477db16ca051b656bc0fe1f11bca85a23dbcd14
Author: Ian Alexander Joiner <[email protected]>
AuthorDate: Fri Sep 30 15:05:56 2022 -0400
Prepare for `24.0.0` (#2808)
* Create changelog
* Update version
* Update instructions to reflect label_issues.py needs admin
* Update release instructions with notes about the github token
* Update changelog
* update log
Co-authored-by: Ian Joiner <[email protected]>
Co-authored-by: Andrew Lamb <[email protected]>
---
CHANGELOG-old.md | 103 ++++++++++++++++++++++
CHANGELOG.md | 126 +++++++++------------------
arrow-array/Cargo.toml | 8 +-
arrow-buffer/Cargo.toml | 2 +-
arrow-data/Cargo.toml | 6 +-
arrow-flight/Cargo.toml | 4 +-
arrow-flight/README.md | 2 +-
arrow-pyarrow-integration-testing/Cargo.toml | 4 +-
arrow-schema/Cargo.toml | 2 +-
arrow/Cargo.toml | 10 +--
arrow/README.md | 4 +-
dev/release/README.md | 11 ++-
dev/release/update_change_log.sh | 6 +-
integration-testing/Cargo.toml | 2 +-
parquet/Cargo.toml | 6 +-
parquet_derive/Cargo.toml | 4 +-
parquet_derive/README.md | 4 +-
parquet_derive_test/Cargo.toml | 6 +-
18 files changed, 187 insertions(+), 123 deletions(-)
diff --git a/CHANGELOG-old.md b/CHANGELOG-old.md
index 02cb7ec24..3305a6cfd 100644
--- a/CHANGELOG-old.md
+++ b/CHANGELOG-old.md
@@ -19,6 +19,109 @@
# Historical Changelog
+## [24.0.0](https://github.com/apache/arrow-rs/tree/24.0.0) (2022-09-16)
+
+[Full Changelog](https://github.com/apache/arrow-rs/compare/22.0.0...24.0.0)
+
+**Breaking changes:**
+
+- Move JSON Test Format To integration-testing
[\#2724](https://github.com/apache/arrow-rs/pull/2724)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Split out arrow-buffer crate \(\#2594\)
[\#2693](https://github.com/apache/arrow-rs/pull/2693)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Simplify DictionaryBuilder constructors \(\#2684\) \(\#2054\)
[\#2685](https://github.com/apache/arrow-rs/pull/2685)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Deprecate RecordBatch::concat replace with concat\_batches \(\#2594\)
[\#2683](https://github.com/apache/arrow-rs/pull/2683)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Add overflow-checking variant for primitive arithmetic kernels and
explicitly define overflow behavior
[\#2643](https://github.com/apache/arrow-rs/pull/2643)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Update thrift v0.16 and vendor parquet-format \(\#2502\)
[\#2626](https://github.com/apache/arrow-rs/pull/2626)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- Update flight definitions including backwards-incompatible change to
GetSchema [\#2586](https://github.com/apache/arrow-rs/pull/2586)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([liukun4515](https://github.com/liukun4515))
+
+**Implemented enhancements:**
+
+- Cleanup like and nlike utf8 kernels
[\#2744](https://github.com/apache/arrow-rs/issues/2744)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Speedup eq and neq kernels for utf8 arrays
[\#2742](https://github.com/apache/arrow-rs/issues/2742)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- API for more ergonomic construction of `RecordBatchOptions`
[\#2728](https://github.com/apache/arrow-rs/issues/2728)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Automate updates to `CHANGELOG-old.md`
[\#2726](https://github.com/apache/arrow-rs/issues/2726)
+- Don't check the `DivideByZero` error for float modulus
[\#2720](https://github.com/apache/arrow-rs/issues/2720)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- `try_binary` should not panic on unequaled array length.
[\#2715](https://github.com/apache/arrow-rs/issues/2715)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add benchmark for bitwise operation
[\#2714](https://github.com/apache/arrow-rs/issues/2714)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add overflow-checking variants of arithmetic scalar dyn kernels
[\#2712](https://github.com/apache/arrow-rs/issues/2712)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add divide\_opt kernel which produce null values on division by zero error
[\#2709](https://github.com/apache/arrow-rs/issues/2709)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add `DataType` function to detect nested types
[\#2704](https://github.com/apache/arrow-rs/issues/2704)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add support of sorting dictionary of other primitive types
[\#2700](https://github.com/apache/arrow-rs/issues/2700)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Sort indices of dictionary string values
[\#2697](https://github.com/apache/arrow-rs/issues/2697)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Support empty projection in `RecordBatch::project`
[\#2690](https://github.com/apache/arrow-rs/issues/2690)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Support sorting dictionary encoded primitive integer arrays
[\#2679](https://github.com/apache/arrow-rs/issues/2679)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Use BitIndexIterator in min\_max\_helper
[\#2674](https://github.com/apache/arrow-rs/issues/2674)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Support building comparator for dictionaries of primitive integer values
[\#2672](https://github.com/apache/arrow-rs/issues/2672)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Change max/min string macro to generic helper function `min_max_helper`
[\#2657](https://github.com/apache/arrow-rs/issues/2657)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add overflow-checking variant of arithmetic scalar kernels
[\#2651](https://github.com/apache/arrow-rs/issues/2651)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Compare dictionary with binary array
[\#2644](https://github.com/apache/arrow-rs/issues/2644)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add overflow-checking variant for primitive arithmetic kernels
[\#2642](https://github.com/apache/arrow-rs/issues/2642)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Use `downcast_primitive_array` in arithmetic kernels
[\#2639](https://github.com/apache/arrow-rs/issues/2639)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Support DictionaryArray in temporal kernels
[\#2622](https://github.com/apache/arrow-rs/issues/2622)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Inline Generated Thift Code Into Parquet Crate
[\#2502](https://github.com/apache/arrow-rs/issues/2502)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+
+**Fixed bugs:**
+
+- Escape contains patterns for utf8 like kernels
[\#2745](https://github.com/apache/arrow-rs/issues/2745)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Float Array should not panic on `DivideByZero` in the `Divide` kernel
[\#2719](https://github.com/apache/arrow-rs/issues/2719)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- DictionaryBuilders can Create Invalid DictionaryArrays
[\#2684](https://github.com/apache/arrow-rs/issues/2684)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- `arrow` crate does not build with `features = ["ffi"]` and `default_features
= false`. [\#2670](https://github.com/apache/arrow-rs/issues/2670)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Invalid results with `RowSelector` having `row_count` of 0
[\#2669](https://github.com/apache/arrow-rs/issues/2669)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- clippy error: unresolved import `crate::array::layout`
[\#2659](https://github.com/apache/arrow-rs/issues/2659)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Cast the numeric without the `CastOptions`
[\#2648](https://github.com/apache/arrow-rs/issues/2648)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Explicitly define overflow behavior for primitive arithmetic kernels
[\#2641](https://github.com/apache/arrow-rs/issues/2641)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- update the `flight.proto` and fix schema to SchemaResult
[\#2571](https://github.com/apache/arrow-rs/issues/2571)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- Panic when first data page is skipped using ColumnChunkData::Sparse
[\#2543](https://github.com/apache/arrow-rs/issues/2543)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- `SchemaResult` in IPC deviates from other implementations
[\#2445](https://github.com/apache/arrow-rs/issues/2445)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+
+**Closed issues:**
+
+- Implement collect for int values
[\#2696](https://github.com/apache/arrow-rs/issues/2696)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+
+**Merged pull requests:**
+
+- Speedup string equal/not equal to empty string, cleanup like/ilike kernels,
fix escape bug [\#2743](https://github.com/apache/arrow-rs/pull/2743)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Dandandan](https://github.com/Dandandan))
+- Partially flatten arrow-buffer
[\#2737](https://github.com/apache/arrow-rs/pull/2737)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Automate updates to `CHANGELOG-old.md`
[\#2732](https://github.com/apache/arrow-rs/pull/2732)
([iajoiner](https://github.com/iajoiner))
+- Update read parquet example in parquet/arrow home
[\#2730](https://github.com/apache/arrow-rs/pull/2730)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([datapythonista](https://github.com/datapythonista))
+- Better construction of RecordBatchOptions
[\#2729](https://github.com/apache/arrow-rs/pull/2729)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([askoa](https://github.com/askoa))
+- benchmark: bitwise operation
[\#2718](https://github.com/apache/arrow-rs/pull/2718)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
+- Update `try_binary` and `checked_ops`, and remove `math_checked_op`
[\#2717](https://github.com/apache/arrow-rs/pull/2717)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([HaoYang670](https://github.com/HaoYang670))
+- Support bitwise op in kernel: or,xor,not
[\#2716](https://github.com/apache/arrow-rs/pull/2716)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
+- Add overflow-checking variants of arithmetic scalar dyn kernels
[\#2713](https://github.com/apache/arrow-rs/pull/2713)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Add divide\_opt kernel which produce null values on division by zero error
[\#2710](https://github.com/apache/arrow-rs/pull/2710)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Add DataType::is\_nested\(\)
[\#2707](https://github.com/apache/arrow-rs/pull/2707)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kfastov](https://github.com/kfastov))
+- Update criterion requirement from 0.3 to 0.4
[\#2706](https://github.com/apache/arrow-rs/pull/2706)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Support bitwise and operation in the kernel
[\#2703](https://github.com/apache/arrow-rs/pull/2703)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
+- Add support of sorting dictionary of other primitive arrays
[\#2701](https://github.com/apache/arrow-rs/pull/2701)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Clarify docs of binary and string builders
[\#2699](https://github.com/apache/arrow-rs/pull/2699)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([datapythonista](https://github.com/datapythonista))
+- Sort indices of dictionary string values
[\#2698](https://github.com/apache/arrow-rs/pull/2698)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Add support for empty projection in RecordBatch::project
[\#2691](https://github.com/apache/arrow-rs/pull/2691)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Dandandan](https://github.com/Dandandan))
+- Temporarily disable Golang integration tests re-enable JS
[\#2689](https://github.com/apache/arrow-rs/pull/2689)
([tustvold](https://github.com/tustvold))
+- Verify valid UTF-8 when converting byte array \(\#2205\)
[\#2686](https://github.com/apache/arrow-rs/pull/2686)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Support sorting dictionary encoded primitive integer arrays
[\#2680](https://github.com/apache/arrow-rs/pull/2680)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Skip RowSelectors with zero rows
[\#2678](https://github.com/apache/arrow-rs/pull/2678)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([askoa](https://github.com/askoa))
+- Faster Null Path Selection in ArrayData Equality
[\#2676](https://github.com/apache/arrow-rs/pull/2676)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dhruv9vats](https://github.com/dhruv9vats))
+- Use BitIndexIterator in min\_max\_helper
[\#2675](https://github.com/apache/arrow-rs/pull/2675)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Support building comparator for dictionaries of primitive integer values
[\#2673](https://github.com/apache/arrow-rs/pull/2673)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- json feature always requires base64 feature
[\#2668](https://github.com/apache/arrow-rs/pull/2668)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([eagletmt](https://github.com/eagletmt))
+- Add try\_unary, binary, try\_binary kernels ~90% faster
[\#2666](https://github.com/apache/arrow-rs/pull/2666)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Use downcast\_dictionary\_array in unary\_dyn
[\#2663](https://github.com/apache/arrow-rs/pull/2663)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- optimize the `numeric_cast_with_error`
[\#2661](https://github.com/apache/arrow-rs/pull/2661)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
+- ffi feature also requires layout
[\#2660](https://github.com/apache/arrow-rs/pull/2660)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Change max/min string macro to generic helper function min\_max\_helper
[\#2658](https://github.com/apache/arrow-rs/pull/2658)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Fix flaky test `test_fuzz_async_reader_selection`
[\#2656](https://github.com/apache/arrow-rs/pull/2656)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([thinkharderdev](https://github.com/thinkharderdev))
+- MINOR: Ignore flaky test test\_fuzz\_async\_reader\_selection
[\#2655](https://github.com/apache/arrow-rs/pull/2655)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([viirya](https://github.com/viirya))
+- MutableBuffer::typed\_data - shared ref access to the typed slice
[\#2652](https://github.com/apache/arrow-rs/pull/2652)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([medwards](https://github.com/medwards))
+- Overflow-checking variant of arithmetic scalar kernels
[\#2650](https://github.com/apache/arrow-rs/pull/2650)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- support `CastOption` for casting numeric
[\#2649](https://github.com/apache/arrow-rs/pull/2649)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
+- Help LLVM vectorize comparison kernel ~50-80% faster
[\#2646](https://github.com/apache/arrow-rs/pull/2646)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Support comparison between dictionary array and binary array
[\#2645](https://github.com/apache/arrow-rs/pull/2645)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Use `downcast_primitive_array` in arithmetic kernels
[\#2640](https://github.com/apache/arrow-rs/pull/2640)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Fully qualifying parquet items
[\#2638](https://github.com/apache/arrow-rs/pull/2638)
([dingxiangfei2009](https://github.com/dingxiangfei2009))
+- Support DictionaryArray in temporal kernels
[\#2623](https://github.com/apache/arrow-rs/pull/2623)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Comparable Row Format [\#2593](https://github.com/apache/arrow-rs/pull/2593)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Fix bug in page skipping
[\#2552](https://github.com/apache/arrow-rs/pull/2552)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([thinkharderdev](https://github.com/thinkharderdev))
+
## [22.0.0](https://github.com/apache/arrow-rs/tree/22.0.0) (2022-09-02)
[Full Changelog](https://github.com/apache/arrow-rs/compare/21.0.0...22.0.0)
diff --git a/CHANGELOG.md b/CHANGELOG.md
index 4a063594d..9b334b699 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -19,108 +19,62 @@
# Changelog
-## [23.0.0](https://github.com/apache/arrow-rs/tree/23.0.0) (2022-09-16)
+## [24.0.0](https://github.com/apache/arrow-rs/tree/24.0.0) (2022-09-30)
-[Full Changelog](https://github.com/apache/arrow-rs/compare/22.0.0...23.0.0)
+[Full Changelog](https://github.com/apache/arrow-rs/compare/23.0.0...24.0.0)
**Breaking changes:**
-- Move JSON Test Format To integration-testing
[\#2724](https://github.com/apache/arrow-rs/pull/2724)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Split out arrow-buffer crate \(\#2594\)
[\#2693](https://github.com/apache/arrow-rs/pull/2693)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Simplify DictionaryBuilder constructors \(\#2684\) \(\#2054\)
[\#2685](https://github.com/apache/arrow-rs/pull/2685)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Deprecate RecordBatch::concat replace with concat\_batches \(\#2594\)
[\#2683](https://github.com/apache/arrow-rs/pull/2683)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Add overflow-checking variant for primitive arithmetic kernels and
explicitly define overflow behavior
[\#2643](https://github.com/apache/arrow-rs/pull/2643)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Update thrift v0.16 and vendor parquet-format \(\#2502\)
[\#2626](https://github.com/apache/arrow-rs/pull/2626)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
-- Update flight definitions including backwards-incompatible change to
GetSchema [\#2586](https://github.com/apache/arrow-rs/pull/2586)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([liukun4515](https://github.com/liukun4515))
+- Cleanup `ArrowNativeType` \(\#1918\)
[\#2793](https://github.com/apache/arrow-rs/pull/2793)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Remove `ArrowNativeType::FromStr`
[\#2775](https://github.com/apache/arrow-rs/pull/2775)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Split out `arrow-array` crate \(\#2594\)
[\#2769](https://github.com/apache/arrow-rs/pull/2769)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Add `dyn_arith_dict` feature flag
[\#2760](https://github.com/apache/arrow-rs/pull/2760)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Split out `arrow-data` into a separate crate
[\#2746](https://github.com/apache/arrow-rs/pull/2746)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Split out arrow-schema \(\#2594\)
[\#2711](https://github.com/apache/arrow-rs/pull/2711)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
**Implemented enhancements:**
-- Cleanup like and nlike utf8 kernels
[\#2744](https://github.com/apache/arrow-rs/issues/2744)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Speedup eq and neq kernels for utf8 arrays
[\#2742](https://github.com/apache/arrow-rs/issues/2742)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- API for more ergonomic construction of `RecordBatchOptions`
[\#2728](https://github.com/apache/arrow-rs/issues/2728)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Automate updates to `CHANGELOG-old.md`
[\#2726](https://github.com/apache/arrow-rs/issues/2726)
-- Don't check the `DivideByZero` error for float modulus
[\#2720](https://github.com/apache/arrow-rs/issues/2720)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- `try_binary` should not panic on unequaled array length.
[\#2715](https://github.com/apache/arrow-rs/issues/2715)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Add benchmark for bitwise operation
[\#2714](https://github.com/apache/arrow-rs/issues/2714)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Add overflow-checking variants of arithmetic scalar dyn kernels
[\#2712](https://github.com/apache/arrow-rs/issues/2712)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Add divide\_opt kernel which produce null values on division by zero error
[\#2709](https://github.com/apache/arrow-rs/issues/2709)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Add `DataType` function to detect nested types
[\#2704](https://github.com/apache/arrow-rs/issues/2704)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Add support of sorting dictionary of other primitive types
[\#2700](https://github.com/apache/arrow-rs/issues/2700)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Sort indices of dictionary string values
[\#2697](https://github.com/apache/arrow-rs/issues/2697)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Support empty projection in `RecordBatch::project`
[\#2690](https://github.com/apache/arrow-rs/issues/2690)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Support sorting dictionary encoded primitive integer arrays
[\#2679](https://github.com/apache/arrow-rs/issues/2679)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Use BitIndexIterator in min\_max\_helper
[\#2674](https://github.com/apache/arrow-rs/issues/2674)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Support building comparator for dictionaries of primitive integer values
[\#2672](https://github.com/apache/arrow-rs/issues/2672)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Change max/min string macro to generic helper function `min_max_helper`
[\#2657](https://github.com/apache/arrow-rs/issues/2657)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Add overflow-checking variant of arithmetic scalar kernels
[\#2651](https://github.com/apache/arrow-rs/issues/2651)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Compare dictionary with binary array
[\#2644](https://github.com/apache/arrow-rs/issues/2644)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Add overflow-checking variant for primitive arithmetic kernels
[\#2642](https://github.com/apache/arrow-rs/issues/2642)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Use `downcast_primitive_array` in arithmetic kernels
[\#2639](https://github.com/apache/arrow-rs/issues/2639)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Support DictionaryArray in temporal kernels
[\#2622](https://github.com/apache/arrow-rs/issues/2622)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Inline Generated Thift Code Into Parquet Crate
[\#2502](https://github.com/apache/arrow-rs/issues/2502)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Include field name in Parquet PrimitiveTypeBuilder error messages
[\#2804](https://github.com/apache/arrow-rs/issues/2804)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Add PrimitiveArray::reinterpret\_cast
[\#2785](https://github.com/apache/arrow-rs/issues/2785)
+- BinaryBuilder and StringBuilder initialization parameters in struct\_builder
may be wrong [\#2783](https://github.com/apache/arrow-rs/issues/2783)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add divide scalar dyn kernel which produces null for division by zero
[\#2767](https://github.com/apache/arrow-rs/issues/2767)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add divide dyn kernel which produces null for division by zero
[\#2763](https://github.com/apache/arrow-rs/issues/2763)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Improve performance of checked kernels on non-null data
[\#2747](https://github.com/apache/arrow-rs/issues/2747)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add overflow-checking variants of arithmetic dyn kernels
[\#2739](https://github.com/apache/arrow-rs/issues/2739)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- The `binary` function should not panic on unequaled array length.
[\#2721](https://github.com/apache/arrow-rs/issues/2721)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
**Fixed bugs:**
-- Escape contains patterns for utf8 like kernels
[\#2745](https://github.com/apache/arrow-rs/issues/2745)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Float Array should not panic on `DivideByZero` in the `Divide` kernel
[\#2719](https://github.com/apache/arrow-rs/issues/2719)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- DictionaryBuilders can Create Invalid DictionaryArrays
[\#2684](https://github.com/apache/arrow-rs/issues/2684)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- `arrow` crate does not build with `features = ["ffi"]` and `default_features
= false`. [\#2670](https://github.com/apache/arrow-rs/issues/2670)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Invalid results with `RowSelector` having `row_count` of 0
[\#2669](https://github.com/apache/arrow-rs/issues/2669)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- clippy error: unresolved import `crate::array::layout`
[\#2659](https://github.com/apache/arrow-rs/issues/2659)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Cast the numeric without the `CastOptions`
[\#2648](https://github.com/apache/arrow-rs/issues/2648)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Explicitly define overflow behavior for primitive arithmetic kernels
[\#2641](https://github.com/apache/arrow-rs/issues/2641)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- update the `flight.proto` and fix schema to SchemaResult
[\#2571](https://github.com/apache/arrow-rs/issues/2571)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
-- Panic when first data page is skipped using ColumnChunkData::Sparse
[\#2543](https://github.com/apache/arrow-rs/issues/2543)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- `SchemaResult` in IPC deviates from other implementations
[\#2445](https://github.com/apache/arrow-rs/issues/2445)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- min compute kernel is incorrect with sliced buffers in arrow 23
[\#2779](https://github.com/apache/arrow-rs/issues/2779)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- `try_unary_dict` should check value type of dictionary array
[\#2754](https://github.com/apache/arrow-rs/issues/2754)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
**Closed issues:**
-- Implement collect for int values
[\#2696](https://github.com/apache/arrow-rs/issues/2696)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add back JSON import/export for schema
[\#2762](https://github.com/apache/arrow-rs/issues/2762)
+- null casting and coercion for Decimal128
[\#2761](https://github.com/apache/arrow-rs/issues/2761)
+- Json decoder behavior changed from versions 21 to 21 and returns
non-sensical num\_rows for RecordBatch
[\#2722](https://github.com/apache/arrow-rs/issues/2722)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Release Arrow `23.0.0` \(next release after `22.0.0`\)
[\#2665](https://github.com/apache/arrow-rs/issues/2665)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
**Merged pull requests:**
-- Speedup string equal/not equal to empty string, cleanup like/ilike kernels,
fix escape bug [\#2743](https://github.com/apache/arrow-rs/pull/2743)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Dandandan](https://github.com/Dandandan))
-- Partially flatten arrow-buffer
[\#2737](https://github.com/apache/arrow-rs/pull/2737)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Automate updates to `CHANGELOG-old.md`
[\#2732](https://github.com/apache/arrow-rs/pull/2732)
([iajoiner](https://github.com/iajoiner))
-- Update read parquet example in parquet/arrow home
[\#2730](https://github.com/apache/arrow-rs/pull/2730)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([datapythonista](https://github.com/datapythonista))
-- Better construction of RecordBatchOptions
[\#2729](https://github.com/apache/arrow-rs/pull/2729)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([askoa](https://github.com/askoa))
-- benchmark: bitwise operation
[\#2718](https://github.com/apache/arrow-rs/pull/2718)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
-- Update `try_binary` and `checked_ops`, and remove `math_checked_op`
[\#2717](https://github.com/apache/arrow-rs/pull/2717)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([HaoYang670](https://github.com/HaoYang670))
-- Support bitwise op in kernel: or,xor,not
[\#2716](https://github.com/apache/arrow-rs/pull/2716)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
-- Add overflow-checking variants of arithmetic scalar dyn kernels
[\#2713](https://github.com/apache/arrow-rs/pull/2713)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Add divide\_opt kernel which produce null values on division by zero error
[\#2710](https://github.com/apache/arrow-rs/pull/2710)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Add DataType::is\_nested\(\)
[\#2707](https://github.com/apache/arrow-rs/pull/2707)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kfastov](https://github.com/kfastov))
-- Update criterion requirement from 0.3 to 0.4
[\#2706](https://github.com/apache/arrow-rs/pull/2706)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dependabot[bot]](https://github.com/apps/dependabot))
-- Support bitwise and operation in the kernel
[\#2703](https://github.com/apache/arrow-rs/pull/2703)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
-- Add support of sorting dictionary of other primitive arrays
[\#2701](https://github.com/apache/arrow-rs/pull/2701)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Clarify docs of binary and string builders
[\#2699](https://github.com/apache/arrow-rs/pull/2699)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([datapythonista](https://github.com/datapythonista))
-- Sort indices of dictionary string values
[\#2698](https://github.com/apache/arrow-rs/pull/2698)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Add support for empty projection in RecordBatch::project
[\#2691](https://github.com/apache/arrow-rs/pull/2691)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Dandandan](https://github.com/Dandandan))
-- Temporarily disable Golang integration tests re-enable JS
[\#2689](https://github.com/apache/arrow-rs/pull/2689)
([tustvold](https://github.com/tustvold))
-- Verify valid UTF-8 when converting byte array \(\#2205\)
[\#2686](https://github.com/apache/arrow-rs/pull/2686)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Support sorting dictionary encoded primitive integer arrays
[\#2680](https://github.com/apache/arrow-rs/pull/2680)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Skip RowSelectors with zero rows
[\#2678](https://github.com/apache/arrow-rs/pull/2678)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([askoa](https://github.com/askoa))
-- Faster Null Path Selection in ArrayData Equality
[\#2676](https://github.com/apache/arrow-rs/pull/2676)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dhruv9vats](https://github.com/dhruv9vats))
-- Use BitIndexIterator in min\_max\_helper
[\#2675](https://github.com/apache/arrow-rs/pull/2675)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Support building comparator for dictionaries of primitive integer values
[\#2673](https://github.com/apache/arrow-rs/pull/2673)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- json feature always requires base64 feature
[\#2668](https://github.com/apache/arrow-rs/pull/2668)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([eagletmt](https://github.com/eagletmt))
-- Add try\_unary, binary, try\_binary kernels ~90% faster
[\#2666](https://github.com/apache/arrow-rs/pull/2666)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Use downcast\_dictionary\_array in unary\_dyn
[\#2663](https://github.com/apache/arrow-rs/pull/2663)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- optimize the `numeric_cast_with_error`
[\#2661](https://github.com/apache/arrow-rs/pull/2661)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
-- ffi feature also requires layout
[\#2660](https://github.com/apache/arrow-rs/pull/2660)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Change max/min string macro to generic helper function min\_max\_helper
[\#2658](https://github.com/apache/arrow-rs/pull/2658)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Fix flaky test `test_fuzz_async_reader_selection`
[\#2656](https://github.com/apache/arrow-rs/pull/2656)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([thinkharderdev](https://github.com/thinkharderdev))
-- MINOR: Ignore flaky test test\_fuzz\_async\_reader\_selection
[\#2655](https://github.com/apache/arrow-rs/pull/2655)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([viirya](https://github.com/viirya))
-- MutableBuffer::typed\_data - shared ref access to the typed slice
[\#2652](https://github.com/apache/arrow-rs/pull/2652)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([medwards](https://github.com/medwards))
-- Overflow-checking variant of arithmetic scalar kernels
[\#2650](https://github.com/apache/arrow-rs/pull/2650)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- support `CastOption` for casting numeric
[\#2649](https://github.com/apache/arrow-rs/pull/2649)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
-- Help LLVM vectorize comparison kernel ~50-80% faster
[\#2646](https://github.com/apache/arrow-rs/pull/2646)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Support comparison between dictionary array and binary array
[\#2645](https://github.com/apache/arrow-rs/pull/2645)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Use `downcast_primitive_array` in arithmetic kernels
[\#2640](https://github.com/apache/arrow-rs/pull/2640)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Fully qualifying parquet items
[\#2638](https://github.com/apache/arrow-rs/pull/2638)
([dingxiangfei2009](https://github.com/dingxiangfei2009))
-- Support DictionaryArray in temporal kernels
[\#2623](https://github.com/apache/arrow-rs/pull/2623)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
-- Comparable Row Format [\#2593](https://github.com/apache/arrow-rs/pull/2593)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Fix bug in page skipping
[\#2552](https://github.com/apache/arrow-rs/pull/2552)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([thinkharderdev](https://github.com/thinkharderdev))
+- add field name to parquet PrimitiveTypeBuilder error messages
[\#2805](https://github.com/apache/arrow-rs/pull/2805)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([andygrove](https://github.com/andygrove))
+- Add struct equality test case \(\#514\)
[\#2791](https://github.com/apache/arrow-rs/pull/2791)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Move unary kernels to arrow-array \(\#2787\)
[\#2789](https://github.com/apache/arrow-rs/pull/2789)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Disable test harness for string\_dictionary\_builder benchmark
[\#2788](https://github.com/apache/arrow-rs/pull/2788)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Add PrimitiveArray::reinterpret\_cast \(\#2785\)
[\#2786](https://github.com/apache/arrow-rs/pull/2786)
([tustvold](https://github.com/tustvold))
+- Fix BinaryBuilder and StringBuilder Capacity Allocation in StructBuilder
[\#2784](https://github.com/apache/arrow-rs/pull/2784)
([chunshao90](https://github.com/chunshao90))
+- Fix min/max computation for sliced arrays \(\#2779\)
[\#2780](https://github.com/apache/arrow-rs/pull/2780)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Fix Backwards Compatible Parquet List Encodings \(\#1915\)
[\#2774](https://github.com/apache/arrow-rs/pull/2774)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- MINOR: Fix clippy for rust 1.64.0
[\#2772](https://github.com/apache/arrow-rs/pull/2772)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- MINOR: Fix clippy for rust 1.64.0
[\#2771](https://github.com/apache/arrow-rs/pull/2771)
([viirya](https://github.com/viirya))
+- Add divide scalar dyn kernel which produces null for division by zero
[\#2768](https://github.com/apache/arrow-rs/pull/2768)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Add divide dyn kernel which produces null for division by zero
[\#2764](https://github.com/apache/arrow-rs/pull/2764)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Add value type check in try\_unary\_dict
[\#2755](https://github.com/apache/arrow-rs/pull/2755)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Fix `verify_release_candidate.sh` for new arrow subcrates
[\#2752](https://github.com/apache/arrow-rs/pull/2752)
([alamb](https://github.com/alamb))
+- Fix: Issue 2721 : binary function should not panic but return error w…
[\#2750](https://github.com/apache/arrow-rs/pull/2750)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([aksharau](https://github.com/aksharau))
+- Speed up checked kernels for non-null data \(~1.4-5x faster\)
[\#2749](https://github.com/apache/arrow-rs/pull/2749)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Dandandan](https://github.com/Dandandan))
+- Add overflow-checking variants of arithmetic dyn kernels
[\#2740](https://github.com/apache/arrow-rs/pull/2740)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Trim parquet row selection
[\#2705](https://github.com/apache/arrow-rs/pull/2705)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
diff --git a/arrow-array/Cargo.toml b/arrow-array/Cargo.toml
index 8e66bf3b7..30fa311b2 100644
--- a/arrow-array/Cargo.toml
+++ b/arrow-array/Cargo.toml
@@ -17,7 +17,7 @@
[package]
name = "arrow-array"
-version = "23.0.0"
+version = "24.0.0"
description = "Array abstractions for Apache Arrow"
homepage = "https://github.com/apache/arrow-rs";
repository = "https://github.com/apache/arrow-rs";
@@ -45,9 +45,9 @@ ahash = { version = "0.8", default-features = false, features
= ["compile-time-r
ahash = { version = "0.8", default-features = false, features =
["runtime-rng"] }
[dependencies]
-arrow-buffer = { version = "23.0.0", path = "../arrow-buffer" }
-arrow-schema = { version = "23.0.0", path = "../arrow-schema" }
-arrow-data = { version = "23.0.0", path = "../arrow-data" }
+arrow-buffer = { version = "24.0.0", path = "../arrow-buffer" }
+arrow-schema = { version = "24.0.0", path = "../arrow-schema" }
+arrow-data = { version = "24.0.0", path = "../arrow-data" }
chrono = { version = "0.4", default-features = false, features = ["clock"] }
num = { version = "0.4", default-features = false, features = ["std"] }
half = { version = "2.0", default-features = false }
diff --git a/arrow-buffer/Cargo.toml b/arrow-buffer/Cargo.toml
index c5a81b30f..8ca95b956 100644
--- a/arrow-buffer/Cargo.toml
+++ b/arrow-buffer/Cargo.toml
@@ -17,7 +17,7 @@
[package]
name = "arrow-buffer"
-version = "23.0.0"
+version = "24.0.0"
description = "Buffer abstractions for Apache Arrow"
homepage = "https://github.com/apache/arrow-rs";
repository = "https://github.com/apache/arrow-rs";
diff --git a/arrow-data/Cargo.toml b/arrow-data/Cargo.toml
index 289b1bbd0..4dbc5fa3f 100644
--- a/arrow-data/Cargo.toml
+++ b/arrow-data/Cargo.toml
@@ -17,7 +17,7 @@
[package]
name = "arrow-data"
-version = "23.0.0"
+version = "24.0.0"
description = "Array data abstractions for Apache Arrow"
homepage = "https://github.com/apache/arrow-rs";
repository = "https://github.com/apache/arrow-rs";
@@ -45,8 +45,8 @@ force_validate = []
[dependencies]
-arrow-buffer = { version = "23.0.0", path = "../arrow-buffer" }
-arrow-schema = { version = "23.0.0", path = "../arrow-schema" }
+arrow-buffer = { version = "24.0.0", path = "../arrow-buffer" }
+arrow-schema = { version = "24.0.0", path = "../arrow-schema" }
num = { version = "0.4", default-features = false, features = ["std"] }
half = { version = "2.0", default-features = false }
diff --git a/arrow-flight/Cargo.toml b/arrow-flight/Cargo.toml
index a6fb8751c..724767921 100644
--- a/arrow-flight/Cargo.toml
+++ b/arrow-flight/Cargo.toml
@@ -18,7 +18,7 @@
[package]
name = "arrow-flight"
description = "Apache Arrow Flight"
-version = "23.0.0"
+version = "24.0.0"
edition = "2021"
rust-version = "1.62"
authors = ["Apache Arrow <[email protected]>"]
@@ -27,7 +27,7 @@ repository = "https://github.com/apache/arrow-rs";
license = "Apache-2.0"
[dependencies]
-arrow = { path = "../arrow", version = "23.0.0", default-features = false,
features = ["ipc"] }
+arrow = { path = "../arrow", version = "24.0.0", default-features = false,
features = ["ipc"] }
base64 = { version = "0.13", default-features = false }
tonic = { version = "0.8", default-features = false, features = ["transport",
"codegen", "prost"] }
bytes = { version = "1", default-features = false }
diff --git a/arrow-flight/README.md b/arrow-flight/README.md
index e01809f38..4ebf98c06 100644
--- a/arrow-flight/README.md
+++ b/arrow-flight/README.md
@@ -27,7 +27,7 @@ Add this to your Cargo.toml:
```toml
[dependencies]
-arrow-flight = "23.0.0"
+arrow-flight = "24.0.0"
```
Apache Arrow Flight is a gRPC based protocol for exchanging Arrow data between
processes. See the blog post [Introducing Apache Arrow Flight: A Framework for
Fast Data
Transport](https://arrow.apache.org/blog/2019/10/13/introducing-arrow-flight/)
for more information.
diff --git a/arrow-pyarrow-integration-testing/Cargo.toml
b/arrow-pyarrow-integration-testing/Cargo.toml
index 38bbcf9e8..3e32aab98 100644
--- a/arrow-pyarrow-integration-testing/Cargo.toml
+++ b/arrow-pyarrow-integration-testing/Cargo.toml
@@ -18,7 +18,7 @@
[package]
name = "arrow-pyarrow-integration-testing"
description = ""
-version = "23.0.0"
+version = "24.0.0"
homepage = "https://github.com/apache/arrow-rs";
repository = "https://github.com/apache/arrow-rs";
authors = ["Apache Arrow <[email protected]>"]
@@ -32,7 +32,7 @@ name = "arrow_pyarrow_integration_testing"
crate-type = ["cdylib"]
[dependencies]
-arrow = { path = "../arrow", version = "23.0.0", features = ["pyarrow"] }
+arrow = { path = "../arrow", version = "24.0.0", features = ["pyarrow"] }
pyo3 = { version = "0.17", features = ["extension-module"] }
[package.metadata.maturin]
diff --git a/arrow-schema/Cargo.toml b/arrow-schema/Cargo.toml
index d35a99a6d..d052c9061 100644
--- a/arrow-schema/Cargo.toml
+++ b/arrow-schema/Cargo.toml
@@ -17,7 +17,7 @@
[package]
name = "arrow-schema"
-version = "23.0.0"
+version = "24.0.0"
description = "Defines the logical types for arrow arrays"
homepage = "https://github.com/apache/arrow-rs";
repository = "https://github.com/apache/arrow-rs";
diff --git a/arrow/Cargo.toml b/arrow/Cargo.toml
index b3500f4e5..a7726b96c 100644
--- a/arrow/Cargo.toml
+++ b/arrow/Cargo.toml
@@ -17,7 +17,7 @@
[package]
name = "arrow"
-version = "23.0.0"
+version = "24.0.0"
description = "Rust implementation of Apache Arrow"
homepage = "https://github.com/apache/arrow-rs";
repository = "https://github.com/apache/arrow-rs";
@@ -44,10 +44,10 @@ ahash = { version = "0.8", default-features = false,
features = ["compile-time-r
ahash = { version = "0.8", default-features = false, features =
["runtime-rng"] }
[dependencies]
-arrow-buffer = { version = "23.0.0", path = "../arrow-buffer" }
-arrow-data = { version = "23.0.0", path = "../arrow-data" }
-arrow-schema = { version = "23.0.0", path = "../arrow-schema" }
-arrow-array = { version = "23.0.0", path = "../arrow-array" }
+arrow-buffer = { version = "24.0.0", path = "../arrow-buffer" }
+arrow-data = { version = "24.0.0", path = "../arrow-data" }
+arrow-schema = { version = "24.0.0", path = "../arrow-schema" }
+arrow-array = { version = "24.0.0", path = "../arrow-array" }
serde_json = { version = "1.0", default-features = false, features = ["std"],
optional = true }
indexmap = { version = "1.9", default-features = false, features = ["std"] }
rand = { version = "0.8", default-features = false, features = ["std",
"std_rng"], optional = true }
diff --git a/arrow/README.md b/arrow/README.md
index e168d4a09..ade41311c 100644
--- a/arrow/README.md
+++ b/arrow/README.md
@@ -35,7 +35,7 @@ This crate is tested with the latest stable version of Rust.
We do not currently
The arrow crate follows the [SemVer
standard](https://doc.rust-lang.org/cargo/reference/semver.html) defined by
Cargo and works well within the Rust crate ecosystem.
-However, for historical reasons, this crate uses versions with major numbers
greater than `0.x` (e.g. `23.0.0`), unlike many other crates in the Rust
ecosystem which spend extended time releasing versions `0.x` to signal planned
ongoing API changes. Minor arrow releases contain only compatible changes,
while major releases may contain breaking API changes.
+However, for historical reasons, this crate uses versions with major numbers
greater than `0.x` (e.g. `24.0.0`), unlike many other crates in the Rust
ecosystem which spend extended time releasing versions `0.x` to signal planned
ongoing API changes. Minor arrow releases contain only compatible changes,
while major releases may contain breaking API changes.
## Feature Flags
@@ -62,7 +62,7 @@ The [Apache Arrow
Status](https://arrow.apache.org/docs/status.html) page lists
## Safety
-Arrow seeks to uphold the Rust Soundness Pledge as articulated eloquently
[here](https://raphlinus.github.io/rust/23.0.01/18/soundness-pledge.html).
Specifically:
+Arrow seeks to uphold the Rust Soundness Pledge as articulated eloquently
[here](https://raphlinus.github.io/rust/24.0.01/18/soundness-pledge.html).
Specifically:
> The intent of this crate is to be free of soundness bugs. The developers
> will do their best to avoid them, and welcome help in analyzing and fixing
> them
diff --git a/dev/release/README.md b/dev/release/README.md
index d418a09d0..82cb9fbfc 100644
--- a/dev/release/README.md
+++ b/dev/release/README.md
@@ -71,17 +71,24 @@ git checkout -b make-release
# Copy the content of CHANGELOG.md to the beginning of CHANGELOG-old.md
+# ensure your github token is available
+export ARROW_GITHUB_API_TOKEN=<TOKEN>
+
# manully edit ./dev/release/update_change_log.sh to reflect the release
version
# create the changelog
-CHANGELOG_GITHUB_TOKEN=<TOKEN> ./dev/release/update_change_log.sh
+./dev/release/update_change_log.sh
+
# run automated script to copy labels to issues based on referenced PRs
+# (NOTE this must be done by a committer / other who has
+# write access to the repository)
python dev/release/label_issues.py
+
# review change log / edit issues and labels if needed, rerun
git commit -a -m 'Create changelog'
# update versions
-sed -i '' -e 's/14.0.0/23.0.0/g' `find . -name 'Cargo.toml' -or -name '*.md' |
grep -v CHANGELOG.md`
+sed -i '' -e 's/14.0.0/24.0.0/g' `find . -name 'Cargo.toml' -or -name '*.md' |
grep -v CHANGELOG.md`
git commit -a -m 'Update version'
```
diff --git a/dev/release/update_change_log.sh b/dev/release/update_change_log.sh
index a3af50a8a..67f772d37 100755
--- a/dev/release/update_change_log.sh
+++ b/dev/release/update_change_log.sh
@@ -29,8 +29,8 @@
set -e
-SINCE_TAG="22.0.0"
-FUTURE_RELEASE="23.0.0"
+SINCE_TAG="23.0.0"
+FUTURE_RELEASE="24.0.0"
SOURCE_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
SOURCE_TOP_DIR="$(cd "${SOURCE_DIR}/../../" && pwd)"
@@ -72,7 +72,7 @@ mv "${OLD_OUTPUT_PATH}".tmp "${OLD_OUTPUT_PATH}"
# use exclude-tags-regex to filter out tags used for object_store
# crates and only only look at tags that DO NOT begin with `object_store_`
pushd "${SOURCE_TOP_DIR}"
-docker run -it --rm -e CHANGELOG_GITHUB_TOKEN="$CHANGELOG_GITHUB_TOKEN" -v
"$(pwd)":/usr/local/src/your-app
githubchangeloggenerator/github-changelog-generator \
+docker run -it --rm -e CHANGELOG_GITHUB_TOKEN="$ARROW_GITHUB_API_TOKEN" -v
"$(pwd)":/usr/local/src/your-app
githubchangeloggenerator/github-changelog-generator \
--user apache \
--project arrow-rs \
--cache-file=.githubchangeloggenerator.cache \
diff --git a/integration-testing/Cargo.toml b/integration-testing/Cargo.toml
index e45b812dd..687e91ac4 100644
--- a/integration-testing/Cargo.toml
+++ b/integration-testing/Cargo.toml
@@ -18,7 +18,7 @@
[package]
name = "arrow-integration-testing"
description = "Binaries used in the Arrow integration tests"
-version = "23.0.0"
+version = "24.0.0"
homepage = "https://github.com/apache/arrow-rs";
repository = "https://github.com/apache/arrow-rs";
authors = ["Apache Arrow <[email protected]>"]
diff --git a/parquet/Cargo.toml b/parquet/Cargo.toml
index 9b95868f3..e1593e4b9 100644
--- a/parquet/Cargo.toml
+++ b/parquet/Cargo.toml
@@ -17,7 +17,7 @@
[package]
name = "parquet"
-version = "23.0.0"
+version = "24.0.0"
license = "Apache-2.0"
description = "Apache Parquet implementation in Rust"
homepage = "https://github.com/apache/arrow-rs";
@@ -41,7 +41,7 @@ zstd = { version = "0.11.1", optional = true,
default-features = false }
chrono = { version = "0.4", default-features = false, features = ["alloc"] }
num = { version = "0.4", default-features = false }
num-bigint = { version = "0.4", default-features = false }
-arrow = { path = "../arrow", version = "23.0.0", optional = true,
default-features = false, features = ["ipc"] }
+arrow = { path = "../arrow", version = "24.0.0", optional = true,
default-features = false, features = ["ipc"] }
base64 = { version = "0.13", default-features = false, features = ["std"],
optional = true }
clap = { version = "3", default-features = false, features = ["std", "derive",
"env"], optional = true }
serde_json = { version = "1.0", default-features = false, features = ["std"],
optional = true }
@@ -61,7 +61,7 @@ flate2 = { version = "1.0", default-features = false,
features = ["rust_backend"
lz4 = { version = "1.23", default-features = false }
zstd = { version = "0.11", default-features = false }
serde_json = { version = "1.0", features = ["std"], default-features = false }
-arrow = { path = "../arrow", version = "23.0.0", default-features = false,
features = ["ipc", "test_utils", "prettyprint", "json"] }
+arrow = { path = "../arrow", version = "24.0.0", default-features = false,
features = ["ipc", "test_utils", "prettyprint", "json"] }
[package.metadata.docs.rs]
all-features = true
diff --git a/parquet_derive/Cargo.toml b/parquet_derive/Cargo.toml
index 54aa6d52f..2fc6f55af 100644
--- a/parquet_derive/Cargo.toml
+++ b/parquet_derive/Cargo.toml
@@ -17,7 +17,7 @@
[package]
name = "parquet_derive"
-version = "23.0.0"
+version = "24.0.0"
license = "Apache-2.0"
description = "Derive macros for the Rust implementation of Apache Parquet"
homepage = "https://github.com/apache/arrow-rs";
@@ -35,4 +35,4 @@ proc-macro = true
proc-macro2 = { version = "1.0", default-features = false }
quote = { version = "1.0", default-features = false }
syn = { version = "1.0", default-features = false }
-parquet = { path = "../parquet", version = "23.0.0" }
+parquet = { path = "../parquet", version = "24.0.0" }
diff --git a/parquet_derive/README.md b/parquet_derive/README.md
index 4aae73dfc..907a71432 100644
--- a/parquet_derive/README.md
+++ b/parquet_derive/README.md
@@ -32,8 +32,8 @@ Add this to your Cargo.toml:
```toml
[dependencies]
-parquet = "23.0.0"
-parquet_derive = "23.0.0"
+parquet = "24.0.0"
+parquet_derive = "24.0.0"
```
and this to your crate root:
diff --git a/parquet_derive_test/Cargo.toml b/parquet_derive_test/Cargo.toml
index dd8486da2..78207399f 100644
--- a/parquet_derive_test/Cargo.toml
+++ b/parquet_derive_test/Cargo.toml
@@ -17,7 +17,7 @@
[package]
name = "parquet_derive_test"
-version = "23.0.0"
+version = "24.0.0"
license = "Apache-2.0"
description = "Integration test package for parquet-derive"
homepage = "https://github.com/apache/arrow-rs";
@@ -29,6 +29,6 @@ publish = false
rust-version = "1.62"
[dependencies]
-parquet = { path = "../parquet", version = "23.0.0", default-features = false }
-parquet_derive = { path = "../parquet_derive", version = "23.0.0",
default-features = false }
+parquet = { path = "../parquet", version = "24.0.0", default-features = false }
+parquet_derive = { path = "../parquet_derive", version = "24.0.0",
default-features = false }
chrono = { version="0.4.19", default-features = false, features = [ "clock" ] }
