This is an automated email from the ASF dual-hosted git repository.
tustvold pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
The following commit(s) were added to refs/heads/master by this push:
new 6e332b8f57 Prepare arrow 48.0.0 (#4948)
6e332b8f57 is described below
commit 6e332b8f570d53bdc906159a97b2c5f95db670e5
Author: Raphael Taylor-Davies <[email protected]>
AuthorDate: Wed Oct 18 14:20:57 2023 +0100
Prepare arrow 48.0.0 (#4948)
---
CHANGELOG-old.md | 69 +++++++++++++++++++++++
CHANGELOG.md | 117 +++++++++++++++++++++------------------
Cargo.toml | 32 +++++------
dev/release/update_change_log.sh | 4 +-
4 files changed, 151 insertions(+), 71 deletions(-)
diff --git a/CHANGELOG-old.md b/CHANGELOG-old.md
index bac7847bda..cde9b8f3b5 100644
--- a/CHANGELOG-old.md
+++ b/CHANGELOG-old.md
@@ -19,6 +19,75 @@
# Historical Changelog
+## [47.0.0](https://github.com/apache/arrow-rs/tree/47.0.0) (2023-09-19)
+
+[Full Changelog](https://github.com/apache/arrow-rs/compare/46.0.0...47.0.0)
+
+**Breaking changes:**
+
+- Make FixedSizeBinaryArray value\_data return a reference
[\#4820](https://github.com/apache/arrow-rs/issues/4820)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Update prost to v0.12.1
[\#4825](https://github.com/apache/arrow-rs/pull/4825)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([tustvold](https://github.com/tustvold))
+- feat: FixedSizeBinaryArray::value\_data return reference
[\#4821](https://github.com/apache/arrow-rs/pull/4821)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([wjones127](https://github.com/wjones127))
+- Stateless Row Encoding / Don't Preserve Dictionaries in `RowConverter`
\(\#4811\) [\#4819](https://github.com/apache/arrow-rs/pull/4819)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([tustvold](https://github.com/tustvold))
+- fix: entries field is non-nullable
[\#4808](https://github.com/apache/arrow-rs/pull/4808)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([wjones127](https://github.com/wjones127))
+- Fix flight sql do put handling, add bind parameter support to FlightSQL cli
client [\#4797](https://github.com/apache/arrow-rs/pull/4797)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([suremarc](https://github.com/suremarc))
+- Remove unused dyn\_cmp\_dict feature
[\#4766](https://github.com/apache/arrow-rs/pull/4766)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Add underlying `std::io::Error` to `IoError` and add `IpcError` variant
[\#4726](https://github.com/apache/arrow-rs/pull/4726)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alexandreyc](https://github.com/alexandreyc))
+
+**Implemented enhancements:**
+
+- Row Format Adapative Block Size
[\#4812](https://github.com/apache/arrow-rs/issues/4812)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Stateless Row Conversion
[\#4811](https://github.com/apache/arrow-rs/issues/4811)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- Add option to specify custom null values for CSV reader
[\#4794](https://github.com/apache/arrow-rs/issues/4794)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- parquet::record::RowIter cannot be customized with batch\_size and defaults
to 1024 [\#4782](https://github.com/apache/arrow-rs/issues/4782)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- `DynScalar` abstraction \(something that makes it easy to create scalar
`Datum`s\) [\#4781](https://github.com/apache/arrow-rs/issues/4781)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- `Datum` is not exported as part of `arrow` \(it is only exported in
`arrow_array`\) [\#4780](https://github.com/apache/arrow-rs/issues/4780)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- `Scalar` is not exported as part of `arrow` \(it is only exported in
`arrow_array`\) [\#4779](https://github.com/apache/arrow-rs/issues/4779)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Support IntoPyArrow for impl RecordBatchReader
[\#4730](https://github.com/apache/arrow-rs/issues/4730)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Datum Based String Kernels
[\#4595](https://github.com/apache/arrow-rs/issues/4595)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+
+**Fixed bugs:**
+
+- MapArray::new\_from\_strings creates nullable entries field
[\#4807](https://github.com/apache/arrow-rs/issues/4807)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- pyarrow module can't roundtrip tensor arrays
[\#4805](https://github.com/apache/arrow-rs/issues/4805)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- `concat_batches` errors with "schema mismatch" error when only metadata
differs [\#4799](https://github.com/apache/arrow-rs/issues/4799)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- panic in `cmp` kernels with DictionaryArrays: `Option::unwrap()` on a
`None` value' [\#4788](https://github.com/apache/arrow-rs/issues/4788)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- stream ffi panics if schema metadata values aren't valid utf8
[\#4750](https://github.com/apache/arrow-rs/issues/4750)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Regression: Incorrect Sorting of `*ListArray` in 46.0.0
[\#4746](https://github.com/apache/arrow-rs/issues/4746)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Row is no longer comparable after reuse
[\#4741](https://github.com/apache/arrow-rs/issues/4741)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- DoPut FlightSQL handler inadvertently consumes schema at start of
Request\<Streaming\<FlightData\>\>
[\#4658](https://github.com/apache/arrow-rs/issues/4658)
+- Return error when converting schema
[\#4752](https://github.com/apache/arrow-rs/pull/4752)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([wjones127](https://github.com/wjones127))
+- Implement PyArrowType for `Box<dyn RecordBatchReader + Send>`
[\#4751](https://github.com/apache/arrow-rs/pull/4751)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([wjones127](https://github.com/wjones127))
+
+**Closed issues:**
+
+- Building arrow-rust for target wasm32-wasi falied to compile packed\_simd\_2
[\#4717](https://github.com/apache/arrow-rs/issues/4717)
+
+**Merged pull requests:**
+
+- Respect FormatOption::nulls for NullArray
[\#4836](https://github.com/apache/arrow-rs/pull/4836)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Fix merge\_dictionary\_values in selection kernels
[\#4833](https://github.com/apache/arrow-rs/pull/4833)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Fix like scalar null [\#4832](https://github.com/apache/arrow-rs/pull/4832)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- More chrono deprecations
[\#4822](https://github.com/apache/arrow-rs/pull/4822)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Adaptive Row Block Size \(\#4812\)
[\#4818](https://github.com/apache/arrow-rs/pull/4818)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Update proc-macro2 requirement from =1.0.66 to =1.0.67
[\#4816](https://github.com/apache/arrow-rs/pull/4816)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Do not check schema for equality in concat\_batches
[\#4815](https://github.com/apache/arrow-rs/pull/4815)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- fix: export record batch through stream
[\#4806](https://github.com/apache/arrow-rs/pull/4806)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([wjones127](https://github.com/wjones127))
+- Improve CSV Reader Benchmark Coverage of Small Primitives
[\#4803](https://github.com/apache/arrow-rs/pull/4803)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- csv: Add option to specify custom null values
[\#4795](https://github.com/apache/arrow-rs/pull/4795)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([vrongmeal](https://github.com/vrongmeal))
+- Expand docstring and add example to `Scalar`
[\#4793](https://github.com/apache/arrow-rs/pull/4793)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Re-export array crate root \(\#4780\) \(\#4779\)
[\#4791](https://github.com/apache/arrow-rs/pull/4791)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Fix DictionaryArray::normalized\_keys \(\#4788\)
[\#4789](https://github.com/apache/arrow-rs/pull/4789)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Allow custom tree builder for parquet::record::RowIter
[\#4783](https://github.com/apache/arrow-rs/pull/4783)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([YuraKotov](https://github.com/YuraKotov))
+- Bump actions/checkout from 3 to 4
[\#4767](https://github.com/apache/arrow-rs/pull/4767)
([dependabot[bot]](https://github.com/apps/dependabot))
+- fix: avoid panic if offset index not exists.
[\#4761](https://github.com/apache/arrow-rs/pull/4761)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([RinChanNOWWW](https://github.com/RinChanNOWWW))
+- Relax constraints on PyArrowType
[\#4757](https://github.com/apache/arrow-rs/pull/4757)
([tustvold](https://github.com/tustvold))
+- Chrono deprecations [\#4748](https://github.com/apache/arrow-rs/pull/4748)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Fix List Sorting, Revert Removal of Rank Kernels
[\#4747](https://github.com/apache/arrow-rs/pull/4747)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Clear row buffer before reuse
[\#4742](https://github.com/apache/arrow-rs/pull/4742)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([yjshen](https://github.com/yjshen))
+- Datum based like kernels \(\#4595\)
[\#4732](https://github.com/apache/arrow-rs/pull/4732)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([tustvold](https://github.com/tustvold))
+- feat: expose DoGet response headers & trailers
[\#4727](https://github.com/apache/arrow-rs/pull/4727)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([crepererum](https://github.com/crepererum))
+- Cleanup length and bit\_length kernels
[\#4718](https://github.com/apache/arrow-rs/pull/4718)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
## [46.0.0](https://github.com/apache/arrow-rs/tree/46.0.0) (2023-08-21)
[Full Changelog](https://github.com/apache/arrow-rs/compare/45.0.0...46.0.0)
diff --git a/CHANGELOG.md b/CHANGELOG.md
index 1f97055a9c..8c5351708c 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -19,75 +19,86 @@
# Changelog
-## [47.0.0](https://github.com/apache/arrow-rs/tree/47.0.0) (2023-09-19)
+## [48.0.0](https://github.com/apache/arrow-rs/tree/48.0.0) (2023-10-18)
-[Full Changelog](https://github.com/apache/arrow-rs/compare/46.0.0...47.0.0)
+[Full Changelog](https://github.com/apache/arrow-rs/compare/47.0.0...48.0.0)
**Breaking changes:**
-- Make FixedSizeBinaryArray value\_data return a reference
[\#4820](https://github.com/apache/arrow-rs/issues/4820)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Update prost to v0.12.1
[\#4825](https://github.com/apache/arrow-rs/pull/4825)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([tustvold](https://github.com/tustvold))
-- feat: FixedSizeBinaryArray::value\_data return reference
[\#4821](https://github.com/apache/arrow-rs/pull/4821)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([wjones127](https://github.com/wjones127))
-- Stateless Row Encoding / Don't Preserve Dictionaries in `RowConverter`
\(\#4811\) [\#4819](https://github.com/apache/arrow-rs/pull/4819)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([tustvold](https://github.com/tustvold))
-- fix: entries field is non-nullable
[\#4808](https://github.com/apache/arrow-rs/pull/4808)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([wjones127](https://github.com/wjones127))
-- Fix flight sql do put handling, add bind parameter support to FlightSQL cli
client [\#4797](https://github.com/apache/arrow-rs/pull/4797)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([suremarc](https://github.com/suremarc))
-- Remove unused dyn\_cmp\_dict feature
[\#4766](https://github.com/apache/arrow-rs/pull/4766)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Add underlying `std::io::Error` to `IoError` and add `IpcError` variant
[\#4726](https://github.com/apache/arrow-rs/pull/4726)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alexandreyc](https://github.com/alexandreyc))
+- Evaluate null\_regex for string type in csv \(now such values will be parsed
as `Null` rather than `""`\)
[\#4942](https://github.com/apache/arrow-rs/pull/4942)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([haohuaijin](https://github.com/haohuaijin))
+- fix\(csv\)!: infer null for empty column.
[\#4910](https://github.com/apache/arrow-rs/pull/4910)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kskalski](https://github.com/kskalski))
+- feat: log headers/trailers in flight CLI \(+ minor fixes\)
[\#4898](https://github.com/apache/arrow-rs/pull/4898)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([crepererum](https://github.com/crepererum))
+- fix\(arrow-json\)!: include null fields in schema inference with a type of
Null [\#4894](https://github.com/apache/arrow-rs/pull/4894)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kskalski](https://github.com/kskalski))
+- Mark OnCloseRowGroup Send
[\#4893](https://github.com/apache/arrow-rs/pull/4893)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([devinjdangelo](https://github.com/devinjdangelo))
+- Specialize Thrift Decoding \(~40% Faster\) \(\#4891\)
[\#4892](https://github.com/apache/arrow-rs/pull/4892)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- Make ArrowRowGroupWriter Public and SerializedRowGroupWriter Send
[\#4850](https://github.com/apache/arrow-rs/pull/4850)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([devinjdangelo](https://github.com/devinjdangelo))
**Implemented enhancements:**
-- Row Format Adapative Block Size
[\#4812](https://github.com/apache/arrow-rs/issues/4812)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Stateless Row Conversion
[\#4811](https://github.com/apache/arrow-rs/issues/4811)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
-- Add option to specify custom null values for CSV reader
[\#4794](https://github.com/apache/arrow-rs/issues/4794)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- parquet::record::RowIter cannot be customized with batch\_size and defaults
to 1024 [\#4782](https://github.com/apache/arrow-rs/issues/4782)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- `DynScalar` abstraction \(something that makes it easy to create scalar
`Datum`s\) [\#4781](https://github.com/apache/arrow-rs/issues/4781)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- `Datum` is not exported as part of `arrow` \(it is only exported in
`arrow_array`\) [\#4780](https://github.com/apache/arrow-rs/issues/4780)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- `Scalar` is not exported as part of `arrow` \(it is only exported in
`arrow_array`\) [\#4779](https://github.com/apache/arrow-rs/issues/4779)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Support IntoPyArrow for impl RecordBatchReader
[\#4730](https://github.com/apache/arrow-rs/issues/4730)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Datum Based String Kernels
[\#4595](https://github.com/apache/arrow-rs/issues/4595)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- Allow schema fields to merge with `Null` datatype
[\#4901](https://github.com/apache/arrow-rs/issues/4901)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add option to FlightDataEncoder to always send dictionaries
[\#4895](https://github.com/apache/arrow-rs/issues/4895)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- Rework Thrift Encoding / Decoding of Parquet Metadata
[\#4891](https://github.com/apache/arrow-rs/issues/4891)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Plans for supporting Extension Array to support Fixed shape tensor Array
[\#4890](https://github.com/apache/arrow-rs/issues/4890)
+- Implement Take for UnionArray
[\#4882](https://github.com/apache/arrow-rs/issues/4882)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Check precision overflow for casting floating to decimal
[\#4865](https://github.com/apache/arrow-rs/issues/4865)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Replace lexical [\#4774](https://github.com/apache/arrow-rs/issues/4774)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add read access to settings in `csv::WriterBuilder`
[\#4735](https://github.com/apache/arrow-rs/issues/4735)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Improve the performance of "DictionaryValue" row encoding
[\#4712](https://github.com/apache/arrow-rs/issues/4712)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
**Fixed bugs:**
-- MapArray::new\_from\_strings creates nullable entries field
[\#4807](https://github.com/apache/arrow-rs/issues/4807)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- pyarrow module can't roundtrip tensor arrays
[\#4805](https://github.com/apache/arrow-rs/issues/4805)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- `concat_batches` errors with "schema mismatch" error when only metadata
differs [\#4799](https://github.com/apache/arrow-rs/issues/4799)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- panic in `cmp` kernels with DictionaryArrays: `Option::unwrap()` on a
`None` value' [\#4788](https://github.com/apache/arrow-rs/issues/4788)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- stream ffi panics if schema metadata values aren't valid utf8
[\#4750](https://github.com/apache/arrow-rs/issues/4750)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Regression: Incorrect Sorting of `*ListArray` in 46.0.0
[\#4746](https://github.com/apache/arrow-rs/issues/4746)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Row is no longer comparable after reuse
[\#4741](https://github.com/apache/arrow-rs/issues/4741)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- DoPut FlightSQL handler inadvertently consumes schema at start of
Request\<Streaming\<FlightData\>\>
[\#4658](https://github.com/apache/arrow-rs/issues/4658)
-- Return error when converting schema
[\#4752](https://github.com/apache/arrow-rs/pull/4752)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([wjones127](https://github.com/wjones127))
-- Implement PyArrowType for `Box<dyn RecordBatchReader + Send>`
[\#4751](https://github.com/apache/arrow-rs/pull/4751)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([wjones127](https://github.com/wjones127))
+- Should we make blank values and empty string to `None` in csv?
[\#4939](https://github.com/apache/arrow-rs/issues/4939)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- \[FlightSQL\] SubstraitPlan structure is not exported
[\#4932](https://github.com/apache/arrow-rs/issues/4932)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- Loading page index breaks skipping of pages with nested types
[\#4921](https://github.com/apache/arrow-rs/issues/4921)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- CSV schema inference assumes `Utf8` for empty columns
[\#4903](https://github.com/apache/arrow-rs/issues/4903)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- parquet: Field Ids are not read from a Parquet file without serialized arrow
schema [\#4877](https://github.com/apache/arrow-rs/issues/4877)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- make\_primitive\_scalar function loses DataType Internal information
[\#4851](https://github.com/apache/arrow-rs/issues/4851)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- StructBuilder doesn't handle nulls correctly for empty structs
[\#4842](https://github.com/apache/arrow-rs/issues/4842)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- `NullArray::is_null()` returns `false` incorrectly
[\#4835](https://github.com/apache/arrow-rs/issues/4835)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- cast\_string\_to\_decimal should check precision overflow
[\#4829](https://github.com/apache/arrow-rs/issues/4829)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Null fields are omitted by `infer_json_schema_from_seekable`
[\#4814](https://github.com/apache/arrow-rs/issues/4814)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
**Closed issues:**
-- Building arrow-rust for target wasm32-wasi falied to compile packed\_simd\_2
[\#4717](https://github.com/apache/arrow-rs/issues/4717)
+- Support for reading JSON Array to Arrow
[\#4905](https://github.com/apache/arrow-rs/issues/4905)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
**Merged pull requests:**
-- Respect FormatOption::nulls for NullArray
[\#4836](https://github.com/apache/arrow-rs/pull/4836)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Fix merge\_dictionary\_values in selection kernels
[\#4833](https://github.com/apache/arrow-rs/pull/4833)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Fix like scalar null [\#4832](https://github.com/apache/arrow-rs/pull/4832)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- More chrono deprecations
[\#4822](https://github.com/apache/arrow-rs/pull/4822)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Adaptive Row Block Size \(\#4812\)
[\#4818](https://github.com/apache/arrow-rs/pull/4818)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Update proc-macro2 requirement from =1.0.66 to =1.0.67
[\#4816](https://github.com/apache/arrow-rs/pull/4816)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
-- Do not check schema for equality in concat\_batches
[\#4815](https://github.com/apache/arrow-rs/pull/4815)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- fix: export record batch through stream
[\#4806](https://github.com/apache/arrow-rs/pull/4806)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([wjones127](https://github.com/wjones127))
-- Improve CSV Reader Benchmark Coverage of Small Primitives
[\#4803](https://github.com/apache/arrow-rs/pull/4803)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- csv: Add option to specify custom null values
[\#4795](https://github.com/apache/arrow-rs/pull/4795)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([vrongmeal](https://github.com/vrongmeal))
-- Expand docstring and add example to `Scalar`
[\#4793](https://github.com/apache/arrow-rs/pull/4793)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Re-export array crate root \(\#4780\) \(\#4779\)
[\#4791](https://github.com/apache/arrow-rs/pull/4791)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Fix DictionaryArray::normalized\_keys \(\#4788\)
[\#4789](https://github.com/apache/arrow-rs/pull/4789)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Allow custom tree builder for parquet::record::RowIter
[\#4783](https://github.com/apache/arrow-rs/pull/4783)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([YuraKotov](https://github.com/YuraKotov))
-- Bump actions/checkout from 3 to 4
[\#4767](https://github.com/apache/arrow-rs/pull/4767)
([dependabot[bot]](https://github.com/apps/dependabot))
-- fix: avoid panic if offset index not exists.
[\#4761](https://github.com/apache/arrow-rs/pull/4761)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([RinChanNOWWW](https://github.com/RinChanNOWWW))
-- Relax constraints on PyArrowType
[\#4757](https://github.com/apache/arrow-rs/pull/4757)
([tustvold](https://github.com/tustvold))
-- Chrono deprecations [\#4748](https://github.com/apache/arrow-rs/pull/4748)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Fix List Sorting, Revert Removal of Rank Kernels
[\#4747](https://github.com/apache/arrow-rs/pull/4747)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Clear row buffer before reuse
[\#4742](https://github.com/apache/arrow-rs/pull/4742)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([yjshen](https://github.com/yjshen))
-- Datum based like kernels \(\#4595\)
[\#4732](https://github.com/apache/arrow-rs/pull/4732)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([tustvold](https://github.com/tustvold))
-- feat: expose DoGet response headers & trailers
[\#4727](https://github.com/apache/arrow-rs/pull/4727)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([crepererum](https://github.com/crepererum))
-- Cleanup length and bit\_length kernels
[\#4718](https://github.com/apache/arrow-rs/pull/4718)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Assume Pages Delimit Records When Offset Index Loaded \(\#4921\)
[\#4943](https://github.com/apache/arrow-rs/pull/4943)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- Update pyo3 requirement from 0.19 to 0.20
[\#4941](https://github.com/apache/arrow-rs/pull/4941)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([crepererum](https://github.com/crepererum))
+- Add `FileWriter` schema getter
[\#4940](https://github.com/apache/arrow-rs/pull/4940)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([haixuanTao](https://github.com/haixuanTao))
+- feat: support parsing for parquet writer option
[\#4938](https://github.com/apache/arrow-rs/pull/4938)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([fansehep](https://github.com/fansehep))
+- Export `SubstraitPlan` structure in arrow\_flight::sql \(\#4932\)
[\#4933](https://github.com/apache/arrow-rs/pull/4933)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([amartins23](https://github.com/amartins23))
+- Update zstd requirement from 0.12.0 to 0.13.0
[\#4923](https://github.com/apache/arrow-rs/pull/4923)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- feat: add method for async read bloom filter
[\#4917](https://github.com/apache/arrow-rs/pull/4917)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([hengfeiyang](https://github.com/hengfeiyang))
+- Minor: Clarify rationale for `FlightDataEncoder` API, add examples
[\#4916](https://github.com/apache/arrow-rs/pull/4916)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alamb](https://github.com/alamb))
+- Update regex-syntax requirement from 0.7.1 to 0.8.0
[\#4914](https://github.com/apache/arrow-rs/pull/4914)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- feat: document & streamline flight SQL CLI
[\#4912](https://github.com/apache/arrow-rs/pull/4912)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([crepererum](https://github.com/crepererum))
+- Support Arbitrary JSON values in JSON Reader \(\#4905\)
[\#4911](https://github.com/apache/arrow-rs/pull/4911)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Cleanup CSV WriterBuilder, Default to AutoSI Second Precision \(\#4735\)
[\#4909](https://github.com/apache/arrow-rs/pull/4909)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Update proc-macro2 requirement from =1.0.68 to =1.0.69
[\#4907](https://github.com/apache/arrow-rs/pull/4907)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- chore: add csv example
[\#4904](https://github.com/apache/arrow-rs/pull/4904)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([fansehep](https://github.com/fansehep))
+- feat\(schema\): allow null fields to be merged with other datatypes
[\#4902](https://github.com/apache/arrow-rs/pull/4902)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([kskalski](https://github.com/kskalski))
+- Update proc-macro2 requirement from =1.0.67 to =1.0.68
[\#4900](https://github.com/apache/arrow-rs/pull/4900)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Add option to `FlightDataEncoder` to always resend batch dictionaries
[\#4896](https://github.com/apache/arrow-rs/pull/4896)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([alexwilcoxson-rel](https://github.com/alexwilcoxson-rel))
+- Fix integration tests [\#4889](https://github.com/apache/arrow-rs/pull/4889)
([tustvold](https://github.com/tustvold))
+- Support Parsing Avro File Headers
[\#4888](https://github.com/apache/arrow-rs/pull/4888)
([tustvold](https://github.com/tustvold))
+- Support parquet bloom filter length
[\#4885](https://github.com/apache/arrow-rs/pull/4885)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([letian-jiang](https://github.com/letian-jiang))
+- Replace lz4 with lz4\_flex Allowing Compilation for WASM
[\#4884](https://github.com/apache/arrow-rs/pull/4884)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Implement Take for UnionArray
[\#4883](https://github.com/apache/arrow-rs/pull/4883)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([avantgardnerio](https://github.com/avantgardnerio))
+- Update tonic-build requirement from =0.10.1 to =0.10.2
[\#4881](https://github.com/apache/arrow-rs/pull/4881)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- parquet: Read field IDs from Parquet Schema
[\#4878](https://github.com/apache/arrow-rs/pull/4878)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Samrose-Ahmed](https://github.com/Samrose-Ahmed))
+- feat: improve flight CLI error handling
[\#4873](https://github.com/apache/arrow-rs/pull/4873)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([crepererum](https://github.com/crepererum))
+- Support Encoding Parquet Columns in Parallel
[\#4871](https://github.com/apache/arrow-rs/pull/4871)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- Check precision overflow for casting floating to decimal
[\#4866](https://github.com/apache/arrow-rs/pull/4866)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Make align\_buffers as public API
[\#4863](https://github.com/apache/arrow-rs/pull/4863)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Enable new integration tests \(\#4828\)
[\#4862](https://github.com/apache/arrow-rs/pull/4862)
([tustvold](https://github.com/tustvold))
+- Faster Serde Integration \(~80% faster\)
[\#4861](https://github.com/apache/arrow-rs/pull/4861)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- fix: make\_primitive\_scalar bug
[\#4852](https://github.com/apache/arrow-rs/pull/4852)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([JasonLi-cn](https://github.com/JasonLi-cn))
+- Update tonic-build requirement from =0.10.0 to =0.10.1
[\#4846](https://github.com/apache/arrow-rs/pull/4846)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Allow Constructing Non-Empty StructArray with no Fields \(\#4842\)
[\#4845](https://github.com/apache/arrow-rs/pull/4845)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Refine documentation to `Array::is_null`
[\#4838](https://github.com/apache/arrow-rs/pull/4838)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- fix: add missing precision overflow checking for `cast_string_to_decimal`
[\#4830](https://github.com/apache/arrow-rs/pull/4830)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([jonahgao](https://github.com/jonahgao))
diff --git a/Cargo.toml b/Cargo.toml
index d874e335ee..d59a5af68a 100644
--- a/Cargo.toml
+++ b/Cargo.toml
@@ -62,7 +62,7 @@ exclude = [
]
[workspace.package]
-version = "47.0.0"
+version = "48.0.0"
homepage = "https://github.com/apache/arrow-rs";
repository = "https://github.com/apache/arrow-rs";
authors = ["Apache Arrow <[email protected]>"]
@@ -77,20 +77,20 @@ edition = "2021"
rust-version = "1.62"
[workspace.dependencies]
-arrow = { version = "47.0.0", path = "./arrow", default-features = false }
-arrow-arith = { version = "47.0.0", path = "./arrow-arith" }
-arrow-array = { version = "47.0.0", path = "./arrow-array" }
-arrow-buffer = { version = "47.0.0", path = "./arrow-buffer" }
-arrow-cast = { version = "47.0.0", path = "./arrow-cast" }
-arrow-csv = { version = "47.0.0", path = "./arrow-csv" }
-arrow-data = { version = "47.0.0", path = "./arrow-data" }
-arrow-ipc = { version = "47.0.0", path = "./arrow-ipc" }
-arrow-json = { version = "47.0.0", path = "./arrow-json" }
-arrow-ord = { version = "47.0.0", path = "./arrow-ord" }
-arrow-row = { version = "47.0.0", path = "./arrow-row" }
-arrow-schema = { version = "47.0.0", path = "./arrow-schema" }
-arrow-select = { version = "47.0.0", path = "./arrow-select" }
-arrow-string = { version = "47.0.0", path = "./arrow-string" }
-parquet = { version = "47.0.0", path = "./parquet", default-features = false }
+arrow = { version = "48.0.0", path = "./arrow", default-features = false }
+arrow-arith = { version = "48.0.0", path = "./arrow-arith" }
+arrow-array = { version = "48.0.0", path = "./arrow-array" }
+arrow-buffer = { version = "48.0.0", path = "./arrow-buffer" }
+arrow-cast = { version = "48.0.0", path = "./arrow-cast" }
+arrow-csv = { version = "48.0.0", path = "./arrow-csv" }
+arrow-data = { version = "48.0.0", path = "./arrow-data" }
+arrow-ipc = { version = "48.0.0", path = "./arrow-ipc" }
+arrow-json = { version = "48.0.0", path = "./arrow-json" }
+arrow-ord = { version = "48.0.0", path = "./arrow-ord" }
+arrow-row = { version = "48.0.0", path = "./arrow-row" }
+arrow-schema = { version = "48.0.0", path = "./arrow-schema" }
+arrow-select = { version = "48.0.0", path = "./arrow-select" }
+arrow-string = { version = "48.0.0", path = "./arrow-string" }
+parquet = { version = "48.0.0", path = "./parquet", default-features = false }
chrono = { version = "0.4.31", default-features = false, features = ["clock"] }
diff --git a/dev/release/update_change_log.sh b/dev/release/update_change_log.sh
index 74bbb4ac1e..c1627ebb8c 100755
--- a/dev/release/update_change_log.sh
+++ b/dev/release/update_change_log.sh
@@ -29,8 +29,8 @@
set -e
-SINCE_TAG="46.0.0"
-FUTURE_RELEASE="47.0.0"
+SINCE_TAG="47.0.0"
+FUTURE_RELEASE="48.0.0"
SOURCE_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
SOURCE_TOP_DIR="$(cd "${SOURCE_DIR}/../../" && pwd)"
