This is an automated email from the ASF dual-hosted git repository.
alamb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
The following commit(s) were added to refs/heads/master by this push:
new eb91dac6e Final 28.0.0 CHANGELOG updates (#3194)
eb91dac6e is described below
commit eb91dac6e99b0bcbcbd8057b03233059089bbf27
Author: Andrew Lamb <[email protected]>
AuthorDate: Fri Nov 25 14:03:38 2022 -0500
Final 28.0.0 CHANGELOG updates (#3194)
* Update Changelog with labels
* Update with latest
* update
---
CHANGELOG.md | 51 ++++++++++++++++++++++++++++++---------------------
1 file changed, 30 insertions(+), 21 deletions(-)
diff --git a/CHANGELOG.md b/CHANGELOG.md
index c775d3352..accec4491 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -19,12 +19,13 @@
# Changelog
-## [28.0.0](https://github.com/apache/arrow-rs/tree/28.0.0) (2022-11-24)
+## [28.0.0](https://github.com/apache/arrow-rs/tree/28.0.0) (2022-11-25)
[Full Changelog](https://github.com/apache/arrow-rs/compare/27.0.0...28.0.0)
**Breaking changes:**
+- StructArray::columns return slice
[\#3186](https://github.com/apache/arrow-rs/pull/3186)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
- Return slice from GenericByteArray::value\_data
[\#3171](https://github.com/apache/arrow-rs/pull/3171)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
- Support decimal negative scale
[\#3152](https://github.com/apache/arrow-rs/pull/3152)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
- refactor: convert `Field::metadata` to `HashMap`
[\#3148](https://github.com/apache/arrow-rs/pull/3148)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([crepererum](https://github.com/crepererum))
@@ -37,41 +38,47 @@
**Implemented enhancements:**
- Add iterator to RowSelection
[\#3172](https://github.com/apache/arrow-rs/issues/3172)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Row Format Size Tracking
[\#3160](https://github.com/apache/arrow-rs/issues/3160)
-- Add ArrayBuilder::finish\_cloned\(\)
[\#3154](https://github.com/apache/arrow-rs/issues/3154)
+- create an integration test set for parquet crate against pyspark for working
with bloom filters [\#3167](https://github.com/apache/arrow-rs/issues/3167)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Row Format Size Tracking
[\#3160](https://github.com/apache/arrow-rs/issues/3160)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add ArrayBuilder::finish\_cloned\(\)
[\#3154](https://github.com/apache/arrow-rs/issues/3154)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
- Optimize memory usage of json reader
[\#3150](https://github.com/apache/arrow-rs/issues/3150)
-- Add `Field::size` and `DataType::size`
[\#3147](https://github.com/apache/arrow-rs/issues/3147)
-- Add like\_utf8\_scalar\_dyn kernel
[\#3145](https://github.com/apache/arrow-rs/issues/3145)
-- support comparison for decimal128 array with scalar in kernel
[\#3140](https://github.com/apache/arrow-rs/issues/3140)
-- Replace custom date/time add/sub months by chrono 0.4.23's new api
[\#3131](https://github.com/apache/arrow-rs/issues/3131)
+- Add `Field::size` and `DataType::size`
[\#3147](https://github.com/apache/arrow-rs/issues/3147)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Add like\_utf8\_scalar\_dyn kernel
[\#3145](https://github.com/apache/arrow-rs/issues/3145)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- support comparison for decimal128 array with scalar in kernel
[\#3140](https://github.com/apache/arrow-rs/issues/3140)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- audit and create a document for bloom filter configurations
[\#3138](https://github.com/apache/arrow-rs/issues/3138)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Should be the rounding vs truncation when cast decimal to smaller scale
[\#3137](https://github.com/apache/arrow-rs/issues/3137)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
- Upgrade chrono to 0.4.23
[\#3120](https://github.com/apache/arrow-rs/issues/3120)
-- Implements more temporal kernels using time\_fraction\_dyn
[\#3108](https://github.com/apache/arrow-rs/issues/3108)
-- Upgrade to thrift 0.17
[\#3105](https://github.com/apache/arrow-rs/issues/3105)
-- Be able to parse time formatted strings
[\#3100](https://github.com/apache/arrow-rs/issues/3100)
-- Improve "Fail to merge schema" error messages
[\#3095](https://github.com/apache/arrow-rs/issues/3095)
+- Implements more temporal kernels using time\_fraction\_dyn
[\#3108](https://github.com/apache/arrow-rs/issues/3108)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Upgrade to thrift 0.17
[\#3105](https://github.com/apache/arrow-rs/issues/3105)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Be able to parse time formatted strings
[\#3100](https://github.com/apache/arrow-rs/issues/3100)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Improve "Fail to merge schema" error messages
[\#3095](https://github.com/apache/arrow-rs/issues/3095)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
- Expose `SortingColumn` when reading and writing parquet metadata
[\#3090](https://github.com/apache/arrow-rs/issues/3090)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Change Field::metadata to HashMap
[\#3086](https://github.com/apache/arrow-rs/issues/3086)
+- Change Field::metadata to HashMap
[\#3086](https://github.com/apache/arrow-rs/issues/3086)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Support bloom filter reading and writing for parquet
[\#3023](https://github.com/apache/arrow-rs/issues/3023)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
- API to take back ownership of an ArrayRef
[\#2901](https://github.com/apache/arrow-rs/issues/2901)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Specialized Interleave Kernel
[\#2864](https://github.com/apache/arrow-rs/issues/2864)
+- Specialized Interleave Kernel
[\#2864](https://github.com/apache/arrow-rs/issues/2864)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
**Fixed bugs:**
-- arithmatic overflow leads to segfault in `concat_batches`
[\#3123](https://github.com/apache/arrow-rs/issues/3123)
-- Clippy failing on master : error: use of deprecated associated function
chrono::NaiveDate::from\_ymd: use from\_ymd\_opt\(\) instead
[\#3097](https://github.com/apache/arrow-rs/issues/3097)
-- Pretty print for interval types has wrong formatting
[\#3092](https://github.com/apache/arrow-rs/issues/3092)
-- Field is not serializable with binary formats
[\#3082](https://github.com/apache/arrow-rs/issues/3082)
-- Decimal Casts are Unchecked
[\#2986](https://github.com/apache/arrow-rs/issues/2986)
-- Reading parquet files with a corrupt ARROW:schema panics
[\#2855](https://github.com/apache/arrow-rs/issues/2855)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- arithmatic overflow leads to segfault in `concat_batches`
[\#3123](https://github.com/apache/arrow-rs/issues/3123)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Clippy failing on master : error: use of deprecated associated function
chrono::NaiveDate::from\_ymd: use from\_ymd\_opt\(\) instead
[\#3097](https://github.com/apache/arrow-rs/issues/3097)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Pretty print for interval types has wrong formatting
[\#3092](https://github.com/apache/arrow-rs/issues/3092)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Field is not serializable with binary formats
[\#3082](https://github.com/apache/arrow-rs/issues/3082)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Decimal Casts are Unchecked
[\#2986](https://github.com/apache/arrow-rs/issues/2986)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
**Closed issues:**
-- audit and create a document for bloom filter configurations
[\#3138](https://github.com/apache/arrow-rs/issues/3138)
-- Release Arrow `27.0.0` \(next release after `26.0.0`\)
[\#3045](https://github.com/apache/arrow-rs/issues/3045)
+- Release Arrow `27.0.0` \(next release after `26.0.0`\)
[\#3045](https://github.com/apache/arrow-rs/issues/3045)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
- Perf about ParquetRecordBatchStream vs ParquetRecordBatchReader
[\#2916](https://github.com/apache/arrow-rs/issues/2916)
**Merged pull requests:**
+- Improve regex related kernels by upto 85%
[\#3192](https://github.com/apache/arrow-rs/pull/3192)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([psvri](https://github.com/psvri))
+- Derive clone for arrays
[\#3184](https://github.com/apache/arrow-rs/pull/3184)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Row decode cleanups [\#3180](https://github.com/apache/arrow-rs/pull/3180)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
- Update zstd requirement from 0.11.1 to 0.12.0
[\#3178](https://github.com/apache/arrow-rs/pull/3178)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Move decimal constants from `arrow-data` to `arrow-schema` crate
[\#3177](https://github.com/apache/arrow-rs/pull/3177)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([mbrobbel](https://github.com/mbrobbel))
+- bloom filter part V: add an integration with pytest against pyspark
[\#3176](https://github.com/apache/arrow-rs/pull/3176)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([Jimexist](https://github.com/Jimexist))
- Bloom filter config tweaks \(\#3023\)
[\#3175](https://github.com/apache/arrow-rs/pull/3175)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
- Add RowParser [\#3174](https://github.com/apache/arrow-rs/pull/3174)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
- Add `RowSelection::iter()`, `Into<Vec<RowSelector>>` and example
[\#3173](https://github.com/apache/arrow-rs/pull/3173)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([alamb](https://github.com/alamb))
@@ -86,11 +93,13 @@
- Add finish\_cloned to ArrayBuilder
[\#3158](https://github.com/apache/arrow-rs/pull/3158)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([askoa](https://github.com/askoa))
- Check overflow in MutableArrayData extend offsets \(\#3123\)
[\#3157](https://github.com/apache/arrow-rs/pull/3157)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
- Extend Decimal256 as Primitive
[\#3156](https://github.com/apache/arrow-rs/pull/3156)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Doc improvements [\#3155](https://github.com/apache/arrow-rs/pull/3155)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([psvri](https://github.com/psvri))
- Add collect.rs example
[\#3153](https://github.com/apache/arrow-rs/pull/3153)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
- Implement Neg for i256
[\#3151](https://github.com/apache/arrow-rs/pull/3151)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
- feat: `{Field,DataType}::size`
[\#3149](https://github.com/apache/arrow-rs/pull/3149)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([crepererum](https://github.com/crepererum))
- Add like\_utf8\_scalar\_dyn kernel
[\#3146](https://github.com/apache/arrow-rs/pull/3146)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
- comparison op: decimal128 array with scalar
[\#3141](https://github.com/apache/arrow-rs/pull/3141)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
+- Cast: should get the round result for decimal to a decimal with smaller
scale [\#3139](https://github.com/apache/arrow-rs/pull/3139)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
- Fix Panic on Reading Corrupt Parquet Schema \(\#2855\)
[\#3130](https://github.com/apache/arrow-rs/pull/3130)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([psvri](https://github.com/psvri))
- Clippy parquet fixes [\#3124](https://github.com/apache/arrow-rs/pull/3124)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([psvri](https://github.com/psvri))
- Add GenericByteBuilder \(\#2969\)
[\#3122](https://github.com/apache/arrow-rs/pull/3122)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
