This is an automated email from the ASF dual-hosted git repository.
tustvold pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
The following commit(s) were added to refs/heads/master by this push:
new b61741503 Prep for 39.0.0 (#4171)
b61741503 is described below
commit b6174150399f6c0e13b5dfb8ad283468a2c6c31a
Author: Ian Alexander Joiner <[email protected]>
AuthorDate: Fri May 5 09:05:15 2023 -0400
Prep for 39.0.0 (#4171)
* feat: update versions
* feat: update versions
* feat: update versions
* docs: update changelog
---
CHANGELOG-old.md | 76 +++++++++++++++++++++++++++++++
CHANGELOG.md | 98 +++++++++++++++++-----------------------
Cargo.toml | 32 ++++++-------
arrow-flight/README.md | 2 +-
arrow/README.md | 2 +-
dev/release/README.md | 2 +-
dev/release/update_change_log.sh | 4 +-
parquet_derive/README.md | 4 +-
8 files changed, 141 insertions(+), 79 deletions(-)
diff --git a/CHANGELOG-old.md b/CHANGELOG-old.md
index e04f0f5d2..fa932b103 100644
--- a/CHANGELOG-old.md
+++ b/CHANGELOG-old.md
@@ -19,6 +19,82 @@
# Historical Changelog
+## [38.0.0](https://github.com/apache/arrow-rs/tree/38.0.0) (2023-04-21)
+
+[Full Changelog](https://github.com/apache/arrow-rs/compare/37.0.0...38.0.0)
+
+**Breaking changes:**
+
+- Remove DataType from PrimitiveArray constructors
[\#4098](https://github.com/apache/arrow-rs/pull/4098)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Use Into\<Arc\<str\>\> for PrimitiveArray::with\_timezone
[\#4097](https://github.com/apache/arrow-rs/pull/4097)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Store StructArray entries in MapArray
[\#4085](https://github.com/apache/arrow-rs/pull/4085)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Add DictionaryArray Constructors \(\#3879\)
[\#4068](https://github.com/apache/arrow-rs/pull/4068)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([tustvold](https://github.com/tustvold))
+- Relax JSON schema inference generics
[\#4063](https://github.com/apache/arrow-rs/pull/4063)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Remove ArrayData from Array \(\#3880\)
[\#4061](https://github.com/apache/arrow-rs/pull/4061)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Add CommandGetXdbcTypeInfo to Flight SQL Server
[\#4055](https://github.com/apache/arrow-rs/pull/4055)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([c-thiel](https://github.com/c-thiel))
+- Remove old JSON Reader and Decoder \(\#3610\)
[\#4052](https://github.com/apache/arrow-rs/pull/4052)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Use BufRead for JSON Schema Inference
[\#4041](https://github.com/apache/arrow-rs/pull/4041)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([WenyXu](https://github.com/WenyXu))
+
+**Implemented enhancements:**
+
+- Support dyn\_compare\_scalar for Decimal256
[\#4083](https://github.com/apache/arrow-rs/issues/4083)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Better JSON Reader Error Messages
[\#4076](https://github.com/apache/arrow-rs/issues/4076)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Additional data type groups
[\#4056](https://github.com/apache/arrow-rs/issues/4056)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Async JSON reader [\#4043](https://github.com/apache/arrow-rs/issues/4043)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Field::contains Should Recurse into DataType
[\#4029](https://github.com/apache/arrow-rs/issues/4029)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Prevent UnionArray with Repeated Type IDs
[\#3982](https://github.com/apache/arrow-rs/issues/3982)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Support `Timestamp` `+`/`-` `Interval` types
[\#3963](https://github.com/apache/arrow-rs/issues/3963)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- First-Class Array Abstractions
[\#3880](https://github.com/apache/arrow-rs/issues/3880)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+
+**Fixed bugs:**
+
+- Update readme to remove reference to Jira
[\#4091](https://github.com/apache/arrow-rs/issues/4091)
+- OffsetBuffer::new Rejects 0 Offsets
[\#4066](https://github.com/apache/arrow-rs/issues/4066)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Parquet AsyncArrowWriter not shutting down inner async writer.
[\#4058](https://github.com/apache/arrow-rs/issues/4058)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
+- Flight SQL Server missing command
type.googleapis.com/arrow.flight.protocol.sql.CommandGetXdbcTypeInfo
[\#4054](https://github.com/apache/arrow-rs/issues/4054)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- RawJsonReader Errors with Empty Schema
[\#4053](https://github.com/apache/arrow-rs/issues/4053)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- RawJsonReader Integer Truncation
[\#4049](https://github.com/apache/arrow-rs/issues/4049)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Sparse UnionArray Equality Incorrect Offset Handling
[\#4044](https://github.com/apache/arrow-rs/issues/4044)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+
+**Documentation updates:**
+
+- Write blog about improvements in JSON and CSV processing
[\#4062](https://github.com/apache/arrow-rs/issues/4062)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+
+**Closed issues:**
+
+- Parquet reader of Int96 columns and coercion to timestamps
[\#4075](https://github.com/apache/arrow-rs/issues/4075)
+- Serializing timestamp from int \(json raw decoder\)
[\#4069](https://github.com/apache/arrow-rs/issues/4069)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Support casting to/from Interval and Duration
[\#3998](https://github.com/apache/arrow-rs/issues/3998)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+
+**Merged pull requests:**
+
+- Fix Docs Typos [\#4100](https://github.com/apache/arrow-rs/pull/4100)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([rnarkk](https://github.com/rnarkk))
+- Update tonic-build requirement from =0.9.1 to =0.9.2
[\#4099](https://github.com/apache/arrow-rs/pull/4099)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Increase minimum chrono version to 0.4.24
[\#4093](https://github.com/apache/arrow-rs/pull/4093)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
+- Simplify reference to GitHub issues
[\#4092](https://github.com/apache/arrow-rs/pull/4092)
([bkmgit](https://github.com/bkmgit))
+- \[Minor\]: Add `Hash` trait to SortOptions.
[\#4089](https://github.com/apache/arrow-rs/pull/4089)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([mustafasrepo](https://github.com/mustafasrepo))
+- Include byte offsets in parquet-layout
[\#4086](https://github.com/apache/arrow-rs/pull/4086)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- feat: Support dyn\_compare\_scalar for Decimal256
[\#4084](https://github.com/apache/arrow-rs/pull/4084)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([izveigor](https://github.com/izveigor))
+- Add ByteArray constructors \(\#3879\)
[\#4081](https://github.com/apache/arrow-rs/pull/4081)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Update prost-build requirement from =0.11.8 to =0.11.9
[\#4080](https://github.com/apache/arrow-rs/pull/4080)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Improve JSON decoder errors \(\#4076\)
[\#4079](https://github.com/apache/arrow-rs/pull/4079)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Fix Timestamp Numeric Truncation in JSON Reader
[\#4074](https://github.com/apache/arrow-rs/pull/4074)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Serialize numeric to tape \(\#4069\)
[\#4073](https://github.com/apache/arrow-rs/pull/4073)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- feat: Prevent UnionArray with Repeated Type IDs
[\#4070](https://github.com/apache/arrow-rs/pull/4070)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
+- Add PrimitiveArray::try\_new \(\#3879\)
[\#4067](https://github.com/apache/arrow-rs/pull/4067)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Add ListArray Constructors \(\#3879\)
[\#4065](https://github.com/apache/arrow-rs/pull/4065)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Shutdown parquet async writer
[\#4059](https://github.com/apache/arrow-rs/pull/4059)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([kindly](https://github.com/kindly))
+- feat: additional data type groups
[\#4057](https://github.com/apache/arrow-rs/pull/4057)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([izveigor](https://github.com/izveigor))
+- Fix precision loss in Raw JSON decoder \(\#4049\)
[\#4051](https://github.com/apache/arrow-rs/pull/4051)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Use lexical\_core in CSV and JSON parser \(~25% faster\)
[\#4050](https://github.com/apache/arrow-rs/pull/4050)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Add offsets accessors to variable length arrays \(\#3879\)
[\#4048](https://github.com/apache/arrow-rs/pull/4048)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Document Async decoder usage \(\#4043\) \(\#78\)
[\#4046](https://github.com/apache/arrow-rs/pull/4046)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Fix sparse union array equality \(\#4044\)
[\#4045](https://github.com/apache/arrow-rs/pull/4045)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- feat: DataType::contains support nested type
[\#4042](https://github.com/apache/arrow-rs/pull/4042)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
+- feat: Support Timestamp +/- Interval types
[\#4038](https://github.com/apache/arrow-rs/pull/4038)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
+- Fix object\_store CI [\#4037](https://github.com/apache/arrow-rs/pull/4037)
([tustvold](https://github.com/tustvold))
+- feat: cast from/to interval and duration
[\#4020](https://github.com/apache/arrow-rs/pull/4020)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
+
## [37.0.0](https://github.com/apache/arrow-rs/tree/37.0.0) (2023-04-07)
[Full Changelog](https://github.com/apache/arrow-rs/compare/36.0.0...37.0.0)
diff --git a/CHANGELOG.md b/CHANGELOG.md
index f5dfa46ea..d5b6293b6 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -19,81 +19,67 @@
# Changelog
-## [38.0.0](https://github.com/apache/arrow-rs/tree/38.0.0) (2023-04-21)
+## [39.0.0](https://github.com/apache/arrow-rs/tree/39.0.0) (2023-05-05)
-[Full Changelog](https://github.com/apache/arrow-rs/compare/37.0.0...38.0.0)
+[Full Changelog](https://github.com/apache/arrow-rs/compare/38.0.0...39.0.0)
**Breaking changes:**
-- Remove DataType from PrimitiveArray constructors
[\#4098](https://github.com/apache/arrow-rs/pull/4098)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Use Into\<Arc\<str\>\> for PrimitiveArray::with\_timezone
[\#4097](https://github.com/apache/arrow-rs/pull/4097)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Store StructArray entries in MapArray
[\#4085](https://github.com/apache/arrow-rs/pull/4085)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Add DictionaryArray Constructors \(\#3879\)
[\#4068](https://github.com/apache/arrow-rs/pull/4068)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([tustvold](https://github.com/tustvold))
-- Relax JSON schema inference generics
[\#4063](https://github.com/apache/arrow-rs/pull/4063)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Remove ArrayData from Array \(\#3880\)
[\#4061](https://github.com/apache/arrow-rs/pull/4061)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Add CommandGetXdbcTypeInfo to Flight SQL Server
[\#4055](https://github.com/apache/arrow-rs/pull/4055)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([c-thiel](https://github.com/c-thiel))
-- Remove old JSON Reader and Decoder \(\#3610\)
[\#4052](https://github.com/apache/arrow-rs/pull/4052)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Use BufRead for JSON Schema Inference
[\#4041](https://github.com/apache/arrow-rs/pull/4041)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([WenyXu](https://github.com/WenyXu))
+- Cleanup ChunkReader \(\#4118\)
[\#4156](https://github.com/apache/arrow-rs/pull/4156)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- Remove Type from NativeIndex
[\#4146](https://github.com/apache/arrow-rs/pull/4146)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- Don't Duplicate Offset Index on RowGroupMetadata
[\#4142](https://github.com/apache/arrow-rs/pull/4142)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- Return BooleanBuffer from BooleanBufferBuilder
[\#4140](https://github.com/apache/arrow-rs/pull/4140)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Cleanup CSV schema inference \(\#4129\) \(\#4130\)
[\#4133](https://github.com/apache/arrow-rs/pull/4133)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- Remove deprecated parquet ArrowReader
[\#4125](https://github.com/apache/arrow-rs/pull/4125)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- refactor: construct `StructArray` w/ `FieldRef`
[\#4116](https://github.com/apache/arrow-rs/pull/4116)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([crepererum](https://github.com/crepererum))
+- Ignore Field Metadata in equals\_datatype for Dictionary, RunEndEncoded, Map
and Union [\#4111](https://github.com/apache/arrow-rs/pull/4111)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([izveigor](https://github.com/izveigor))
+- Add StructArray Constructors \(\#3879\)
[\#4064](https://github.com/apache/arrow-rs/pull/4064)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
**Implemented enhancements:**
-- Support dyn\_compare\_scalar for Decimal256
[\#4083](https://github.com/apache/arrow-rs/issues/4083)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Better JSON Reader Error Messages
[\#4076](https://github.com/apache/arrow-rs/issues/4076)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Additional data type groups
[\#4056](https://github.com/apache/arrow-rs/issues/4056)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Async JSON reader [\#4043](https://github.com/apache/arrow-rs/issues/4043)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Field::contains Should Recurse into DataType
[\#4029](https://github.com/apache/arrow-rs/issues/4029)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Prevent UnionArray with Repeated Type IDs
[\#3982](https://github.com/apache/arrow-rs/issues/3982)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Support `Timestamp` `+`/`-` `Interval` types
[\#3963](https://github.com/apache/arrow-rs/issues/3963)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- First-Class Array Abstractions
[\#3880](https://github.com/apache/arrow-rs/issues/3880)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
+- InMemory append API [\#4152](https://github.com/apache/arrow-rs/issues/4152)
+- Fixed point decimal multiplication for DictionaryArray
[\#4135](https://github.com/apache/arrow-rs/issues/4135)
+- Remove Seek Requirement from CSV ReaderBuilder
[\#4130](https://github.com/apache/arrow-rs/issues/4130)
+- Inconsistent CSV Inference and Parsing DateTime Handling
[\#4129](https://github.com/apache/arrow-rs/issues/4129)
+- Support accessing ipc Reader/Writer inner by reference
[\#4121](https://github.com/apache/arrow-rs/issues/4121)
+- \[object\_store\] Retry requests on connection error
[\#4119](https://github.com/apache/arrow-rs/issues/4119)
+- Add Type Declarations for All Primitive Tensors and Buffer Builders
[\#4112](https://github.com/apache/arrow-rs/issues/4112)
+- Support `Interval + Timestamp` and `Interval + Date` in addition to
`Timestamp + Interval` and `Interval + Date`
[\#4094](https://github.com/apache/arrow-rs/issues/4094)
+- Enable setting FlightDescriptor on FlightDataEncoderBuilder
[\#3855](https://github.com/apache/arrow-rs/issues/3855)
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
**Fixed bugs:**
-- Update readme to remove reference to Jira
[\#4091](https://github.com/apache/arrow-rs/issues/4091)
-- OffsetBuffer::new Rejects 0 Offsets
[\#4066](https://github.com/apache/arrow-rs/issues/4066)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Parquet AsyncArrowWriter not shutting down inner async writer.
[\#4058](https://github.com/apache/arrow-rs/issues/4058)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
-- Flight SQL Server missing command
type.googleapis.com/arrow.flight.protocol.sql.CommandGetXdbcTypeInfo
[\#4054](https://github.com/apache/arrow-rs/issues/4054)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
-- RawJsonReader Errors with Empty Schema
[\#4053](https://github.com/apache/arrow-rs/issues/4053)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- RawJsonReader Integer Truncation
[\#4049](https://github.com/apache/arrow-rs/issues/4049)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Sparse UnionArray Equality Incorrect Offset Handling
[\#4044](https://github.com/apache/arrow-rs/issues/4044)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Parquet Page Index Reader Assumes Consecutive Offsets
[\#4149](https://github.com/apache/arrow-rs/issues/4149)
+- Equality of nested data types
[\#4110](https://github.com/apache/arrow-rs/issues/4110)
**Documentation updates:**
-- Write blog about improvements in JSON and CSV processing
[\#4062](https://github.com/apache/arrow-rs/issues/4062)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- Improve Documentation of Parquet ChunkReader
[\#4118](https://github.com/apache/arrow-rs/issues/4118)
**Closed issues:**
-- Parquet reader of Int96 columns and coercion to timestamps
[\#4075](https://github.com/apache/arrow-rs/issues/4075)
-- Serializing timestamp from int \(json raw decoder\)
[\#4069](https://github.com/apache/arrow-rs/issues/4069)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
-- Support casting to/from Interval and Duration
[\#3998](https://github.com/apache/arrow-rs/issues/3998)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
+- add specific error log for empty JSON array
[\#4105](https://github.com/apache/arrow-rs/issues/4105)
**Merged pull requests:**
-- Fix Docs Typos [\#4100](https://github.com/apache/arrow-rs/pull/4100)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([rnarkk](https://github.com/rnarkk))
-- Update tonic-build requirement from =0.9.1 to =0.9.2
[\#4099](https://github.com/apache/arrow-rs/pull/4099)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
-- Increase minimum chrono version to 0.4.24
[\#4093](https://github.com/apache/arrow-rs/pull/4093)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://github.com/alamb))
-- Simplify reference to GitHub issues
[\#4092](https://github.com/apache/arrow-rs/pull/4092)
([bkmgit](https://github.com/bkmgit))
-- \[Minor\]: Add `Hash` trait to SortOptions.
[\#4089](https://github.com/apache/arrow-rs/pull/4089)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([mustafasrepo](https://github.com/mustafasrepo))
-- Include byte offsets in parquet-layout
[\#4086](https://github.com/apache/arrow-rs/pull/4086)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
-- feat: Support dyn\_compare\_scalar for Decimal256
[\#4084](https://github.com/apache/arrow-rs/pull/4084)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([izveigor](https://github.com/izveigor))
-- Add ByteArray constructors \(\#3879\)
[\#4081](https://github.com/apache/arrow-rs/pull/4081)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Update prost-build requirement from =0.11.8 to =0.11.9
[\#4080](https://github.com/apache/arrow-rs/pull/4080)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot[bot]](https://github.com/apps/dependabot))
-- Improve JSON decoder errors \(\#4076\)
[\#4079](https://github.com/apache/arrow-rs/pull/4079)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Fix Timestamp Numeric Truncation in JSON Reader
[\#4074](https://github.com/apache/arrow-rs/pull/4074)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Serialize numeric to tape \(\#4069\)
[\#4073](https://github.com/apache/arrow-rs/pull/4073)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- feat: Prevent UnionArray with Repeated Type IDs
[\#4070](https://github.com/apache/arrow-rs/pull/4070)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
-- Add PrimitiveArray::try\_new \(\#3879\)
[\#4067](https://github.com/apache/arrow-rs/pull/4067)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Add ListArray Constructors \(\#3879\)
[\#4065](https://github.com/apache/arrow-rs/pull/4065)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Shutdown parquet async writer
[\#4059](https://github.com/apache/arrow-rs/pull/4059)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([kindly](https://github.com/kindly))
-- feat: additional data type groups
[\#4057](https://github.com/apache/arrow-rs/pull/4057)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([izveigor](https://github.com/izveigor))
-- Fix precision loss in Raw JSON decoder \(\#4049\)
[\#4051](https://github.com/apache/arrow-rs/pull/4051)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Use lexical\_core in CSV and JSON parser \(~25% faster\)
[\#4050](https://github.com/apache/arrow-rs/pull/4050)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Add offsets accessors to variable length arrays \(\#3879\)
[\#4048](https://github.com/apache/arrow-rs/pull/4048)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Document Async decoder usage \(\#4043\) \(\#78\)
[\#4046](https://github.com/apache/arrow-rs/pull/4046)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- Fix sparse union array equality \(\#4044\)
[\#4045](https://github.com/apache/arrow-rs/pull/4045)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
-- feat: DataType::contains support nested type
[\#4042](https://github.com/apache/arrow-rs/pull/4042)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
-- feat: Support Timestamp +/- Interval types
[\#4038](https://github.com/apache/arrow-rs/pull/4038)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
-- Fix object\_store CI [\#4037](https://github.com/apache/arrow-rs/pull/4037)
([tustvold](https://github.com/tustvold))
-- feat: cast from/to interval and duration
[\#4020](https://github.com/apache/arrow-rs/pull/4020)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
+- Support Compression in parquet-fromcsv
[\#4160](https://github.com/apache/arrow-rs/pull/4160)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([suxiaogang223](https://github.com/suxiaogang223))
+- feat: support bitwise shift left/right with scalars
[\#4159](https://github.com/apache/arrow-rs/pull/4159)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([izveigor](https://github.com/izveigor))
+- Cleanup reading page index \(\#4149\) \(\#4090\)
[\#4151](https://github.com/apache/arrow-rs/pull/4151)
[[parquet](https://github.com/apache/arrow-rs/labels/parquet)]
([tustvold](https://github.com/tustvold))
+- feat: support `bitwise` shift left/right
[\#4148](https://github.com/apache/arrow-rs/pull/4148)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
+- Don't hardcode port in FlightSQL tests
[\#4145](https://github.com/apache/arrow-rs/pull/4145)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([tustvold](https://github.com/tustvold))
+- Better flight SQL example codes
[\#4144](https://github.com/apache/arrow-rs/pull/4144)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([sundy-li](https://github.com/sundy-li))
+- chore: clean the code by using `as_primitive`
[\#4143](https://github.com/apache/arrow-rs/pull/4143)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
+- docs: fix the wrong ln command in CONTRIBUTING.md
[\#4139](https://github.com/apache/arrow-rs/pull/4139)
([SteveLauC](https://github.com/SteveLauC))
+- Infer Float64 for JSON Numerics Beyond Bounds of i64
[\#4138](https://github.com/apache/arrow-rs/pull/4138)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([SteveLauC](https://github.com/SteveLauC))
+- Support fixed point multiplication for DictionaryArray of Decimals
[\#4136](https://github.com/apache/arrow-rs/pull/4136)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://github.com/viirya))
+- Make arrow\_json::ReaderBuilder method names consistent
[\#4128](https://github.com/apache/arrow-rs/pull/4128)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://github.com/tustvold))
+- feat: add get\_{ref, mut} to arrow\_ipc Reader and Writer
[\#4122](https://github.com/apache/arrow-rs/pull/4122)
([sticnarf](https://github.com/sticnarf))
+- feat: support `Interval` + `Timestamp` and `Interval` + `Date`
[\#4117](https://github.com/apache/arrow-rs/pull/4117)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([Weijun-H](https://github.com/Weijun-H))
+- Support NullArray in JSON Reader
[\#4114](https://github.com/apache/arrow-rs/pull/4114)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([jiangzhx](https://github.com/jiangzhx))
+- Add Type Declarations for All Primitive Tensors and Buffer Builders
[\#4113](https://github.com/apache/arrow-rs/pull/4113)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([izveigor](https://github.com/izveigor))
+- Update regex-syntax requirement from 0.6.27 to 0.7.1
[\#4107](https://github.com/apache/arrow-rs/pull/4107)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- feat: set FlightDescriptor on FlightDataEncoderBuilder
[\#4101](https://github.com/apache/arrow-rs/pull/4101)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
[[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)]
([Weijun-H](https://github.com/Weijun-H))
+- optimize cast for same decimal type and same scale
[\#4088](https://github.com/apache/arrow-rs/pull/4088)
[[arrow](https://github.com/apache/arrow-rs/labels/arrow)]
([liukun4515](https://github.com/liukun4515))
diff --git a/Cargo.toml b/Cargo.toml
index 872bb2919..1b3a76db9 100644
--- a/Cargo.toml
+++ b/Cargo.toml
@@ -61,7 +61,7 @@ exclude = [
]
[workspace.package]
-version = "38.0.0"
+version = "39.0.0"
homepage = "https://github.com/apache/arrow-rs";
repository = "https://github.com/apache/arrow-rs";
authors = ["Apache Arrow <[email protected]>"]
@@ -76,18 +76,18 @@ edition = "2021"
rust-version = "1.62"
[workspace.dependencies]
-arrow = { version = "38.0.0", path = "./arrow", default-features = false }
-arrow-arith = { version = "38.0.0", path = "./arrow-arith" }
-arrow-array = { version = "38.0.0", path = "./arrow-array" }
-arrow-buffer = { version = "38.0.0", path = "./arrow-buffer" }
-arrow-cast = { version = "38.0.0", path = "./arrow-cast" }
-arrow-csv = { version = "38.0.0", path = "./arrow-csv" }
-arrow-data = { version = "38.0.0", path = "./arrow-data" }
-arrow-ipc = { version = "38.0.0", path = "./arrow-ipc" }
-arrow-json = { version = "38.0.0", path = "./arrow-json" }
-arrow-ord = { version = "38.0.0", path = "./arrow-ord" }
-arrow-row = { version = "38.0.0", path = "./arrow-row" }
-arrow-schema = { version = "38.0.0", path = "./arrow-schema" }
-arrow-select = { version = "38.0.0", path = "./arrow-select" }
-arrow-string = { version = "38.0.0", path = "./arrow-string" }
-parquet = { version = "38.0.0", path = "./parquet", default-features = false }
+arrow = { version = "39.0.0", path = "./arrow", default-features = false }
+arrow-arith = { version = "39.0.0", path = "./arrow-arith" }
+arrow-array = { version = "39.0.0", path = "./arrow-array" }
+arrow-buffer = { version = "39.0.0", path = "./arrow-buffer" }
+arrow-cast = { version = "39.0.0", path = "./arrow-cast" }
+arrow-csv = { version = "39.0.0", path = "./arrow-csv" }
+arrow-data = { version = "39.0.0", path = "./arrow-data" }
+arrow-ipc = { version = "39.0.0", path = "./arrow-ipc" }
+arrow-json = { version = "39.0.0", path = "./arrow-json" }
+arrow-ord = { version = "39.0.0", path = "./arrow-ord" }
+arrow-row = { version = "39.0.0", path = "./arrow-row" }
+arrow-schema = { version = "39.0.0", path = "./arrow-schema" }
+arrow-select = { version = "39.0.0", path = "./arrow-select" }
+arrow-string = { version = "39.0.0", path = "./arrow-string" }
+parquet = { version = "39.0.0", path = "./parquet", default-features = false }
diff --git a/arrow-flight/README.md b/arrow-flight/README.md
index 7ddc20434..86ef8f00b 100644
--- a/arrow-flight/README.md
+++ b/arrow-flight/README.md
@@ -27,7 +27,7 @@ Add this to your Cargo.toml:
```toml
[dependencies]
-arrow-flight = "37.0.0"
+arrow-flight = "39.0.0"
```
Apache Arrow Flight is a gRPC based protocol for exchanging Arrow data between
processes. See the blog post [Introducing Apache Arrow Flight: A Framework for
Fast Data
Transport](https://arrow.apache.org/blog/2019/10/13/introducing-arrow-flight/)
for more information.
diff --git a/arrow/README.md b/arrow/README.md
index c7a0416a6..fde716072 100644
--- a/arrow/README.md
+++ b/arrow/README.md
@@ -35,7 +35,7 @@ This crate is tested with the latest stable version of Rust.
We do not currently
The arrow crate follows the [SemVer
standard](https://doc.rust-lang.org/cargo/reference/semver.html) defined by
Cargo and works well within the Rust crate ecosystem.
-However, for historical reasons, this crate uses versions with major numbers
greater than `0.x` (e.g. `37.0.0`), unlike many other crates in the Rust
ecosystem which spend extended time releasing versions `0.x` to signal planned
ongoing API changes. Minor arrow releases contain only compatible changes,
while major releases may contain breaking API changes.
+However, for historical reasons, this crate uses versions with major numbers
greater than `0.x` (e.g. `39.0.0`), unlike many other crates in the Rust
ecosystem which spend extended time releasing versions `0.x` to signal planned
ongoing API changes. Minor arrow releases contain only compatible changes,
while major releases may contain breaking API changes.
## Feature Flags
diff --git a/dev/release/README.md b/dev/release/README.md
index e844e676a..8c699d163 100644
--- a/dev/release/README.md
+++ b/dev/release/README.md
@@ -70,7 +70,7 @@ git pull
git checkout -b <RELEASE_BRANCH>
# Update versions. Make sure to run it before the next step since we do not
want CHANGELOG-old.md affected.
-sed -i '' -e 's/14.0.0/37.0.0/g' `find . -name 'Cargo.toml' -or -name '*.md' |
grep -v CHANGELOG.md`
+sed -i '' -e 's/14.0.0/39.0.0/g' `find . -name 'Cargo.toml' -or -name '*.md' |
grep -v CHANGELOG.md`
git commit -a -m 'Update version'
# Copy the content of CHANGELOG.md to the beginning of CHANGELOG-old.md
diff --git a/dev/release/update_change_log.sh b/dev/release/update_change_log.sh
index c1f3167e7..0b8ad7052 100755
--- a/dev/release/update_change_log.sh
+++ b/dev/release/update_change_log.sh
@@ -29,8 +29,8 @@
set -e
-SINCE_TAG="37.0.0"
-FUTURE_RELEASE="38.0.0"
+SINCE_TAG="38.0.0"
+FUTURE_RELEASE="39.0.0"
SOURCE_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
SOURCE_TOP_DIR="$(cd "${SOURCE_DIR}/../../" && pwd)"
diff --git a/parquet_derive/README.md b/parquet_derive/README.md
index 26112d009..b20721079 100644
--- a/parquet_derive/README.md
+++ b/parquet_derive/README.md
@@ -32,8 +32,8 @@ Add this to your Cargo.toml:
```toml
[dependencies]
-parquet = "37.0.0"
-parquet_derive = "37.0.0"
+parquet = "39.0.0"
+parquet_derive = "39.0.0"
```
and this to your crate root:
