alamb commented on code in PR #305:
URL: https://github.com/apache/arrow-site/pull/305#discussion_r1093107053
##########
_posts/2023-01-26-rust-32.0.0.md:
##########
@@ -0,0 +1,189 @@
+---
+layout: post
+title: "January 2023 Rust Apache Arrow 32.0.0 Highlights"
+date: "2023-01-26 00:00:00 +0000"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+
+With the recent release of version 32.0.0 of the Rust implementation of
[Apache Arrow](https://arrow.apache.org/), it seemed timely to highlight some
exciting things the community has been working on since the [last
update](https://arrow.apache.org/blog/2022/06/16/rust-16.0.0/).
+
+The most recent set of changes can be found in the
[CHANGELOG](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md), with
the full historical list available
[here](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md).
+
+# Arrow
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Multiple Crates**: The arrow crate has been split into multiple smaller
crates, allowing for lighter depencies, thanks to @tustvold and @alamb
+* **Reduced Codegen**: Expensive kernels have been moved behind optional
feature flags to reduce executable size and build times, thanks to @tustvold
+* **Copy-On-Write Support**: Arrow arrays now support copy-on-write, thanks to
@viirya
+* **Comparable Row Format**: A spillable, comparable row-format has been added
enabling [incredibly fast multi-column sorts and
grouping](https://arrow.apache.org/blog/2022/11/07/multi-column-sorts-in-arrow-rust-part-1/),
thanks to @tustvold
+* **FlightSQL Support**: FlightSQL support is maturing, with the addition of
higher-level APIs for clients and servers, thanks to @alamb, @tustvold,
@viirya, @liukun4515, @Dandandan and @avantgardnerio
Review Comment:
```suggestion
* **FlightSQL Support**: FlightSQL support is maturing, with the addition of
higher-level APIs for clients and servers, thanks to @alamb, @tustvold,
@viirya, @liukun4515, @Dandandan and @avantgardnerio
```
Maybe also a link to
https://docs.rs/arrow-flight/32.0.0/arrow_flight/sql/index.html
##########
_posts/2023-01-26-rust-32.0.0.md:
##########
@@ -0,0 +1,189 @@
+---
+layout: post
+title: "January 2023 Rust Apache Arrow 32.0.0 Highlights"
+date: "2023-01-26 00:00:00 +0000"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+
+With the recent release of version 32.0.0 of the Rust implementation of
[Apache Arrow](https://arrow.apache.org/), it seemed timely to highlight some
exciting things the community has been working on since the [last
update](https://arrow.apache.org/blog/2022/06/16/rust-16.0.0/).
+
+The most recent set of changes can be found in the
[CHANGELOG](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md), with
the full historical list available
[here](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md).
+
+# Arrow
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Multiple Crates**: The arrow crate has been split into multiple smaller
crates, allowing for lighter depencies, thanks to @tustvold and @alamb
+* **Reduced Codegen**: Expensive kernels have been moved behind optional
feature flags to reduce executable size and build times, thanks to @tustvold
+* **Copy-On-Write Support**: Arrow arrays now support copy-on-write, thanks to
@viirya
+* **Comparable Row Format**: A spillable, comparable row-format has been added
enabling [incredibly fast multi-column sorts and
grouping](https://arrow.apache.org/blog/2022/11/07/multi-column-sorts-in-arrow-rust-part-1/),
thanks to @tustvold
Review Comment:
👍
##########
_posts/2023-01-26-rust-32.0.0.md:
##########
@@ -0,0 +1,189 @@
+---
+layout: post
+title: "January 2023 Rust Apache Arrow 32.0.0 Highlights"
+date: "2023-01-26 00:00:00 +0000"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+
+With the recent release of version 32.0.0 of the Rust implementation of
[Apache Arrow](https://arrow.apache.org/), it seemed timely to highlight some
exciting things the community has been working on since the [last
update](https://arrow.apache.org/blog/2022/06/16/rust-16.0.0/).
+
+The most recent set of changes can be found in the
[CHANGELOG](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md), with
the full historical list available
[here](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md).
+
+# Arrow
+
+_TODO: Some pre-amble_
Review Comment:
Here are some thoughts off the top of my head. maybe needs to be toned down?
```suggestion
[arrow](https://crates.io/crates/arrow) and
[arrow-flight](https://crates.io/crates/arrow-flight) are native Rust
implementations of Apache Arrow. Apache Arrow defines a language-independent
columnar memory format for flat and hierarchical data, organized for efficient
analytic operations on modern hardware like CPUs and GPUs. The Arrow memory
format also supports zero-copy reads for lightning-fast data access without
serialization overhead.
The [Rust language](https://www.rust-lang.org/) offers best in class
performance, memory safety, and the developer productivity of a modern
programming language. These features make Rust an excellent choice for building
modern high performance analytical systems. When combined, Rust and the Apache
Arrow Ecosystem are a compelling toolkit for building the next generation of
systems.
The repository has recently passed 1300 stars on github, and our community
has been focusing on performance and feature completeness, with significant
community contribution.
```
Check out the star history https://star-history.com/#apache/arrow-rs&Date
-- perhaps we can add that image 🤔
##########
_posts/2023-01-26-rust-32.0.0.md:
##########
@@ -0,0 +1,189 @@
+---
+layout: post
+title: "January 2023 Rust Apache Arrow 32.0.0 Highlights"
+date: "2023-01-26 00:00:00 +0000"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+
+With the recent release of version 32.0.0 of the Rust implementation of
[Apache Arrow](https://arrow.apache.org/), it seemed timely to highlight some
exciting things the community has been working on since the [last
update](https://arrow.apache.org/blog/2022/06/16/rust-16.0.0/).
+
+The most recent set of changes can be found in the
[CHANGELOG](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md), with
the full historical list available
[here](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md).
+
+# Arrow
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Multiple Crates**: The arrow crate has been split into multiple smaller
crates, allowing for lighter depencies, thanks to @tustvold and @alamb
+* **Reduced Codegen**: Expensive kernels have been moved behind optional
feature flags to reduce executable size and build times, thanks to @tustvold
+* **Copy-On-Write Support**: Arrow arrays now support copy-on-write, thanks to
@viirya
+* **Comparable Row Format**: A spillable, comparable row-format has been added
enabling [incredibly fast multi-column sorts and
grouping](https://arrow.apache.org/blog/2022/11/07/multi-column-sorts-in-arrow-rust-part-1/),
thanks to @tustvold
+* **FlightSQL Support**: FlightSQL support is maturing, with the addition of
higher-level APIs for clients and servers, thanks to @alamb, @tustvold,
@viirya, @liukun4515, @Dandandan and @avantgardnerio
+* **New CSV/JSON Readers**: The CSV and JSON readers have been revamped, more
than doubling performance, and facilitating object storage integration, thanks
to @tustvold
+* **IPC File Compression**: IPC file compression is now supported, thanks to
@liukun4515 and @alamb
+* **Improved Decimal Support**: 256-bit decimals and negative scales are now
supported, along with better kernel support including arithmetic, thanks to
@tustvold, @viirya, @waitingkuo, @liukun4515 and @HaoYang670
+* **Improved Dictionary Support**: Dictionaries are now transparently
supported in most kernels, thanks to @viirya
+* **Improved Temporal Support**: The support for timezones and other temporal
kernels has been significantly improved, thanks to @gaelwjl, @Jefffrey,
@gruuya, @tustvod, @naosense, @ovr, @MazterQyou, @comphead and @waitingkuo
+* **Improved Generics**: Improved generics allow writing code generic over all
arrays, or all arrays with the same layout, thanks to @tustvold
+* **Downcast Macros**: Various helper macros are provided to simplify dynamic
dispatch to statically typed implementations, thanks to @tustvold
+
+# Parquet
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Arbitrarily Nested Schema**: arbitrarily nested schemas can be read to and
written from arrow, see
[here](https://arrow.apache.org/blog/2022/10/05/arrow-parquet-encoding-part-1/)
for more information, thanks to @tustvold
Review Comment:
```suggestion
* **Arbitrarily Nested Schema**: arbitrarily nested schemas can be read to
and written from arrow, see [the blog
posts](https://arrow.apache.org/blog/2022/10/05/arrow-parquet-encoding-part-1/)
for more information, thanks to @tustvold
```
##########
_posts/2023-01-26-rust-32.0.0.md:
##########
@@ -0,0 +1,189 @@
+---
+layout: post
+title: "January 2023 Rust Apache Arrow 32.0.0 Highlights"
+date: "2023-01-26 00:00:00 +0000"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+
+With the recent release of version 32.0.0 of the Rust implementation of
[Apache Arrow](https://arrow.apache.org/), it seemed timely to highlight some
exciting things the community has been working on since the [last
update](https://arrow.apache.org/blog/2022/06/16/rust-16.0.0/).
+
+The most recent set of changes can be found in the
[CHANGELOG](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md), with
the full historical list available
[here](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md).
+
+# Arrow
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Multiple Crates**: The arrow crate has been split into multiple smaller
crates, allowing for lighter depencies, thanks to @tustvold and @alamb
+* **Reduced Codegen**: Expensive kernels have been moved behind optional
feature flags to reduce executable size and build times, thanks to @tustvold
+* **Copy-On-Write Support**: Arrow arrays now support copy-on-write, thanks to
@viirya
+* **Comparable Row Format**: A spillable, comparable row-format has been added
enabling [incredibly fast multi-column sorts and
grouping](https://arrow.apache.org/blog/2022/11/07/multi-column-sorts-in-arrow-rust-part-1/),
thanks to @tustvold
+* **FlightSQL Support**: FlightSQL support is maturing, with the addition of
higher-level APIs for clients and servers, thanks to @alamb, @tustvold,
@viirya, @liukun4515, @Dandandan and @avantgardnerio
+* **New CSV/JSON Readers**: The CSV and JSON readers have been revamped, more
than doubling performance, and facilitating object storage integration, thanks
to @tustvold
+* **IPC File Compression**: IPC file compression is now supported, thanks to
@liukun4515 and @alamb
+* **Improved Decimal Support**: 256-bit decimals and negative scales are now
supported, along with better kernel support including arithmetic, thanks to
@tustvold, @viirya, @waitingkuo, @liukun4515 and @HaoYang670
+* **Improved Dictionary Support**: Dictionaries are now transparently
supported in most kernels, thanks to @viirya
+* **Improved Temporal Support**: The support for timezones and other temporal
kernels has been significantly improved, thanks to @gaelwjl, @Jefffrey,
@gruuya, @tustvod, @naosense, @ovr, @MazterQyou, @comphead and @waitingkuo
+* **Improved Generics**: Improved generics allow writing code generic over all
arrays, or all arrays with the same layout, thanks to @tustvold
+* **Downcast Macros**: Various helper macros are provided to simplify dynamic
dispatch to statically typed implementations, thanks to @tustvold
+
+# Parquet
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Arbitrarily Nested Schema**: arbitrarily nested schemas can be read to and
written from arrow, see
[here](https://arrow.apache.org/blog/2022/10/05/arrow-parquet-encoding-part-1/)
for more information, thanks to @tustvold
+* **Predicate Pushdown**: the arrow reader now supports advanced predicate
pushdown, including late materialization, see
[here](https://arrow.apache.org/blog/2022/12/26/querying-parquet-with-millisecond-latency/)
for more information, thanks to @tustvold, @Ted-Jiang, @thinkharderdev, and
@liukun4515
+* **Bloom Filter Support**: support for both reading and writing bloom filters
has been added, thanks to @Jimexist and @viirya
Review Comment:
```suggestion
* **Bloom Filter Support**: support for both [reading and writing bloom
filters](https://docs.rs/parquet/32.0.0/parquet/bloom_filter/index.html) has
been added, thanks to @Jimexist and @viirya
```
##########
_posts/2023-01-26-rust-32.0.0.md:
##########
@@ -0,0 +1,189 @@
+---
+layout: post
+title: "January 2023 Rust Apache Arrow 32.0.0 Highlights"
+date: "2023-01-26 00:00:00 +0000"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+
+With the recent release of version 32.0.0 of the Rust implementation of
[Apache Arrow](https://arrow.apache.org/), it seemed timely to highlight some
exciting things the community has been working on since the [last
update](https://arrow.apache.org/blog/2022/06/16/rust-16.0.0/).
+
+The most recent set of changes can be found in the
[CHANGELOG](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md), with
the full historical list available
[here](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md).
+
+# Arrow
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Multiple Crates**: The arrow crate has been split into multiple smaller
crates, allowing for lighter depencies, thanks to @tustvold and @alamb
+* **Reduced Codegen**: Expensive kernels have been moved behind optional
feature flags to reduce executable size and build times, thanks to @tustvold
+* **Copy-On-Write Support**: Arrow arrays now support copy-on-write, thanks to
@viirya
+* **Comparable Row Format**: A spillable, comparable row-format has been added
enabling [incredibly fast multi-column sorts and
grouping](https://arrow.apache.org/blog/2022/11/07/multi-column-sorts-in-arrow-rust-part-1/),
thanks to @tustvold
+* **FlightSQL Support**: FlightSQL support is maturing, with the addition of
higher-level APIs for clients and servers, thanks to @alamb, @tustvold,
@viirya, @liukun4515, @Dandandan and @avantgardnerio
+* **New CSV/JSON Readers**: The CSV and JSON readers have been revamped, more
than doubling performance, and facilitating object storage integration, thanks
to @tustvold
+* **IPC File Compression**: IPC file compression is now supported, thanks to
@liukun4515 and @alamb
+* **Improved Decimal Support**: 256-bit decimals and negative scales are now
supported, along with better kernel support including arithmetic, thanks to
@tustvold, @viirya, @waitingkuo, @liukun4515 and @HaoYang670
+* **Improved Dictionary Support**: Dictionaries are now transparently
supported in most kernels, thanks to @viirya
+* **Improved Temporal Support**: The support for timezones and other temporal
kernels has been significantly improved, thanks to @gaelwjl, @Jefffrey,
@gruuya, @tustvod, @naosense, @ovr, @MazterQyou, @comphead and @waitingkuo
+* **Improved Generics**: Improved generics allow writing code generic over all
arrays, or all arrays with the same layout, thanks to @tustvold
+* **Downcast Macros**: Various helper macros are provided to simplify dynamic
dispatch to statically typed implementations, thanks to @tustvold
+
+# Parquet
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Arbitrarily Nested Schema**: arbitrarily nested schemas can be read to and
written from arrow, see
[here](https://arrow.apache.org/blog/2022/10/05/arrow-parquet-encoding-part-1/)
for more information, thanks to @tustvold
+* **Predicate Pushdown**: the arrow reader now supports advanced predicate
pushdown, including late materialization, see
[here](https://arrow.apache.org/blog/2022/12/26/querying-parquet-with-millisecond-latency/)
for more information, thanks to @tustvold, @Ted-Jiang, @thinkharderdev, and
@liukun4515
Review Comment:
```suggestion
* **Predicate Pushdown**: the arrow reader now supports advanced predicate
pushdown, including late materialization, see [the blog
posts](https://arrow.apache.org/blog/2022/12/26/querying-parquet-with-millisecond-latency/)
for more information, and see
[RowSelection](https://docs.rs/parquet/32.0.0/parquet/arrow/arrow_reader/struct.RowSelection.html)
for the code, thanks to @tustvold, @Ted-Jiang, @thinkharderdev, and @liukun4515
```
##########
_posts/2023-01-26-rust-32.0.0.md:
##########
@@ -0,0 +1,189 @@
+---
+layout: post
+title: "January 2023 Rust Apache Arrow 32.0.0 Highlights"
+date: "2023-01-26 00:00:00 +0000"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+
+With the recent release of version 32.0.0 of the Rust implementation of
[Apache Arrow](https://arrow.apache.org/), it seemed timely to highlight some
exciting things the community has been working on since the [last
update](https://arrow.apache.org/blog/2022/06/16/rust-16.0.0/).
+
+The most recent set of changes can be found in the
[CHANGELOG](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md), with
the full historical list available
[here](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md).
+
+# Arrow
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Multiple Crates**: The arrow crate has been split into multiple smaller
crates, allowing for lighter depencies, thanks to @tustvold and @alamb
+* **Reduced Codegen**: Expensive kernels have been moved behind optional
feature flags to reduce executable size and build times, thanks to @tustvold
+* **Copy-On-Write Support**: Arrow arrays now support copy-on-write, thanks to
@viirya
+* **Comparable Row Format**: A spillable, comparable row-format has been added
enabling [incredibly fast multi-column sorts and
grouping](https://arrow.apache.org/blog/2022/11/07/multi-column-sorts-in-arrow-rust-part-1/),
thanks to @tustvold
+* **FlightSQL Support**: FlightSQL support is maturing, with the addition of
higher-level APIs for clients and servers, thanks to @alamb, @tustvold,
@viirya, @liukun4515, @Dandandan and @avantgardnerio
+* **New CSV/JSON Readers**: The CSV and JSON readers have been revamped, more
than doubling performance, and facilitating object storage integration, thanks
to @tustvold
+* **IPC File Compression**: IPC file compression is now supported, thanks to
@liukun4515 and @alamb
+* **Improved Decimal Support**: 256-bit decimals and negative scales are now
supported, along with better kernel support including arithmetic, thanks to
@tustvold, @viirya, @waitingkuo, @liukun4515 and @HaoYang670
+* **Improved Dictionary Support**: Dictionaries are now transparently
supported in most kernels, thanks to @viirya
+* **Improved Temporal Support**: The support for timezones and other temporal
kernels has been significantly improved, thanks to @gaelwjl, @Jefffrey,
@gruuya, @tustvod, @naosense, @ovr, @MazterQyou, @comphead and @waitingkuo
+* **Improved Generics**: Improved generics allow writing code generic over all
arrays, or all arrays with the same layout, thanks to @tustvold
+* **Downcast Macros**: Various helper macros are provided to simplify dynamic
dispatch to statically typed implementations, thanks to @tustvold
+
+# Parquet
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Arbitrarily Nested Schema**: arbitrarily nested schemas can be read to and
written from arrow, see
[here](https://arrow.apache.org/blog/2022/10/05/arrow-parquet-encoding-part-1/)
for more information, thanks to @tustvold
+* **Predicate Pushdown**: the arrow reader now supports advanced predicate
pushdown, including late materialization, see
[here](https://arrow.apache.org/blog/2022/12/26/querying-parquet-with-millisecond-latency/)
for more information, thanks to @tustvold, @Ted-Jiang, @thinkharderdev, and
@liukun4515
+* **Bloom Filter Support**: support for both reading and writing bloom filters
has been added, thanks to @Jimexist and @viirya
+* **Additional CLI Tools**: additional CLI tools have been added for
introspecting and manipulating parquet data, thanks to @tustvold, @Jimexist,
@crepererum and @bmmeijers
Review Comment:
It would be neat to add a link here to a readme that explained the tools and
how to use them
##########
_posts/2023-01-26-rust-32.0.0.md:
##########
@@ -0,0 +1,189 @@
+---
+layout: post
+title: "January 2023 Rust Apache Arrow 32.0.0 Highlights"
+date: "2023-01-26 00:00:00 +0000"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+
+With the recent release of version 32.0.0 of the Rust implementation of
[Apache Arrow](https://arrow.apache.org/), it seemed timely to highlight some
exciting things the community has been working on since the [last
update](https://arrow.apache.org/blog/2022/06/16/rust-16.0.0/).
+
+The most recent set of changes can be found in the
[CHANGELOG](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md), with
the full historical list available
[here](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md).
+
+# Arrow
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
Review Comment:
How about we create a section for "ongoing work" -- I think there are a few
features that are worth highlighting in such a section:
RunEndEncoded arrays
Improved Arrow Flight usability (FlightClient, etc)
FlightSQL https://arrow.apache.org/docs/format/FlightSql.html support
(FlightSQL experimental features)
##########
_posts/2023-01-26-rust-32.0.0.md:
##########
@@ -0,0 +1,189 @@
+---
+layout: post
+title: "January 2023 Rust Apache Arrow 32.0.0 Highlights"
+date: "2023-01-26 00:00:00 +0000"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+
+With the recent release of version 32.0.0 of the Rust implementation of
[Apache Arrow](https://arrow.apache.org/), it seemed timely to highlight some
exciting things the community has been working on since the [last
update](https://arrow.apache.org/blog/2022/06/16/rust-16.0.0/).
+
+The most recent set of changes can be found in the
[CHANGELOG](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md), with
the full historical list available
[here](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md).
+
+# Arrow
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
+
+* **Multiple Crates**: The arrow crate has been split into multiple smaller
crates, allowing for lighter depencies, thanks to @tustvold and @alamb
+* **Reduced Codegen**: Expensive kernels have been moved behind optional
feature flags to reduce executable size and build times, thanks to @tustvold
+* **Copy-On-Write Support**: Arrow arrays now support copy-on-write, thanks to
@viirya
+* **Comparable Row Format**: A spillable, comparable row-format has been added
enabling [incredibly fast multi-column sorts and
grouping](https://arrow.apache.org/blog/2022/11/07/multi-column-sorts-in-arrow-rust-part-1/),
thanks to @tustvold
+* **FlightSQL Support**: FlightSQL support is maturing, with the addition of
higher-level APIs for clients and servers, thanks to @alamb, @tustvold,
@viirya, @liukun4515, @Dandandan and @avantgardnerio
+* **New CSV/JSON Readers**: The CSV and JSON readers have been revamped, more
than doubling performance, and facilitating object storage integration, thanks
to @tustvold
Review Comment:
I also think this item should be put towards the top of the new features
```suggestion
* ** Faster CSV/JSON Readers**: The CSV and JSON readers have been revamped,
more than doubling performance, and facilitating object storage integration,
thanks to @tustvold
```
##########
_posts/2023-01-26-rust-32.0.0.md:
##########
@@ -0,0 +1,189 @@
+---
+layout: post
+title: "January 2023 Rust Apache Arrow 32.0.0 Highlights"
+date: "2023-01-26 00:00:00 +0000"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+
+With the recent release of version 32.0.0 of the Rust implementation of
[Apache Arrow](https://arrow.apache.org/), it seemed timely to highlight some
exciting things the community has been working on since the [last
update](https://arrow.apache.org/blog/2022/06/16/rust-16.0.0/).
+
+The most recent set of changes can be found in the
[CHANGELOG](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md), with
the full historical list available
[here](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md).
+
+# Arrow
+
+_TODO: Some pre-amble_
+
+**Major Highlights**
Review Comment:
Also I would suggest breaking this section apart into a few sub parts:
New Features
Improvements
In Progress
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
