alamb commented on a change in pull request #140:
URL: https://github.com/apache/arrow-site/pull/140#discussion_r691348829



##########
File path: _posts/2021-08-18-ballista-0.5.0.md
##########
@@ -0,0 +1,75 @@
+---
+layout: post
+title: Apache Arrow Ballista 0.5.0 Release
+date: "2021-08-18 00:00:00"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements.  See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License.  You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+Ballista extends DataFusion to provide support for distributed queries. This 
is the first release of Ballista since 
+the project was 
[donated](https://arrow.apache.org/blog/2021/04/12/ballista-donation/) to the 
Apache Arrow project 
+and includes 80 commits from 11 contributors.
+
+```
+git shortlog -sn 4.0.0..5.0.0 ballista/rust/client ballista/rust/core 
ballista/rust/executor ballista/rust/scheduler
+  27  Andy Grove
+  15  Jiayu Liu
+  12  Andrew Lamb
+   8  Ximo Guanter
+   6  Daniël Heres
+   5  QP Hou
+   2  Jorge Leitao
+   1  Javier Goday
+   1  K.I. (Dennis) Jung
+   1  Mike Seddon
+   1  sathis
+```
+
+<!--
+$ git log --pretty=oneline 4.0.0..5.0.0 ballista/rust/client 
ballista/rust/core ballista/rust/executor ballista/rust/scheduler 
ballista-examples/ | wc -l
+80
+-->
+
+The release notes below are not exhaustive and only expose selected highlights 
of the release. Many other bug fixes 
+and improvements have been made: we refer you to the complete changelog.

Review comment:
       ```suggestion
   and improvements have been made: we refer you to the [complete 
changelog](https://github.com/apache/arrow-datafusion/blob/5.0.0/ballista/CHANGELOG.md).
   ```

##########
File path: _posts/2021-08-18-datafusion-5.0.0.md
##########
@@ -0,0 +1,107 @@
+---
+layout: post
+title: Apache Arrow DataFusion 5.0.0 Release
+date: "2021-08-18 00:00:00"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements.  See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License.  You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+The Apache Arrow team is pleased to announce the DataFusion 5.0.0 release. 
This covers 4 months of development work 
+and includes 211 commits from the following 31 distinct contributors.
+
+```
+$ git shortlog -sn 4.0.0..5.0.0 datafusion datafusion-cli datafusion-examples
+    61  Jiayu Liu
+    47  Andrew Lamb
+    27  Daniël Heres
+    13  QP Hou
+    13  Andy Grove
+     4  Javier Goday
+     4  sathis
+     3  Ruan Pearce-Authers
+     3  Raphael Taylor-Davies
+     3  Jorge Leitao
+     3  Cui Wenzheng
+     3  Mike Seddon
+     3  Edd Robinson
+     2  思维
+     2  Liang-Chi Hsieh
+     2  Michael Lu
+     2  Parth Sarthy
+     2  Patrick More
+     2  Rich
+     1  Charlie Evans
+     1  Gang Liao
+     1  Agata Naomichi
+     1  Ritchie Vink
+     1  Evan Chan
+     1  Ruihang Xia
+     1  Todd Treece
+     1  Yichen Wang
+     1  baishen
+     1  Nga Tran
+     1  rdettai
+     1  Marco Neumann
+```
+
+<!--
+$ git log --pretty=oneline 4.0.0..5.0.0 datafusion datafusion-cli 
datafusion-examples | wc -l
+     211
+-->
+
+The release notes below are not exhaustive and only expose selected highlights 
of the release. Many other bug fixes 
+and improvements have been made: we refer you to the complete 
+[changelog](https://github.com/apache/arrow-datafusion/blob/master/datafusion/CHANGELOG.md).
+
+# Performance
+
+There have been numerous performance improvements in this release. The 
following chart shows the relative 
+performance of individual TPC-H queries compared to the previous release.
+
+<i>TPC-H @ scale factor 100, in parquet format. Concurrency 24.</i>
+
+<img src="{{ site.baseurl }}/img/2021-08-18-datafusion500perf.png" />
+
+We also extended support for more TPC-H queries: q7, q8, q9 and q13 are 
running successfully in DataFusion 5.0.
+
+# New Features

Review comment:
       This is a good list for a release :bowtie: 

##########
File path: _posts/2021-08-18-ballista-0.5.0.md
##########
@@ -0,0 +1,75 @@
+---
+layout: post
+title: Apache Arrow Ballista 0.5.0 Release
+date: "2021-08-18 00:00:00"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements.  See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License.  You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+Ballista extends DataFusion to provide support for distributed queries. This 
is the first release of Ballista since 
+the project was 
[donated](https://arrow.apache.org/blog/2021/04/12/ballista-donation/) to the 
Apache Arrow project 
+and includes 80 commits from 11 contributors.
+
+```
+git shortlog -sn 4.0.0..5.0.0 ballista/rust/client ballista/rust/core 
ballista/rust/executor ballista/rust/scheduler
+  27  Andy Grove
+  15  Jiayu Liu
+  12  Andrew Lamb
+   8  Ximo Guanter
+   6  Daniël Heres
+   5  QP Hou
+   2  Jorge Leitao
+   1  Javier Goday
+   1  K.I. (Dennis) Jung
+   1  Mike Seddon
+   1  sathis
+```
+
+<!--
+$ git log --pretty=oneline 4.0.0..5.0.0 ballista/rust/client 
ballista/rust/core ballista/rust/executor ballista/rust/scheduler 
ballista-examples/ | wc -l
+80
+-->
+
+The release notes below are not exhaustive and only expose selected highlights 
of the release. Many other bug fixes 
+and improvements have been made: we refer you to the complete changelog.
+
+# Performance and Scalability
+
+Ballista is now capable of running complex SQL queries at scale and supports 
scalable distributed joins. We have been 
+benchmarking using individual queries from the TPC-H benchmark at scale 
factors up to 1000 (1 TB). When running against 
+CSV files, performance is generally very close to DataFusion, and 
significantly faster in some cases due to the fact 
+that the scheduler limits the number of concurrent tasks that run at any given 
time. Performance against large Parquet 
+datasets is currently poor due to some issues 
([#867](https://github.com/apache/arrow-datafusion/issues/867), 

Review comment:
       ```suggestion
   datasets is currently non ideal due to some issues 
([#867](https://github.com/apache/arrow-datafusion/issues/867), 
   ```

##########
File path: _posts/2021-08-18-datafusion-5.0.0.md
##########
@@ -0,0 +1,107 @@
+---
+layout: post
+title: Apache Arrow DataFusion 5.0.0 Release
+date: "2021-08-18 00:00:00"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements.  See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License.  You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+The Apache Arrow team is pleased to announce the DataFusion 5.0.0 release. 
This covers 4 months of development work 
+and includes 211 commits from the following 31 distinct contributors.
+
+```
+$ git shortlog -sn 4.0.0..5.0.0 datafusion datafusion-cli datafusion-examples
+    61  Jiayu Liu
+    47  Andrew Lamb
+    27  Daniël Heres
+    13  QP Hou
+    13  Andy Grove
+     4  Javier Goday
+     4  sathis
+     3  Ruan Pearce-Authers
+     3  Raphael Taylor-Davies
+     3  Jorge Leitao
+     3  Cui Wenzheng
+     3  Mike Seddon
+     3  Edd Robinson
+     2  思维
+     2  Liang-Chi Hsieh
+     2  Michael Lu
+     2  Parth Sarthy
+     2  Patrick More
+     2  Rich
+     1  Charlie Evans
+     1  Gang Liao
+     1  Agata Naomichi
+     1  Ritchie Vink
+     1  Evan Chan
+     1  Ruihang Xia
+     1  Todd Treece
+     1  Yichen Wang
+     1  baishen
+     1  Nga Tran
+     1  rdettai
+     1  Marco Neumann
+```
+
+<!--
+$ git log --pretty=oneline 4.0.0..5.0.0 datafusion datafusion-cli 
datafusion-examples | wc -l
+     211
+-->
+
+The release notes below are not exhaustive and only expose selected highlights 
of the release. Many other bug fixes 
+and improvements have been made: we refer you to the complete 
+[changelog](https://github.com/apache/arrow-datafusion/blob/master/datafusion/CHANGELOG.md).

Review comment:
       ```suggestion
   
[changelog](https://github.com/apache/arrow-datafusion/blob/5.0.0/datafusion/CHANGELOG.md).
   ```
   
   Might make sense to pin to the 5.0.0 tag release so it doesn't get stale 
when we do another release




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to