Release notes were generated automatically based on resolved Jiras with fix
version 1.14.0.
Updated the report.
I am going to sen it tomorrow if there won't be any other comments.
----------------------
=====
## Description:
- Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Since the last board report, Drill has released version 1.14.0,
including the following enhancements:
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- Lateral / Unnest support (disabled by default)
- Support Transitive Closure during Filter Push Down and Partition Pruning
- Batch processing improvements to limit the amount of memory for Hash
Join,
Union All, Project, Hash Aggregate and Nested Loop Join.
- There were active discussions about schema provision in Drill.
Based on these discussions two projects are currently evolving:
Drill metastore and schema provision in the file and in a query.
- Apache Drill book has been written by two PMC members (Charles and Paul).
- Drill developer meet up will be held on November 14, 2018.
The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow
## Health report:
- The project is healthy. Development activity
as reflected in the pull requests and JIRAs is good.
- Activity on the dev and user mailing lists are stable.
- Three committers and three new PMC member were added in the last period.
## PMC changes:
- Currently 23 PMC members.
- New PMC members:
- Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
- Charles Givre was added to the PMC on Mon Sep 03 2018
- Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
## Committer base changes:
- Currently 48 committers.
- New commmitters:
- Chunhui Shi was added as a committer on Thu Sep 27 2018
- Gautam Parai was added as a committer on Mon Oct 22 2018
- Weijie Tong was added as a committer on Fri Aug 31 2018
## Releases:
- 1.14.0 was released on Sat Aug 04 2018
## Mailing list activity:
- d...@drill.apache.org:
- 427 subscribers (down -6 in the last 3 months):
- 2827 emails sent to list (2126 in previous quarter)
- iss...@drill.apache.org:
- 18 subscribers (down -1 in the last 3 months):
- 3487 emails sent to list (4769 in previous quarter)
- user@drill.apache.org:
- 597 subscribers (down -6 in the last 3 months):
- 332 emails sent to list (346 in previous quarter)
## JIRA activity:
- 164 JIRA tickets created in the last 3 months
- 128 JIRA tickets closed/resolved in the last 3 months
On Wed, Nov 7, 2018 at 5:37 PM Padma Penumarthy <penumarthy.pa...@gmail.com>
wrote:
> 1.14 release notes should mention batch sizing also.
>
> For the board report, can you please add the following :
> Batch processing improvements to limit the amount of memory for Hash Join,
> Union All, Project, Hash Aggregate and Nested Loop Join.
>
> Just FYI for everyone. Here is the link to the document which has details
> about batch sizing work:
>
> https://docs.google.com/document/d/1Z-67Y_KNcbA2YYWCHEwf2PUEmXRPWSXsw-CHnXW_98Q/
>
> Thanks
> Padma
>
>
>
>
>
> On Wed, Nov 7, 2018 at 5:56 AM Arina Ielchiieva <ar...@apache.org> wrote:
>
> > Hi Padma,
> >
> > I can include mention about batch sizing but I am not sure what I should
> > mention, quick search over release notes shows a couple of changes
> related
> > to batch sizing:
> > https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
> > Could you please propose what I should include?
> >
> > @PMCs and committers
> > Only one PMC member has given +1 for the report. Could more folks please
> > review the report?
> >
> > Kind regards,
> > Arina
> >
> > On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
> > penumarthy.pa...@gmail.com>
> > wrote:
> >
> > > Hi Arina,
> > >
> > > Can you add batch sizing (for bunch of operators and parquet reader)
> > also ?
> > >
> > > Thanks
> > > Padma
> > >
> > >
> > > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
> > wrote:
> > >
> > > > Sure, let's mention.
> > > > Updated the report.
> > > >
> > > > =====
> > > >
> > > > ## Description:
> > > > - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> Cloud
> > > > Storage.
> > > >
> > > > ## Issues:
> > > > - There are no issues requiring board attention at this time.
> > > >
> > > > ## Activity:
> > > > - Since the last board report, Drill has released version 1.14.0,
> > > > including the following enhancements:
> > > > - Drill in a Docker container
> > > > - Image metadata format plugin
> > > > - Upgrade to Calcite 1.16.0
> > > > - Kafka plugin push down support
> > > > - Phonetic and String functions
> > > > - Enhanced decimal data support
> > > > - Spill to disk for the Hash Join support
> > > > - CGROUPs resource management support
> > > > - Lateral / Unnest support (disabled by default)
> > > > - There were active discussions about schema provision in Drill.
> > > > Based on these discussions two projects are currently evolving:
> > > > Drill metastore and schema provision in the file and in a query.
> > > > - Apache Drill book has been written by two PMC members (Charles and
> > > > Paul).
> > > > - Drill developer meet up will be held on November 14, 2018.
> > > >
> > > > The following areas are going to be discussed:
> > > > - Storage plugins
> > > > - Schema discovery & Evolution
> > > > - Metadata Management
> > > > - Resource management
> > > > - Integration with Apache Arrow
> > > >
> > > > ## Health report:
> > > > - The project is healthy. Development activity
> > > > as reflected in the pull requests and JIRAs is good.
> > > > - Activity on the dev and user mailing lists are stable.
> > > > - Three committers and three new PMC member were added in the last
> > > period.
> > > >
> > > > ## PMC changes:
> > > >
> > > > - Currently 23 PMC members.
> > > > - New PMC members:
> > > > - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > >
> > > > ## Committer base changes:
> > > >
> > > > - Currently 48 committers.
> > > > - New commmitters:
> > > > - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > >
> > > > ## Releases:
> > > >
> > > > - 1.14.0 was released on Sat Aug 04 2018
> > > >
> > > > ## Mailing list activity:
> > > >
> > > > - d...@drill.apache.org:
> > > > - 427 subscribers (down -6 in the last 3 months):
> > > > - 2827 emails sent to list (2126 in previous quarter)
> > > >
> > > > - iss...@drill.apache.org:
> > > > - 18 subscribers (down -1 in the last 3 months):
> > > > - 3487 emails sent to list (4769 in previous quarter)
> > > >
> > > > - user@drill.apache.org:
> > > > - 597 subscribers (down -6 in the last 3 months):
> > > > - 332 emails sent to list (346 in previous quarter)
> > > >
> > > >
> > > > ## JIRA activity:
> > > >
> > > > - 164 JIRA tickets created in the last 3 months
> > > > - 128 JIRA tickets closed/resolved in the last 3 months
> > > >
> > > >
> > > >
> > > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
> > shamirwa...@mapr.com>
> > > > wrote:
> > > >
> > > > > Hi Arina,
> > > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > > > default.
> > > > > Should we mention it as part of 1.14 enhancements in the report?
> > > > >
> > > > > Thanks,
> > > > > Sorabh
> > > > >
> > > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > > > arina.yelchiy...@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Thanks, Aman! Updated the report.
> > > > > > I went too far with 2019, luckily the meet up will be much
> earlier
> > :)
> > > > > >
> > > > > > =====
> > > > > >
> > > > > > ## Description:
> > > > > > - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > > Cloud
> > > > > > Storage.
> > > > > >
> > > > > > ## Issues:
> > > > > > - There are no issues requiring board attention at this time.
> > > > > >
> > > > > > ## Activity:
> > > > > > - Since the last board report, Drill has released version
> 1.14.0,
> > > > > > including the following enhancements:
> > > > > > - Drill in a Docker container
> > > > > > - Image metadata format plugin
> > > > > > - Upgrade to Calcite 1.16.0
> > > > > > - Kafka plugin push down support
> > > > > > - Phonetic and String functions
> > > > > > - Enhanced decimal data support
> > > > > > - Spill to disk for the Hash Join support
> > > > > > - CGROUPs resource management support
> > > > > > - There were active discussions about schema provision in Drill.
> > > > > > Based on these discussions two projects are currently
> evolving:
> > > > > > Drill metastore and schema provision in the file and in a
> query.
> > > > > > - Apache Drill book has been written by two PMC members (Charles
> > and
> > > > > > Paul).
> > > > > > - Drill developer meet up will be held on November 14, 2018.
> > > > > > The following areas are going to be discussed:
> > > > > > - Storage plugins
> > > > > > - Schema discovery & Evolution
> > > > > > - Metadata Management
> > > > > > - Resource management
> > > > > > - Integration with Apache Arrow
> > > > > >
> > > > > > ## Health report:
> > > > > > - The project is healthy. Development activity
> > > > > > as reflected in the pull requests and JIRAs is good.
> > > > > > - Activity on the dev and user mailing lists are stable.
> > > > > > - Three committers and three new PMC member were added in the
> last
> > > > > period.
> > > > > >
> > > > > > ## PMC changes:
> > > > > >
> > > > > > - Currently 23 PMC members.
> > > > > > - New PMC members:
> > > > > > - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > > - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > > - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > >
> > > > > > ## Committer base changes:
> > > > > >
> > > > > > - Currently 48 committers.
> > > > > > - New commmitters:
> > > > > > - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > > - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > > - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > >
> > > > > > ## Releases:
> > > > > >
> > > > > > - 1.14.0 was released on Sat Aug 04 2018
> > > > > >
> > > > > > ## Mailing list activity:
> > > > > >
> > > > > > - d...@drill.apache.org:
> > > > > > - 427 subscribers (down -6 in the last 3 months):
> > > > > > - 2827 emails sent to list (2126 in previous quarter)
> > > > > >
> > > > > > - iss...@drill.apache.org:
> > > > > > - 18 subscribers (down -1 in the last 3 months):
> > > > > > - 3487 emails sent to list (4769 in previous quarter)
> > > > > >
> > > > > > - user@drill.apache.org:
> > > > > > - 597 subscribers (down -6 in the last 3 months):
> > > > > > - 332 emails sent to list (346 in previous quarter)
> > > > > >
> > > > > >
> > > > > > ## JIRA activity:
> > > > > >
> > > > > > - 164 JIRA tickets created in the last 3 months
> > > > > > - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > >
> > > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <amansi...@apache.org>
> > > > wrote:
> > > > > >
> > > > > > > Docket container ==> 'Docker'
> > > > > > > November 14, 2019 ==> 2018 :) (this is wrong in email
> > that
> > > > was
> > > > > > sent
> > > > > > > out)
> > > > > > >
> > > > > > > Rest LGTM.
> > > > > > >
> > > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
> > ar...@apache.org>
> > > > > > wrote:
> > > > > > >
> > > > > > > > Hi all,
> > > > > > > >
> > > > > > > > please take a look at the draft board report for the last
> > quarter
> > > > and
> > > > > > let
> > > > > > > > me know if you have any comments.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Arina
> > > > > > > >
> > > > > > > > =====
> > > > > > > >
> > > > > > > > ## Description:
> > > > > > > > - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
> > and
> > > > > Cloud
> > > > > > > > Storage.
> > > > > > > >
> > > > > > > > ## Issues:
> > > > > > > > - There are no issues requiring board attention at this
> time.
> > > > > > > >
> > > > > > > > ## Activity:
> > > > > > > > - Since the last board report, Drill has released version
> > > 1.14.0,
> > > > > > > > including the following enhancements:
> > > > > > > > - Drill in a Docket container
> > > > > > > > - Image metadata format plugin
> > > > > > > > - Upgrade to Calcite 1.16.0
> > > > > > > > - Kafka plugin push down support
> > > > > > > > - Phonetic and String functions
> > > > > > > > - Enhanced decimal data support
> > > > > > > > - Spill to disk for the Hash Join support
> > > > > > > > - CGROUPs resource management support
> > > > > > > > - There were active discussions about schema provision in
> > Drill.
> > > > > > > > Based on these discussions two projects are currently
> > > evolving:
> > > > > > > > Drill metastore and schema provision in the file and in a
> > > query.
> > > > > > > > - Apache Drill book has been written by two PMC members
> > (Charles
> > > > and
> > > > > > > > Paul).
> > > > > > > > - Drill developer meet up will be held on November 14, 2019.
> > > > > > > > The following areas are going to be discussed:
> > > > > > > > - Storage plugins
> > > > > > > > - Schema discovery & Evolution
> > > > > > > > - Metadata Management
> > > > > > > > - Resource management
> > > > > > > > - Integration with Apache Arrow
> > > > > > > >
> > > > > > > > ## Health report:
> > > > > > > > - The project is healthy. Development activity
> > > > > > > > as reflected in the pull requests and JIRAs is good.
> > > > > > > > - Activity on the dev and user mailing lists are stable.
> > > > > > > > - Three committers and three new PMC member were added in
> the
> > > last
> > > > > > > period.
> > > > > > > >
> > > > > > > > ## PMC changes:
> > > > > > > >
> > > > > > > > - Currently 23 PMC members.
> > > > > > > > - New PMC members:
> > > > > > > > - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > > > > - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > > > > - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > > > >
> > > > > > > > ## Committer base changes:
> > > > > > > >
> > > > > > > > - Currently 48 committers.
> > > > > > > > - New commmitters:
> > > > > > > > - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > > > > - Gautam Parai was added as a committer on Mon Oct 22
> 2018
> > > > > > > > - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > > > >
> > > > > > > > ## Releases:
> > > > > > > >
> > > > > > > > - 1.14.0 was released on Sat Aug 04 2018
> > > > > > > >
> > > > > > > > ## Mailing list activity:
> > > > > > > >
> > > > > > > > - d...@drill.apache.org:
> > > > > > > > - 427 subscribers (down -6 in the last 3 months):
> > > > > > > > - 2827 emails sent to list (2126 in previous quarter)
> > > > > > > >
> > > > > > > > - iss...@drill.apache.org:
> > > > > > > > - 18 subscribers (down -1 in the last 3 months):
> > > > > > > > - 3487 emails sent to list (4769 in previous quarter)
> > > > > > > >
> > > > > > > > - user@drill.apache.org:
> > > > > > > > - 597 subscribers (down -6 in the last 3 months):
> > > > > > > > - 332 emails sent to list (346 in previous quarter)
> > > > > > > >
> > > > > > > >
> > > > > > > > ## JIRA activity:
> > > > > > > >
> > > > > > > > - 164 JIRA tickets created in the last 3 months
> > > > > > > > - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
