Re: Podling Report Reminder - April 2018

[Roman Shaposhnik]

Signed off!

On Sat, Apr 7, 2018 at 7:00 PM, Lei Chang  wrote:
> Thank you Radar. Please see the comments below.
>
>
> On Thu, Apr 5, 2018 at 12:29 PM, Radar Lei  wrote:
>
>> Thanks Lei, nice report.
>>
>> Please check below comments:
>>
>> Three most important issues to address in the move towards
>> > graduation:
>>
>> Should be one?
>>
>
> This is the template. Currently we have only one issue left for the top
> three.
>
>
>>
>> > Three committer candidates passed the voting process:
>>
>> Should be two.
>>
>
> Corrected.
>
>
>>
>> When were the last committers or PPMC members elected?
>> >1) Amy BAI:  Nov 1, 2017
>> >2) ChunLing WANG: Nov 1, 2017
>> >3) Hongxu MA: Nov 4, 2017
>>
>>
> Maybe we should update with the latest committer votes.
>>
>
>
> Updated.
>
>
>
>
>>
>> Regards,
>> Radar
>>
>> On Wed, Apr 4, 2018 at 10:11 PM, Lei Chang  wrote:
>>
>> > Hi Guys,
>> >
>> > Here is the podling report. Please feel free to add your comments.
>> >
>> > Cheers
>> > Lei
>> >
>> >
>> > 
>> > 
>> > HAWQ
>> >
>> > HAWQ is an advanced enterprise SQL on Hadoop analytic engine built
>> around a
>> > robust and high-performance massively-parallel processing (MPP) SQL
>> engine
>> > evolved from Greenplum Database.
>> >
>> > HAWQ has been incubating since 2015-09-04.
>> >
>> > Three most important issues to address in the move towards
>> > graduation:
>> >
>> >   1. Continue to improve the project's release cadence. To this
>> >  end we plan on expanding automation services to support
>> >  increased developer participation. (HAWQ-127)
>> >
>> >
>> > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need
>> > to be aware of?
>> >
>> >  Nothing urgent at this time.
>> >
>> > How has the community developed since the last report?
>> >
>> > 1. Conference Talks :
>> >
>> >  * HAWQ on Microsoft Azure Cloud. Microsoft Incubator Talk (Speaker: Lei
>> > Chang, Mar 21, 2018)
>> >
>> >
>> > 2. Three committer candidates passed the voting process:
>> >
>> >1) Shubham SHARMA
>> >2) Lav JAIN
>> >
>> >
>> > How has the project developed since the last report?
>> >
>> >
>> > 1. HAWQ 2.3 released. It includes the following features.
>> >
>> >   1) New Feature: HAWQ Core supports plugable external storage framework.
>> >   2) New Feature: HAWQ Ranger supports RPS HA.
>> >   3) New Feature: HAWQ Ranger supports Kerberos authentication.
>> >   4) New Feature: HAWQ Core supports HDFS TDE (Transparent Data
>> Encryption)
>> > through libHdfs3.
>> >   5) Licenses: Fix PXF license files located in PXF jar files.
>> >   6) Licenses: Check Apache HAWQ mandatory libraries to match LC20, LC30
>> > license criteria.
>> >   7) Build: Release build project
>> >   8) Bug fixes.
>> >
>> > Project page link:
>> > https://cwiki.apache.org/confluence/display/HAWQ/Apache+HAWQ+2.3.0.0-
>> > incubating+Release
>> >
>> > 2. HAWQ 2.4 release plan was proposed.
>> >
>> >   1) New Feature: Pluggable Vectorized Execution Engine on HAWQ.
>> >   2) New Feature: Support Runtime Filter for HAWQ local hash join.
>> >   3) New Feature: Support accessing Hive table data by the new Pluggable
>> > Storage Framework.
>> >   4) Bug fixes.
>> >
>> > Project page link:
>> > https://cwiki.apache.org/confluence/display/HAWQ/Apache+HAWQ+2.4.0.0-
>> > incubating+Release
>> >
>> >
>> > How would you assess the podling's maturity?
>> > Please feel free to add your own commentary.
>> >
>> >   [ ] Initial setup
>> >   [ ] Working towards first release
>> >   [ ] Community building
>> >   [X] Nearing graduation
>> >   [ ] Other:
>> >
>> > Date of last release:
>> >
>> > 2018-03-12, Apache HAWQ 2.3.0.0
>> >
>> > When were the last committers or PPMC members elected?
>> >
>> >1) Amy BAI:  Nov 1, 2017
>> >2) ChunLing WANG: Nov 1, 2017
>> >3) Hongxu MA: Nov 4, 2017
>> >
>> >
>> > Signed-off-by:
>> >
>> >   [](hawq) Alan Gates
>> >  Comments:
>> >   [ ](hawq) Konstantin Boudnik
>> >  Comments:
>> >   [ ](hawq) Justin Erenkrantz
>> >  Comments:
>> >   [ ](hawq) Thejas Nair
>> >  Comments:
>> >   [](hawq) Roman Shaposhnik
>> >  Comments:
>> >
>> > On Wed, Apr 4, 2018 at 8:55 AM,  wrote:
>> >
>> > > Dear podling,
>> > >
>> > > This email was sent by an automated system on behalf of the Apache
>> > > Incubator PMC. It is an initial reminder to give you plenty of time to
>> > > prepare your quarterly board report.
>> > >
>> > > The board meeting is scheduled for Wed, 18 April 2018, 10:30 am PDT.
>> > > The report for your podling will form a part of the Incubator PMC
>> > > report. The Incubator PMC requires your report to be submitted 2 weeks
>> > > before the board meeting, to allow sufficient time for review and
>> > > submission (Wed, April 04).
>> > >
>> > > Please submit your report with sufficient time to allow the Incubator
>> > > PMC, and 

[DRAFT] Incubator PMC Board Report - April 2018

[John D. Ament]

All,

Below is the current draft of the report.  Waiting on the MXNet podling's
report, as well as multiple requiring sign offs.

I haven't summarized things like absent mentors, please feel free to add
comments to the report to better reflect its state.

Incubator PMC report for April 2018

The Apache Incubator is the entry path into the ASF for projects and
codebases wishing to become part of the Foundation's efforts.

There are presently 53 podlings incubating. During the month of March,
podlings executed 5 distinct releases, 6 total artifacts.  We added 2 new
IPMC members.

* Community

  New IPMC members:

  - Jun Rao
  - Matt Sicker

  People who left the IPMC:

  - None

* New Podlings

  - None

* Podlings that failed to report, expected next month

  - Gossip - No on list activity, likely to retire.
  - Milagro - Retirement vote started
  - MXNet - Report written, not posted yet

* Podlings missing sign off, will be removed if not signed off

  - BatchEE
  - HAWQ
  - Livy
  - ODF Toolkit
  - Service Comb
  - Singa
  - Weex

* Graduations

  The board has motions for the following:

  - Your podling here?
  - Your podling here?

* Releases

  The following releases entered distribution during the month of
  March:

  - 2018-03-04 Apache Rya 3.2.12
  - 2018-03-05 Apache Pulsar 1.22.0
  - 2018-03-09 Apache SensSoft Useralejs 1.0.0
  - 2018-03-17 Apache HAWQ 2.3.0.0
  - 2018-03-27 Apache ServiceComb Service Center 1.0.0-m1
  - 2018-03-27 Apache ServiceComb Saga 0.1.0

* IP Clearance



* Legal / Trademarks



* Infrastructure

  - An issue came up recently between the ECharts podling and
Infrastructure that was communicated privately to mentors - not posted to
any list.  In future, such problems should at least be reported to the
private@incubator list to ensure they are archived.

* Miscellaneous



* Credits

--
   Table of Contents
Airflow
Amaterasu
Annotator
BatchEE
Druid
Dubbo
ECharts
Gearpump
Gobblin
Gossip
HAWQ
Hivemall
Livy
Milagro
MXNet
Nemo
NetBeans
ODF Toolkit
PLC4X
Pony Mail
Quickstep
Rya
SensSoft
ServiceComb
SINGA
Traffic Control
Weex

--


Airflow

Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.

Airflow has been incubating since 2016-03-31.

Three most important issues to address in the move towards graduation:

  1. Once we make a release with the licensing fix we will move forward
with graduation.
  2.
  3.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None


How has the community developed since the last report?
1. Since our last podling report 1.5 months ago (i.e. between Feb 8 & March
28,
   inclusive), we grew our contributors from 375 to 427
2. Since our last podling report 1.5 months ago (i.e. between Feb 8 & March
28,
   inclusive), we resolved 152 pull requests (currently at 2280 closed PRs)
3. Since being accepted into the incubator, the number of companies
officially
   using Apache Airflow has risen from 30 to 149, 17 new from the last
podling
   report 1.5 months ago.


How has the project developed since the last report?
  See above : 152 PRs resolved, 52 new contributors, & 17 new companies
  officially using it.

How would you assess the podling's maturity?
Please feel free to add your own commentary.

  [ ] Initial setup
  [ ] Working towards first release
  [ ] Community building
  [x] Nearing graduation
  [ ] Other:

Date of last release:

  2018-01-02

When were the last committers or PPMC members elected?

  2017-11-30 joygao a.k.a Joy Gao (committer/PMC)

Signed-off-by:

  [ ](airflow) Chris Nauroth
 Comments:
  [x](airflow) Hitesh Shah
 Comments:
  [x](airflow) Jakob Homan
 Comments: Ready for graduation


IPMC/Shepherd notes:
I checked into the licensing issue and it is resolved, but it seems that a
release will be needed before graduation.
Dave Fisher


Amaterasu

Apache Amaterasu is a framework providing configuration management and
deployment for Big Data Pipelines.

It provides the following capabilities:

Continuous integration tools to package pipelines and run tests.
A repository to store those packaged applications: the applications
repository.
A repository to store the pipelines, and engine configuration (for
instance, the location of the Spark master, etc.): per environment - the
configuration repository.
A dashboard to monitor the pipelines.
A DSL and integration hooks allowing third parties to easily integrate.

Amaterasu has been incubating since 2017-09.

Three most important issues to address in the move towards graduation:

1. Prepare the first release
2. Grow up user and contributor communities
3. Prepare documentation

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

None

How has the community developed since the 

[jira] [Created] (HAWQ-1605) Support INSERT in PXF JDBC plugin

[Ivan Leskin (JIRA)]

Ivan Leskin created HAWQ-1605:
-

 Summary: Support INSERT in PXF JDBC plugin
 Key: HAWQ-1605
 URL: https://issues.apache.org/jira/browse/HAWQ-1605
 Project: Apache HAWQ
  Issue Type: Improvement
  Components: PXF
Reporter: Ivan Leskin
Assignee: Ed Espino


Add support of INSERT queries in PXF JDBC plugin:
 * Implement `WriteAccessor` and `WriteResolver` interfaces. Both are 
implemented in the same classes as `ReadAccessor` and `ReadResolver`;
 * Support query batching in Accessor. The size of a batch is defined by user 
and may be "infinite";
 * In Accessor, use `java.sql.PreparedStatement` and built-in functions in it 
to process queries;
 * In `setFields()` method of Resolver, perform type conversions of the data 
tuples received from PXF.

Optimize and refactor the code in PXF JDBC plugin, make some fixes:
 * Make functions for building WHERE statements static where possible to reduce 
the number of InputData checks;
 * Organize imports;
 * Check the codestyle;
 * Fix the handling of TIMESTAMP values when performing SELECT requests.

Improve documentation:
 * Correct or rewrite Javadoc strings for plugin functions;
 * Rewrite README.md.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HAWQ-1604) Add A New GUC hawq_hashjoin_bloomfilter

[Lin Wen (JIRA)]

Lin Wen created HAWQ-1604:
-

 Summary: Add A New GUC hawq_hashjoin_bloomfilter
 Key: HAWQ-1604
 URL: https://issues.apache.org/jira/browse/HAWQ-1604
 Project: Apache HAWQ
  Issue Type: Sub-task
  Components: Query Execution
Reporter: Lin Wen
Assignee: Lei Chang
 Fix For: 2.4.0.0-incubating


# Add A New GUC hawq_hashjoin_bloomfilter to indicate if use Bloom filter for 
hash join.
 # remove gp_hashjoin_bloomfilter and bloom filter in hash join table, this 
legacy has been verified that it won't improve hash join performance.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)