Re: [DISCUSS] Graduate Apache HAWQ (incubating) as a TLP

2018-07-06 Thread Lei Chang
Hi Bertrand,

Some new PPMC members are not added to the page, now it is corrected.

Thank you for pointing this out.

Cheers
Lei




On Fri, Jul 6, 2018 at 4:01 PM, Bertrand Delacretaz <
bdelacre...@codeconsult.ch> wrote:

> Hi Roman,
>
> On Fri, Jul 6, 2018 at 3:54 AM Roman Shaposhnik  wrote:
> > ...HAWQ community seems to be ready to graduate. What
> > do fellow IPMC members think?...
>
> I had a look at
> https://cwiki.apache.org/confluence/display/HAWQ/ASF+Maturity+Evaluation
> - thanks for providing that BTW!
>
> Do I understand CO40 correctly that only one PPMC member was added
> during the incubation of HAWQ, since September 2015 ?
>
> If yes that raises some alarms, can the mentors comment on that?
>
> -Bertrand
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: [VOTE] Accept Doris into the Apache Incubator

2018-07-06 Thread Timothy Chen
+1 (binding)

Been following the discussions and knowing the mentors I believe the team
can continue to improve and learn how the Apache way works.

Tim
On Fri, Jul 6, 2018 at 5:15 PM Bertrand Delacretaz <
bdelacre...@codeconsult.ch> wrote:

> On Fri, Jul 6, 2018 at 10:11 AM Li,De(BDG)  wrote:
> > ...None of them are affiliated with Baidu Inc., just initial committers
> are...
>
> Ok, thanks for clarifying!
>
> Here's my +1
>
> -Bertrand
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: [VOTE] Accept Doris into the Apache Incubator

2018-07-06 Thread Bertrand Delacretaz
On Fri, Jul 6, 2018 at 10:11 AM Li,De(BDG)  wrote:
> ...None of them are affiliated with Baidu Inc., just initial committers are...

Ok, thanks for clarifying!

Here's my +1

-Bertrand

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [VOTE] Accept Doris into the Apache Incubator

2018-07-06 Thread Li,De(BDG)
None of them are affiliated with Baidu Inc., just initial committers are.

Best Regards,
Reed

On 2018/7/6 下午4:04, "Bertrand Delacretaz" 
wrote:

>Hi,
>
>On Thu, Jul 5, 2018 at 9:22 PM Dave Fisher  wrote:
>> The initial committers are employees of Baidu Inc..
>...
>> === Nominated Mentors ===
>>
>>  * Luke Han, luke...@apache.org
>>  * Dave Fisher, w...@apache.org
>>  * Willem Jiang, ningji...@apache.org ...
>
>Are the mentors also affiliated with Baidu Inc.. ?
>
>-Bertrand
>
>-
>To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
>For additional commands, e-mail: general-h...@incubator.apache.org
>


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org


Re: [VOTE] Accept Doris into the Apache Incubator

2018-07-06 Thread Bertrand Delacretaz
Hi,

On Thu, Jul 5, 2018 at 9:22 PM Dave Fisher  wrote:
> The initial committers are employees of Baidu Inc..
...
> === Nominated Mentors ===
>
>  * Luke Han, luke...@apache.org
>  * Dave Fisher, w...@apache.org
>  * Willem Jiang, ningji...@apache.org ...

Are the mentors also affiliated with Baidu Inc.. ?

-Bertrand

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] Graduate Apache HAWQ (incubating) as a TLP

2018-07-06 Thread Bertrand Delacretaz
Hi Roman,

On Fri, Jul 6, 2018 at 3:54 AM Roman Shaposhnik  wrote:
> ...HAWQ community seems to be ready to graduate. What
> do fellow IPMC members think?...

I had a look at
https://cwiki.apache.org/confluence/display/HAWQ/ASF+Maturity+Evaluation
- thanks for providing that BTW!

Do I understand CO40 correctly that only one PPMC member was added
during the incubation of HAWQ, since September 2015 ?

If yes that raises some alarms, can the mentors comment on that?

-Bertrand

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: Podling Report Reminder - July 2018

2018-07-06 Thread Bertrand Delacretaz
Hi,

On Thu, Jul 5, 2018 at 1:36 PM Edward Capriolo  wrote:
> ...I want to get this out there. I do not know why everyone is stuck on
> gossip

It's not "everyone" - Josh who's a Gossip mentor says:

On Thu, Jun 28, 2018 at 6:44 PM Josh Elser  wrote:
> ...We've gone through many months where the only traffic I've seen on the
> mailing list are the report reminders

You are right that some TLPs have little activity, but they also don't
use much volunteer energy beyond people who are involved in them.

Podlings, on the other hand, consume energy from the Incubator and
from its mentors, so we don't want podlings to stay inactive for long
- a podling needs to be working and growing towards graduation, to
make space for other podlings in a reasonable time.

Retiring from graduation does not mean failure - the Apache model does
not fit all projects and communities, there's no shame in continuing
work elsewhere if incubation is not progressing.

I don't know much about Gossip, speaking in general terms only.

-Bertrand

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [VOTE] Accept Doris into the Apache Incubator

2018-07-06 Thread Tong,Jianru
+1 (non binding)

On 2018/07/05 19:22:19, Dave Fisher  wrote: 
> Hi All,> 
> 
> I would like to start a VOTE to bring the Doris project as an Apache 
> incubator podling.> 
> 
> The ASF voting rules are described:> 
> 
> https://www.apache.org/foundation/voting.html 
> > 
> 
> A vote for accepting a new Apache Incubator podling is a majority vote for 
> which only Incubator PMC member votes are binding.> 
> 
> This vote will run for at least 72 hours. Please VOTE as follows> 
> [] +1 Accept Doris into the Apache Incubator> 
> [] +0 Abstain.> 
> [] -1 Do not accept Doris into the Apache Incubator because ...> 
> 
> The proposal is listed below, but you can also access it on the wiki:> 
> 
> https://wiki.apache.org/incubator/DorisProposal> 
> 
> Best regards,> 
> Dave> 
> 
> = Apache Doris => 
> 
> == Abstract ==> 
> 
> Doris is a MPP-based interactive SQL data warehousing for reporting and 
> analysis.> 
> 
> == Proposal ==> 
> 
> We propose to contribute the Doris codebase and associated artifacts (e.g. 
> documentation, web-site content etc.) to the Apache Software Foundation, and 
> aim to build an open community around Doris’s continued development in the 
> ‘Apache Way’.> 
> 
> === Overview of Doris ===> 
> 
> Doris’s implementation consists of two daemons: Frontend (FE) and Backend 
> (BE).> 
> 
> **Frontend daemon** consists of query coordinator and catalog manager. Query 
> coordinator is responsible for receiving users’ sql queries, compiling 
> queries and managing queries execution. Catalog manager is responsible for 
> managing metadata such as databases, tables, partitions, replicas and etc. 
> Several frontend daemons could be deployed to guarantee fault-tolerance, and 
> load balancing.> 
> 
> **Backend daemon** stores the data and executes the query fragments. Many 
> backend daemons could also be deployed to provide scalability and 
> fault-tolerance.> 
> 
> A typical Doris cluster generally composes of several frontend daemons and 
> dozens to hundreds of backend daemons.> 
> 
> Users can use MySQL client tools to connect any frontend daemon to submit SQL 
> query. Frontend receives the query and compiles it into query plans 
> executable by the Backend. Then Frontend sends the query plan fragments to 
> Backend. Backend will build a query execution DAG. Data is fetched and 
> pipelined into the DAG. The final result response is sent to client via 
> Frontend. The distribution of query fragment execution takes minimizing data 
> movement and maximizing scan locality as the main goal.> 
> 
> == Background ==> 
> 
> At Baidu, Prior to Doris, different tools were deployed to solve diverse 
> requirements in many ways. And when a use case requires the simultaneous 
> availability of capabilities that cannot all be provided by a single tool, 
> users were forced to build hybrid architectures that stitch multiple tools 
> together, but we believe that they shouldn’t need to accept such inherent 
> complexity. A storage system built to provide great performance across a 
> broad range of workloads provides a more elegant solution to the problems 
> that hybrid architectures aim to solve. Doris is the solution.> 
> 
> Doris is designed to be a simple and single tightly coupled system, not 
> depending on other systems. Doris provides high concurrent low latency point 
> query performance, but also provides high throughput queries of ad-hoc 
> analysis. Doris provides bulk-batch data loading, but also provides near 
> real-time mini-batch data loading. Doris also provides high availability, 
> reliability, fault tolerance, and scalability.> 
> 
> == Rationale ==> 
> 
> Doris mainly integrates the technology of Google Mesa and Apache Impala.> 
> 
> Mesa is a highly scalable analytic data storage system that stores critical 
> measurement data related to Google's Internet advertising business. Mesa is 
> designed to satisfy complex and challenging set of users’ and systems’ 
> requirements, including near real-time data ingestion and query ability, as 
> well as high availability, reliability, fault tolerance, and scalability for 
> large data and query volumes.> 
> 
> Impala is a modern, open-source MPP SQL engine architected from the ground up 
> for the Hadoop data processing environment. At present, by virtue of its 
> superior performance and rich functionality, Impala has been comparable to 
> many commercial MPP database query engine. Mesa can satisfy the needs of many 
> of our storage requirements, however Mesa itself does not provide a SQL query 
> engine; Impala is a very good MPP SQL query engine, but the lack of a perfect 
> distributed storage engine. So in the end we chose the combination of these 
> two technologies.> 
> 
> Learning from Mesa’s data model, we developed a distributed storage engine. 
> Unlike Mesa, this storage engine does not rely on any distributed file 
> system. Then we deeply integrate this storage engine with Impala