Re: Podling Pinot Report Reminder - August 2020

2020-07-31 Thread Felix Cheung
Another reminder


From: Felix Cheung 
Sent: Sunday, July 26, 2020 5:09:32 PM
To: dev@pinot.apache.org ; 
d...@pinot.incubator.apache.org 
Subject: Re: Podling Pinot Report Reminder - August 2020

Reminder on the report.

https://cwiki.apache.org/confluence/display/INCUBATOR/August2020


From: jmcl...@apache.org 
Sent: Thursday, July 23, 2020 1:21:50 AM
To: d...@pinot.incubator.apache.org 
Subject: Podling Pinot Report Reminder - August 2020

Dear podling,

This email was sent by an automated system on behalf of the Apache
Incubator PMC. It is an initial reminder to give you plenty of time to
prepare your quarterly board report.

The board meeting is scheduled for Wed, 19 August 2020.
The report for your podling will form a part of the Incubator PMC
report. The Incubator PMC requires your report to be submitted 2 weeks
before the board meeting, to allow sufficient time for review and
submission (Wed, August 05).

Please submit your report with sufficient time to allow the Incubator
PMC, and subsequently board members to review and digest. Again, the
very latest you should submit your report is 2 weeks prior to the board
meeting.

Candidate names should not be made public before people are actually
elected, so please do not include the names of potential committers or
PPMC members in your report.

Thanks,

The Apache Incubator PMC

Submitting your Report

--

Your report should contain the following:

*   Your project name
*   A brief description of your project, which assumes no knowledge of
the project or necessarily of its field
*   A list of the three most important issues to address in the move
towards graduation.
*   Any issues that the Incubator PMC or ASF Board might wish/need to be
aware of
*   How has the community developed since the last report
*   How has the project developed since the last report.
*   How does the podling rate their own maturity.

This should be appended to the Incubator Wiki page at:

https://cwiki.apache.org/confluence/display/INCUBATOR/August2020

Note: This is manually populated. You may need to wait a little before
this page is created from a template.

Note: The format of the report has changed to use markdown.

Mentors
---

Mentors should review reports for their project(s) and sign them off on
the Incubator wiki page. Signing off reports shows that you are
following the project - projects that are not signed may raise alarms
for the Incubator PMC.

Incubator PMC

-
To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
For additional commands, e-mail: dev-h...@pinot.apache.org



Apache Pinot Daily Email Digest (2020-07-31)

2020-07-31 Thread Pinot Slack Email Digest
#general@mayanks: Hello Pinot community, 
we at LinkedIn, are planning to host a Virtual Meetup for Apache Pinot on Aug 
27. We would like to have one presenter from the community share their 
success-story/journey/etc with Pinot. Please reply to this thread if you would 
be interested in speaking, with a brief on what you would like to talk 
about.@christian: @christian has joined the 
channel@qiaochu: @qiaochu has joined the 
channel#random@christian: @christian 
has joined the channel@qiaochu: @qiaochu has joined the 
channel#feat-text-search@christian: 
@christian has joined the 
channel#troubleshooting@sosyalmedya.oguzhan: 
can someone help me about maven enforcer rules? 
:disappointed:@yash.agarwal: I am getting the following 
exception when querying the controller with a specific sql query.
```Caught exception while sending query request
java.io.IOException: Failed : HTTP error code : 500
at 
org.apache.pinot.controller.api.resources.PinotQueryResource.sendPostRaw(PinotQueryResource.java:284)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-0fc081157c88734af0433c3cd30f310474d177f0]
at 
org.apache.pinot.controller.api.resources.PinotQueryResource.sendRequestRaw(PinotQueryResource.java:322)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-0fc081157c88734af0433c3cd30f310474d177f0]
at 
org.apache.pinot.controller.api.resources.PinotQueryResource.getQueryResponse(PinotQueryResource.java:204)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-0fc081157c88734af0433c3cd30f310474d177f0]
at 
org.apache.pinot.controller.api.resources.PinotQueryResource.handlePostSql(PinotQueryResource.java:131)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-0fc081157c88734af0433c3cd30f310474d177f0]```
If I directly query the broker I am getting
```html

head
titleGrizzly 2.4.4/title
style
!--div.header 
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#003300;font-size:22px;-moz-border-radius-topleft:
 10px;border-top-left-radius: 10px;-moz-border-radius-topright: 
10px;border-top-right-radius: 10px;padding-left: 5px}div.body 
{font-family:Tahoma,Arial,sans-serif;color:black;background-color:#CC;font-size:16px;padding-top:10px;padding-bottom:10px;padding-left:10px}div.footer
 
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#33;font-size:14px;-moz-border-radius-bottomleft:
 10px;border-bottom-left-radius: 10px;-moz-border-radius-bottomright: 
10px;border-bottom-right-radius: 10px;padding-left: 5px}BODY 
{font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;}B 
{font-family:Tahoma,Arial,sans-serif;color:black;}A {color : black;}HR {color : 
#66;}
--
/style
/head

body
div class="header"Request failed./div
div class="body"Request failed./div
div class="footer"Grizzly 2.4.4/div
/body

/html```
I have recently added a config in broker
```pinot.broker.timeoutMs=12```
Any Ideas ?@yash.agarwal: There are no logs in broker. 
Other queries are working fine, this query would scan 1.7 Bil recods and do a 
sum of 3 metrics and distinctcount of 1 dimension@yash.agarwal: 
It might be because of high memory usage on broker. as i am seeing 
usage spikes upto 60 - 80 %@mayanks: Yes, distinctcount on 
1.7B records may the likely issue. Have you considered using HLL based 
approximate distinctcount?@yash.agarwal: We have tried HLL 
in the past. We are not looking for approximations.@yash.agarwal: 
Also seems like that is the problem, I tried without the distinctcount 
and it is returning successfully in 2 secs.@mailtobuchi: 
@mailtobuchi has left the channel@christian: 
@christian has joined the 
channel#pinot-dev@mayanks: `mvn clean 
install -DskipTests -Pbin-dist` takes awfully long time, it seems to have 
creeped up quite a bit over the years. Any ideas on how to make the build 
faster?@dlavoie: ~ 10 minutes on my own CI server.

```[INFO] Pinot .. SUCCESS [ 22.428 
s]
[INFO] Pinot Service Provider Interface ... SUCCESS [  7.931 s]
[INFO] Pinot Common ... SUCCESS [ 32.668 s]
[INFO] Pinot Plugins .. SUCCESS [  0.563 s]
[INFO] Pinot Input Format . SUCCESS [  0.510 s]
[INFO] Pinot Avro Base  SUCCESS [  1.694 s]
[INFO] Pinot Avro . SUCCESS [  5.284 s]
[INFO] Pinot Csv .. SUCCESS [  0.844 s]
[INFO] Pinot JSON . SUCCESS [  0.738 s]
[INFO] Pinot Core . SUCCESS [ 22.112 s]
[INFO] Pinot Server ... SUCCESS [  9.760 s]
[INFO] Pinot Controller ... SUCCESS [01:25 min]
[INFO] 

Call for features you want to listed in Pinot 0.5 release

2020-07-31 Thread TING CHEN
  As I plan to release Pinot 0.5 in the coming 1 or 2 weeks, can you send
me any major feature you want to announce in the release note? Please reply
to this email thread with a short 1-3 sentence summary of the features
added.

Thanks,
Ting Chen