Re: Review request for Apache Maturity Model Assessment for Pinot

2021-05-17 Thread kishore g
Thanks Seunghyun for putting this together.

On Mon, May 17, 2021 at 9:01 PM Felix Cheung 
wrote:

> Great!
>
> --
> *From:* Seunghyun Lee 
> *Sent:* Monday, May 17, 2021 5:08:42 PM
> *To:* dev@pinot.apache.org 
> *Subject:* Review request for Apache Maturity Model Assessment for Pinot
>
> Hi all,
>
> I have finished the initial draft of Apache Maturity Model Assessment
> document for Pinot. This document will be evaluated as part of our
> graduation process.
>
>
> https://cwiki.apache.org/confluence/display/PINOT/Apache+Maturity+Model+Assessment+for+Pinot
>
> It would be great if we can get some reviews from the community.
>
> Best,
> Seunghyun
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
> For additional commands, e-mail: dev-h...@pinot.apache.org
>
>


Re: Review request for Apache Maturity Model Assessment for Pinot

2021-05-17 Thread Felix Cheung
Great!


From: Seunghyun Lee 
Sent: Monday, May 17, 2021 5:08:42 PM
To: dev@pinot.apache.org 
Subject: Review request for Apache Maturity Model Assessment for Pinot

Hi all,

I have finished the initial draft of Apache Maturity Model Assessment
document for Pinot. This document will be evaluated as part of our
graduation process.

https://cwiki.apache.org/confluence/display/PINOT/Apache+Maturity+Model+Assessment+for+Pinot

It would be great if we can get some reviews from the community.

Best,
Seunghyun

-
To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
For additional commands, e-mail: dev-h...@pinot.apache.org



Apache Pinot Daily Email Digest (2021-05-17)

2021-05-17 Thread Pinot Slack Email Digest
#general@mohitdubey95: HI,
Is the cloud pubsub driver available with apache pinot?  @g.kishore: Not as of now.  @mohitdubey95: Any plans for supporting that in future?  @g.kishore: yes, if there is enough interest, it should be possible. we recently added Kinesis@patidar.rahul8392: Can anyone explain me what is the issue here.i have started Pinot controller broker and server.since last 2 weeks it is working fine but today suddenly that UI part is not loading.  @aiyer: did you try to load in incognito ? I had a similar issue .  @patidar.rahul8392: Yes tried.but same issue  @aiyer: hmm.. ok.. i will let the experts reply then :slightly_smiling_face:  @mayanks: Is the controller up and running?  @patidar.rahul8392: Yes up and running  @dlavoie: the console is trying to reach the 8008 port. checkout out <#C011C9JHN7R|troubleshooting>  @dlavoie: Wondering if that is not a bug present on the 0.7.0 release.@patidar.rahul8392: I have attached the video also.its not stable loading for milliseconds and then again showing blank  @mayanks: I don’t see the video file, it was deleted   @patidar.rahul8392: Attached again@patidar.rahul8392: @mayanks: Hmm, can you file an issue? Also check if restarting helps @patidar.rahul8392: Restarted everything , and tried but still no luck@mohamedkashifuddin: @mohamedkashifuddin has joined the channel@patidar.rahul8392: Is there any other way to update this server instance so it can  reach port 8098 instead of 8008?@prince2015999: @prince2015999 has joined the channel@hrsripad: @hrsripad has joined the channel@btripathy: Hello everyone...
We are new to Pinot and exploring the OLAP possibilities.
We want to increase the performance of some of our dashboard queries running on Presto involving typical joins ,aggregations and filters.
We already have dimensions and Facts on S3/Presto and use spark to populate those.
Is it worth to pre compute in 1 more layer and push it to Pinot for slice and dice only with fat table structure  or use Presto to join the Pinot offline tables.
How you guys have solved the problem.Any pointers is appreciated.@mayanks: We have seen both models in deployment. It depends on your use case. If you are going to just server dashboards and are ok with sub-second latencies, Pinot+Presto might work (note that complex joins/nested queries may make the latency higher than expected). If you are looking for high-throughput at low latency, perhaps using Pinot would be better option.  @btripathy: Thanks@machhindra.nale: @machhindra.nale has joined the channel@zlchen.ken: @zlchen.ken has joined the channel@cyril: @cyril has joined the channel#random@mohamedkashifuddin: @mohamedkashifuddin has joined the channel@prince2015999: @prince2015999 has joined the channel@hrsripad: @hrsripad has joined the channel@machhindra.nale: @machhindra.nale has joined the channel@zlchen.ken: @zlchen.ken has joined the channel@cyril: @cyril has joined the channel#troubleshooting@patidar.rahul8392: Someone kindly help here.
"PINOT UI LOADING FOR A SECOND AND THEN SHOWING BLANK PAGE"

Hi starting pinot in cluster mode and started controller , server and broker.
Since last 2 weeks it is working fine but today suddenly I am facing this issue.UI  is not loading properly it's coming for a second and showing blank. I tried in all the browsers, cleared cache and cookies tried in different laptop but still the issue is same.
Kindly suggest.@dlavoie: What does the browser dev console has to say? Any error?@patidar.rahul8392: No error let me attach the short video@patidar.rahul8392: @dlavoie: There is no output in the dev console?@patidar.rahul8392: No@dlavoie: To be sure we are on the same page I’m talking of this:@patidar.rahul8392: Actually on UI server tab I changed server one of the server host from 8089 to 8008 and now in dev console it's showing same as not found but after that I cleared everything and updated again stated controller server and broker but not sure why it's still looking for same url@dlavoie: Can you show a complete screenshot of the first error? It’s cropped@dlavoie: Which revision of pinot are you running?@patidar.rahul8392: 0.7@dlavoie: Have you tried running the latest version of pinot?@patidar.rahul8392: No, I have done all the setups with this 0.7  so using this for now@patidar.rahul8392: This is the latest one right? 0.7.1 I am using this only@dlavoie: I would suggest upgrading to 0.7.1 first. I’m not sure but I think there was a bug in 0.7.0 that justified releasing 0.7.1 right after.@dlavoie: Might not be related but that’s going to be a better place to start with@patidar.rahul8392: Yes I am using 0.7.1@mohamedkashifuddin: @mohamedkashifuddin has joined the channel@prince2015999: @prince2015999 has joined the channel@hrsripad: @hrsripad has joined the channel@patidar.rahul8392: @npawar @slack1 @tingchen  kindly suggest for one of the instance it's taking 8008 port is there any way to fixed it. I have checked  configuration files.but couldn't find to update this 

Re: DISCUSS Pinot Graduation

2021-05-17 Thread Mayank Shrivastava
Thanks Felix, for your valuable inputs. We have updated the project page
and also added the maturity model. Please let us know if there are other
things we should address.

1. Project Page 
2. Maturity Model


On Sun, May 16, 2021 at 1:57 PM Felix Cheung 
wrote:

> Agreed it is not a blocker per se, but I figure it will raise some
> questions if more board/podling reports are missed.
>
> Maybe worthwhile to setup forwarding from dev@ to slack.
>
>
> --
> *From:* kishore g 
> *Sent:* Saturday, May 15, 2021 6:53 PM
> *To:* dev@pinot.apache.org
> *Cc:* Mayank Shrivastava; j...@apache.org; ol...@apache.org
> *Subject:* Re: DISCUSS Pinot Graduation
>
> I agree with you on traffic on dev. We tried to move few discussions to
> dev@ but entire community is active on the slack channel and prefer
> discussion on GitHub issues. We push everything to dev@ so folks on ML
> have all the information.
>
> We have < 100 on @dev vs ~1300 on slack. Trying to push slack members to
> join dev did not work in the past and I doubt it will work now. We will
> continue to make sure all discussions on slack are sent as digest to dev.
>
> We have mentioned this in our reports last year and we did not hear any
> objections from the board.
>
>
> Thanks,
> Kishore G
>
> On Fri, May 14, 2021 at 8:38 PM Felix Cheung 
> wrote:
>
>> Generally it looks good, I’ve checked clutch report, website checks etc,
>> but a few reminders and areas to pay attention to:
>>
>> - dev@ traffic is very or almost zero? I realize the community is active
>> on slack and summary is sent to dev@ everyday, but some traffic there
>> will be good...
>>
>> - ... because people will miss stuff. The podling report reminder was
>> sent there and Pinot just missed this month’s podling report. Let’s make
>> sure the month is out promptly next month
>>
>> - pls make sure the incubation status is updated
>> http://incubator.apache.org/projects/pinot - for instance either the
>> committer list is not sorted or the last date is wrong (should not be
>> 2020). The rest of the page can use updating too. Also many sections there
>> have placeholder content, pls fill them in.
>>
>> - also as suggested, please take the maturity model, fill it in and share
>> with dev@ anything identified - project maturity model (as a guide)
>> https://community.apache.org/apache-way/apache-project-maturity-model.html
>>
>>
>>
>> On Fri, May 14, 2021 at 3:13 PM Mayank Shrivastava 
>> wrote:
>>
>>> Mentors - Felix, Olivier, Jim,
>>> Wondering what your thoughts on are for proposing Pinot's graduation. We
>>> have addressed all the issues that have been brought up in the past. If
>>> there are other steps to be taken, please let us know and we can also take
>>> care of those as well. Looking forward to your suggestions and support.
>>>
>>> Regards,
>>> Mayank
>>>
>>> On Mon, May 10, 2021 at 12:54 PM Fu Xiang  wrote:
>>>
 +1! Glad to see we've accomplished a lot and the community is pretty
 strong and healthy!

 On Mon, May 10, 2021 at 11:23 AM Subbu Subramaniam 
 wrote:

> +1
>
> Let us know how we can help with the graduation, and if there are any
> pending items to be resolved.
>
> -Subbu
>
> On 2021/05/09 14:07:45, kishore g  wrote:
> > Hello,
> >
> >
> > I would like to start a conversation about the readiness of Apache
> Pinot to
> > graduate. We have come a long way since we incubated in Apache, with:
> >
> >
> >-
> >
> >7800+ contributions from 168 contributors
> >-
> >
> >7 releases by various committers
> >-
> >
> >6 new committers invited (all accepted)
> >-
> >
> >Apache website available at: https://pinot.apache.org
> >-
> >
> >Updated Apache Pinot (incubating) page
> >
> >-
> >
> >Updated Roster Page 
> >-
> >
> >Dev conversations at d...@pinot.incubator.org
> >-
> >
> >Diverse committers and PPMCs (from 7 companies / institutes)
> >-
> >
> >We have built a meritocratic and open collaborative progress (the
> Apache
> >way)
> >-
> >
> >A strong community of 1200+ members in Apache Pinot Slack
> >.
> All
> >conversations emailed to dev@ in the form of a digest
> >
> >
> > Please let us know if there are remaining steps involved in
> completing the
> > graduation process.
> >
> > Thanks,
> >
> > Kishore G
> >
>
> -
> To 

Review request for Apache Maturity Model Assessment for Pinot

2021-05-17 Thread Seunghyun Lee
Hi all,

I have finished the initial draft of Apache Maturity Model Assessment
document for Pinot. This document will be evaluated as part of our
graduation process.

https://cwiki.apache.org/confluence/display/PINOT/Apache+Maturity+Model+Assessment+for+Pinot

It would be great if we can get some reviews from the community.

Best,
Seunghyun

-
To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
For additional commands, e-mail: dev-h...@pinot.apache.org