Re: [VOTE] Apache Pinot 1.1.0 RC1

2024-03-16 Thread Subbu Subramaniam
+1 (binding) -Subbu Subramaniam Apache PMC On 2024/03/07 04:03:58 Vivek Iyer Vaidyanathan Iyer wrote: > Hi Pinot Community, > > This is a call for a vote to release Apache Pinot 1.1.0 > > The release candidate: > https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-1

Re: Apache pinot release 1.0.0 RC3 voting

2023-09-12 Thread Subbu Subramaniam
Verified +1 [Binding] -Subbu Subramaniam Apache Pinot PMC On 2023/09/12 10:02:26 saurabh dubey wrote: > Hi Pinot Community, > > This is a call for a vote to release Apache Pinot 1.0.0 > > The release candidate: > https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-1

Re: [VOTE] Apache Pinot 0.12.0 RC0

2023-01-23 Thread Subbu Subramaniam
+1 (binding) Verified on Centos Linux 7.9.2009 -Subbu From: Xiang Fu Sent: Friday, January 20, 2023 3:18 PM To: Xiang Fu Cc: dev@pinot.apache.org Subject: Re: [VOTE] Apache Pinot 0.12.0 RC0 Ping. On Dec 29, 2022, at 01:26, Xiang Fu wrote: Hi Pinot

Re: [VOTE] Apache Pinot 0.11.0 RC0

2022-09-05 Thread Subbu Subramaniam
Verified, RC1 to be good. +1 (binding) -Subbu Subramaniam PMC, Apache Pinot From: Xiang Fu Sent: Sunday, September 4, 2022 3:54 AM To: dev@pinot.apache.org Subject: Re: [VOTE] Apache Pinot 0.11.0 RC0 Hi, I did some research on this, and I can reproduce

Re: [VOTE] Apache Pinot 0.11.0 RC0

2022-09-03 Thread Subbu Subramaniam
I am seeing the following exception when the source is compiled with Java 11 on Centos 7.9.2009. Not sure if I need a glibc upgrade? -Subbu   * Bootstrap tables * java.lang.RuntimeException: Caught exception during running -

Re: Apache Pinot™ Slack Workspace Rename

2022-05-26 Thread Subbu Subramaniam
[I am on vacation, so I just saw this thread] Thanks for conveying your intentions, Tim. I see that others in the community have weighed in as well, so the good thing is that our decision will be based on what the community agrees to. As others have pointed out, we must certainly acknowledge

CVE-2022-23974: Apache Pinot: Pinot segment push endpoint has a vulnerability in unprotected environments

2022-04-05 Thread Subbu Subramaniam
Description: In 0.9.3 or older versions of Apache Pinot segment upload path allowed segment directories to be imported into pinot tables. In pinot installations that allow open access to the controller a specially crafted request can potentially be exploited to cause disruption in pinot

Re: [VOTE] Apache Pinot 0.10.0 RC0

2022-03-25 Thread Subbu Subramaniam
+1 (binding) I want to thank you for putting together excellent Release Notes. This can be an example for committers doing future releases. -Subbu From: Xiang Fu Sent: Wednesday, March 23, 2022 2:44 PM To: dev@pinot.apache.org Subject: Re: [VOTE] Apache Pinot

Re: [VOTE] Apache Pinot 0.9.3 RC0

2021-12-24 Thread Subbu Subramaniam
Maybe a tad late, but here is my vote: +1 -Subbu From: kishore g Sent: Friday, December 24, 2021 7:42 AM To: dev@pinot.apache.org Subject: Re: [VOTE] Apache Pinot 0.9.3 RC0 +1 On Fri, Dec 24, 2021 at 7:00 AM Mayank Shrivastava

Re: [GitHub] [pinot] Jackie-Jiang commented on issue #7290: PinotAdminCommand throws exception

2021-08-12 Thread Subbu Subramaniam
It is there in the issue. Just run the admin with --help From: GitBox Sent: Thursday, August 12, 2021 3:07 PM To: comm...@pinot.apache.org Subject: [GitHub] [pinot] Jackie-Jiang commented on issue #7290: PinotAdminCommand throws exception Jackie-Jiang

Re: [VOTE] Graduate Apache Pinot as TLP

2021-06-22 Thread Subbu Subramaniam
erve as the initial members of the Apache Pinot Project: > >- > > Felix Cheung >- > >Jackie Jiang >- > >Jim Jagielski >- > >Kishore G >- > >Mayank Shrivastava >- > >Neha Pawar >-

Re: [VOTE] Apache Pinot graduation to a TLP

2021-06-04 Thread Subbu Subramaniam
ng >- > >Jackie Jiang >- > >Jim Jagielski >- > > Kishore G >- > >Mayank Shrivastava >- > >Neha Pawar >- > >Olivier Lamy >- > >Seunghyun Lee >- > >

Re: About cutting the 0.8.0 release (graduation release)

2021-05-10 Thread Subbu Subramaniam
Hopefully, everyone has been following the process of labelling PRs for release notes and noting any compatibility issues as well. If so, you should be able to get a list of commits (and PRs) and look for the labelled ones to answer the compatibility and release notes questions. I don't know

Re: DISCUSS Pinot Graduation

2021-05-10 Thread Subbu Subramaniam
+1 Let us know how we can help with the graduation, and if there are any pending items to be resolved. -Subbu On 2021/05/09 14:07:45, kishore g wrote: > Hello, > > > I would like to start a conversation about the readiness of Apache Pinot to > graduate. We have come a long way since we

Re: [Vote] Enabling html for Pinot related mailing lists

2020-06-15 Thread Subbu Subramaniam
+1 On 2020/06/14 03:01:03, Seunghyun Lee wrote: > Hi all, > > While I was working on setting up the daily digest from slack channels, I > found that the html rendering feature is turned off by default for Pinot > mailing list. > > I tried to request to enable the feature from >

Re: new Metadata format for download url in LLCRealtimeSegmentZKMetadata

2020-06-15 Thread Subbu Subramaniam
ave an implementation of pinotFS ? > > > > > > On Thu, Jun 11, 2020 at 2:58 PM kishore g wrote: > > > > > > > +1 peer. > > > > > > > > unrelated to this - do we support multiple URI's? > > > > > > > >

Re: new Metadata format for download url in LLCRealtimeSegmentZKMetadata

2020-06-12 Thread Subbu Subramaniam
iteranddownloadsegmentfrompeerservers > > .> > > > implementing the above method. That is why we do not add a full-fledged > > > pinotFS subclass for this design. > > > > > > > > > On Thu, Jun 11, 2020 at 3:00 PM kishore g wrote: > >

Re: new Metadata format for download url in LLCRealtimeSegmentZKMetadata

2020-06-11 Thread Subbu Subramaniam
Hey Ting, I like the URI in metadata as "peer:///segmentName". This way, the URI remains parsable and we can use the scheme to check for a segment fetcher, thanks -Subbu On 2020/06/10 01:09:25, TING CHEN wrote: > As part of the deep store by-passing >

Re: [VOTE] Apache Pinot (incubating) 0.4.0 RC2

2020-06-08 Thread Subbu Subramaniam
+1 The functionality works, but I do see exceptions from jersey when running quickstart programs. -Subbu On 2020/06/02 15:10:11, H wrote: > Hi Pinot Community, > > This is a call for vote to the release Apache Pinot (incubating) version > 0.4.0 > > The release candidate: >

Re: Preparing for the upcoming Pinot 0.4.0 release

2020-05-19 Thread Subbu Subramaniam
gt; If we have thought of all the cases and know that it won't impact existing > > - why delay it to the next release?. The earlier we start pushing users to > > use datetimespec the better it is for us. > > > > On Tue, May 19, 2020 at 10:20 AM Subbu Subraman

Re: Preparing for the upcoming Pinot 0.4.0 release

2020-05-19 Thread Subbu Subramaniam
I meant to suggest release 0.4.0 excluding PR 5399 (date time spec) -Subbu On 2020/05/19 17:18:13, Subbu Subramaniam wrote: > On the other hand, it may be wise to release 0.4.0 without this change. > > Those of us who pick up changes regularly from the master c

Re: Preparing for the upcoming Pinot 0.4.0 release

2020-05-19 Thread Subbu Subramaniam
On the other hand, it may be wise to release 0.4.0 without this change. Those of us who pick up changes regularly from the master can verify that there is no incompatibility inadvertently introduced by this change (Not everything can be caught by review) And then we can push this change in

Re: Preparing for the upcoming Pinot 0.4.0 release

2020-05-19 Thread Subbu Subramaniam
I think we should also bump up helix version to 0.9.7. A recent version has been released that fixes a couple of annoyances we reported. Also Haibo, a general piece of advice. In the past, the release has been a moving target. Pick a commit hash, start the process, and if necessary cherry-pick

Re: Adding a new field in SegmentsValidationAndRetentionConfig for peer segment download

2020-05-11 Thread Subbu Subramaniam
The goal of the config change in [arts other than StreamConfig is to ensure that the config can be used for offline segments as well, if for some reason download fails. However, a race condition can happen for offline segments that can be dangerous. If a segment has been updated with a newer

Re: [VOTE] Apache Pinot (incubating) 0.3.0 RC1

2020-03-09 Thread Subbu Subramaniam
+1 -Subbu On 2020/03/09 18:29:43, Fu Xiang wrote: > Hi Pinot Community, > > This is a call for vote to the release Apache Pinot (incubating) version > 0.3.0. > > The release candidate: > https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.3.0-rc1 > > Git tag for

Re: Pinot-incubator question about unofficial publications

2020-03-09 Thread Subbu Subramaniam
No concerns. -Subbu On 2020/03/03 22:52:08, kishore g wrote: > This looks good to me. Adding dev to see if others have any concerns. > > On Tue, Mar 3, 2020 at 1:49 PM Szczepan Faber wrote: > > > Hello ASF Pinot mentors! > > > > > > > > We are looking for a way for Apache Pinot (incubator)

Re: Pinot-incubator question about unofficial publications

2020-03-05 Thread Subbu Subramaniam
As far as I could gather, the main point was to ensure that these are NOT called apache pinot releases , which they will not be. Any others have any concerns about this? thanks -Subbu On 2020/03/03 22:52:08, kishore g wrote: > This looks good to me. Adding dev to see if others have any

Re: Tooling for Segment level Kafka offsets management

2020-02-26 Thread Subbu Subramaniam
@xiiang, Yes, it is useful to have a tool to change the offset of a consuming segment in case it errors out due to data in stream. I have added this as a todo in https://github.com/apache/incubator-pinot/issues/4035 There is limited number of things that can be done if data in incoming stream

Re: Jepsen testing for Pinot

2020-02-25 Thread Subbu Subramaniam
Certainly a possibility, I am curious how they do it, though, Last time I tried to test corner cases, the only way I could reproduce them was by putting sleeps in the code, where some operations may take an unnaturally long time due to local implementation/thread contention/os issues, or such.

Re: Preparing for upcoming Pinot Release

2020-02-13 Thread Subbu Subramaniam
Thanks, @kishore g Please do send it out for a review when the docs are ready thanks -Subbu On Thu, Feb 13, 2020 at 10:27 AM kishore g wrote: > @Siddharth Teotia Lets get the text PR merged. > Will be good to release it as experimental and collect feedback. > > @Subbu Subraman

Re: Preparing for upcoming Pinot Release

2020-02-13 Thread Subbu Subramaniam
Hi Xiang, Thanks for taking on the release work. I suppose the version will be 1.0.0? Please make sure that: 1. Either we are migrated fully to the new documentation, OR we have documented all new features in the existing documentation. The current situation is that neither of these is true.

Re: Remove index from segment

2020-02-11 Thread Subbu Subramaniam
I believe we do not map the index if it is not sset in the table config, so the index is not loaded. The cost on storage exists, but hopefully is a lot smaller than memory. -Subbu On 2020/02/11 22:37:13, kishore g wrote: > Currently, we only support adding indices to the pinot segment. If

[ANNOUNCE] Apache Pinot (incubating) 0.2.0 released

2019-11-22 Thread Subbu Subramaniam
Hello Pinot community, We are pleased to announce that Apache Pinot (incubating) 0.2.0 is released! The release can be downloaded at: https://pinot.apache.org/download The release note is available at: https://github.com/apache/incubator-pinot/releases Best Regards, Subbu Subramaniam

Re: [VOTE] Release Apache Pinot (incubating) 0.2.0 RC0

2019-11-19 Thread Subbu Subramaniam
18, 2019 at 7:47 PM Olivier Lamy wrote: > > > +1 > > > > On Tue, 19 Nov 2019 at 3:49 am, Subbu Subramaniam > > wrote: > > > > > Hi all, > > > > > > This is a call for vote to the release Apache Pinot (incubating) version > > >

[VOTE] Release Apache Pinot (incubating) 0.2.0 RC0

2019-11-18 Thread Subbu Subramaniam
Hi all, This is a call for vote to the release Apache Pinot (incubating) version 0.2.0. Apache Pinot (incubating) is a distributed columnar storage engine that can ingest data in realtime and serve analytical queries at low latency. Pinot community has voted and approved this release. Vote

[RESULT][VOTE] Apache Pinot (incubating) 0.2.0 RC0

2019-11-18 Thread Subbu Subramaniam
-binding: +1 Siddharth Teotia +1 Ting Chen Thanks -Subbu Subramaniam

Re: [VOTE] Apache Pinot (incubating) 0.2.0 RC0

2019-11-13 Thread Subbu Subramaniam
Hi Seunghyun, Thanks for your vote. With respect to your suggestions: 1. 164D961B is still your key :-) I had sent a follow-up vote request with my correct key (B530034C). 2. I have also added the signature to the KEYS file now. thanks again -Subbu On Tue, Nov 12, 2019 at 1:52 PM Subbu

[VOTE] Apache Pinot (incubating) 0.2.0 RC0

2019-11-12 Thread Subbu Subramaniam
Please disregard the earlier message. Here is the correct one Hi Pinot Community, This is a call for vote to the release Apache Pinot (incubating) version 0.2.0. The release candidate:https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.2.0-rc0 Git tag for this

[VOTE] Apache Pinot (incubating) 0.2.0 RC0

2019-11-12 Thread Subbu Subramaniam
Hi Pinot Community, This is a call for vote to the release Apache Pinot (incubating) version 0.2.0. The release candidate:https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.2.0-rc0 Git tag for this

Re: Fwd: Incubator report timeline August 2019

2019-08-07 Thread Subbu Subramaniam
%3Dreserved=0 From: Subbu Subramaniam Sent: Wednesday, August 7, 2019 9:19 AM To: dev@pinot.apache.org Subject: Re: Fwd: Incubator report timeline August 2019 Thank you, Justin and Felix, for your guidance and suggestions. I have added more material

Re: Fwd: Incubator report timeline August 2019

2019-08-07 Thread Subbu Subramaniam
-Subbu From: Subbu Subramaniam Sent: Wednesday, August 7, 2019 8:54 AM To: dev@pinot.apache.org Subject: Re: Fwd: Incubator report timeline August 2019 Hi Justin, Thanks for your suggestion. Really, we believe the only thing that is blocking us from graduation

Re: Fwd: Incubator report timeline August 2019

2019-08-07 Thread Subbu Subramaniam
Hi Justin, Thanks for your suggestion. Really, we believe the only thing that is blocking us from graduation is the releases. And, we have been blocked by helix bugs in that regard. I would like your suggestions on anything else that we may be unaware of, in terms of getting to graduation.

Re: Fwd: Incubator report timeline August 2019

2019-08-06 Thread Subbu Subramaniam
Hi Justin I had updated the podling report in this page a few days back. https://cwiki.apache.org/confluence/display/INCUBATOR/August2019#pinot Is there anything else needed? thanks -Subbu From: Justin Mclean Sent: Tuesday, August 6, 2019 8:04 PM To:

Re: Missing podling logos

2019-06-03 Thread Subbu Subramaniam
Thanks for the reminder Felix. Where exactly do we add the logo? We do have one in this page: https://pinot.incubator.apache.org/ thanks -Subbu From: Felix Cheung Sent: Sunday, June 2, 2019 11:51 AM To: dev@pinot.apache.org Subject: Fwd: Missing podling logos

Re: Apache Pinot Dev,uSer, Committer mailing lists

2019-03-27 Thread Subbu Subramaniam
Hi Sai, At the end of the document on realtime indexing, there are many items that we are inviting contributions on. https://cwiki.apache.org/confluence/display/PINOT/Consuming+and+Indexing+rows+in+Realtime#ConsumingandIndexingrowsinRealtime-ContributionsWelcome You may want to start with

Re: Help with permissions to cwiki pages

2019-03-02 Thread Subbu Subramaniam
To: Subbu Subramaniam Cc: dev@pinot.apache.org Subject: Re: Help with permissions to cwiki pages I saw the other comment and the INFRA JIRA. My understanding would be that you would need to ensure the user has permission in the “space” first. On Fri, Mar 1, 2019 at 2:48 PM Felix Cheung

Help with permissions to cwiki pages

2019-03-01 Thread Subbu Subramaniam
Hi Felix, In the Pinot project we decided to use cwiki for design documents. We need to collaborate across companies on these, so we are trying to give access to specific pages to engineers in the community who are working on that feature. But then they are not able to edit the pages even

Re: [VOTE] Apache Pinot (incubating) 0.1.0 RC0

2019-02-19 Thread Subbu Subramaniam
+1 All checked out after the key was fixed. Some suggestions: * We should add verification for realtime also. * We should verify from binary distribution rather than the src that has been built? (not sure about this) Otherwise, lgtm -Subbu From:

Re: You incubator report missing a few answers

2019-02-03 Thread Subbu Subramaniam
Hi Justin, I believe we have not made any changes to PPMC after the initiation, but @kishoreg may have more information. I have updated the answer with this info. And yes, the mentors have been helpful, I filled that in as well. -Subbu PS: By mistake I ended up updating Jan 2019 report first,

Re: Unapproved releases

2019-01-29 Thread Subbu Subramaniam
to delete these? I confirm that we can drop these releases, so if you can do a mass delete at your end that will be awesome. -Subbu From: Subbu Subramaniam Sent: Tuesday, January 29, 2019 5:00 PM To: Felix Cheung Cc: Justin Mclean; dev@pinot.apache.org; kisho

Re: Unapproved releases

2019-01-29 Thread Subbu Subramaniam
stopping checkin to the trunk. -Subbu From: Felix Cheung Sent: Tuesday, January 29, 2019 4:52 PM To: Subbu Subramaniam Cc: Justin Mclean; dev@pinot.apache.org; kisho...@apache.org Subject: Re: Unapproved releases Hi Subbu How are these releases made and what

Re: Unapproved releases

2019-01-29 Thread Subbu Subramaniam
if there are users that are using these images. thanks, -Subbu From: Justin Mclean Sent: Tuesday, January 29, 2019 3:09 PM To: Subbu Subramaniam Cc: dev@pinot.apache.org Subject: Re: Unapproved releases Hi, Is it sufficient if we write that the snapshots

Re: Unapproved releases

2019-01-29 Thread Subbu Subramaniam
Hi Justin, Sure, we can include something in the report. Is it sufficient if we write that the snapshots in the links are unofficial snapshots of Pinot, and that we are working on a formal apache release? (the latter part is there in the report anyway) thanks -Subbu

Re: Pinot website and DOAP

2018-12-29 Thread Subbu Subramaniam
Jennifer, can you please take these two JIRAs? https://issues.apache.org/jira/browse/PINOT-3 https://issues.apache.org/jira/browse/PINOT-2 -Subbu From: Felix Cheung Sent: Friday, December 28, 2018 2:54 PM To: dev@pinot.apache.org Subject: Pinot website and DOAP

Re: Podling Report Reminder - January 2019

2018-12-29 Thread Subbu Subramaniam
can add: source repo migrated to Apache, mailing lists and JIRA created. Also a website created. Otherwise LGTM From: Subbu Subramaniam Sent: Friday, December 28, 2018 5:12 PM To: g.kish...@gmail.com; dev@pinot.apache.org Subject: Re: Podling Report Reminder

Re: Podling Report Reminder - January 2019

2018-12-28 Thread Subbu Subramaniam
Thanks Felix. I have updated the podling page. Please take a look and let me know if there is anything else needed. -Subbu From: Felix Cheung Sent: Thursday, December 27, 2018 12:12 PM To: dev@pinot.apache.org; g.kish...@gmail.com Subject: Re: Podling Report

Re: Incubator Podling Report (Due 5th December)

2018-12-03 Thread Subbu Subramaniam
What is involved here? Having never done one before, I have no idea. Is there a template for the report? thanks -Subbu From: kishore g Sent: Sunday, December 2, 2018 2:57 PM To: dev@pinot.apache.org Subject: Re: Incubator Podling Report (Due 5th December)