Re: Druid 0.12.1-rc2 vote

2018-05-14 Thread Gian Merlino
+1 On Mon, May 14, 2018 at 1:43 PM, Driesprong, Fokko wrote: > +1 as well > > (Charles, your awesome email address works correctly! :) > > 2018-05-14 22:35 GMT+02:00 Charles Allen : > > > +1 > > > > ((crosses fingers that this email sends correctly from the

Re: Druid 0.12.1-rc1 vote

2018-04-27 Thread Gian Merlino
ithub.com/druid-io/druid/pull/5674 - > it's failing in Travis for unknown reasons. The bug in local tests has been > fixed. > > On Thu, Apr 26, 2018 at 9:57 PM, Gian Merlino <g...@apache.org> wrote: > > > I'm reviewing https://github.com/druid-io/druid/pull/5692 rig

Re: A question about Druid design

2018-06-19 Thread Gian Merlino
s it true that TimeAndDims are > ordered firstly according to time anyway? > I am most likely missing something, just would like to understand what :) > Thanks,Anastasia > > On Wednesday, May 30, 2018, 10:56:26 AM GMT+3, Gian Merlino < > gianmerl...@gmail.com> wrote: > &

Re: New Druid Meetup group for LA / Venice / Santa Monica!

2018-06-14 Thread Gian Merlino
Awesome Charles! I joined in case I'm down there :) If you are already thinking about scheduling the ones later in the year, a couple of us are planning on being in the LA area from November 5–7 and I would love to attend if the schedules line up. On Sat, Jun 9, 2018 at 12:11 PM Charles Allen

Re: New Druid Meetup group for LA / Venice / Santa Monica!

2018-06-14 Thread Gian Merlino
PM Gian Merlino wrote: > Awesome Charles! I joined in case I'm down there :) > > If you are already thinking about scheduling the ones later in the year, a > couple of us are planning on being in the LA area from November 5–7 and I > would love to attend if the schedules line up. &g

Re: Transactions in Druid?

2018-05-29 Thread Gian Merlino
Hi Edward, There are a couple of ways to do transactional updates to Druid today: 1) When using streaming ingestion with the "parseBatch" feature (see io.druid.data.input.impl.InputRowParser), rows in the batch are inserted transactionally. 2) When using batch ingestion in overwrite mode (the

Re: A question about Druid design

2018-05-30 Thread Gian Merlino
Hi Anastasia, 1) At ingestion time the FactsHolder is sorted. The unsorted code path is used by groupBy v1, which hasn't been common since groupBy v2 was made the default a few releases ago. So I would only worry about the sorted case. 2) PlainFactsHolder is used when the user has disabled

Re: Access to jira

2018-05-31 Thread Gian Merlino
We should probably have a label for it too. On Thu, May 31, 2018 at 9:23 AM, Gian Merlino wrote: > I don't see why not! > > On Thu, May 31, 2018 at 9:21 AM, Charles Allen wrote: > >> Sounds good. I'd like to put some more formal tracking and responsibility >> to the r

Re: Access to jira

2018-05-31 Thread Gian Merlino
I don't see why not! On Thu, May 31, 2018 at 9:21 AM, Charles Allen wrote: > Sounds good. I'd like to put some more formal tracking and responsibility > to the remaining incubator items. Would github issues be the preferred > place to do that? > > On Thu, May 31, 2018 at 9:20

Re: Access to jira

2018-05-31 Thread Gian Merlino
I think we are planning to keep using GitHub issues, based on the discussion in the migration logistics thread. And based on the fact that Apache seems to allow that now (https://github.com/apache/fluo was given as an example). So probably the right thing to do is update

Re: CLA still required?

2018-06-01 Thread Gian Merlino
Yes we are still collecting them, although once we are fully migrated to ASF, then we won't anymore (as per ASF policy - as I understand it - CLAs are only required for committers). On Fri, Jun 1, 2018 at 6:27 AM, Pierre Lacave wrote: > Hi, > > With the incubation ongoing, do you still require

Re: Podling Report Reminder - June 2018

2018-06-20 Thread Gian Merlino
Hi Justin, As Julian said, he is active, and has been very helpful as a mentor. (Thanks Julian!!) Thanks for checking up on us. We'll make sure not to miss next month's report; we are aware they are a thing (we did a couple already -- Nishant did one and I did one or two) but it looks like

Re: Druid repo migration plan

2018-06-20 Thread Gian Merlino
+1; thanks Jon! On Wed, Jun 20, 2018 at 5:52 PM Jihoon Son wrote: > +1 > > Sounds good to me. > > Jihoon > > On Wed, Jun 20, 2018 at 5:12 PM Nishant Bangarwa < > nbanga...@hortonworks.com> > wrote: > > > +1 > > > > -- > > Nishant Bangarwa > > > > Hortonworks > > > > On 6/20/18, 3:57 PM,

Re: Considering 0.12.2 release

2018-06-20 Thread Gian Merlino
+1 I would suggest adding these two as well. https://github.com/druid-io/druid/pull/5878 - Fix inefficient available segment cache population in SQLMetadataSegmentManager. https://github.com/druid-io/druid/pull/5873 - HdfsDataSegmentPusher: Close tmpIndexFile before copying it. On Tue, Jun 12,

Re: Druid Security / Segment Encryption

2018-07-02 Thread Gian Merlino
Hi Ben, Druid's security features today consist of an authentication/authorization layer, and the ability to use TLS. To my knowledge encrypting the data files at rest has not been looked into yet. In the past when I've been asked, I've suggested using disk encryption, and people usually seem

Re: [druid-user] Druid 12.1 Datasource load fails in Coordinator due change in implementation from Set to Map

2018-07-03 Thread Gian Merlino
Yes, this should be out soon. We regret the regression! If you are comfortable patching #5878 into your build, that should fix it. It will also be included in 0.12.2. Gian On Thu, Jun 28, 2018 at 10:35 AM, Samarth Jain wrote: > Adding the dev email group. > > We are currently hitting this

Re: Considering 0.12.2 release

2018-06-29 Thread Gian Merlino
5729 and 5745 in this week and then start the release > >> process for 0.12.2. > >> > >> Jihoon > >> > >> On Tue, Jun 26, 2018 at 10:42 AM Prashant Deva > > >> wrote: > >> > >> > Jihoon, > >> > +1 for a

Re: Podling Report Reminder - May 2018

2018-05-03 Thread Gian Merlino
me and I will post it. > > -Taylor > > > On May 3, 2018, at 2:01 PM, Gian Merlino <g...@apache.org> wrote: > > > > I can take up this one. > > > > On Thu, May 3, 2018 at 10:48 AM, P. Taylor Goetz <ptgo...@gmail.com> > wrote: > > > >&

Re: Podling Report Reminder - May 2018

2018-05-03 Thread Gian Merlino
I have posted this on https://wiki.apache.org/incubator/May2018. On Thu, May 3, 2018 at 1:03 PM, Gian Merlino <g...@apache.org> wrote: > Here's a draft (below). Since it's already overdue, I'll post it on the > wiki in a few hours. > > Druid > > Druid is a high-perf

Re: Druid repo migration plan

2018-07-03 Thread Gian Merlino
Here is the ticket, btw: https://issues.apache.org/jira/browse/INFRA-16674. Repo move should be happening real soon now! On Mon, Jul 2, 2018 at 11:55 PM Gian Merlino wrote: > Our infra ticket is progressing along and it looks like we're just about > ready to pull the trigger on moving th

Re: Podling Report (August 2018)

2018-08-02 Thread Gian Merlino
That sounds like a good question for gene...@incubator.apache.org. On Thu, Aug 2, 2018 at 2:22 PM Jonathan Wei wrote: > Hm, looks like the wiki page https://wiki.apache.org/incubator/August2018 > still > doesn't exist, any idea when it'll be up? > > > On Thu, Aug 2, 2018 at 1:04 PM, Julian Hyde

Re: Issue with documentation

2018-07-25 Thread Gian Merlino
Hey Himanshu, The docs are kept in the main Druid repo and released to the site when we do Druid releases. The source for the doc you mentioned is here: https://github.com/apache/incubator-druid/blob/master/docs/content/tutorials/quickstart.md If you still see the error in master, please raise a

Re: About creating 0.12.2-rc1

2018-08-05 Thread Gian Merlino
+1, and fwiw, it looks like Apache projects don't always need to do votes for creating release candidates. For example on the Calcite mailing list I see votes for _final_ releases, but the release candidates seem to be created and uploaded without a vote. There is generally some discussion on the

Re: Issue with documentation

2018-07-26 Thread Gian Merlino
Just a pull request is good enough. On Wed, Jul 25, 2018 at 4:23 PM Himanshu Pandey wrote: > Thanks Gian! Do I still need to create a new issue in GitHub for this ? or > just a pull request will suffice? > > > > *Thanks & Regards,* > *Himanshu Pandey* > > > On

Re: Docs for 'master'

2018-08-10 Thread Gian Merlino
That sounds nice, I am all for it. It should ideally be automated, maybe with Jenkins. On Fri, Aug 10, 2018 at 5:13 PM Jihoon Son wrote: > Hi all, > > We currently have the following system for docs. > > - http://druid.io/docs/{version}: docs for a specific version > -

Re: Changing release process for release candidates

2018-08-06 Thread Gian Merlino
It sounds good to me, it streamlines things a bit and seems to be what other projects are doing. As Julian pointed out in the other thread it still pays to have someone "managing" the release and to have some discussion about when's the right time to start a release branch. The "release manager"

Re: Druid 0.12.2 release vote

2018-08-07 Thread Gian Merlino
+1. Thank you Jihoon for running this release. On Tue, Aug 7, 2018 at 10:04 AM Jihoon Son wrote: > Sure, > > the release note is available here: > https://github.com/apache/incubator-druid/issues/6116. > > Best, > Jihoon > > On Tue, Aug 7, 2018 at 10:02 AM Charles Allen wrote: > > > ((don't

Re: Podling Report (August 2018)

2018-08-06 Thread Gian Merlino
It looks like the page is up now, so I posted this report there. On Thu, Aug 2, 2018 at 3:03 PM Gian Merlino wrote: > That sounds like a good question for gene...@incubator.apache.org. > > On Thu, Aug 2, 2018 at 2:22 PM Jonathan Wei wrote: > >> Hm, looks like t

Re: Different query results for 0.12.2 and 0.10.1

2018-08-06 Thread Gian Merlino
Hi Samarth, The doubleSum difference is likely due to the fact that before 0.11.0, Druid read values out of columns as 32 bit floats and then cast them to 64 bit doubles. Now it can read them directly as 64 bit doubles. And actually, it can _store_ floating point values as 64 bit doubles too,

Re: 0.10.1 and 0.12.2 group by/search/select/top n query results

2018-08-06 Thread Gian Merlino
Hi Samarth, It looks like you posted this message twice with two different subjects. I responded to the other one, titled "Different query results for 0.12.2 and 0.10.1". On Sun, Aug 5, 2018 at 9:41 PM Samarth Jain wrote: > I have an internal test harness setup that I am using for testing

Re: About creating 0.12.2-rc1

2018-08-06 Thread Gian Merlino
asking people to stop pushing, > > again by a non-vote email thread. > > > > Julian > > > > > On Aug 5, 2018, at 8:56 AM, Gian Merlino wrote: > > > > > > +1, and fwiw, it looks like Apache projects don't always need to do > votes > > > for

Re: Druid 0.12.2 release vote

2018-08-09 Thread Gian Merlino
, Jihoon Son >> wrote: >> > >> > > Awesome! Thanks Charles! >> > > >> > > Jihoon >> > > >> > > On Wed, Aug 8, 2018 at 1:16 PM Gian Merlino wrote: >> > > >> > > > Thanks, it will be nice to see!

Re: Nightly build!

2018-08-09 Thread Gian Merlino
I found http://www.apache.org/legal/release-policy.html#host-rc which looks like the policy we should follow if we start doing nightly builds. I guess we shouldn't archive nightly builds, since there would be too many. On Thu, Aug 9, 2018 at 6:02 PM Jihoon Son wrote: > Hi all, > > Nightly build

Re: CLA still required?

2018-08-17 Thread Gian Merlino
a.html? > > > On Fri, Jun 1, 2018 at 12:52 PM, Gian Merlino wrote: > > > Yes we are still collecting them, although once we are fully migrated to > > ASF, then we won't anymore (as per ASF policy - as I understand it - CLAs > > are only required for committers). > >

Re: Late June/July podling reports

2018-07-18 Thread Gian Merlino
OMG! I don't see a report reminder for July. Is that not something that is happening anymore? I was relying on getting one of those… IMO, there is no reason to write the older June report. We missed it, and that is sad, but it is probably not super interesting to look back and see what was

Re: Java script engine to be removed

2018-07-16 Thread Gian Merlino
IIRC we never moved to Nashorn, and are still using Rhino. Certainly, all the imports in the relevant files are "org.mozilla". On Sat, Jul 14, 2018 at 1:54 PM Charles Allen wrote: > http://openjdk.java.net/jeps/335 > > https://bugs.openjdk.java.net/browse/JDK-8202786 > > The javascript Nashorn

Re: Travis Permissions

2018-07-16 Thread Gian Merlino
Fwiw, I do have permissions to restart individual builds, but I'm not sure why. On Sat, Jul 14, 2018 at 12:09 PM Roman Leventov wrote: > Seems that I no longer have permissions to restart builds in Travis. Could > we do something about this, or we now need to close/open PRs to restart > builds?

Re: Build failure on 0.13.SNAPSHOT

2018-07-23 Thread Gian Merlino
Interesting. Fwiw, I am using Maven 3.5.2 for building Druid and it has been working for for me. I don't think I"m using any special Maven overrides (at least, I don't see anything interesting in my ~/.m2 directory or in my environment variables). It might have to do with how much memory our

Re: Release process for Maven artifacts?

2018-07-23 Thread Gian Merlino
Hi Joseph, For official releases we just do mvn release:prepare release:perform. The poms encode everything that has to happen, including sources jars, javadocs jars, signing everything, and pushing it up to Maven Central. You might be able to modify them to push to a different repo. On Mon, Jul

Re: Druid 0.12.2-rc1 vote

2018-07-24 Thread Gian Merlino
+1 On Thu, Jul 19, 2018 at 1:09 PM Jihoon Son wrote: > Hi all, > > we have no open issues and PRs for 0.12.2 ( > https://github.com/apache/incubator-druid/milestone/27). The 0.12.2 branch > is already available and all PRs for 0.12.2 have merged into that branch. > > Let's vote on releasing

Re: GitBox review comments

2018-07-24 Thread Gian Merlino
There is a github feature to make multiple comments as a single "review", although from what I can see, gitbox splits those up into multiple emails anyway, so it doesn't help. I have poked Infra again on our ticket: https://issues.apache.org/jira/browse/INFRA-16674 On Tue, Jul 24, 2018 at 5:55 PM

Re: Subscription Request

2018-07-19 Thread Gian Merlino
Hi Dongjin, To subscribe, just send a mail to dev-subscr...@druid.apache.org. On Wed, Jul 18, 2018 at 9:55 PM Dongjin Lee wrote: > -- > *Dongjin Lee* > > *A hitchhiker in the mathematical world.* > > *github: github.com/dongjinleekr >

Re: synchronization question about datasketches aggregator

2018-07-19 Thread Gian Merlino
Hi Will, Check out also this thread for related discussion: https://lists.apache.org/thread.html/9899aa790a7eb561ab66f47b35c8f66ffe695432719251351339521a@%3Cdev.druid.apache.org%3E On Thu, Jul 19, 2018 at 11:21 AM Will Lauer wrote: > A colleague recently pointed out to me that all the sketch

Re: list polluted by gitbox messages

2018-07-19 Thread Gian Merlino
We're working with infra to redirect the notifications: https://issues.apache.org/jira/browse/INFRA-16674 In the meantime, I have been using these filters to keep myself sane: https://gist.github.com/gianm/0eb410915c02e3844e11235172894c62 (it's a gist because the filters are partially based on

Re: Build failure on 0.13.SNAPSHOT

2018-07-25 Thread Gian Merlino
; memory. Only the 'strict compilation' Travis job requires 3 GB of memory. >> >> I think it's worthwhile to look into this more. Maybe we somehow use more >> memory when we run all tests by 'mvn install'. Maybe this relates to the >> frequent transient failur

Re: Release process for Maven artifacts?

2018-07-25 Thread Gian Merlino
pom to point > to it. > It was non-obvious where the release plugin was configured until I spotted > the parent reference. > > Joseph. > > On Tue, Jul 24, 2018 at 9:09 AM, Gian Merlino wrote: > > > Hi Joseph, > > > > For official releases we just do mvn release:p

Re: Flushing Travis Caches

2018-07-25 Thread Gian Merlino
No objection, I did it at one point in the past too when it seemed to have got corrupted (weird, inexplicable errors unpacking jars that got fixed when the cache was cleared). On Wed, Jul 25, 2018 at 10:10 AM Charles Allen wrote: > The cache for one of my PRs got corrupt on travis and I had to

Re: Towards 0.13 (Apache release)

2018-08-30 Thread Gian Merlino
cleanly, after setting this config. I just had a few conflicts to resolve in imports. On Wed, Aug 29, 2018 at 4:09 PM Gian Merlino wrote: > I just raised https://github.com/apache/incubator-druid/pull/6266. I > think for sanity's sake, I would really appreciate it if we got this one > merg

Re: Druid 0.12.3-rc1 available

2018-09-05 Thread Gian Merlino
Thanks Jon!! How does everyone feel about starting the vote on this next Monday? On Tue, Sep 4, 2018 at 12:41 PM Jonathan Wei wrote: > We're happy to announce our next release candidate, Druid 0.12.3-rc1! > > Druid 0.12.3 is a non-ASF release. It contains stability improvements and > bug fixes

Re: Towards 0.13 (Apache release)

2018-08-29 Thread Gian Merlino
I just raised https://github.com/apache/incubator-druid/pull/6266. I think for sanity's sake, I would really appreciate it if we got this one merged before merging any other PRs. (It will conflict with 100% of other PRs) On Wed, Aug 29, 2018 at 9:34 AM Gian Merlino wrote: > Hi every

Druid August 2018 Bay Area meetup

2018-07-10 Thread Gian Merlino
Please join us for our next Druid meetup at Lyft, which you can RSVP to here: https://www.meetup.com/druidio/events/252515792/ Speakers will be sharing real-world experience with Druid and discussing the upcoming Druid roadmap. Hope to see everyone there!

Re: Question about sketches aggregation in druid

2018-07-10 Thread Gian Merlino
Hi Eshcar, To my knowledge, in the Druid Aggregator and BufferAggregator interfaces, the main place where concurrency happens is that "aggregate" and "get" may be called simultaneously during realtime ingestion. So if there would be a benefit from improving concurrency it would probably end up in

Re: TeamCity Inspections CI broke

2018-07-10 Thread Gian Merlino
Any idea what has to be done to fix it? I am not too familiar with how the TeamCity integration works. Is it something we can fix ourselves or something Infra has to do? On Tue, Jul 10, 2018 at 7:29 AM Roman Leventov wrote: > Since the repo was moved to apache org, the integration failed, the

Re: Druid repo migration plan

2018-07-06 Thread Gian Merlino
on content, and if paste them in this message, they'll catch it as a false positive gitbox mail…) On Fri, Jul 6, 2018 at 1:31 PM Gian Merlino wrote: > IMO, GitHub has good tools already for subscribing to repos, > notifications, and issues. I would expect Druid contributors to use those &

Re: Druid repo migration plan

2018-07-06 Thread Gian Merlino
8, at 12:24 PM, Samarth Jain <mailto:samarth.j...@gmail.com>> wrote: > >> > >> +1 to sending to git...@druid.apache.org git...@druid.apache.org> > >> > >> On Fri, Jul 6, 2018 at 12:17 PM, Gian Merlino g...@apache.org>> wrote: > >> > &

Re: Regarding becoming a contributor

2018-07-12 Thread Gian Merlino
Hi Himanshu, Awesome that you are interested in helping out! We have a community page here that describes how you can get started: http://druid.io/community/ The basics are: 1) Subscribe to the dev list. 2) If you are using Druid today and have an itch, scratching that itch is the best way to

Re: Druid 0.12.2-rc1 vote

2018-07-11 Thread Gian Merlino
e again once a patch to fix is merged? > > Jihoon > > On Wed, Jul 11, 2018 at 10:02 AM Jonathan Wei wrote: > > > +1 > > > > On Wed, Jul 11, 2018 at 9:44 AM, Gian Merlino wrote: > > > > > +1 from me too! > > > > > > On Wed, Jul 11, 2018

Re: [druid-dev] Apache migration logistics

2018-03-12 Thread Gian Merlino
Committers: please, 1) If you don't have an apache id already, fill out an ICLA: https://www.apache.org/dev/new-committers-guide.html# guide-for-new-committers and then post here and hopefully someone can figure out how to get you an id? 2) When you have an id, post it here if it's not in

Re: [druid-dev] Apache migration logistics

2018-03-13 Thread Gian Merlino
I think rather than subscribing the apache dev list to the google group, it'd be better to do a clean break and disable posting on the google group. The autoreply feature seems to need a business account, which we don't have, but we could turn on "Moderate all messages to the group" and combine

Re: Podling report - April 2018

2018-04-06 Thread Gian Merlino
@gmail.com> > > wrote: > > > > > > > I've signed an ICLA for a different project before, doesn't it count? > > > > > > > > On Thu, 5 Apr 2018, 01:39 Gian Merlino, <gianmerl...@gmail.com> > wrote: > > > > > > > &g

Re: [druid-dev] consider doing a 0.12.1 release

2018-04-09 Thread Gian Merlino
I think this conversation is worth having. I have cross posted this to dev@druid.apache.org and will reply there. Since we're trying to migrate the dev list, please cross post any dev messages there, or even only post to that list. Gian On Sun, Apr 8, 2018 at 5:45 PM, Prashant Deva

Re: [druid-dev] Load rule doesn't honor intervals properly

2018-04-09 Thread Gian Merlino
io/druid/pull/5595. > > Whoever is the right owner please take a look - let me know if i should @ > a specific person and i can do that. > > > Thanks, > pala > > > > On Fri, Mar 30, 2018 at 2:12 PM, Gian Merlino <g...@imply.io> wrote: > >> Hi P

Re: Podling report - April 2018

2018-04-04 Thread Gian Merlino
he only ones I can't find in the directory are Parag and Roman. > > Everyone that hasn't updated the incubator page at > http://incubator.apache.org/projects/druid.html with their apache id, > would > you mind doing so? > > On Tue, Apr 3, 2018 at 4:31 PM Gian Merlino <gi

Re: [druid-dev] consider doing a 0.12.1 release

2018-04-09 Thread Gian Merlino
eshes when they fail. (#5328) On Mon, Apr 9, 2018 at 10:35 AM, Gian Merlino <g...@imply.io> wrote: > I think this conversation is worth having. I have cross posted this to > dev@druid.apache.org and will reply there. Since we're trying to migrate > the dev list, please cr

Re: [druid-dev] consider doing a 0.12.1 release

2018-04-09 Thread Gian Merlino
It looks like there's a lot of support for doing a 0.12.1… I'll make a milestone in GH. On Mon, Apr 9, 2018 at 12:12 PM, Slim Bouguerra <bs...@apache.org> wrote: > +1 especially there is some instability bugs. > > On Apr 9, 2018, at 11:57 AM, Gian Merlino <g...@apache.org>

Re: [druid-dev] consider doing a 0.12.1 release

2018-04-09 Thread Gian Merlino
Deva <prashant.d...@gmail.com> wrote: > also for the list: > > - compact task throws exception #5611 > > i dont have permission to add to gian's github milestone > > Prashant > > On Mon, Apr 9, 2018 at 12:26 PM, Gian Merlino <gianmerl...@gmail.com> > wrote:

Re: [druid-dev] consider doing a 0.12.1 release

2018-04-09 Thread Gian Merlino
I backported 5504 and 5587. I skipped 5374 since it turns out it isn't relevant to 0.12.0 -- it fixes something introduced since then -- so I moved that back to 0.13.0. On Mon, Apr 9, 2018 at 1:56 PM, Gian Merlino <g...@apache.org> wrote: > I raised backport PRs for everything on my li

Re: [druid-dev] consider doing a 0.12.1 release

2018-04-09 Thread Gian Merlino
Here we go: https://github.com/druid-io/druid/milestone/26. Please add stuff if it makes sense (high importance / low risk bug fixes). On Mon, Apr 9, 2018 at 12:14 PM, Gian Merlino <gianmerl...@gmail.com> wrote: > It looks like there's a lot of support for doing a 0.12.1… I'll make a &g

Re: Podling report - April 2018

2018-04-06 Thread Gian Merlino
ould suggest Roman just request an Apache ID directly and > > re-sign the icla like everyone else did. That will probably be faster > than > > tracking down the old cla. > > > > On Fri, Apr 6, 2018 at 12:05 AM Gian Merlino <gianmerl...@gmail.com> >

Re: Dependencies licenses Report

2018-04-18 Thread Gian Merlino
Hi Slim, Do you know if ORC & Hive use this tool as part of their release process? And if it's considered a good tool by itself for verifying we meet all of the Apache licensing requirements, or if we'll need something else too? On Tue, Apr 17, 2018 at 9:15 PM, Slim Bouguerra

Today's dev sync

2018-04-17 Thread Gian Merlino
https://hangouts.google.com/hangouts/_/calendar/Z2lhbm1lcmxpbm9AZ21haWwuY29t.73eguu7d0a9gr27kt1ugitllq3

Re: Dependencies licenses Report

2018-04-20 Thread Gian Merlino
; > wrote: > > > The main tool to use is Apache RAT. Definitely use that. > > > > One of the hardest tasks is getting the contents of LICENSE and NOTICE > > right. That is a manual task I’m afraid. > > > > Julian > > > > > On Apr 18, 2018, at 0

Re: Web site

2018-04-16 Thread Gian Merlino
ant every contributor to have to download a huge git repo. > > Julian > > > > On Apr 16, 2018, at 8:48 AM, Gian Merlino <g...@apache.org> wrote: > > > > A technical note that I also posted in the "migration logistics" thread: > > the sources for the

Re: Web site

2018-04-16 Thread Gian Merlino
A technical note that I also posted in the "migration logistics" thread: the sources for the site are at https://github.com/apache/incubator-druid-website. The branch "asf-git" is served on the site https://druid.incubator.apache.org/. I think once we migrate http://druid.io/, we could do

Re: [druid-dev] Apache migration logistics

2018-04-15 Thread Gian Merlino
re in "src" and the built site is in "master". Except in the ASF infra, it makes more sense to put the sources in "master" and the built site in "asf-git". On Sun, Apr 15, 2018 at 7:56 AM, Gian Merlino <gianmerl...@gmail.com> wrote: > FYI: We receive

Re: [druid-dev] Apache migration logistics

2018-04-15 Thread Gian Merlino
; Julian > > > On Mar 27, 2018, at 5:20 PM, Gian Merlino <gianmerl...@gmail.com> wrote: > > Hi, today I found myself wondering about migration of source repos. > > Does anyone know if we've got our GitBox git repo set up? And who we need > to talk to about getting the dr

Re: [druid-dev] Apache migration logistics

2018-04-16 Thread Gian Merlino
Oh cool, I didn't realize that. We should stick to https://druid.apache.org/ then. Gian On Mon, Apr 16, 2018 at 10:51 AM, Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > Quick note to say that apache sets up both http://druid.incubator.ap > ache.org/ and http://druid.apache.org/ >

Re: Dependencies licenses Report

2018-04-24 Thread Gian Merlino
gt; > > > > > > On Wed, Apr 18, 2018 at 8:45 AM, Julian Hyde <jhyde.apa...@gmail.com> > wrote: > > > > > The main tool to use is Apache RAT. Definitely use that. > > > > > > One of the hardest tasks is getting the contents of LICENSE and NOTIC

Re: Dependencies licenses Report

2018-04-24 Thread Gian Merlino
> you are sure about this? thought the donation paper work is signed right? Not yet as far as I know; last I heard was a week or so ago. On Tue, Apr 24, 2018 at 1:41 PM, Slim Bouguerra <slim.bougue...@gmail.com> wrote: > > > On Apr 24, 2018, at 1:18 PM, Gian Merlino <g

Re: [druid-dev] Apache migration logistics

2018-04-23 Thread Gian Merlino
apache id recently, its pjain1 > Not sure how to add it to the page - http://incubator.apache.org/ > projects/druid.html. If anyone knows, can you please add it. > Thanks,Parag > > On Monday, March 12, 2018, 4:49:41 PM CDT, Gian Merlino <g...@imply.io> > wrote: > > Com

Re: Dev list migration

2018-04-24 Thread Gian Merlino
gt; > > On 4/17/18, 10:19 PM, "Jonathan Wei" <jon...@apache.org> wrote: > > > > >+1 > > > > > >On 2018/04/17 18:09:37, David Lim <david...@apache.org> wrote: > > >> +1 > > >> > > >> On Tue, Apr 17

Re: [druid-dev] consider doing a 0.12.1 release

2018-04-17 Thread Gian Merlino
, but we are not yet ready to do Apache releases from either an IP or technical standpoint. On Mon, Apr 9, 2018 at 9:07 PM, Gian Merlino <gianmerl...@gmail.com> wrote: > I backported 5504 and 5587. I skipped 5374 since it turns out it isn't > relevant to 0.12.0 -- it fixes somethin

Re: Tranquility Future

2018-04-17 Thread Gian Merlino
Is anyone interested in doing the work to migrate it to Apache? If so, I think we should definitely do that. In general I have been more interested in contributing to the Kafka indexing service lately since it has nicer properties (exactly once, no extra processes, can read late data). But

Re: Making sure Github / Gitbox is setup properly

2018-04-18 Thread Gian Merlino
Those are good tips… thanks! Does it make sense to send every GitHub notification to g...@druid.apache.org or is there a reason you suggested splitting out issues and PRs? On Wed, Apr 18, 2018 at 8:44 AM, Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > Hi dev@druid.apache.org, > >

Re: [druid-dev] Apache migration logistics

2018-03-27 Thread Gian Merlino
<xav...@confluent.io> wrote: > FYI, to update your information on the status page you need to check out > https://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/ > with > your Apache credentials and update the druid.xml file in that directory. > > On Mon, Mar 12, 201

Re: [druid-dev] any reason to still keep overlord as separate node?

2018-03-31 Thread Gian Merlino
Hi Prashant, The only issue that I can think of is that in some (super large) clusters, the coordinator and overlord can both be pretty demanding in terms of memory and it helps for scalability to have them be separate. But this is not the common case - most clusters are smaller or medium sized.

Re: [druid-dev] Questions about Public API

2018-03-31 Thread Gian Merlino
I cross-posted my reply, so this thread is on both lists now. On Fri, Mar 30, 2018 at 3:32 PM, Jihoon Son <ghoon...@gmail.com> wrote: > Thanks. > > Should I send this email to the Apache mailing list as well? > > Jihoon > > 2018년 3월 30일 (금) 오후 1:58, Gian Merlino <

Re: [druid-dev] Questions about Public API

2018-04-01 Thread Gian Merlino
Hi Jihoon, The javadoc for @PublicApi explains the intent. They can change, but not in a minor release. There should also be some consensus around changing them. Once we are 1.0, then we should only change PublicApis when going to 2.0. Btw, since we are trying to migrate the dev mailing list to

Podling report - April 2018

2018-04-03 Thread Gian Merlino
Hi Druids, Our podling report is due tomorrow and I am starting work on it. I will post a draft here before editing the incubator wiki.

Re: [druid-dev] Skipping Empty Buckets feature

2018-04-03 Thread Gian Merlino
Hi Suhas, How would you expect the results to come back if groupBy did _not_ skip empty time buckets, and one day was empty? Should all the dimensions be null? Btw, since we are migrating the dev mailing list to Apache, please cross post this sort of thing with dev@druid.apache.org, or even only

Re: Podling report - April 2018

2018-04-03 Thread Gian Merlino
. On Tue, Apr 3, 2018 at 11:43 AM, Gian Merlino <g...@apache.org> wrote: > Hi Druids, > > Our podling report is due tomorrow and I am starting work on it. > > I will post a draft here before editing the incubator wiki. >

Re: Considering 0.12.2 release

2018-06-21 Thread Gian Merlino
Leventov wrote: > Why won't release 13.0 instead (as non-Apache)? > > On Thu, 21 Jun 2018, 08:18 Gian Merlino, wrote: > > > +1 > > > > I would suggest adding these two as well. > > > > https://github.com/druid-io/druid/pull/5878 - Fix ineffici

Re: Netty 4.1.x

2018-10-05 Thread Gian Merlino
It sounds good to me. BTW, we still use netty 3.x for http-client and so it's pretty pervasive. It coexists with netty 4.x (the packages are different) so there isn't a conflict at that level. But if we wanted to, like, _fully_ upgrade to netty 4.1.x then it'd involve porting over the

Re: ICLA

2018-10-16 Thread Gian Merlino
That is the understanding we've been applying to Druid itself. My understanding of ASF policy is that committers need ICLAs, and other contributors only need "clear intent to contribute", which is established if the PR author == the code author. On Tue, Oct 16, 2018 at 12:18 PM Maxime Beauchemin

Re: [VOTE] Tranquility 0.8.3 release

2018-10-16 Thread Gian Merlino
Tranquility isn't an Apache project (yet?). It is one of Druid's companion projects, like pydruid and RDruid, that live in separate git repos with an independent release process. What is being voted on is the latest commit in github. Unlike Druid we have typically not done release candidates or

Re: Metrics updates in Release Notes

2018-10-31 Thread Gian Merlino
Why not also tag those with "Release Notes"? It makes it a lot easier for release managers to do their jobs if they just have to look at one label. (Or two, I guess: "release notes" and "incompatible". But I would be down to merge them.) On Wed, Oct 31, 2018 at 9:26 AM David Lim wrote: > Thanks

Re: Metrics updates in Release Notes

2018-10-31 Thread Gian Merlino
, 2018 at 10:07 AM Gian Merlino wrote: > Why not also tag those with "Release Notes"? It makes it a lot easier for > release managers to do their jobs if they just have to look at one label. > (Or two, I guess: "release notes" and "incompatible". But I would be

Re: [VOTE] Release Apache Druid (incubating) 0.13.0 [RC1]

2018-10-30 Thread Gian Merlino
-1 because there are issues tagged for 0.13.0 that are not part of this release: - https://github.com/apache/incubator-druid/pull/6512 - https://github.com/apache/incubator-druid/pull/6514 - https://github.com/apache/incubator-druid/pull/6516 - https://github.com/apache/incubator-druid/pull/6508

Re: Please add me to dev subscriber list

2018-09-29 Thread Gian Merlino
Hey Panner, You can subscribe to the list by emailing "dev-subscr...@druid.apache.org". On Sat, Sep 29, 2018 at 1:15 AM Panner selvam Velmyl < pannerselvam.vel...@gmail.com> wrote: > >

Re: Druid Developer Contribution

2018-10-03 Thread Gian Merlino
Hi Ravi, All of us use either MacOS or Linux for development, so that issue might be Windows related (it does use different end-of-line markers from what MacOS/Linux use). On Wed, Oct 3, 2018 at 4:19 AM Ravi Kumar Gadagotti < ravikumargadago...@gmail.com> wrote: > Hi, > > I am getting the

  1   2   3   4   5   >