Re: Transactions in Druid?

Hi Edward, There are a couple of ways to do transactional updates to Druid today: 1) When using streaming ingestion with the "parseBatch" feature (see io.druid.data.input.impl.InputRowParser), rows in the batch are inserted transactionally. 2) When using batch ingestion in overwrite mode (the

Re: Druid 0.12.1-rc2 vote

+1 On Mon, May 14, 2018 at 1:43 PM, Driesprong, Fokko wrote: > +1 as well > > (Charles, your awesome email address works correctly! :) > > 2018-05-14 22:35 GMT+02:00 Charles Allen : > > > +1 > > > > ((crosses fingers that this email sends correctly from the

Re: Podling Report Reminder - May 2018

I have posted this on https://wiki.apache.org/incubator/May2018. On Thu, May 3, 2018 at 1:03 PM, Gian Merlino <g...@apache.org> wrote: > Here's a draft (below). Since it's already overdue, I'll post it on the > wiki in a few hours. > > Druid > > Druid is a high-perf

Re: Podling Report Reminder - May 2018

me and I will post it. > > -Taylor > > > On May 3, 2018, at 2:01 PM, Gian Merlino <g...@apache.org> wrote: > > > > I can take up this one. > > > > On Thu, May 3, 2018 at 10:48 AM, P. Taylor Goetz <ptgo...@gmail.com> > wrote: > > > >&

Re: Druid 0.12.1-rc1 vote

ithub.com/druid-io/druid/pull/5674 - > it's failing in Travis for unknown reasons. The bug in local tests has been > fixed. > > On Thu, Apr 26, 2018 at 9:57 PM, Gian Merlino <g...@apache.org> wrote: > > > I'm reviewing https://github.com/druid-io/druid/pull/5692 rig

Re: Dependencies licenses Report

> you are sure about this? thought the donation paper work is signed right? Not yet as far as I know; last I heard was a week or so ago. On Tue, Apr 24, 2018 at 1:41 PM, Slim Bouguerra <slim.bougue...@gmail.com> wrote: > > > On Apr 24, 2018, at 1:18 PM, Gian Merlino <g

Re: Dependencies licenses Report

gt; > > > > > > On Wed, Apr 18, 2018 at 8:45 AM, Julian Hyde <jhyde.apa...@gmail.com> > wrote: > > > > > The main tool to use is Apache RAT. Definitely use that. > > > > > > One of the hardest tasks is getting the contents of LICENSE and NOTIC

Re: Dev list migration

gt; > > On 4/17/18, 10:19 PM, "Jonathan Wei" <jon...@apache.org> wrote: > > > > >+1 > > > > > >On 2018/04/17 18:09:37, David Lim <david...@apache.org> wrote: > > >> +1 > > >> > > >> On Tue, Apr 17

Re: [druid-dev] Apache migration logistics

apache id recently, its pjain1 > Not sure how to add it to the page - http://incubator.apache.org/ > projects/druid.html. If anyone knows, can you please add it. > Thanks,Parag > > On Monday, March 12, 2018, 4:49:41 PM CDT, Gian Merlino <g...@imply.io> > wrote: > > Com

Re: Dependencies licenses Report

; > wrote: > > > The main tool to use is Apache RAT. Definitely use that. > > > > One of the hardest tasks is getting the contents of LICENSE and NOTICE > > right. That is a manual task I’m afraid. > > > > Julian > > > > > On Apr 18, 2018, at 0

Re: Making sure Github / Gitbox is setup properly

Those are good tips… thanks! Does it make sense to send every GitHub notification to g...@druid.apache.org or is there a reason you suggested splitting out issues and PRs? On Wed, Apr 18, 2018 at 8:44 AM, Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > Hi dev@druid.apache.org, > >

Re: Dependencies licenses Report

Hi Slim, Do you know if ORC & Hive use this tool as part of their release process? And if it's considered a good tool by itself for verifying we meet all of the Apache licensing requirements, or if we'll need something else too? On Tue, Apr 17, 2018 at 9:15 PM, Slim Bouguerra

Re: Tranquility Future

Is anyone interested in doing the work to migrate it to Apache? If so, I think we should definitely do that. In general I have been more interested in contributing to the Kafka indexing service lately since it has nicer properties (exactly once, no extra processes, can read late data). But

Re: [druid-dev] consider doing a 0.12.1 release

, but we are not yet ready to do Apache releases from either an IP or technical standpoint. On Mon, Apr 9, 2018 at 9:07 PM, Gian Merlino <gianmerl...@gmail.com> wrote: > I backported 5504 and 5587. I skipped 5374 since it turns out it isn't > relevant to 0.12.0 -- it fixes somethin

Today's dev sync

https://hangouts.google.com/hangouts/_/calendar/Z2lhbm1lcmxpbm9AZ21haWwuY29t.73eguu7d0a9gr27kt1ugitllq3

Re: [druid-dev] Apache migration logistics

Oh cool, I didn't realize that. We should stick to https://druid.apache.org/ then. Gian On Mon, Apr 16, 2018 at 10:51 AM, Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > Quick note to say that apache sets up both http://druid.incubator.ap > ache.org/ and http://druid.apache.org/ >

Re: Web site

ant every contributor to have to download a huge git repo. > > Julian > > > > On Apr 16, 2018, at 8:48 AM, Gian Merlino <g...@apache.org> wrote: > > > > A technical note that I also posted in the "migration logistics" thread: > > the sources for the

Re: Web site

A technical note that I also posted in the "migration logistics" thread: the sources for the site are at https://github.com/apache/incubator-druid-website. The branch "asf-git" is served on the site https://druid.incubator.apache.org/. I think once we migrate http://druid.io/, we could do

Re: [druid-dev] Apache migration logistics

re in "src" and the built site is in "master". Except in the ASF infra, it makes more sense to put the sources in "master" and the built site in "asf-git". On Sun, Apr 15, 2018 at 7:56 AM, Gian Merlino <gianmerl...@gmail.com> wrote: > FYI: We receive

Re: [druid-dev] Apache migration logistics

; Julian > > > On Mar 27, 2018, at 5:20 PM, Gian Merlino <gianmerl...@gmail.com> wrote: > > Hi, today I found myself wondering about migration of source repos. > > Does anyone know if we've got our GitBox git repo set up? And who we need > to talk to about getting the dr

Re: [druid-dev] consider doing a 0.12.1 release

I backported 5504 and 5587. I skipped 5374 since it turns out it isn't relevant to 0.12.0 -- it fixes something introduced since then -- so I moved that back to 0.13.0. On Mon, Apr 9, 2018 at 1:56 PM, Gian Merlino <g...@apache.org> wrote: > I raised backport PRs for everything on my li

Re: [druid-dev] consider doing a 0.12.1 release

Deva <prashant.d...@gmail.com> wrote: > also for the list: > > - compact task throws exception #5611 > > i dont have permission to add to gian's github milestone > > Prashant > > On Mon, Apr 9, 2018 at 12:26 PM, Gian Merlino <gianmerl...@gmail.com> > wrote:

Re: [druid-dev] consider doing a 0.12.1 release

Here we go: https://github.com/druid-io/druid/milestone/26. Please add stuff if it makes sense (high importance / low risk bug fixes). On Mon, Apr 9, 2018 at 12:14 PM, Gian Merlino <gianmerl...@gmail.com> wrote: > It looks like there's a lot of support for doing a 0.12.1… I'll make a &g

Re: [druid-dev] consider doing a 0.12.1 release

It looks like there's a lot of support for doing a 0.12.1… I'll make a milestone in GH. On Mon, Apr 9, 2018 at 12:12 PM, Slim Bouguerra <bs...@apache.org> wrote: > +1 especially there is some instability bugs. > > On Apr 9, 2018, at 11:57 AM, Gian Merlino <g...@apache.org>

Re: [druid-dev] consider doing a 0.12.1 release

eshes when they fail. (#5328) On Mon, Apr 9, 2018 at 10:35 AM, Gian Merlino <g...@imply.io> wrote: > I think this conversation is worth having. I have cross posted this to > dev@druid.apache.org and will reply there. Since we're trying to migrate > the dev list, please cr

Re: [druid-dev] Load rule doesn't honor intervals properly

io/druid/pull/5595. > > Whoever is the right owner please take a look - let me know if i should @ > a specific person and i can do that. > > > Thanks, > pala > > > > On Fri, Mar 30, 2018 at 2:12 PM, Gian Merlino <g...@imply.io> wrote: > >> Hi P

Re: [druid-dev] consider doing a 0.12.1 release

I think this conversation is worth having. I have cross posted this to dev@druid.apache.org and will reply there. Since we're trying to migrate the dev list, please cross post any dev messages there, or even only post to that list. Gian On Sun, Apr 8, 2018 at 5:45 PM, Prashant Deva

Re: Podling report - April 2018

ould suggest Roman just request an Apache ID directly and > > re-sign the icla like everyone else did. That will probably be faster > than > > tracking down the old cla. > > > > On Fri, Apr 6, 2018 at 12:05 AM Gian Merlino <gianmerl...@gmail.com> >

Re: Podling report - April 2018

@gmail.com> > > wrote: > > > > > > > I've signed an ICLA for a different project before, doesn't it count? > > > > > > > > On Thu, 5 Apr 2018, 01:39 Gian Merlino, <gianmerl...@gmail.com> > wrote: > > > > > > > &g

Re: Podling report - April 2018

he only ones I can't find in the directory are Parag and Roman. > > Everyone that hasn't updated the incubator page at > http://incubator.apache.org/projects/druid.html with their apache id, > would > you mind doing so? > > On Tue, Apr 3, 2018 at 4:31 PM Gian Merlino <gi

Re: Podling report - April 2018

. On Tue, Apr 3, 2018 at 11:43 AM, Gian Merlino <g...@apache.org> wrote: > Hi Druids, > > Our podling report is due tomorrow and I am starting work on it. > > I will post a draft here before editing the incubator wiki. >

Re: [druid-dev] Skipping Empty Buckets feature

Hi Suhas, How would you expect the results to come back if groupBy did _not_ skip empty time buckets, and one day was empty? Should all the dimensions be null? Btw, since we are migrating the dev mailing list to Apache, please cross post this sort of thing with dev@druid.apache.org, or even only

Podling report - April 2018

Hi Druids, Our podling report is due tomorrow and I am starting work on it. I will post a draft here before editing the incubator wiki.

Re: [druid-dev] Questions about Public API

Hi Jihoon, The javadoc for @PublicApi explains the intent. They can change, but not in a minor release. There should also be some consensus around changing them. Once we are 1.0, then we should only change PublicApis when going to 2.0. Btw, since we are trying to migrate the dev mailing list to

Re: [druid-dev] any reason to still keep overlord as separate node?

Hi Prashant, The only issue that I can think of is that in some (super large) clusters, the coordinator and overlord can both be pretty demanding in terms of memory and it helps for scalability to have them be separate. But this is not the common case - most clusters are smaller or medium sized.

Re: [druid-dev] Questions about Public API

I cross-posted my reply, so this thread is on both lists now. On Fri, Mar 30, 2018 at 3:32 PM, Jihoon Son <ghoon...@gmail.com> wrote: > Thanks. > > Should I send this email to the Apache mailing list as well? > > Jihoon > > 2018년 3월 30일 (금) 오후 1:58, Gian Merlino <

Re: [druid-dev] Apache migration logistics

<xav...@confluent.io> wrote: > FYI, to update your information on the status page you need to check out > https://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/ > with > your Apache credentials and update the druid.xml file in that directory. > > On Mon, Mar 12, 201

Re: [druid-dev] Apache migration logistics

I think rather than subscribing the apache dev list to the google group, it'd be better to do a clean break and disable posting on the google group. The autoreply feature seems to need a business account, which we don't have, but we could turn on "Moderate all messages to the group" and combine

Re: [druid-dev] Apache migration logistics

Committers: please, 1) If you don't have an apache id already, fill out an ICLA: https://www.apache.org/dev/new-committers-guide.html# guide-for-new-committers and then post here and hopefully someone can figure out how to get you an id? 2) When you have an id, post it here if it's not in

<    1   2   3   4   5