Re: Hbase IO preview

2017-02-22 Thread Jean-Baptiste Onofré
Hi Ismaël, Great work ! I saw the Jira you created: it makes perfect sense. I bet we will have some contributions on it ;) Thanks ! Regards JB On 02/22/2017 12:01 PM, Ismaël Mejía wrote: For those interested (and working on Beam snapshots), HBaseIO was merged today (thanks Dan and JB for

Re: Beam on Kubernetes

2017-02-22 Thread Jean-Baptiste Onofré
Hi, I can invite you on the slack channel. Can you send (in private message) the e-mail address you want to use ? Thanks ! Regards JB On 02/22/2017 09:56 AM, Ekrem Aksoy wrote: Hi, I think I'm unable to login to this Slack channel it says (I'm just using my gmail dot com account or I have a

Re: Interest in a (virtual) contributor meeting?

2017-02-22 Thread Aljoscha Krettek
+1 On Wed, 22 Feb 2017 at 10:08 JingsongLee wrote: > +1 > > > 来自阿里邮箱 iPhone版 --原始邮件 --发件人:Davor Bonaci < > da...@apache.org>日期:2017-02-22 11:19:12收件人:dev@beam.apache.org < > dev@beam.apache.org>主题:Interest in a (virtual) contributor

Re: Better developer instructions for using Maven?

2017-02-22 Thread Jean-Baptiste Onofré
Hi guys, sorry, I thought we got a consensus about the usage of quick but it doesn't seem so. I reverted the corresponding commit. Can we finalize a decision about this ? So basically, the question is: 1. Do we enable checkstyle, findbugs, ... (all things increasing the build duration,

Re: Better developer instructions for using Maven?

2017-02-22 Thread Robert Bradshaw
On Wed, Feb 22, 2017 at 7:51 AM, Jean-Baptiste Onofré wrote: > Thanks Kenn, it's perfectly clear now ;) > That was Kenn's vote. I'm of the opposite opinion (at least I think checkstyle should be done by default, possibly others). It's clear many people aren't very happy with

Re: Metrics for Beam IOs.

2017-02-22 Thread Ismaël Mejía
Hello, Thanks everyone for giving your points of view. I was waiting to see how the conversation evolved to summarize it and continue on the open points. Points where mostly everybody agrees (please correct me if somebody still disagrees): - Default metrics should not affect performance, for

Re: Better developer instructions for using Maven?

2017-02-22 Thread Kenneth Knowles
On Wed, Feb 22, 2017 at 10:04 AM, Robert Bradshaw < rober...@google.com.invalid> wrote: > with their respective costs (e.g. runtime, > dependencies) expected utility (how likely it is to find something) and > actionability (how easy it would be for someone to fix the reported errors > without

Re: Interest in a (virtual) contributor meeting?

2017-02-22 Thread Sourabh Bajaj
+1 On Wed, Feb 22, 2017 at 2:11 PM Kenneth Knowles wrote: > +1 !! > > On Wed, Feb 22, 2017 at 6:19 AM, Kobi Salant > wrote: > > > +1 > > > > בתאריך 22 בפבר' 2017 2:54 PM,‏ "Aljoscha Krettek" > > כתב: > > > > > +1 > > > > > >

Re: Performance Testing Next Steps

2017-02-22 Thread Jason Kuster
Hey all, just wanted to pop this up again for people -- if anyone has thoughts on performance testing please feel welcome to chime in. :) On Fri, Feb 17, 2017 at 4:03 PM, Jason Kuster wrote: > Hi all, > > I've written up a doc on next steps for getting performance

Re: Next major milestone: first stable release

2017-02-22 Thread Chamikara Jayalath
Great to see Beam API becoming stable and Python SDK becoming a part of it. On Wed, Feb 22, 2017 at 2:57 PM Kenneth Knowles wrote: This is pretty exciting. I'll add thoughts inline. On Tue, Feb 21, 2017 at 6:31 PM, Davor Bonaci wrote: > * Support

Re: Interest in a (virtual) contributor meeting?

2017-02-22 Thread María García Herrero
+1 On Wed, Feb 22, 2017 at 2:17 PM, Sourabh Bajaj < sourabhba...@google.com.invalid> wrote: > +1 > > On Wed, Feb 22, 2017 at 2:11 PM Kenneth Knowles > wrote: > > > +1 !! > > > > On Wed, Feb 22, 2017 at 6:19 AM, Kobi Salant > > wrote: > > > > > +1

Re: Interest in a (virtual) contributor meeting?

2017-02-22 Thread Kobi Salant
+1 בתאריך 22 בפבר' 2017 2:54 PM,‏ "Aljoscha Krettek" כתב: > +1 > > On Wed, 22 Feb 2017 at 10:08 JingsongLee wrote: > > > +1 > > > > > > 来自阿里邮箱 iPhone版 --原始邮件 --发件人:Davor Bonaci > < > > da...@apache.org>日期:2017-02-22

BEAM-831 ParDo chaining for Apex runner

2017-02-22 Thread Chinmay Kolhatkar
Dear Community, I'm working on BEAM-831 to implement ParDo chaining for Apache Apex Runner. As suggested on Jira, chaining needs to be done using Stream locality of Apache Apex engine. I got some links from Eugene Kirpichov on the Jira. I'm currently focusing on producer-consumer fusion

Re: Next major milestone: first stable release

2017-02-22 Thread Kenneth Knowles
On Wed, Feb 22, 2017 at 5:35 PM, Chamikara Jayalath wrote: > > I think, this point applies to Python SDK as well (though as you mentioned, > API hiding in Python is a mere convention (prefix with underscore) not > enforced. We already have mechanism for marking APIs as

Re: Better developer instructions for using Maven?

2017-02-22 Thread Jean-Baptiste Onofré
Thanks Kenn, it's perfectly clear now ;) Regards JB On 02/22/2017 04:40 PM, Kenneth Knowles wrote: On Wed, Feb 22, 2017 at 6:50 AM, Jean-Baptiste Onofré wrote: Can we finalize a decision about this ? So basically, the question is: 1. Do we enable checkstyle, findbugs,

Re: Metrics for Beam IOs.

2017-02-22 Thread Jean-Baptiste Onofré
Hi Ismaël, You did a great summary and you put the emphasis on the valid point. I full agree with you about the fact we should provide something agnostic for end-users to get the metrics. Let's see what the others are thinking. I'm ready to start a PoC to bring part of Decanter in Beam ;)