why Source#validate() is not declared to throw any exception

2017-03-20 Thread Ted Yu
Hi, I was reading HDFSFileSource.java where: @Override public void validate() { ... } catch (IOException | InterruptedException e) { throw new RuntimeException(e); } Why is validate() not declared to throw any exception ? If validation doesn't pass, there is nothing to

Re: [ANNOUNCEMENT] New committers, March 2017 edition!

2017-03-20 Thread Ismaël Mejía
Thanks everyone, Feels great to be part of the team. Congratulations to the other new committers ! -Ismaël On Mon, Mar 20, 2017 at 2:50 PM, Tyler Akidau wrote: > Welcome! > > On Mon, Mar 20, 2017, 02:25 Jean-Baptiste Onofré wrote: > >> Welcome

Re: splitIntoBundles vs. generateInitialSplits

2017-03-20 Thread Ismaël Mejía
This is an forgotten one, Stas did you create a JIRA about this one? I think this change should be also tagged as First version release, because this is an API change and can break stuff if we do it later on. On Wed, Jan 11, 2017 at 4:30 PM, Jean-Baptiste Onofré wrote: > Hi

Re: Beam File System in the Python SDK

2017-03-20 Thread Sourabh Bajaj
Thanks for the feedback Tibor. I think in the first iteration we can probably assume that the underlying filesystem is taking care of permission enforcement. Once we have a few sources using the FS API we can may be revisit this as we'll surely learn a few things from that. Thoughts ? On Sun, Mar

Re: Call for help: let's add Splittable DoFn to Spark, Flink and Apex runners

2017-03-20 Thread Eugene Kirpichov
Thomas - yes, 9:30 works, shall we do that? JB - excellent! You can start experimenting already, using direct runner! On Mon, Mar 20, 2017, 2:26 AM Jean-Baptiste Onofré wrote: > Hi Eugene, > > Thanks for the meeting notes ! > > I will be in the next call and Ismaël also

Re: [ANNOUNCEMENT] New committers, March 2017 edition!

2017-03-20 Thread Tyler Akidau
Welcome! On Mon, Mar 20, 2017, 02:25 Jean-Baptiste Onofré wrote: > Welcome aboard, and congrats ! > > Really happy to count you all in the team ;) > > Regards > JB > > On 03/17/2017 10:13 PM, Davor Bonaci wrote: > > Please join me and the rest of Beam PMC in welcoming the

Re: Call for help: let's add Splittable DoFn to Spark, Flink and Apex runners

2017-03-20 Thread Jean-Baptiste Onofré
Hi Eugene, Thanks for the meeting notes ! I will be in the next call and Ismaël also provided to me some updates. I will sync with Amit on Spark runner and start to experiment and test SDF on the JMS IO. Thanks ! Regards JB On 03/17/2017 04:36 PM, Eugene Kirpichov wrote: Meeting notes

Re: [ANNOUNCEMENT] New committers, March 2017 edition!

2017-03-20 Thread Jean-Baptiste Onofré
Welcome aboard, and congrats ! Really happy to count you all in the team ;) Regards JB On 03/17/2017 10:13 PM, Davor Bonaci wrote: Please join me and the rest of Beam PMC in welcoming the following contributors as our newest committers. They have significantly contributed to the project in