Re: [Discussion] Query regarding Join

2016-06-14 Thread Vinay Patil
You are right, debugged it for all elements , I can do that now. Thanks a lot. Regards, Vinay Patil On Tue, Jun 14, 2016 at 11:56 AM, Jark Wu wrote: > In `coGroup(Iterable iter1, Iterable iter2, > Collector out)` , when both iter1 and iter2 are not empty, it >

Re: How to contribute to Streaming Table API and StreamSQL

2016-06-14 Thread Jark Wu
Hi Fabian, It’s great to hear that we are going to start it! I’m glad to share our current Streaming Table API [1]. I find that that all aggregation functions are scoped to the defined window in Flink Stream Table API design [2] and Calcite StreamSQL desgin [3]. I’m thinking that do we need

Meet up at Hadoop Summit?

2016-06-14 Thread THORMAN, ROBERT D
Anyone planning a Flink meetup at the Hadoop Summit in San Jose, CA June 28-30, 2016? Bob Thorman Principal – Technology Security AT Chief Security Organization 208 S Akard, 14th Floor Dallas, TX 75075 (972) 658-1714 This e-mail and any files transmitted with it are the property of the AT

Re: Yarn Integration Test

2016-06-14 Thread Vijay
Thanks Max. I am able to run the test now. Regards, Vijay Sent from my iPhone > On Jun 14, 2016, at 6:31 AM, Maximilian Michels wrote: > > Hi Vijay, > > Please try `mvn verify -pl flink-yarn-tests -Pinclude-yarn-tests`. The > additional profix switch will include the

Re: Yarn Integration Test

2016-06-14 Thread Maximilian Michels
Hi Vijay, Please try `mvn verify -pl flink-yarn-tests -Pinclude-yarn-tests`. The additional profix switch will include the "flink-yarn-tests" module. By default, we exclude the module "flink-yarn-tests" because we have a Yarn free Hadoop 1 module. The Yarn tests need to reside in an extra module

Re: Adding a Histogram Metric

2016-06-14 Thread Till Rohrmann
+1 for the thread safe metrics. This should be a rather low hanging fruit and easily added. If we decide to add a histogram, then I would also be in favour of implementing our own version of a histogram. This avoids adding a hard dependency on Dropwizard or another metrics library to Flink core.

Re: Adding a Histogram Metric

2016-06-14 Thread Cody Innowhere
Counter of dropwizard is thread-safe. I think dropwizard metrics are implemented fairly well and used quite widely in open source projects, I personally on the side of using dropwizard metrics rather than re-implement them, unless for performance reasons. Still, I'm +1 for adding a wrapper on top

Re: Meet up at Hadoop Summit?

2016-06-14 Thread Robert Metzger
Hi Bob, there's going to be a Flink Meetup colocated with the Hadoop Summit: http://www.meetup.com/Bay-Area-Apache-Flink-Meetup/events/231347668/ Regards, Robert On Tue, Jun 14, 2016 at 3:22 PM, THORMAN, ROBERT D wrote: > Anyone planning a Flink meetup at the Hadoop Summit in

Re: Meet up at Hadoop Summit?

2016-06-14 Thread THORMAN, ROBERT D
That’s the same time as the Accumulo meet-up I’ve already RSVP’d. Bummer. Thanks for the heads up anyway. On 6/14/16, 11:11 AM, "Robert Metzger" wrote: >Hi Bob, > >there's going to be a Flink Meetup colocated with the Hadoop Summit:

Re: [Discussion] Query regarding Join

2016-06-14 Thread Vinay Patil
Hi Jark, I am able to get the non-matching elements in a stream :, Of-course we can collect the matching elements in the same stream as well, however I want to perform additional operations on the joined stream before writing it to S3, so I would have to include a separate join operator for the