Re: Precommit Jenkins Linkage Broken

2017-06-02 Thread Jean-Baptiste Onofré
Hi guys, just a quick update about Jenkins and GitHub integration. After working with INFRA, the issue has been identified and fixed (the permissions got a bit messed up in the last week which is why it stopped working). We fixed the credentials with INFRA and now, all is back to normal. We

Re: [DISCUSS] Source Watermark Metrics

2017-06-02 Thread Ben Chambers
I think having runners report important, general properties such as the source watermark is great. It is much easier than requiring every source to expose it. I'm not sure how we would require this or do so in a general way. Each runner has seperate code for handling the watermark as well as

Re: [DISCUSS] Source Watermark Metrics

2017-06-02 Thread Aljoscha Krettek
Hi, Thanks for reviving this thread. I think having the watermark is very good. Some runners, for example Dataflow and Flink have their own internal metric for the watermark but having it cross-runner seems beneficial (if maybe a bit wasteful). Best, Aljoscha > On 2. Jun 2017, at 03:52,