Re: Performance tests status and anomaly detection proposal

2018-04-14 Thread Tim Robertson
Very nice Dariusz +1 to putting the daily report on Slack to help prompt early comments and investigation on change. A couple very minor comments: a) Would it make sense to track number of tests run as well as duration? b) Labels on the Y-axis / a title with units would be a good addition to the

Re: Performance tests status and anomaly detection proposal

2018-04-14 Thread Kenneth Knowles
This is very cool. So is it easy for someone to integrate the proposal to regularly run Nexmark benchmarks and get those on the dashboard? (or a separate one to keep IOs in their own page) Kenn On Fri, Apr 13, 2018 at 9:02 AM Dariusz Aniszewski < dariusz.aniszew...@polidea.com> wrote: > > > > >

Re: Updated [Proposal] Apache Beam Fn API : Defining and adding SDK Metrics

2018-04-14 Thread Kenneth Knowles
One reason I resist the user/system distinction is that Beam is a multi-party system with at least SDK, runner, and pipeline. Often there may be a DSL like SQL or Scio, or similarly someone may be building a platform for their company where there is no user authoring the pipeline. Should Scio, SQL,

Re: Gradle Status [April 6]

2018-04-14 Thread Kenneth Knowles
You shouldn't do :module:cleanTest. If that is necessary that's a major bug in the build. Kenn On Fri, Apr 13, 2018 at 11:46 PM Romain Manni-Bucau wrote: > There is a fake module xxx_test which should have the right classpath but > since idea compilation is messed up you will still have to run

Re: "Radically modular data ingestion APIs in Apache Beam" @ Strata - slides available

2018-04-14 Thread Eugene Kirpichov
Hi all, The video is now available. I got it from my Strata account and I have permission to use and share it freely, so I published it on my own YouTube page (where there's nothing else...). Perhaps it makes sense to add to the Beam YouTube channel, but AFAIK only a PMC member can do that. https

Build failed in Jenkins: beam_Release_Gradle_NightlySnapshot #5

2018-04-14 Thread Apache Jenkins Server
See Changes: [sidhom] Support impulse transforms in Flink [sidhom] Add Impulse ValidatesRunner test [tgroh] Fix materializesWithDifferentEnvConsumer [tgroh] Reduce Requirements to be considered