Percentile metrics in Beam

Hi All, I am working on adding support for some additional distribution metrics like std dev, percentiles to the Metrics API. The runner of interest here is Samza runner. I wanted to get the opinion of fellow beam devs on this. One way to do this would be to make changes to the existing

Flaky test issue report (27)

This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to

Re: Unexpected in TestStream in Portable Mode

On 9/7/21 6:02 PM, Reuven Lax wrote: Historically the DataflowRunner has been much more careful about not breaking update, since this is a frequent operation by Dataflow users. I think we've been less careful aboutt other runners, but as we see clearly here Fllnk users do care about this as

Re: Unexpected in TestStream in Portable Mode

Makes sense, I missed that part. That is why a generic "inlining" scheme is problematic, because that depends on how does the runner encodes the elements on the wire. And it is where TestStream's output needs to be encoded into raw bytes, because the wire coder is unknown the the SDK when

P1 issues report (54)

This is your daily summary of Beam's current P1 issues, not including flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20priority%20%3D%20P1%20AND%20(labels%20is%20EMPTY%20OR%20labels%20!%3D%20flake). See

P0 (outage) report

This is your daily summary of Beam's current outages. See https://beam.apache.org/contribute/jira-priorities/#p0-outage for the meaning and expectations around P0 issues. BEAM-12844: Cassandra IO Does not work with ssl enabled Cassandra/Cosmos DB on Azure

Re: Apache Beam Contributor

Hi Xinshen, Done. Welcome! --- Alexey > On 4 Sep 2021, at 08:33, Xinshen Yong wrote: > > Hi, > > I'm Xinshen from caper.ai and I am currently running into > this issue: > https://issues.apache.org/jira/browse/BEAM-10655 >

Re: [New Joiner] Contributor permission for Beam Jira tickets

Hi Winson, Done. Welcome! — Alexey > On 7 Sep 2021, at 10:04, Winson Tanputraman > wrote: > > Hi Team, > > My name is Winson and I just signed up to the ASF Jira site. > I'm joining to try and contribute to the project. > Hence, requesting your assistance to add my ID (winsn_t) as a

Apache Beam Contributor

Hi, I'm Xinshen from caper.ai and I am currently running into this issue: https://issues.apache.org/jira/browse/BEAM-10655 I would like this ticket to be assigned to myself and I'll work on it. Jira username: amuletxheart Thanks. Regards, Xinshen

[New Joiner] Contributor permission for Beam Jira tickets

Hi Team, My name is Winson and I just signed up to the ASF Jira site. I'm joining to try and contribute to the project. Hence, requesting your assistance to add my ID (winsn_t) as a contributor in the Beam issue tracker. Thank you in advance! Regards, Winson

Updating Grafana from 6.7.3 to 8.1.2

Hi team! I'm in the process of updating Grafana (and the Apache Beam grahps) from version 6.7.3 to 8.1.2. This, because I need a plugin that only works with Grafana 7.5+ Most of the graphs have already been tested (using the Docker image) and they appear to be working as expected. However, I'm not

Re: [Proposal] => JmsIO auto scaling feature

Hi Luke, Hope you are fine, back from holidays and consecutively to our discussion the 5th of august, I replied to your comments regarding the JmsIO auto-scaling proposal: https://docs.google.com/document/d/1LMPpMpn9DByQcyCdRrTMBa-8ltByO4aqNYY4D9h3m18/edit?usp=sharing To sum up : * The