[jira] [Created] (BEAM-10212) Add support for Java SDK harness state caching

Luke Cwik created BEAM-10212: Summary: Add support for Java SDK harness state caching Key: BEAM-10212 URL: https://issues.apache.org/jira/browse/BEAM-10212 Project: Beam Issue Type: Sub-task

[jira] [Closed] (BEAM-10142) Remove additional identity function workaround in View.java

[ https://issues.apache.org/jira/browse/BEAM-10142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-10142. Fix Version/s: Not applicable Assignee: Luke Cwik Resolution: Not A Problem This isn't

[jira] [Resolved] (BEAM-10190) Reduce cost of toString of MetricKey and MetricName

[ https://issues.apache.org/jira/browse/BEAM-10190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-10190. -- Fix Version/s: 2.23.0 Resolution: Fixed > Reduce cost of toString of MetricKey and MetricName >

[jira] [Resolved] (BEAM-8602) Always use shadow configuration for direct runner dependencies

[ https://issues.apache.org/jira/browse/BEAM-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8602. - Fix Version/s: 2.23.0 Resolution: Fixed > Always use shadow configuration for direct runner

[jira] [Resolved] (BEAM-10179) Remove URNJavaDoFn since the workaround is no longer required

[ https://issues.apache.org/jira/browse/BEAM-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-10179. -- Fix Version/s: 2.23.0 Resolution: Fixed > Remove URNJavaDoFn since the workaround is no longer

[jira] [Created] (BEAM-10179) Remove URNJavaDoFn since the workaround is no longer required

Luke Cwik created BEAM-10179: Summary: Remove URNJavaDoFn since the workaround is no longer required Key: BEAM-10179 URL: https://issues.apache.org/jira/browse/BEAM-10179 Project: Beam Issue

[jira] [Resolved] (BEAM-8374) PublishResult returned by SnsIO is missing sdkResponseMetadata and sdkHttpMetadata

[ https://issues.apache.org/jira/browse/BEAM-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8374. - Fix Version/s: 2.20.0 Resolution: Fixed > PublishResult returned by SnsIO is missing

[jira] [Resolved] (BEAM-4766) Use vendored version of protobuf in sdks/java/core or replace usage of ByteString with something else

[ https://issues.apache.org/jira/browse/BEAM-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-4766. - Fix Version/s: 2.23.0 Assignee: Luke Cwik Resolution: Fixed > Use vendored version of

[jira] [Commented] (BEAM-3736) Add SetUp() and TearDown() for CombineFns

[ https://issues.apache.org/jira/browse/BEAM-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124134#comment-17124134 ] Luke Cwik commented on BEAM-3736: - May I suggest: Step 0: Add a ValidatesRunner test that fails if setup

[jira] [Resolved] (BEAM-7063) Stage Dataflow runner harness in Dataflow FnApi Python test suites that run using an unreleased SDK.

[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-7063. - Fix Version/s: Not applicable Resolution: Fixed I believe we pass the --dataflowWorkerJar

[jira] [Resolved] (BEAM-8539) Clearly define the valid job state transitions

[ https://issues.apache.org/jira/browse/BEAM-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8539. - Fix Version/s: 2.21.0 Assignee: Luke Cwik Resolution: Fixed > Clearly define the valid

[jira] [Resolved] (BEAM-6142) Improve ByteBuddy DoFnInvoker implementation wrt SplittableDoFns / BundleFinalization

[ https://issues.apache.org/jira/browse/BEAM-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6142. - Fix Version/s: 2.21.0 Assignee: Luke Cwik Resolution: Fixed > Improve ByteBuddy

[jira] [Resolved] (BEAM-4660) Add well known timer coder for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-4660. - Fix Version/s: 2.21.0 Assignee: Robert Bradshaw Resolution: Fixed > Add well known timer

[jira] [Resolved] (BEAM-4657) Python SDK harness should support user timers

[ https://issues.apache.org/jira/browse/BEAM-4657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-4657. - Fix Version/s: 2.21.0 Resolution: Fixed > Python SDK harness should support user timers >

[jira] [Assigned] (BEAM-4657) Python SDK harness should support user timers

[ https://issues.apache.org/jira/browse/BEAM-4657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-4657: --- Assignee: Boyuan Zhang > Python SDK harness should support user timers >

[jira] [Resolved] (BEAM-4582) Incorrectly translates apache_beam.runners.dataflow.native_io.streaming_create.DecodeAndEmitDoFn when creating the Dataflow pipeline json description

[ https://issues.apache.org/jira/browse/BEAM-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-4582. - Fix Version/s: 2.21.0 Assignee: Luke Cwik Resolution: Cannot Reproduce Streaming create

[jira] [Closed] (BEAM-4655) Update pipeline translation for timers inside Python SDK

[ https://issues.apache.org/jira/browse/BEAM-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-4655. --- Resolution: Not A Problem Migrated timers to use a separate field on the data channel and not model them as

[jira] [Resolved] (BEAM-4655) Update pipeline translation for timers inside Python SDK

[ https://issues.apache.org/jira/browse/BEAM-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-4655. - Fix Version/s: 2.21.0 Resolution: Fixed > Update pipeline translation for timers inside Python SDK

[jira] [Reopened] (BEAM-4655) Update pipeline translation for timers inside Python SDK

[ https://issues.apache.org/jira/browse/BEAM-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-4655: - > Update pipeline translation for timers inside Python SDK >

[jira] [Updated] (BEAM-4948) Beam Dependency Update Request: com.google.guava

[ https://issues.apache.org/jira/browse/BEAM-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-4948: Fix Version/s: (was: 2.15.0) > Beam Dependency Update Request: com.google.guava >

[jira] [Assigned] (BEAM-4655) Update pipeline translation for timers inside Python SDK

[ https://issues.apache.org/jira/browse/BEAM-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-4655: --- Assignee: Boyuan Zhang > Update pipeline translation for timers inside Python SDK >

[jira] [Commented] (BEAM-4766) Use vendored version of protobuf in sdks/java/core or replace usage of ByteString with something else

[ https://issues.apache.org/jira/browse/BEAM-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123968#comment-17123968 ] Luke Cwik commented on BEAM-4766: - Fix in https://github.com/apache/beam/pull/11891 > Use vendored

[jira] [Assigned] (BEAM-8647) Remove .mailmap from the sources

[ https://issues.apache.org/jira/browse/BEAM-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-8647: --- Assignee: Romain Manni-Bucau > Remove .mailmap from the sources > >

[jira] [Resolved] (BEAM-10158) [Python] Reuse a shared unbounded thread pool

[ https://issues.apache.org/jira/browse/BEAM-10158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-10158. -- Fix Version/s: 2.23.0 Resolution: Fixed > [Python] Reuse a shared unbounded thread pool >

[jira] [Created] (BEAM-10158) [Python] Reuse a shared unbounded thread pool

Luke Cwik created BEAM-10158: Summary: [Python] Reuse a shared unbounded thread pool Key: BEAM-10158 URL: https://issues.apache.org/jira/browse/BEAM-10158 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-10053) Timers exception on "Job Drain" while using stateful beam processing in global window

[ https://issues.apache.org/jira/browse/BEAM-10053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-10053: - Status: Open (was: Triage Needed) > Timers exception on "Job Drain" while using stateful beam

[jira] [Updated] (BEAM-10114) Add Pub/Sub Lite IO to beam builtin

[ https://issues.apache.org/jira/browse/BEAM-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-10114: - Status: Open (was: Triage Needed) > Add Pub/Sub Lite IO to beam builtin >

[jira] [Created] (BEAM-10142) Remove additional identity function workaround in View.java

Luke Cwik created BEAM-10142: Summary: Remove additional identity function workaround in View.java Key: BEAM-10142 URL: https://issues.apache.org/jira/browse/BEAM-10142 Project: Beam Issue

[jira] [Resolved] (BEAM-7568) Java dataflow harness re-encodes value state cells even if they haven't changed

[ https://issues.apache.org/jira/browse/BEAM-7568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-7568. - Fix Version/s: 2.23.0 Resolution: Fixed > Java dataflow harness re-encodes value state cells even

[jira] [Resolved] (BEAM-10075) Allow users to tune the grouping table size in batch dataflow pipelines

[ https://issues.apache.org/jira/browse/BEAM-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-10075. -- Resolution: Fixed > Allow users to tune the grouping table size in batch dataflow pipelines >

[jira] [Comment Edited] (BEAM-10016) Flink postcommits failing testFlattenWithDifferentInputAndOutputCoders2

[ https://issues.apache.org/jira/browse/BEAM-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117378#comment-17117378 ] Luke Cwik edited comment on BEAM-10016 at 5/27/20, 4:19 AM: The issue is that

[jira] [Commented] (BEAM-10016) Flink postcommits failing testFlattenWithDifferentInputAndOutputCoders2

[ https://issues.apache.org/jira/browse/BEAM-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117378#comment-17117378 ] Luke Cwik commented on BEAM-10016: -- The issue is that the GreedyPipelineFuser (and related classes)

[jira] [Resolved] (BEAM-10076) Dataflow worker status page incorrectly displays work item statuses

[ https://issues.apache.org/jira/browse/BEAM-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-10076. -- Resolution: Fixed > Dataflow worker status page incorrectly displays work item statuses >

[jira] [Updated] (BEAM-10094) Spark failing testFlattenWithDifferentInputAndOutputCoders2

[ https://issues.apache.org/jira/browse/BEAM-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-10094: - Status: Open (was: Triage Needed) > Spark failing testFlattenWithDifferentInputAndOutputCoders2 >

[jira] [Created] (BEAM-10097) Migrate PCollection views to use both iterable and multimap materializations/access patterns

Luke Cwik created BEAM-10097: Summary: Migrate PCollection views to use both iterable and multimap materializations/access patterns Key: BEAM-10097 URL: https://issues.apache.org/jira/browse/BEAM-10097

[jira] [Commented] (BEAM-9371) Implement SideInput load test in Java

[ https://issues.apache.org/jira/browse/BEAM-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117146#comment-17117146 ] Luke Cwik commented on BEAM-9371: - Is this a duplicate of https://issues.apache.org/jira/browse/BEAM-5982?

[jira] [Resolved] (BEAM-3419) Enable iterable side input for beam runners.

[ https://issues.apache.org/jira/browse/BEAM-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-3419. - Fix Version/s: 2.19.0 Assignee: Luke Cwik Resolution: Fixed > Enable iterable side input

[jira] [Commented] (BEAM-10057) Failure when getting watermark "getWatermark is never meant to be invoked."

[ https://issues.apache.org/jira/browse/BEAM-10057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116945#comment-17116945 ] Luke Cwik commented on BEAM-10057: -- [~bhulette] https://github.com/apache/beam/pull/11781 is ready for

[jira] [Commented] (BEAM-10057) Failure when getting watermark "getWatermark is never meant to be invoked."

[ https://issues.apache.org/jira/browse/BEAM-10057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113492#comment-17113492 ] Luke Cwik commented on BEAM-10057: -- Cham is working on verifying it fixes the Xlang Kafka issue. >

[jira] [Commented] (BEAM-10057) Failure when getting watermark "getWatermark is never meant to be invoked."

[ https://issues.apache.org/jira/browse/BEAM-10057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113491#comment-17113491 ] Luke Cwik commented on BEAM-10057: -- Fix in https://github.com/apache/beam/pull/11781 > Failure when

[jira] [Updated] (BEAM-9979) Fix race condition where the read index maybe reported from the last executed bundle

[ https://issues.apache.org/jira/browse/BEAM-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9979: Fix Version/s: (was: 2.22.0) 2.23.0 > Fix race condition where the read index maybe

[jira] [Commented] (BEAM-9979) Fix race condition where the read index maybe reported from the last executed bundle

[ https://issues.apache.org/jira/browse/BEAM-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111371#comment-17111371 ] Luke Cwik commented on BEAM-9979: - Nobody is working on it, moved to 2.23. > Fix race condition where the

[jira] [Comment Edited] (BEAM-9339) Declare capabilities in SDK environments

[ https://issues.apache.org/jira/browse/BEAM-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110811#comment-17110811 ] Luke Cwik edited comment on BEAM-9339 at 5/19/20, 3:13 AM: --- Java SDK for

[jira] [Resolved] (BEAM-9339) Declare capabilities in SDK environments

[ https://issues.apache.org/jira/browse/BEAM-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-9339. - Resolution: Fixed Java SDK for Dataflow was fixed in 2.22 > Declare capabilities in SDK environments >

[jira] [Comment Edited] (BEAM-9577) Update artifact staging and retrieval protocols to be dependency aware.

[ https://issues.apache.org/jira/browse/BEAM-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110748#comment-17110748 ] Luke Cwik edited comment on BEAM-9577 at 5/19/20, 1:06 AM: --- I found out that the

[jira] [Commented] (BEAM-9577) Update artifact staging and retrieval protocols to be dependency aware.

[ https://issues.apache.org/jira/browse/BEAM-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110748#comment-17110748 ] Luke Cwik commented on BEAM-9577: - I found out that the DataflowPipelineTranslator does not use the

[jira] [Commented] (BEAM-9339) Declare capabilities in SDK environments

[ https://issues.apache.org/jira/browse/BEAM-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110747#comment-17110747 ] Luke Cwik commented on BEAM-9339: - Fix in https://github.com/apache/beam/pull/11748 > Declare

[jira] [Comment Edited] (BEAM-9339) Declare capabilities in SDK environments

[ https://issues.apache.org/jira/browse/BEAM-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110744#comment-17110744 ] Luke Cwik edited comment on BEAM-9339 at 5/19/20, 1:01 AM: --- Dataflow doesn't

[jira] [Commented] (BEAM-9339) Declare capabilities in SDK environments

[ https://issues.apache.org/jira/browse/BEAM-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110744#comment-17110744 ] Luke Cwik commented on BEAM-9339: - Dataflow doesn't specify the capabilities in its pipeline proto

[jira] [Updated] (BEAM-9339) Declare capabilities in SDK environments

[ https://issues.apache.org/jira/browse/BEAM-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9339: Status: Open (was: Triage Needed) > Declare capabilities in SDK environments >

[jira] [Updated] (BEAM-9339) Declare capabilities in SDK environments

[ https://issues.apache.org/jira/browse/BEAM-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9339: Fix Version/s: (was: 2.21.0) 2.22.0 > Declare capabilities in SDK environments >

[jira] [Reopened] (BEAM-9339) Declare capabilities in SDK environments

[ https://issues.apache.org/jira/browse/BEAM-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-9339: - > Declare capabilities in SDK environments > > >

[jira] [Created] (BEAM-10028) [Java SDK] Support state backed iterables within the SDK harness

Luke Cwik created BEAM-10028: Summary: [Java SDK] Support state backed iterables within the SDK harness Key: BEAM-10028 URL: https://issues.apache.org/jira/browse/BEAM-10028 Project: Beam Issue

[jira] [Updated] (BEAM-10014) [Java] Support retrieval of large gbk iterables over the state API.

[ https://issues.apache.org/jira/browse/BEAM-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-10014: - Status: Open (was: Triage Needed) > [Java] Support retrieval of large gbk iterables over the state API.

[jira] [Assigned] (BEAM-10014) [Java] Support retrieval of large gbk iterables over the state API.

[ https://issues.apache.org/jira/browse/BEAM-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-10014: Assignee: Luke Cwik (was: Robert Bradshaw) > [Java] Support retrieval of large gbk iterables

[jira] [Updated] (BEAM-10014) [Java] Support retrieval of large gbk iterables over the state API.

[ https://issues.apache.org/jira/browse/BEAM-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-10014: - Component/s: (was: sdk-py-harness) sdk-java-harness > [Java] Support retrieval of

[jira] [Updated] (BEAM-10014) [Java] Support retrieval of large gbk iterables over the state API.

[ https://issues.apache.org/jira/browse/BEAM-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-10014: - Fix Version/s: (was: 2.20.0) > [Java] Support retrieval of large gbk iterables over the state API. >

[jira] [Created] (BEAM-10014) [Java] Support retrieval of large gbk iterables over the state API.

Luke Cwik created BEAM-10014: Summary: [Java] Support retrieval of large gbk iterables over the state API. Key: BEAM-10014 URL: https://issues.apache.org/jira/browse/BEAM-10014 Project: Beam

[jira] [Resolved] (BEAM-6120) Support retrieval of large gbk iterables over the state API.

[ https://issues.apache.org/jira/browse/BEAM-6120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6120. - Fix Version/s: 2.20.0 Resolution: Fixed > Support retrieval of large gbk iterables over the state

[jira] [Resolved] (BEAM-2902) Add user state support for ParDo.Multi for the Dataflow runner

[ https://issues.apache.org/jira/browse/BEAM-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2902. - Fix Version/s: 2.21.0 Resolution: Fixed Works with Dataflow runner v2 > Add user state support

[jira] [Assigned] (BEAM-2902) Add user state support for ParDo.Multi for the Dataflow runner

[ https://issues.apache.org/jira/browse/BEAM-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2902: --- Assignee: Luke Cwik > Add user state support for ParDo.Multi for the Dataflow runner >

[jira] [Resolved] (BEAM-6559) IsmReaderImpl makes inconsistent assumptions about nullness

[ https://issues.apache.org/jira/browse/BEAM-6559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6559. - Fix Version/s: Not applicable Resolution: Won't Fix Not worth investigating if this is a real

[jira] [Resolved] (BEAM-6560) IsmReaderImpl has inconsistent synchronization

[ https://issues.apache.org/jira/browse/BEAM-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6560. - Fix Version/s: Not applicable Resolution: Won't Fix Not worth investigating if this is a real

[jira] [Resolved] (BEAM-6597) Put MonitoringInfos/metrics in the Java SDK ProcessBundleProgressResponse

[ https://issues.apache.org/jira/browse/BEAM-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6597. - Fix Version/s: 2.21.0 Resolution: Fixed > Put MonitoringInfos/metrics in the Java SDK

[jira] [Assigned] (BEAM-1866) Fn API support for Metrics

[ https://issues.apache.org/jira/browse/BEAM-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-1866: --- Assignee: Luke Cwik > Fn API support for Metrics > -- > >

[jira] [Updated] (BEAM-10012) Update Python SDK to construct Dataflow job requests from Beam runner API protos

[ https://issues.apache.org/jira/browse/BEAM-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-10012: - Status: Open (was: Triage Needed) > Update Python SDK to construct Dataflow job requests from Beam

[jira] [Resolved] (BEAM-3545) Fn API metrics in Go SDK harness

[ https://issues.apache.org/jira/browse/BEAM-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-3545. - Fix Version/s: 2.21.0 Resolution: Fixed Any additional styles of metrics/capabilities have been

[jira] [Assigned] (BEAM-3543) Fn API metrics in Java SDK Harness

[ https://issues.apache.org/jira/browse/BEAM-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-3543: --- Assignee: Luke Cwik > Fn API metrics in Java SDK Harness > -- > >

[jira] [Resolved] (BEAM-3543) Fn API metrics in Java SDK Harness

[ https://issues.apache.org/jira/browse/BEAM-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-3543. - Fix Version/s: 2.21.0 Resolution: Fixed > Fn API metrics in Java SDK Harness >

[jira] [Resolved] (BEAM-3544) Fn API metrics in Python SDK Harness

[ https://issues.apache.org/jira/browse/BEAM-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-3544. - Fix Version/s: 2.21.0 Resolution: Fixed > Fn API metrics in Python SDK Harness >

[jira] [Assigned] (BEAM-3544) Fn API metrics in Python SDK Harness

[ https://issues.apache.org/jira/browse/BEAM-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-3544: --- Assignee: Robert Bradshaw > Fn API metrics in Python SDK Harness >

[jira] [Updated] (BEAM-9934) Resolve differences in beam:metric:element_count:v1 implementations

[ https://issues.apache.org/jira/browse/BEAM-9934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9934: Fix Version/s: (was: 2.22.0) > Resolve differences in beam:metric:element_count:v1 implementations >

[jira] [Updated] (BEAM-9995) Ensure that the environment is propagated through from ExpansionService to Dataflow

[ https://issues.apache.org/jira/browse/BEAM-9995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9995: Component/s: runner-dataflow > Ensure that the environment is propagated through from ExpansionService to

[jira] [Created] (BEAM-9995) Ensure that the environment is propagated through from ExpansionService to Dataflow

Luke Cwik created BEAM-9995: --- Summary: Ensure that the environment is propagated through from ExpansionService to Dataflow Key: BEAM-9995 URL: https://issues.apache.org/jira/browse/BEAM-9995 Project: Beam

[jira] [Updated] (BEAM-9964) Setting workerCacheMb to make its way to the WindmillStateCache Constructor

[ https://issues.apache.org/jira/browse/BEAM-9964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9964: Status: Open (was: Triage Needed) > Setting workerCacheMb to make its way to the WindmillStateCache

[jira] [Assigned] (BEAM-9964) Setting workerCacheMb to make its way to the WindmillStateCache Constructor

[ https://issues.apache.org/jira/browse/BEAM-9964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-9964: --- Assignee: Omar Ismail > Setting workerCacheMb to make its way to the WindmillStateCache Constructor

[jira] [Commented] (BEAM-9935) Resolve differences in allowed_split_point implementations

[ https://issues.apache.org/jira/browse/BEAM-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107289#comment-17107289 ] Luke Cwik commented on BEAM-9935: - Turns out the go implementation respects the value even if it is too

[jira] [Updated] (BEAM-9935) Resolve differences in allowed_split_point implementations

[ https://issues.apache.org/jira/browse/BEAM-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9935: Fix Version/s: (was: 2.22.0) > Resolve differences in allowed_split_point implementations >

[jira] [Assigned] (BEAM-9935) Resolve differences in allowed_split_point implementations

[ https://issues.apache.org/jira/browse/BEAM-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-9935: --- Assignee: Daniel Oliveira (was: Robert Bradshaw) > Resolve differences in allowed_split_point

[jira] [Commented] (BEAM-9935) Resolve differences in allowed_split_point implementations

[ https://issues.apache.org/jira/browse/BEAM-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106776#comment-17106776 ] Luke Cwik commented on BEAM-9935: - [~danoliveira], can you address the Go version of this code borrowing

[jira] [Commented] (BEAM-9935) Resolve differences in allowed_split_point implementations

[ https://issues.apache.org/jira/browse/BEAM-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106775#comment-17106775 ] Luke Cwik commented on BEAM-9935: - This is not a blocker for 2.21 after 11671 was merged. 11688 was for

[jira] [Updated] (BEAM-9935) Resolve differences in allowed_split_point implementations

[ https://issues.apache.org/jira/browse/BEAM-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9935: Priority: Major (was: Blocker) > Resolve differences in allowed_split_point implementations >

[jira] [Commented] (BEAM-9001) Allow setting environment ID to all transforms in the SDK

[ https://issues.apache.org/jira/browse/BEAM-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106714#comment-17106714 ] Luke Cwik commented on BEAM-9001: - We only need to cherry pick the Python portion of

[jira] [Assigned] (BEAM-6327) Don't attempt to fuse subtransforms of primitive/known transforms.

[ https://issues.apache.org/jira/browse/BEAM-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-6327: --- Assignee: Luke Cwik (was: Kyle Weaver) > Don't attempt to fuse subtransforms of primitive/known

[jira] [Resolved] (BEAM-6327) Don't attempt to fuse subtransforms of primitive/known transforms.

[ https://issues.apache.org/jira/browse/BEAM-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6327. - Fix Version/s: 2.22.0 Resolution: Fixed > Don't attempt to fuse subtransforms of primitive/known

[jira] [Commented] (BEAM-9945) Use consistent element count for progress counter.

[ https://issues.apache.org/jira/browse/BEAM-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106619#comment-17106619 ] Luke Cwik commented on BEAM-9945: - [~ibzib] Can you cherrypick https://github.com/apache/beam/pull/11689

[jira] [Comment Edited] (BEAM-9945) Use consistent element count for progress counter.

[ https://issues.apache.org/jira/browse/BEAM-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106619#comment-17106619 ] Luke Cwik edited comment on BEAM-9945 at 5/13/20, 7:45 PM: --- [~ibzib] Can you

[jira] [Updated] (BEAM-9979) Fix race condition where the read index maybe reported from the last executed bundle

[ https://issues.apache.org/jira/browse/BEAM-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9979: Component/s: (was: sdk-py-harness) > Fix race condition where the read index maybe reported from the

[jira] [Updated] (BEAM-9979) Fix race condition where the read index maybe reported from the last executed bundle

[ https://issues.apache.org/jira/browse/BEAM-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9979: Description: When the BeamFnDataReadRunner is reused there is a short period of time when a progress

[jira] [Updated] (BEAM-9979) Fix race condition where the read index maybe reported from the last executed bundle

[ https://issues.apache.org/jira/browse/BEAM-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9979: Description: When the BeamFnDataReadRunner/DataInputOperation is reused there is a short period of time

[jira] [Updated] (BEAM-9979) Fix race condition where the read index maybe reported from the last executed bundle

[ https://issues.apache.org/jira/browse/BEAM-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9979: Status: Open (was: Triage Needed) > Fix race condition where the read index maybe reported from the last

[jira] [Created] (BEAM-9979) Fix race condition where the read index maybe reported from the last executed bundle

Luke Cwik created BEAM-9979: --- Summary: Fix race condition where the read index maybe reported from the last executed bundle Key: BEAM-9979 URL: https://issues.apache.org/jira/browse/BEAM-9979 Project: Beam

[jira] [Comment Edited] (BEAM-9945) Use consistent element count for progress counter.

[ https://issues.apache.org/jira/browse/BEAM-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105926#comment-17105926 ] Luke Cwik edited comment on BEAM-9945 at 5/13/20, 3:23 AM: --- When testing the

[jira] [Commented] (BEAM-9945) Use consistent element count for progress counter.

[ https://issues.apache.org/jira/browse/BEAM-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105937#comment-17105937 ] Luke Cwik commented on BEAM-9945: - Fix in https://github.com/apache/beam/pull/11689 > Use consistent

[jira] [Updated] (BEAM-9945) Use consistent element count for progress counter.

[ https://issues.apache.org/jira/browse/BEAM-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9945: Status: Open (was: Triage Needed) > Use consistent element count for progress counter. >

[jira] [Reopened] (BEAM-9945) Use consistent element count for progress counter.

[ https://issues.apache.org/jira/browse/BEAM-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-9945: - When testing the implementation against runner v2, I found that the Go SDK's read index ends at *# elements*

[jira] [Commented] (BEAM-9934) Resolve differences in beam:metric:element_count:v1 implementations

[ https://issues.apache.org/jira/browse/BEAM-9934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105866#comment-17105866 ] Luke Cwik commented on BEAM-9934: - 2.22 > Resolve differences in beam:metric:element_count:v1

[jira] [Updated] (BEAM-9934) Resolve differences in beam:metric:element_count:v1 implementations

[ https://issues.apache.org/jira/browse/BEAM-9934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9934: Fix Version/s: (was: 2.21.0) 2.22.0 > Resolve differences in

[jira] [Updated] (BEAM-9488) Python SDK sending unexpected MonitoringInfo

[ https://issues.apache.org/jira/browse/BEAM-9488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9488: Fix Version/s: (was: 2.22.0) 2.21.0 > Python SDK sending unexpected MonitoringInfo >

[jira] [Commented] (BEAM-6327) Don't attempt to fuse subtransforms of primitive/known transforms.

[ https://issues.apache.org/jira/browse/BEAM-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105629#comment-17105629 ] Luke Cwik commented on BEAM-6327: - I'm not sure if we want to add it to the fuser since the pipeline

  1   2   3   4   5   6   7   8   9   >