[jira] [Updated] (BEAM-10837) Remove unused beam_PerformanceTests_Analysis Jenkins Job

2020-08-31 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10837: --- Status: Open (was: Triage Needed) > Remove unused beam_PerformanceTests_Analysis Jenkins Job

[jira] [Updated] (BEAM-10840) Don't run code coverage on microbenchmarks for the Python SDK

2020-08-31 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10840: --- Status: Open (was: Triage Needed) > Don't run code coverage on microbenchmarks for the Pytho

[jira] [Updated] (BEAM-10843) Linkage checker fails with Cannot invoke method startsWith()

2020-08-31 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10843: --- Status: Open (was: Triage Needed) > Linkage checker fails with Cannot invoke method startsWi

[jira] [Updated] (BEAM-10844) Add a way to prebuild python sdk container with dependencies

2020-08-31 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10844: --- Status: Open (was: Triage Needed) > Add a way to prebuild python sdk container with dependen

[jira] [Updated] (BEAM-10847) NPE in BeamUnnestRel

2020-09-01 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10847: --- Status: Open (was: Triage Needed) > NPE in BeamUnnestRel > > >

[jira] [Updated] (BEAM-10849) Test that default Dataflow region option is set.

2020-09-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10849: --- Status: Open (was: Triage Needed) > Test that default Dataflow region option is set. > -

[jira] [Updated] (BEAM-10853) Copy jobs for multi-table imports to BQ have duplicated names.

2020-09-03 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10853: --- Status: Open (was: Triage Needed) > Copy jobs for multi-table imports to BQ have duplicated

[jira] [Updated] (BEAM-10856) Support NestedValueProvider for Python SDK

2020-09-06 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10856: --- Status: Open (was: Triage Needed) > Support NestedValueProvider for Python SDK > ---

[jira] [Updated] (BEAM-10857) Add Pubsub Avro table provider

2020-09-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10857: --- Status: Open (was: Triage Needed) > Add Pubsub Avro table provider > ---

[jira] [Updated] (BEAM-10863) DataflowRunner should set encoding to well-known coder when with pubsub sink

2020-09-08 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10863: --- Status: Open (was: Triage Needed) > DataflowRunner should set encoding to well-known coder w

[jira] [Updated] (BEAM-10870) Add raw private key param to snowflake cross-language python wrapper

2020-09-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10870: --- Status: Open (was: Triage Needed) > Add raw private key param to snowflake cross-language py

[jira] [Updated] (BEAM-10873) Stronger testing of dataframes partitioning declartions.

2020-09-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10873: --- Status: Open (was: Triage Needed) > Stronger testing of dataframes partitioning declartions.

[jira] [Updated] (BEAM-10874) Support both Go versions of proto (v1 & v2) with proto coder.

2020-09-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10874: --- Status: Open (was: Triage Needed) > Support both Go versions of proto (v1 & v2) with proto c

[jira] [Updated] (BEAM-10876) Dataflow metric query result throws TypeError when the distribution sum is large

2020-09-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10876: --- Status: Open (was: Triage Needed) > Dataflow metric query result throws TypeError when the d

[jira] [Updated] (BEAM-10878) Dataflow fails to deserialize logical type with static schema

2020-09-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10878: --- Status: Open (was: Triage Needed) > Dataflow fails to deserialize logical type with static s

[jira] [Updated] (BEAM-10880) Log error counts to debug BigQuery streaming insert requests for Python SDK

2020-09-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10880: --- Status: Open (was: Triage Needed) > Log error counts to debug BigQuery streaming insert requ

[jira] [Updated] (BEAM-10884) Add Proto support to Pubsub table provider

2020-09-11 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10884: --- Status: Open (was: Triage Needed) > Add Proto support to Pubsub table provider > ---

[jira] [Updated] (BEAM-10885) Add Avro support to Kafka Table Provider

2020-09-11 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10885: --- Status: Open (was: Triage Needed) > Add Avro support to Kafka Table Provider > -

[jira] [Updated] (BEAM-10890) Log error counts to debug BigQuery streaming insert requests for Java SDK

2020-09-11 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10890: --- Status: Open (was: Triage Needed) > Log error counts to debug BigQuery streaming insert requ

[jira] [Updated] (BEAM-10891) Dockerfile for development container

2020-09-13 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10891: --- Status: Open (was: Triage Needed) > Dockerfile for development container > -

[jira] [Updated] (BEAM-10892) Add Proto support to Kafka Table Provider

2020-09-14 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10892: --- Status: Open (was: Triage Needed) > Add Proto support to Kafka Table Provider >

[jira] [Updated] (BEAM-10893) Add JSON suport to Kafka Table Provider

2020-09-14 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10893: --- Status: Open (was: Triage Needed) > Add JSON suport to Kafka Table Provider > --

[jira] [Updated] (BEAM-11024) Visit composite transform nodes in Pipeline._check_replacement()

2020-10-06 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11024: --- Status: Open (was: Triage Needed) > Visit composite transform nodes in Pipeline._check_repla

[jira] [Updated] (BEAM-11025) PCollectionVisualizationTest.test_dynamic_plotting_return_handle failing in precommit

2020-10-06 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11025: --- Status: Open (was: Triage Needed) > PCollectionVisualizationTest.test_dynamic_plotting_retur

[jira] [Updated] (BEAM-11027) ZetaSQL Nexmark run takes too long because of excessive logging

2020-10-06 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11027: --- Status: Open (was: Triage Needed) > ZetaSQL Nexmark run takes too long because of excessive

[jira] [Updated] (BEAM-11031) ULR postcommit has flaky startup

2020-10-06 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11031: --- Status: Open (was: Triage Needed) > ULR postcommit has flaky startup > -

[jira] [Created] (BEAM-11031) ULR postcommit has flaky startup

2020-10-06 Thread Kenneth Knowles (Jira)
Kenneth Knowles created BEAM-11031: -- Summary: ULR postcommit has flaky startup Key: BEAM-11031 URL: https://issues.apache.org/jira/browse/BEAM-11031 Project: Beam Issue Type: Bug C

[jira] [Updated] (BEAM-11032) Use metric for Java BigQuery streaming insert API latency logging

2020-10-06 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11032: --- Status: Open (was: Triage Needed) > Use metric for Java BigQuery streaming insert API latenc

[jira] [Updated] (BEAM-11033) Update Dataflow metrics processor to handle portable jobs

2020-10-06 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11033: --- Status: Open (was: Triage Needed) > Update Dataflow metrics processor to handle portable job

[jira] [Updated] (BEAM-11034) State garbage collection timers set by Dataflow SimpleParDoFn pile up for the GlobalWindow

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11034: --- Status: Open (was: Triage Needed) > State garbage collection timers set by Dataflow SimplePa

[jira] [Updated] (BEAM-11035) Pin versions of "untrusted" 3rd-party GitHub Actions

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11035: --- Status: Open (was: Triage Needed) > Pin versions of "untrusted" 3rd-party GitHub Actions > -

[jira] [Updated] (BEAM-11036) Add explanatory comment to PR if GA workflow gets cancelled

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11036: --- Status: Open (was: Triage Needed) > Add explanatory comment to PR if GA workflow gets cancel

[jira] [Work started] (BEAM-11031) ULR postcommit has flaky startup

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-11031 started by Kenneth Knowles. -- > ULR postcommit has flaky startup > > >

[jira] [Commented] (BEAM-11031) ULR postcommit has flaky startup

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209659#comment-17209659 ] Kenneth Knowles commented on BEAM-11031: It is because the port/pid/stdout/stderr

[jira] [Updated] (BEAM-11039) Resolve conflicts between TFMA and Facets imports

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11039: --- Status: Open (was: Triage Needed) > Resolve conflicts between TFMA and Facets imports >

[jira] [Assigned] (BEAM-10997) Make sure SDF unbounded wrapper close reader properly

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-10997: -- Assignee: Kenneth Knowles > Make sure SDF unbounded wrapper close reader properly > --

[jira] [Assigned] (BEAM-10997) Make sure SDF unbounded wrapper close reader properly

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-10997: -- Assignee: (was: Kenneth Knowles) > Make sure SDF unbounded wrapper close reader pr

[jira] [Assigned] (BEAM-10097) Migrate PCollection views to use both iterable and multimap materializations/access patterns

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-10097: -- Assignee: Kenneth Knowles > Migrate PCollection views to use both iterable and multima

[jira] [Updated] (BEAM-10097) Migrate PCollection views to use both iterable and multimap materializations/access patterns

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10097: --- Labels: (was: stale-P2) > Migrate PCollection views to use both iterable and multimap > ma

[jira] [Commented] (BEAM-10097) Migrate PCollection views to use both iterable and multimap materializations/access patterns

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209752#comment-17209752 ] Kenneth Knowles commented on BEAM-10097: This was attached to a TODO that looks a

[jira] [Updated] (BEAM-11041) Match job messages and behavior for Java and Python when launching BQ jobs

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11041: --- Status: Open (was: Triage Needed) > Match job messages and behavior for Java and Python when

[jira] [Updated] (BEAM-11042) Direct runner should not depend on deprecated CreatePCollectionView primitive

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11042: --- Status: Open (was: Triage Needed) > Direct runner should not depend on deprecated CreatePCol

[jira] [Created] (BEAM-11042) Direct runner should not depend on deprecated CreatePCollectionView primitive

2020-10-07 Thread Kenneth Knowles (Jira)
Kenneth Knowles created BEAM-11042: -- Summary: Direct runner should not depend on deprecated CreatePCollectionView primitive Key: BEAM-11042 URL: https://issues.apache.org/jira/browse/BEAM-11042 Proje

[jira] [Work started] (BEAM-11042) Direct runner should not depend on deprecated CreatePCollectionView primitive

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-11042 started by Kenneth Knowles. -- > Direct runner should not depend on deprecated CreatePCollectionView primit

[jira] [Updated] (BEAM-11043) Dataflow runner should not depend on deprecated CreatePCollectionView primitive

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11043: --- Component/s: (was: runner-direct) runner-dataflow > Dataflow runner shou

[jira] [Updated] (BEAM-11043) Dataflow runner should not depend on deprecated CreatePCollectionView primitive

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11043: --- Status: Open (was: Triage Needed) > Dataflow runner should not depend on deprecated CreatePC

[jira] [Work started] (BEAM-11043) Dataflow runner should not depend on deprecated CreatePCollectionView primitive

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-11043 started by Kenneth Knowles. -- > Dataflow runner should not depend on deprecated CreatePCollectionView > p

[jira] [Created] (BEAM-11043) Dataflow runner should not depend on deprecated CreatePCollectionView primitive

2020-10-07 Thread Kenneth Knowles (Jira)
Kenneth Knowles created BEAM-11043: -- Summary: Dataflow runner should not depend on deprecated CreatePCollectionView primitive Key: BEAM-11043 URL: https://issues.apache.org/jira/browse/BEAM-11043 Pro

[jira] [Updated] (BEAM-4237) Migrate WatermarkManager to the local-java package

2020-10-07 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-4237: -- Status: Resolved (was: Open) > Migrate WatermarkManager to the local-java package > ---

[jira] [Commented] (BEAM-10968) flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics

2020-10-08 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210366#comment-17210366 ] Kenneth Knowles commented on BEAM-10968: Maybe [~ajam...@google.com] who has done

[jira] [Updated] (BEAM-11045) Screen diff integration tests fail

2020-10-08 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11045: --- Status: Open (was: Triage Needed) > Screen diff integration tests fail > ---

[jira] [Updated] (BEAM-11040) beam_PostCommit_Java_ValidatesRunner_ULR flaky

2020-10-08 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11040: --- Status: Open (was: Triage Needed) > beam_PostCommit_Java_ValidatesRunner_ULR flaky > ---

[jira] [Updated] (BEAM-11031) ULR postcommit has flaky startup

2020-10-08 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11031: --- Status: Resolved (was: In Progress) > ULR postcommit has flaky startup > ---

[jira] [Updated] (BEAM-11040) beam_PostCommit_Java_ValidatesRunner_ULR flaky

2020-10-08 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11040: --- Status: Resolved (was: Open) > beam_PostCommit_Java_ValidatesRunner_ULR flaky >

[jira] [Updated] (BEAM-942) Gearpump test configuration should exclude merging window tests

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-942: - Status: Resolved (was: Open) > Gearpump test configuration should exclude merging window tests > -

[jira] [Commented] (BEAM-4255) GloballyAsSingletonView is writing multiple values to the SingletonView

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211152#comment-17211152 ] Kenneth Knowles commented on BEAM-4255: --- As mentioned on the PR, side inputs just do

[jira] [Updated] (BEAM-4255) GloballyAsSingletonView is writing multiple values to the SingletonView

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-4255: -- Status: Resolved (was: Open) > GloballyAsSingletonView is writing multiple values to the Single

[jira] [Updated] (BEAM-3971) Pipeline translation utilities should not use SDK construction classes

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3971: -- Issue Type: Improvement (was: Bug) > Pipeline translation utilities should not use SDK construc

[jira] [Updated] (BEAM-942) Gearpump test configuration should exclude merging window tests

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-942: - Status: Resolved (was: Resolved) > Gearpump test configuration should exclude merging window tests

[jira] [Commented] (BEAM-3971) Pipeline translation utilities should not use SDK construction classes

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211153#comment-17211153 ] Kenneth Knowles commented on BEAM-3971: --- Closing because this looks obsolete. > Pip

[jira] [Updated] (BEAM-3971) Pipeline translation utilities should not use SDK construction classes

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3971: -- Status: Resolved (was: Open) > Pipeline translation utilities should not use SDK construction c

[jira] [Created] (BEAM-11049) Elminate CreatePCollectionView pseudo-"primitive"

2020-10-09 Thread Kenneth Knowles (Jira)
Kenneth Knowles created BEAM-11049: -- Summary: Elminate CreatePCollectionView pseudo-"primitive" Key: BEAM-11049 URL: https://issues.apache.org/jira/browse/BEAM-11049 Project: Beam Issue Type

[jira] [Updated] (BEAM-11049) Elminate CreatePCollectionView pseudo-"primitive"

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11049: --- Status: Open (was: Triage Needed) > Elminate CreatePCollectionView pseudo-"primitive" >

[jira] [Updated] (BEAM-11050) AggregatorCombiner reuses mutable accumT across multiple merges leading to incorrect results

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11050: --- Status: Open (was: Triage Needed) > AggregatorCombiner reuses mutable accumT across multiple

[jira] [Updated] (BEAM-11052) to_pcollection should memoize on DF expressions

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11052: --- Status: Open (was: Triage Needed) > to_pcollection should memoize on DF expressions > --

[jira] [Updated] (BEAM-11053) BigQuerySampleIT not using cloud project specified

2020-10-09 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11053: --- Status: Open (was: Triage Needed) > BigQuerySampleIT not using cloud project specified > ---

[jira] [Updated] (BEAM-11055) Update log4j to version 2.13.3

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11055: --- Status: Open (was: Triage Needed) > Update log4j to version 2.13.3 > ---

[jira] [Commented] (BEAM-8212) StatefulParDoFn creates GC timers for every record

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212475#comment-17212475 ] Kenneth Knowles commented on BEAM-8212: --- Makes sense. Note that {{StatefulDoFnRunner

[jira] [Commented] (BEAM-8212) StatefulParDoFn creates GC timers for every record

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212477#comment-17212477 ] Kenneth Knowles commented on BEAM-8212: --- Not also: a runner passes in the CleanupTim

[jira] [Updated] (BEAM-8212) StatefulDoFnRunner creates GC timers for every record

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8212: -- Summary: StatefulDoFnRunner creates GC timers for every record (was: StatefulParDoFn creates G

[jira] [Updated] (BEAM-5649) Remove deprecated primitive CREATE_VIEW transform from Java SDK translation to pipeline proto

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-5649: -- Summary: Remove deprecated primitive CREATE_VIEW transform from Java SDK translation to pipeline

[jira] [Commented] (BEAM-11049) Elminate CreatePCollectionView pseudo-"primitive"

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212534#comment-17212534 ] Kenneth Knowles commented on BEAM-11049: The title, component, and code attached

[jira] [Comment Edited] (BEAM-11049) Elminate CreatePCollectionView pseudo-"primitive"

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212534#comment-17212534 ] Kenneth Knowles edited comment on BEAM-11049 at 10/12/20, 5:36 PM:

[jira] [Commented] (BEAM-10079) Samza tests failing [Java 11]

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212668#comment-17212668 ] Kenneth Knowles commented on BEAM-10079: [~xinyu] are you using Java 11? > Samza

[jira] [Updated] (BEAM-11056) Fix warning message and rename old APIs

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11056: --- Status: Open (was: Triage Needed) > Fix warning message and rename old APIs > --

[jira] [Updated] (BEAM-11057) Make BigQueryIO.Read::withTestServices publicly accessible

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11057: --- Status: Open (was: Triage Needed) > Make BigQueryIO.Read::withTestServices publicly accessib

[jira] [Commented] (BEAM-11049) Elminate CreatePCollectionView pseudo-"primitive"

2020-10-12 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212678#comment-17212678 ] Kenneth Knowles commented on BEAM-11049: It is also present in the protos. Elimin

[jira] [Updated] (BEAM-11058) Run HadoopFormatIOElasticIT in Java PostCommit

2020-10-13 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11058: --- Status: Open (was: Triage Needed) > Run HadoopFormatIOElasticIT in Java PostCommit > ---

[jira] [Reopened] (BEAM-1620) Add streaming Dataflow ValidatesRunner coverage

2020-10-13 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reopened BEAM-1620: --- Reopening while I get the test reliably healthy. > Add streaming Dataflow ValidatesRunner coverag

[jira] [Updated] (BEAM-1620) Add streaming Dataflow ValidatesRunner coverage

2020-10-13 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1620: -- Status: Resolved (was: Triage Needed) > Add streaming Dataflow ValidatesRunner coverage > -

[jira] [Commented] (BEAM-1620) Add streaming Dataflow ValidatesRunner coverage

2020-10-13 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213196#comment-17213196 ] Kenneth Knowles commented on BEAM-1620: --- Mistook this for BEAM-2146, which is restor

[jira] [Updated] (BEAM-11064) Consider adding a pandas typehint

2020-10-14 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11064: --- Status: Open (was: Triage Needed) > Consider adding a pandas typehint >

[jira] [Updated] (BEAM-11067) Source not included on Java SDK docker image for some GPL/LGPL/MPL dependency saxon-he

2020-10-14 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11067: --- Status: Open (was: Triage Needed) > Source not included on Java SDK docker image for some GP

[jira] [Assigned] (BEAM-11065) Apache Beam Template to ingest from Apache Kafka to Google Pub/Sub

2020-10-14 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-11065: -- Assignee: Ilya Kozyrev > Apache Beam Template to ingest from Apache Kafka to Google Pu

[jira] [Updated] (BEAM-11066) Java wordcount example throw exception on dataflow runner with streaming beam_fn_api

2020-10-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11066: --- Status: Open (was: Triage Needed) > Java wordcount example throw exception on dataflow runne

[jira] [Updated] (BEAM-11066) Java wordcount example throw exception on dataflow runner with streaming beam_fn_api

2020-10-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11066: --- Component/s: (was: examples-java) runner-dataflow > Java wordcount examp

[jira] [Commented] (BEAM-11066) Java wordcount example throw exception on dataflow runner with streaming beam_fn_api

2020-10-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214872#comment-17214872 ] Kenneth Knowles commented on BEAM-11066: Commented on the PR: "streaming mode" is

[jira] [Commented] (BEAM-11066) Java wordcount example throw exception on dataflow runner with streaming beam_fn_api

2020-10-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214874#comment-17214874 ] Kenneth Knowles commented on BEAM-11066: Specifically, it looks like {{StreamingF

[jira] [Updated] (BEAM-11066) DataflowRunner crashes during graph rewrites of Java wordcount example with beam_fn_api experiment

2020-10-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11066: --- Summary: DataflowRunner crashes during graph rewrites of Java wordcount example with beam_fn_

[jira] [Updated] (BEAM-11068) beam-sdks-java-bom.pom cannot be signed after upgrade to Gradle 6

2020-10-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11068: --- Status: Open (was: Triage Needed) > beam-sdks-java-bom.pom cannot be signed after upgrade to

[jira] [Commented] (BEAM-11068) beam-sdks-java-bom.pom cannot be signed after upgrade to Gradle 6

2020-10-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17215065#comment-17215065 ] Kenneth Knowles commented on BEAM-11068: Can you manually produce this and go thr

[jira] [Updated] (BEAM-11069) Performance improvements for ReadFromBigQuery transform

2020-10-16 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11069: --- Status: Open (was: Triage Needed) > Performance improvements for ReadFromBigQuery transform

[jira] [Updated] (BEAM-11070) Portable FlinkRunnerTestStreaming. test_register_finalizations is flkay

2020-10-16 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11070: --- Status: Open (was: Triage Needed) > Portable FlinkRunnerTestStreaming. test_register_finaliz

[jira] [Updated] (BEAM-11074) 2.24.0 Post-Release improvements

2020-10-19 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11074: --- Status: Open (was: Triage Needed) > 2.24.0 Post-Release improvements > -

[jira] [Updated] (BEAM-11075) Load Tests for Go SDK

2020-10-20 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11075: --- Status: Open (was: Triage Needed) > Load Tests for Go SDK > - > >

[jira] [Updated] (BEAM-11066) DataflowRunner crashes during graph rewrites of Java wordcount example with beam_fn_api experiment

2020-10-20 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11066: --- Status: Resolved (was: Open) > DataflowRunner crashes during graph rewrites of Java wordcoun

[jira] [Assigned] (BEAM-11066) DataflowRunner crashes during graph rewrites of Java wordcount example with beam_fn_api experiment

2020-10-20 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-11066: -- Assignee: Yichi Zhang > DataflowRunner crashes during graph rewrites of Java wordcount

[jira] [Updated] (BEAM-11078) Add splittable DoFn programming guide documentation

2020-10-20 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-11078: --- Status: Open (was: Triage Needed) > Add splittable DoFn programming guide documentation > --

[jira] [Updated] (BEAM-10222) Dataflow sets CPU limits on docker containers near zero so Java 11 only detects 1 CPU

2020-10-20 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-10222: --- Labels: (was: stale-assigned) > Dataflow sets CPU limits on docker containers near zero so

[jira] [Commented] (BEAM-10222) Dataflow sets CPU limits on docker containers near zero so Java 11 only detects 1 CPU

2020-10-20 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217980#comment-17217980 ] Kenneth Knowles commented on BEAM-10222: Update: simplest fix is to not use {{ava

  1   2   3   4   5   6   7   8   9   10   >