[jira] [Commented] (BEAM-9961) Python MongoDBIO does not apply projection

2020-05-15 Thread Corvin Deboeser (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108875#comment-17108875 ] Corvin Deboeser commented on BEAM-9961: --- Hi [~kenn] sure thing! Could also take care of #9960,

[jira] [Commented] (BEAM-10002) Mongo cursor timeout leads to CursorNotFound error

2020-05-15 Thread Corvin Deboeser (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108874#comment-17108874 ] Corvin Deboeser commented on BEAM-10002: Hi [~yichi] sure thing, will have time to fix it next

[jira] [Work logged] (BEAM-9819) Extend acceptable httplib2 version range.

2020-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9819?focusedWorklogId=434004=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-434004 ] ASF GitHub Bot logged work on BEAM-9819: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-9896) Add streaming for SnowflakeIO.Write to Java SDK

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9896: -- Status: Open (was: Triage Needed) > Add streaming for SnowflakeIO.Write to Java SDK >

[jira] [Updated] (BEAM-9897) Add cross-language support to SnowflakeIO.Read

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9897: -- Status: Open (was: Triage Needed) > Add cross-language support to SnowflakeIO.Read >

[jira] [Updated] (BEAM-9894) Add batch SnowflakeIO.Write to Java SDK

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9894: -- Status: Open (was: Triage Needed) > Add batch SnowflakeIO.Write to Java SDK >

[jira] [Updated] (BEAM-9898) Add cross-language support to SnowflakeIO.Write

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9898: -- Status: Open (was: Triage Needed) > Add cross-language support to SnowflakeIO.Write >

[jira] [Updated] (BEAM-9992) Migrate BeamSQL's SET operators to Sets transforms

2020-05-15 Thread Darshan Jani (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darshan Jani updated BEAM-9992: --- Summary: Migrate BeamSQL's SET operators to Sets transforms (was: Migrate BeamSQL's SET operators to

[jira] [Updated] (BEAM-9992) Migrate BeamSQL's SET operators to SetFns transforms

2020-05-15 Thread Darshan Jani (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darshan Jani updated BEAM-9992: --- Description: As par of [BEAM-9946|https://issues.apache.org/jira/browse/BEAM-9946] we have new Sets

[jira] [Work logged] (BEAM-9951) Create Go SDK synthetic sources.

2020-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9951?focusedWorklogId=433988=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-433988 ] ASF GitHub Bot logged work on BEAM-9951: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9951) Create Go SDK synthetic sources.

2020-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9951?focusedWorklogId=433987=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-433987 ] ASF GitHub Bot logged work on BEAM-9951: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9951) Create Go SDK synthetic sources.

2020-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9951?focusedWorklogId=433985=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-433985 ] ASF GitHub Bot logged work on BEAM-9951: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-9991) Mention start/finishBundle in ParDo documentation

2020-05-15 Thread Rose Nguyen (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108791#comment-17108791 ] Rose Nguyen commented on BEAM-9991: --- I think the ParDo section of the programming guide would be more

[jira] [Closed] (BEAM-8323) Testing Guideline using deprecated DoFnTester

2020-05-15 Thread Brent Worden (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brent Worden closed BEAM-8323. -- Fix Version/s: Not applicable Resolution: Duplicate > Testing Guideline using deprecated

[jira] [Closed] (BEAM-8604) Remove deprecated DoFnTester docs

2020-05-15 Thread Brent Worden (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brent Worden closed BEAM-8604. -- Fix Version/s: Not applicable Resolution: Duplicate > Remove deprecated DoFnTester docs >

[jira] [Closed] (BEAM-9817) beam_PreCommit_Website_Stage_GCS_Commit failed

2020-05-15 Thread Brent Worden (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brent Worden closed BEAM-9817. -- Fix Version/s: Not applicable Resolution: Cannot Reproduce >

[jira] [Created] (BEAM-10016) Flink postcommits failing testFlattenWithDifferentInputAndOutputCoders2

2020-05-15 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-10016: -- Summary: Flink postcommits failing testFlattenWithDifferentInputAndOutputCoders2 Key: BEAM-10016 URL: https://issues.apache.org/jira/browse/BEAM-10016 Project: Beam

[jira] [Updated] (BEAM-10016) Flink postcommits failing testFlattenWithDifferentInputAndOutputCoders2

2020-05-15 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-10016: --- Status: Open (was: Triage Needed) > Flink postcommits failing

[jira] [Assigned] (BEAM-10016) Flink postcommits failing testFlattenWithDifferentInputAndOutputCoders2

2020-05-15 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-10016: -- Assignee: Kyle Weaver > Flink postcommits failing

[jira] [Updated] (BEAM-8735) Beam site says to install tox, but GitHub README does not

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8735: -- Summary: Beam site says to install tox, but GitHub README does not (was: tox: yes or no) >

[jira] [Commented] (BEAM-8735) Beam site says to install tox, but GitHub README does not

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108775#comment-17108775 ] Kenneth Knowles commented on BEAM-8735: --- Ideally we'd just have one set of instructions. > Beam

[jira] [Updated] (BEAM-8735) tox: yes or no

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8735: -- Status: Open (was: Triage Needed) > tox: yes or no > -- > > Key:

[jira] [Commented] (BEAM-9355) Python typehints: support NewType

2020-05-15 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108770#comment-17108770 ] Udi Meiri commented on BEAM-9355: - Yes, it needs an actual implementation. Current support just converts

[jira] [Work logged] (BEAM-9136) Add LICENSES and NOTICES to docker images

2020-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9136?focusedWorklogId=433971=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-433971 ] ASF GitHub Bot logged work on BEAM-9136: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-9999) Remove support for EOLed runners (Apex, etc.)

2020-05-15 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108766#comment-17108766 ] Ahmet Altay commented on BEAM-: --- Thank you for the quick comments. Do you think it will be worth

[jira] [Assigned] (BEAM-8415) Improve error message when adding a PTransform with a name that already exists in the pipeline

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-8415: - Assignee: David Yan > Improve error message when adding a PTransform with a name that

[jira] [Commented] (BEAM-9361) NPE When putting Avro record with enum through SqlTransform

2020-05-15 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108765#comment-17108765 ] Brian Hulette commented on BEAM-9361: - Rueven did add an

[jira] [Commented] (BEAM-8415) Improve error message when adding a PTransform with a name that already exists in the pipeline

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108764#comment-17108764 ] Kenneth Knowles commented on BEAM-8415: --- I see you modified this for the Python SDK. So this may be

[jira] [Updated] (BEAM-8415) Improve error message when adding a PTransform with a name that already exists in the pipeline

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8415: -- Component/s: sdk-java-core > Improve error message when adding a PTransform with a name that

[jira] [Updated] (BEAM-8415) Improve error message when adding a PTransform with a name that already exists in the pipeline

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8415: -- Status: Open (was: Triage Needed) > Improve error message when adding a PTransform with a name

[jira] [Updated] (BEAM-8429) Define API for getting non user metrics.

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8429: -- Status: Open (was: Triage Needed) > Define API for getting non user metrics. >

[jira] [Commented] (BEAM-8423) Japanese characters encoding issue

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108763#comment-17108763 ] Kenneth Knowles commented on BEAM-8423: --- You may need to use the new {{JvmInitializers}} feature to

[jira] [Updated] (BEAM-8423) Japanese characters encoding issue

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8423: -- Status: Open (was: Triage Needed) > Japanese characters encoding issue >

[jira] [Updated] (BEAM-8423) Japanese characters encoding issue

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8423: -- Component/s: (was: beam-model) sdk-java-core > Japanese characters

[jira] [Updated] (BEAM-8423) Japanese characters encoding issue

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8423: -- Component/s: (was: sdk-java-core) runner-dataflow > Japanese characters

[jira] [Updated] (BEAM-8268) Strengthen retry strategy in GCS Java IO

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8268: -- Priority: Major (was: Minor) > Strengthen retry strategy in GCS Java IO >

[jira] [Work logged] (BEAM-9770) Add BigQuery DeadLetter pattern to Patterns Page

2020-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9770?focusedWorklogId=433970=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-433970 ] ASF GitHub Bot logged work on BEAM-9770: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-8268) Strengthen retry strategy in GCS Java IO

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8268: -- Status: Open (was: Triage Needed) > Strengthen retry strategy in GCS Java IO >

[jira] [Work logged] (BEAM-9770) Add BigQuery DeadLetter pattern to Patterns Page

2020-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9770?focusedWorklogId=433968=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-433968 ] ASF GitHub Bot logged work on BEAM-9770: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8239) Docker options in --environment_config

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108759#comment-17108759 ] Kenneth Knowles commented on BEAM-8239: --- [~mxm] [~ibzib] > Docker options in --environment_config >

[jira] [Updated] (BEAM-8239) Docker options in --environment_config

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8239: -- Priority: Major (was: Minor) > Docker options in --environment_config >

[jira] [Updated] (BEAM-3797) Add reference entry for Filter

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3797: -- Issue Type: Improvement (was: Task) > Add reference entry for Filter >

[jira] [Updated] (BEAM-8239) Docker options in --environment_config

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8239: -- Status: Open (was: Triage Needed) > Docker options in --environment_config >

[jira] [Updated] (BEAM-3797) Add reference entry for Filter

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3797: -- Priority: Major (was: Minor) > Add reference entry for Filter > --

[jira] [Commented] (BEAM-8192) Improve version definition

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108758#comment-17108758 ] Kenneth Knowles commented on BEAM-8192: --- The suffixes are controlled by the different language

[jira] [Updated] (BEAM-3797) Add reference entry for Filter

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3797: -- Status: Open (was: Triage Needed) > Add reference entry for Filter >

[jira] [Updated] (BEAM-8192) Improve version definition

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8192: -- Status: Open (was: Triage Needed) > Improve version definition > -- >

[jira] [Commented] (BEAM-8799) Python WordCountIT benchmarks broken

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108756#comment-17108756 ] Kenneth Knowles commented on BEAM-8799: --- This test now seems mostly healthy, though it could still

[jira] [Closed] (BEAM-8799) Python WordCountIT benchmarks broken

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-8799. - Fix Version/s: Not applicable Resolution: Cannot Reproduce > Python WordCountIT benchmarks

[jira] [Commented] (BEAM-9950) cannot find symbol javax.annotation.Generated

2020-05-15 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108755#comment-17108755 ] Kyle Weaver commented on BEAM-9950: --- [~iemejia] suggested this was because there's Java 11 somewhere,

[jira] [Updated] (BEAM-9984) Support BIT_OR aggregation function in Beam SQL

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9984: -- Status: Open (was: Triage Needed) > Support BIT_OR aggregation function in Beam SQL >

[jira] [Updated] (BEAM-9422) Missing comma in worker_pool_main causing syntax error whenever worker is started

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9422: -- Status: Open (was: Triage Needed) > Missing comma in worker_pool_main causing syntax error

[jira] [Updated] (BEAM-9321) BigQuery avro write logical type support

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9321: -- Status: Open (was: Triage Needed) > BigQuery avro write logical type support >

[jira] [Resolved] (BEAM-9422) Missing comma in worker_pool_main causing syntax error whenever worker is started

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-9422. --- Fix Version/s: Not applicable Assignee: Kyle Weaver Resolution: Fixed >

[jira] [Assigned] (BEAM-9321) BigQuery avro write logical type support

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-9321: - Assignee: Filipe Regadas > BigQuery avro write logical type support >

[jira] [Commented] (BEAM-8328) remove :beam-test-infra-metrics:test from build target.

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108753#comment-17108753 ] Kenneth Knowles commented on BEAM-8328: --- [~Ardagan] > remove :beam-test-infra-metrics:test from

[jira] [Commented] (BEAM-8328) remove :beam-test-infra-metrics:test from build target.

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108752#comment-17108752 ] Kenneth Knowles commented on BEAM-8328: --- Ping? Does the attached PR resolve this Jira or no? >

[jira] [Commented] (BEAM-9355) Python typehints: support NewType

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108751#comment-17108751 ] Kenneth Knowles commented on BEAM-9355: --- PR says "basic support". Is this still needing further

[jira] [Updated] (BEAM-9221) Python precommit tests should catch errors when Python SDK dependency chain has conflicting dependencies.

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9221: -- Status: Open (was: Triage Needed) > Python precommit tests should catch errors when Python SDK

[jira] [Updated] (BEAM-9355) Python typehints: support NewType

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9355: -- Status: Open (was: Triage Needed) > Python typehints: support NewType >

[jira] [Commented] (BEAM-9321) BigQuery avro write logical type support

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108750#comment-17108750 ] Kenneth Knowles commented on BEAM-9321: --- I see the PR is merged. Has this fully resolved your issue?

[jira] [Commented] (BEAM-9239) Dependency conflict with Spark using aws io

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108749#comment-17108749 ] Kenneth Knowles commented on BEAM-9239: --- Does Spark 2.4.4 have the option where your

[jira] [Updated] (BEAM-9222) Add distributed read pattern

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9222: -- Status: Open (was: Triage Needed) > Add distributed read pattern >

[jira] [Updated] (BEAM-9239) Dependency conflict with Spark using aws io

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9239: -- Status: Open (was: Triage Needed) > Dependency conflict with Spark using aws io >

[jira] [Updated] (BEAM-9239) Dependency conflict with Spark using aws io

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9239: -- Priority: Critical (was: Major) > Dependency conflict with Spark using aws io >

[jira] [Commented] (BEAM-9417) Unable to Read form BigQuery and File system in same pipeline

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108748#comment-17108748 ] Kenneth Knowles commented on BEAM-9417: --- [~chamikara] [~pabloem] [~robertwb] > Unable to Read form

[jira] [Updated] (BEAM-8919) Move JAVA_11_HOME and JAVA_8_HOME variables to Jenkins envs.

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8919: -- Status: Open (was: Triage Needed) > Move JAVA_11_HOME and JAVA_8_HOME variables to Jenkins

[jira] [Updated] (BEAM-9417) Unable to Read form BigQuery and File system in same pipeline

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9417: -- Status: Open (was: Triage Needed) > Unable to Read form BigQuery and File system in same

[jira] [Updated] (BEAM-8485) Python Beam job is successful regardless of the result of the BigQuery load job (for the BigQuery File Loads)

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8485: -- Status: Open (was: Triage Needed) > Python Beam job is successful regardless of the result of

[jira] [Updated] (BEAM-9431) test_streaming_pipeline_returns_expected_user_metrics_fnapi_it is not supported with streaming engine

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9431: -- Status: Open (was: Triage Needed) >

[jira] [Commented] (BEAM-9431) test_streaming_pipeline_returns_expected_user_metrics_fnapi_it is not supported with streaming engine

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108747#comment-17108747 ] Kenneth Knowles commented on BEAM-9431: --- Already addressed by the linked PR? >

[jira] [Commented] (BEAM-9567) GCS needs to be testable

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108746#comment-17108746 ] Kenneth Knowles commented on BEAM-9567: --- In practice, our tests use Mockito to directly create a

[jira] [Updated] (BEAM-9487) GBKs on unbounded pcolls with global windows and no triggers should fail

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9487: -- Status: Open (was: Triage Needed) > GBKs on unbounded pcolls with global windows and no

[jira] [Updated] (BEAM-9567) GCS needs to be testable

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9567: -- Status: Open (was: Triage Needed) > GCS needs to be testable > > >

[jira] [Updated] (BEAM-9567) GCS needs to be testable

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9567: -- Status: Triage Needed (was: Open) > GCS needs to be testable > > >

[jira] [Updated] (BEAM-9597) Autodetect Avro schema from Avro file

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9597: -- Priority: Major (was: Minor) > Autodetect Avro schema from Avro file >

[jira] [Updated] (BEAM-9597) Autodetect Avro schema from Avro file

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9597: -- Status: Open (was: Triage Needed) > Autodetect Avro schema from Avro file >

[jira] [Commented] (BEAM-9361) NPE When putting Avro record with enum through SqlTransform

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108744#comment-17108744 ] Kenneth Knowles commented on BEAM-9361: --- CC [~reuvenlax] [~bhulette] > NPE When putting Avro

[jira] [Commented] (BEAM-9361) NPE When putting Avro record with enum through SqlTransform

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108743#comment-17108743 ] Kenneth Knowles commented on BEAM-9361: --- I like string > NPE When putting Avro record with enum

[jira] [Work logged] (BEAM-10015) output timestamp not properly propagated through the Dataflow runner

2020-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10015?focusedWorklogId=433966=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-433966 ] ASF GitHub Bot logged work on BEAM-10015: - Author: ASF GitHub Bot

[jira] [Updated] (BEAM-9361) NPE When putting Avro record with enum through SqlTransform

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9361: -- Status: Open (was: Triage Needed) > NPE When putting Avro record with enum through

[jira] [Updated] (BEAM-9568) Move Beam SQL to use the schema join transforms

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9568: -- Status: Open (was: Triage Needed) > Move Beam SQL to use the schema join transforms >

[jira] [Updated] (BEAM-9568) Move Beam SQL to use the schema join transforms

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9568: -- Component/s: (was: sdk-java-core) dsl-sql > Move Beam SQL to use the

[jira] [Updated] (BEAM-9568) Move Beam SQL to use the schema join transforms

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9568: -- Parent: (was: BEAM-4076) Issue Type: Improvement (was: Sub-task) > Move Beam SQL

[jira] [Updated] (BEAM-9939) Make TupleCombineFn play well with NamedTuples

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9939: -- Status: Open (was: Triage Needed) > Make TupleCombineFn play well with NamedTuples >

[jira] [Commented] (BEAM-9950) cannot find symbol javax.annotation.Generated

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108740#comment-17108740 ] Kenneth Knowles commented on BEAM-9950: --- JDK version? > cannot find symbol

[jira] [Updated] (BEAM-9955) Cleanup conditional dependence on grpc.

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9955: -- Status: Open (was: Triage Needed) > Cleanup conditional dependence on grpc. >

[jira] [Commented] (BEAM-9917) BigQueryBatchFileLoads dynamic destination

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108737#comment-17108737 ] Kenneth Knowles commented on BEAM-9917: --- CC [~chamikara] > BigQueryBatchFileLoads dynamic

[jira] [Updated] (BEAM-9917) BigQueryBatchFileLoads dynamic destination

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9917: -- Priority: Critical (was: Minor) > BigQueryBatchFileLoads dynamic destination >

[jira] [Updated] (BEAM-9917) BigQueryBatchFileLoads dynamic destination

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9917: -- Component/s: (was: sdk-py-core) > BigQueryBatchFileLoads dynamic destination >

[jira] [Updated] (BEAM-9917) BigQueryBatchFileLoads dynamic destination

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9917: -- Component/s: io-py-gcp > BigQueryBatchFileLoads dynamic destination >

[jira] [Updated] (BEAM-9917) BigQueryBatchFileLoads dynamic destination

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9917: -- Status: Open (was: Triage Needed) > BigQueryBatchFileLoads dynamic destination >

[jira] [Updated] (BEAM-9965) Explain direct runner running modes

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9965: -- Status: Open (was: Triage Needed) > Explain direct runner running modes >

[jira] [Updated] (BEAM-9965) Explain direct runner running modes

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9965: -- Priority: Major (was: Minor) > Explain direct runner running modes >

[jira] [Updated] (BEAM-9970) beam_PostRelease_NightlySnapshot failing

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9970: -- Status: Open (was: Triage Needed) > beam_PostRelease_NightlySnapshot failing >

[jira] [Updated] (BEAM-9760) KafkaIO supports consumer group?

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9760: -- Status: Open (was: Triage Needed) > KafkaIO supports consumer group? >

[jira] [Updated] (BEAM-9760) KafkaIO supports consumer group?

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9760: -- Priority: Major (was: Minor) > KafkaIO supports consumer group? >

[jira] [Updated] (BEAM-9973) beam_PostCommit_Py_ValCont flakes (before running tests)

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9973: -- Status: Open (was: Triage Needed) > beam_PostCommit_Py_ValCont flakes (before running tests) >

[jira] [Updated] (BEAM-9970) beam_PostRelease_NightlySnapshot failing

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9970: -- Priority: Critical (was: Major) > beam_PostRelease_NightlySnapshot failing >

[jira] [Updated] (BEAM-9972) Test pure SQL UDF for all data types

2020-05-15 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-9972: -- Status: Open (was: Triage Needed) > Test pure SQL UDF for all data types >

  1   2   3   4   >