[jira] [Resolved] (BEAM-8828) BigQueryTableProvider should allow configuration of write disposition

2020-06-09 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved BEAM-8828. - Fix Version/s: 2.23.0 Resolution: Fixed > BigQueryTableProvider should allow configuration

[jira] [Updated] (BEAM-9043) BigQueryIO fails cryptically if gcpTempLocation is set and tempLocation is not

2020-06-09 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9043: Labels: (was: stale-P2) > BigQueryIO fails cryptically if gcpTempLocation is set and tempLocation

[jira] [Comment Edited] (BEAM-10203) Replace fastjson with jackson

2020-06-09 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129671#comment-17129671 ] Brian Hulette edited comment on BEAM-10203 at 6/9/20, 6:06 PM: --- cc:

[jira] [Commented] (BEAM-10203) Replace fastjson with jackson

2020-06-09 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129671#comment-17129671 ] Brian Hulette commented on BEAM-10203: -- cc: [~slukas] this is relevant to your project > Replace

[jira] [Created] (BEAM-10224) Test using a DATE field in an aggregation

2020-06-09 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-10224: Summary: Test using a DATE field in an aggregation Key: BEAM-10224 URL: https://issues.apache.org/jira/browse/BEAM-10224 Project: Beam Issue Type: Task

[jira] [Assigned] (BEAM-8828) BigQueryTableProvider should allow configuration of write disposition

2020-06-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-8828: --- Assignee: Scott Lukas > BigQueryTableProvider should allow configuration of write

[jira] [Closed] (BEAM-10188) Automate Github release

2020-06-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette closed BEAM-10188. Fix Version/s: Not applicable Resolution: Fixed > Automate Github release >

[jira] [Assigned] (BEAM-10188) Automate Github release

2020-06-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-10188: Assignee: (was: Brian Hulette) > Automate Github release > --- >

[jira] [Assigned] (BEAM-10188) Automate Github release

2020-06-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-10188: Assignee: Brian Hulette > Automate Github release > --- > >

[jira] [Commented] (BEAM-7405) Task :sdks:python:hdfsIntegrationTest is failing in Python PostCommits - docker-credential-gcloud not installed

2020-06-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126056#comment-17126056 ] Brian Hulette commented on BEAM-7405: - Oh ok, thanks. I filed BEAM-10193 to track the VM image update.

[jira] [Created] (BEAM-10193) Update Jenkins VMs with docker-credential-gcloud

2020-06-04 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-10193: Summary: Update Jenkins VMs with docker-credential-gcloud Key: BEAM-10193 URL: https://issues.apache.org/jira/browse/BEAM-10193 Project: Beam Issue Type:

[jira] [Commented] (BEAM-8602) Always use shadow configuration for direct runner dependencies

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125431#comment-17125431 ] Brian Hulette commented on BEAM-8602: - Just put up a PR to close this out > Always use shadow

[jira] [Updated] (BEAM-8602) Always use shadow configuration for direct runner dependencies

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8602: Labels: (was: stale-assigned) > Always use shadow configuration for direct runner dependencies >

[jira] [Resolved] (BEAM-10187) build_release_candidate.sh does not push tag to Github

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved BEAM-10187. -- Fix Version/s: Not applicable Resolution: Fixed > build_release_candidate.sh does not

[jira] [Commented] (BEAM-7405) Task :sdks:python:hdfsIntegrationTest is failing in Python PostCommits - docker-credential-gcloud not installed

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125382#comment-17125382 ] Brian Hulette commented on BEAM-7405: - [~udim] what is the action on this now? > Task

[jira] [Commented] (BEAM-5173) org.apache.beam.runners.fnexecution.control.RemoteExecutionTest.testExecutionWithMultipleStages is flaky

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125377#comment-17125377 ] Brian Hulette commented on BEAM-5173: - This still hasn't flaked on PreCommit since the one I linked in

[jira] [Resolved] (BEAM-5173) org.apache.beam.runners.fnexecution.control.RemoteExecutionTest.testExecutionWithMultipleStages is flaky

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved BEAM-5173. - Fix Version/s: Not applicable Resolution: Cannot Reproduce >

[jira] [Commented] (BEAM-9208) Add support for mapping columns to pubsub message attributes in flat schemas DDL

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125374#comment-17125374 ] Brian Hulette commented on BEAM-9208: - I think this should remain P2 > Add support for mapping

[jira] [Updated] (BEAM-9208) Add support for mapping columns to pubsub message attributes in flat schemas DDL

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9208: Labels: (was: stale-P2) > Add support for mapping columns to pubsub message attributes in flat

[jira] [Updated] (BEAM-8330) PubSubIO.readAvros should produce a schema'd PCollection if clazz has a schema

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8330: Labels: (was: stale-P2) > PubSubIO.readAvros should produce a schema'd PCollection if clazz has a

[jira] [Updated] (BEAM-8330) PubSubIO.readAvros should produce a schema'd PCollection if clazz has a schema

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8330: Priority: P3 (was: P2) > PubSubIO.readAvros should produce a schema'd PCollection if clazz has a

[jira] [Resolved] (BEAM-10181) pull_licenses script should create python3 virtualenv

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved BEAM-10181. -- Resolution: Fixed > pull_licenses script should create python3 virtualenv >

[jira] [Updated] (BEAM-10181) pull_licenses script should create python3 virtualenv

2020-06-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-10181: - Fix Version/s: (was: 2.22.0) 2.23.0 > pull_licenses script should create

[jira] [Created] (BEAM-10181) pull_licenses script should create python3 virtualenv

2020-06-02 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-10181: Summary: pull_licenses script should create python3 virtualenv Key: BEAM-10181 URL: https://issues.apache.org/jira/browse/BEAM-10181 Project: Beam Issue

[jira] [Commented] (BEAM-9621) Python SqlTransform follow-ups

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124315#comment-17124315 ] Brian Hulette commented on BEAM-9621: - This is a tracking jira. Not sure how to make Beam Jira Bot

[jira] [Updated] (BEAM-9621) Python SqlTransform follow-ups

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9621: Labels: (was: stale-assigned) > Python SqlTransform follow-ups > -- >

[jira] [Updated] (BEAM-9621) Python SqlTransform follow-ups

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9621: Priority: P4 (was: P2) > Python SqlTransform follow-ups > -- > >

[jira] [Resolved] (BEAM-9390) [PostCommit_Java_PortabilityApi] [BigQuery related ITs] UnsupportedOperationException: BigQuery source must be split before being read

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved BEAM-9390. - Fix Version/s: Not applicable Resolution: Won't Fix This is obsolete since the job in

[jira] [Resolved] (BEAM-8808) TestBigQueryOptions is never registered

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved BEAM-8808. - Fix Version/s: Not applicable Resolution: Won't Fix I don't think this is actually a bug.

[jira] [Commented] (BEAM-8030) Make VarIntCoder overflow behavior consistent

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124284#comment-17124284 ] Brian Hulette commented on BEAM-8030: - I'd still like to take a look at this. > Make VarIntCoder

[jira] [Updated] (BEAM-8030) Make VarIntCoder overflow behavior consistent

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8030: Labels: (was: stale-assigned) > Make VarIntCoder overflow behavior consistent >

[jira] [Assigned] (BEAM-10177) Remove "Review Release Notes in JIRA"

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-10177: Assignee: Brian Hulette > Remove "Review Release Notes in JIRA" >

[jira] [Updated] (BEAM-10177) Remove "Review Release Notes in JIRA"

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-10177: - Status: Open (was: Triage Needed) > Remove "Review Release Notes in JIRA" >

[jira] [Updated] (BEAM-10058) VideoIntelligenceMlTestIT.test_label_detection_with_video_context is flaky

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-10058: - Fix Version/s: (was: 2.23.0) 2.22.0 >

[jira] [Updated] (BEAM-10024) Spark runner failing testOutputTimestampDefault

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-10024: - Fix Version/s: (was: 2.22.0) > Spark runner failing testOutputTimestampDefault >

[jira] [Updated] (BEAM-10050) VideoIntelligenceIT.annotateVideoFromURINoContext is flaky

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-10050: - Fix Version/s: (was: Not applicable) 2.22.0 >

[jira] [Commented] (BEAM-10143) ClassCastException in GROUP BY with non-global window

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124172#comment-17124172 ] Brian Hulette commented on BEAM-10143: -- There are some tests with Window.into and SqlTransform in

[jira] [Commented] (BEAM-9120) Deprecate onSuccessMatcher, onCreateMatcher

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124102#comment-17124102 ] Brian Hulette commented on BEAM-9120: - Lowering priority on this. I'd still like to work on it. I've

[jira] [Updated] (BEAM-9120) Deprecate onSuccessMatcher, onCreateMatcher

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9120: Labels: (was: stale-assigned) > Deprecate onSuccessMatcher, onCreateMatcher >

[jira] [Updated] (BEAM-9120) Deprecate onSuccessMatcher, onCreateMatcher

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9120: Priority: P3 (was: P2) > Deprecate onSuccessMatcher, onCreateMatcher >

[jira] [Commented] (BEAM-4637) Flaky post-commit test org.apache.beam.examples.subprocess.ExampleEchoPipelineTest.testExampleEchoPipeline

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124083#comment-17124083 ] Brian Hulette commented on BEAM-4637: - Closing this as duplicate of BEAM-5286 > Flaky post-commit

[jira] [Closed] (BEAM-4637) Flaky post-commit test org.apache.beam.examples.subprocess.ExampleEchoPipelineTest.testExampleEchoPipeline

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette closed BEAM-4637. --- Fix Version/s: (was: 2.6.0) Not applicable Resolution: Duplicate >

[jira] [Updated] (BEAM-8741) Queries that attempt to write to pubsub publish time should fail at construction time

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8741: Labels: (was: stale-P2) > Queries that attempt to write to pubsub publish time should fail at >

[jira] [Updated] (BEAM-8741) Queries that attempt to write to pubsub publish time should fail at construction time

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8741: Description: Currently it's possible to perform a query like: {code:sql} CREATE TABLE pubsub (

[jira] [Commented] (BEAM-8741) Queries that attempt to write to pubsub publish time should fail at construction time

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124076#comment-17124076 ] Brian Hulette commented on BEAM-8741: - Still P2 > Queries that attempt to write to pubsub publish

[jira] [Updated] (BEAM-8741) Queries that attempt to write to pubsub publish time should fail at construction time

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8741: Summary: Queries that attempt to write to pubsub publish time should fail at construction time

[jira] [Updated] (BEAM-8741) Queries that attempt to write to pubsub publish time should fail

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8741: Status: Open (was: Triage Needed) > Queries that attempt to write to pubsub publish time should

[jira] [Commented] (BEAM-5286) [beam_PostCommit_Java_GradleBuild][org.apache.beam.examples.subprocess.ExampleEchoPipelineTest.testExampleEchoPipeline][Flake] .sh script: text file busy.

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124070#comment-17124070 ] Brian Hulette commented on BEAM-5286: - Raised to P1 per

[jira] [Updated] (BEAM-5286) [beam_PostCommit_Java_GradleBuild][org.apache.beam.examples.subprocess.ExampleEchoPipelineTest.testExampleEchoPipeline][Flake] .sh script: text file busy.

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-5286: Priority: P1 (was: P2) >

[jira] [Commented] (BEAM-5286) [beam_PostCommit_Java_GradleBuild][org.apache.beam.examples.subprocess.ExampleEchoPipelineTest.testExampleEchoPipeline][Flake] .sh script: text file busy.

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124068#comment-17124068 ] Brian Hulette commented on BEAM-5286: - Looks like this is still happening. Here's a failure from June

[jira] [Commented] (BEAM-8560) Construction time schema Validation for writing to BQ

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124055#comment-17124055 ] Brian Hulette commented on BEAM-8560: - Went ahead and unassigned myself since I don't have time for

[jira] [Updated] (BEAM-8560) Construction time schema Validation for writing to BQ

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8560: Priority: P3 (was: P2) > Construction time schema Validation for writing to BQ >

[jira] [Updated] (BEAM-8560) Construction time schema Validation for writing to BQ

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8560: Description: `BigQueryIO.write` should be able to validate the schema of the input PCollection

[jira] [Updated] (BEAM-8560) Construction time schema Validation for writing to BQ

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8560: Labels: (was: stale-assigned) > Construction time schema Validation for writing to BQ >

[jira] [Assigned] (BEAM-8560) Construction time schema Validation for writing to BQ

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-8560: --- Assignee: (was: Brian Hulette) > Construction time schema Validation for writing to BQ >

[jira] [Commented] (BEAM-8438) Update Python/Streaming IO Documentation

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124031#comment-17124031 ] Brian Hulette commented on BEAM-8438: - I think this should still be P2. > Update Python/Streaming IO

[jira] [Updated] (BEAM-8438) Update Python/Streaming IO Documentation

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8438: Labels: (was: stale-P2) > Update Python/Streaming IO Documentation >

[jira] [Updated] (BEAM-7306) [SQL] Add support for distinct aggregations

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-7306: Labels: (was: stale-P2) > [SQL] Add support for distinct aggregations >

[jira] [Updated] (BEAM-7306) [SQL] Add support for distinct aggregations

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-7306: Priority: P3 (was: P2) > [SQL] Add support for distinct aggregations >

[jira] [Commented] (BEAM-8732) Add support for additional structured types to Schemas/RowCoders

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123985#comment-17123985 ] Brian Hulette commented on BEAM-8732: - This is still a P2. Another thing we should think about here:

[jira] [Updated] (BEAM-8732) Add support for additional structured types to Schemas/RowCoders

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8732: Labels: (was: stale-P2) > Add support for additional structured types to Schemas/RowCoders >

[jira] [Updated] (BEAM-8732) Add support for additional structured types to Schemas/RowCoders

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8732: Status: Open (was: Triage Needed) > Add support for additional structured types to

[jira] [Commented] (BEAM-10143) ClassCastException in GROUP BY with non-global window

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123961#comment-17123961 ] Brian Hulette commented on BEAM-10143: -- [~mxm] you haven't seen this happen from Java right? I'm

[jira] [Updated] (BEAM-10143) ClassCastException in GROUP BY with non-global window

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-10143: - Component/s: sdk-py-core > ClassCastException in GROUP BY with non-global window >

[jira] [Updated] (BEAM-9547) Raise NotImplementedError for remaining pandas methods

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9547: Labels: (was: stale-assigned) > Raise NotImplementedError for remaining pandas methods >

[jira] [Assigned] (BEAM-9547) Raise NotImplementedError for remaining pandas methods

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-9547: --- Assignee: Robert Bradshaw (was: Brian Hulette) > Raise NotImplementedError for remaining

[jira] [Commented] (BEAM-8828) BigQueryTableProvider should allow configuration of write disposition

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123940#comment-17123940 ] Brian Hulette commented on BEAM-8828: - Still P2 > BigQueryTableProvider should allow configuration of

[jira] [Updated] (BEAM-8828) BigQueryTableProvider should allow configuration of write disposition

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-8828: Labels: (was: stale-P2) > BigQueryTableProvider should allow configuration of write disposition >

[jira] [Updated] (BEAM-7345) Add support for generics in schema inference

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-7345: Labels: (was: stale-P2) > Add support for generics in schema inference >

[jira] [Commented] (BEAM-7345) Add support for generics in schema inference

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123936#comment-17123936 ] Brian Hulette commented on BEAM-7345: - I think this is legitimately a P3 "nice-to-have" cc: [~kenn]

[jira] [Updated] (BEAM-7345) Add support for generics in schema inference

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-7345: Priority: P3 (was: P2) > Add support for generics in schema inference >

[jira] [Updated] (BEAM-9189) Add Daffodil IO for Apache Beam

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9189: Priority: P3 (was: P2) > Add Daffodil IO for Apache Beam > --- > >

[jira] [Updated] (BEAM-9189) Add Daffodil IO for Apache Beam

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9189: Status: Open (was: Triage Needed) > Add Daffodil IO for Apache Beam >

[jira] [Updated] (BEAM-9189) Add Daffodil IO for Apache Beam

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9189: Labels: gsoc stale-P2 (was: gsoc gsoc2020 mentor stale-P2) > Add Daffodil IO for Apache Beam >

[jira] [Updated] (BEAM-9043) BigQueryIO fails cryptically if gcpTempLocation is set and tempLocation is not

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9043: Status: Open (was: Triage Needed) > BigQueryIO fails cryptically if gcpTempLocation is set and

[jira] [Commented] (BEAM-9043) BigQueryIO fails cryptically if gcpTempLocation is set and tempLocation is not

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123932#comment-17123932 ] Brian Hulette commented on BEAM-9043: - I think this should remain P2 > BigQueryIO fails cryptically

[jira] [Updated] (BEAM-7974) Make RowCoder @Internal

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-7974: Summary: Make RowCoder @Internal (was: Make RowCoder package-private) > Make RowCoder @Internal >

[jira] [Commented] (BEAM-7974) Make RowCoder package-private

2020-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123929#comment-17123929 ] Brian Hulette commented on BEAM-7974: - I don't think this is feasible, maybe we should annotate it

[jira] [Commented] (BEAM-9722) Add batch SnowflakeIO.Read to Java SDK

2020-06-01 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121246#comment-17121246 ] Brian Hulette commented on BEAM-9722: - Updated fix version to 2.23.0 since this wasn't in the 2.22.0

[jira] [Updated] (BEAM-9722) Add batch SnowflakeIO.Read to Java SDK

2020-06-01 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9722: Fix Version/s: (was: 2.22.0) 2.23.0 > Add batch SnowflakeIO.Read to Java SDK

[jira] [Commented] (BEAM-10024) Spark runner failing testOutputTimestampDefault

2020-06-01 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121239#comment-17121239 ] Brian Hulette commented on BEAM-10024: -- Agree it's not great. I would definitely cherrypick a fix

[jira] [Commented] (BEAM-10024) Spark runner failing testOutputTimestampDefault

2020-06-01 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121176#comment-17121176 ] Brian Hulette commented on BEAM-10024: -- I don't think this is worth blocking the release over since

[jira] [Resolved] (BEAM-10121) Python RowCoder doesn't support nested structs

2020-05-29 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved BEAM-10121. -- Resolution: Fixed > Python RowCoder doesn't support nested structs >

[jira] [Updated] (BEAM-10121) Python RowCoder doesn't support nested structs

2020-05-29 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-10121: - Fix Version/s: 2.22.0 > Python RowCoder doesn't support nested structs >

[jira] [Closed] (BEAM-10122) Python RowCoder throws NotImplementedError in DataflowRunner

2020-05-29 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette closed BEAM-10122. Resolution: Fixed > Python RowCoder throws NotImplementedError in DataflowRunner >

[jira] [Resolved] (BEAM-10078) uniquify Dataflow specific jars when staging

2020-05-29 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved BEAM-10078. -- Resolution: Fixed > uniquify Dataflow specific jars when staging >

[jira] [Updated] (BEAM-9621) Python SqlTransform follow-ups

2020-05-29 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-9621: Component/s: cross-language > Python SqlTransform follow-ups > -- > >

[jira] [Resolved] (BEAM-9989) Python Schemas: error encoding from generated user types with an "id" field

2020-05-29 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved BEAM-9989. - Fix Version/s: 2.22.0 Resolution: Fixed > Python Schemas: error encoding from generated

[jira] [Work stopped] (BEAM-10010) Test Python SqlTransform on fn_api_runner

2020-05-29 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-10010 stopped by Brian Hulette. > Test Python SqlTransform on fn_api_runner >

[jira] [Work stopped] (BEAM-9989) Python Schemas: error encoding from generated user types with an "id" field

2020-05-29 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-9989 stopped by Brian Hulette. --- > Python Schemas: error encoding from generated user types with an "id" field >

[jira] [Updated] (BEAM-10122) Python RowCoder throws NotImplementedError in DataflowRunner

2020-05-29 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-10122: - Fix Version/s: 2.22.0 > Python RowCoder throws NotImplementedError in DataflowRunner >

[jira] [Updated] (BEAM-10077) using filename + hash instead of UUID for staging name

2020-05-28 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-10077: - Status: Open (was: Triage Needed) > using filename + hash instead of UUID for staging name >

[jira] [Work started] (BEAM-10121) Python RowCoder doesn't support nested structs

2020-05-27 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-10121 started by Brian Hulette. > Python RowCoder doesn't support nested structs >

[jira] [Created] (BEAM-10122) Python RowCoder throws NotImplementedError in DataflowRunner

2020-05-27 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-10122: Summary: Python RowCoder throws NotImplementedError in DataflowRunner Key: BEAM-10122 URL: https://issues.apache.org/jira/browse/BEAM-10122 Project: Beam

[jira] [Work started] (BEAM-10122) Python RowCoder throws NotImplementedError in DataflowRunner

2020-05-27 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-10122 started by Brian Hulette. > Python RowCoder throws NotImplementedError in DataflowRunner >

[jira] [Created] (BEAM-10121) Python RowCoder doesn't support nested structs

2020-05-27 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-10121: Summary: Python RowCoder doesn't support nested structs Key: BEAM-10121 URL: https://issues.apache.org/jira/browse/BEAM-10121 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-10054) Direct Runner execution stalls with test pipeline

2020-05-27 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118058#comment-17118058 ] Brian Hulette commented on BEAM-10054: -- Should this block the 2.22 release? > Direct Runner

[jira] [Resolved] (BEAM-9974) beam_PostRelease_NightlySnapshot failing

2020-05-27 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved BEAM-9974. - Fix Version/s: 2.23.0 Resolution: Fixed > beam_PostRelease_NightlySnapshot failing >

[jira] [Commented] (BEAM-9974) beam_PostRelease_NightlySnapshot failing

2020-05-27 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117977#comment-17117977 ] Brian Hulette commented on BEAM-9974: - Looks like this was resolved by #11786:

[jira] [Commented] (BEAM-10077) using filename + hash instead of UUID for staging name

2020-05-27 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117928#comment-17117928 ] Brian Hulette commented on BEAM-10077: -- [~heejong] can we close this now that

  1   2   3   4   5   6   >