[jira] [Updated] (BEAM-10016) Flink postcommits failing testFlattenWithDifferentInputAndOutputCoders2

2020-05-15 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-10016: --- Status: Open (was: Triage Needed) > Flink postcommits failing

[jira] [Assigned] (BEAM-10016) Flink postcommits failing testFlattenWithDifferentInputAndOutputCoders2

2020-05-15 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-10016: -- Assignee: Kyle Weaver > Flink postcommits failing

[jira] [Commented] (BEAM-9950) cannot find symbol javax.annotation.Generated

2020-05-15 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108755#comment-17108755 ] Kyle Weaver commented on BEAM-9950: --- [~iemejia] suggested this was because there's Java 11 somewhere,

[jira] [Resolved] (BEAM-3372) Duplicated 'zone' PipelineOption has inconsistent documentation

2020-05-15 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-3372. --- Fix Version/s: Not applicable Assignee: Kyle Weaver Resolution: Fixed The linked PR

[jira] [Created] (BEAM-9997) Improve step names in portable runners

2020-05-14 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9997: - Summary: Improve step names in portable runners Key: BEAM-9997 URL: https://issues.apache.org/jira/browse/BEAM-9997 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-9996) Flink should not shadow FnApiRunnerTest.test_metrics

2020-05-14 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9996: - Summary: Flink should not shadow FnApiRunnerTest.test_metrics Key: BEAM-9996 URL: https://issues.apache.org/jira/browse/BEAM-9996 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-9001) Allow setting environment ID to all transforms in the SDK

2020-05-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9001. --- Resolution: Fixed > Allow setting environment ID to all transforms in the SDK >

[jira] [Updated] (BEAM-9988) Upgrade google-cloud-pubsub to version >=1.4.2

2020-05-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9988: -- Fix Version/s: (was: 2.21.0) > Upgrade google-cloud-pubsub to version >=1.4.2 >

[jira] [Created] (BEAM-9993) Add option defaults for Flink Python tests

2020-05-13 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9993: - Summary: Add option defaults for Flink Python tests Key: BEAM-9993 URL: https://issues.apache.org/jira/browse/BEAM-9993 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-7219) Spark portable runner: support Spark metrics

2020-05-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106702#comment-17106702 ] Kyle Weaver commented on BEAM-7219: --- For the test_metrics failure, I found that metrics are being passed

[jira] [Commented] (BEAM-9971) beam_PostCommit_Java_PVR_Spark_Batch flakes (no such file)

2020-05-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106657#comment-17106657 ] Kyle Weaver commented on BEAM-9971: --- Looking at https://scans.gradle.com/s/v7kky5x7nxiwy, it seems the

[jira] [Resolved] (BEAM-9945) Use consistent element count for progress counter.

2020-05-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9945. --- Resolution: Fixed > Use consistent element count for progress counter. >

[jira] [Commented] (BEAM-9971) beam_PostCommit_Java_PVR_Spark_Batch flakes (no such file)

2020-05-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106646#comment-17106646 ] Kyle Weaver commented on BEAM-9971: --- This also happens with other jars, such as:

[jira] [Commented] (BEAM-9975) PortableRunnerTest flake "ParseError: Unexpected type for Value message."

2020-05-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106612#comment-17106612 ] Kyle Weaver commented on BEAM-9975: --- > Could we add a log error before the raise and log the value

[jira] [Commented] (BEAM-9971) beam_PostCommit_Java_PVR_Spark_Batch flakes (no such file)

2020-05-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106609#comment-17106609 ] Kyle Weaver commented on BEAM-9971: --- This has afflicted the last 5 builds. >

[jira] [Resolved] (BEAM-9213) FlinkRunner ignores --flink_submit_uber_jar when master unset

2020-05-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9213. --- Fix Version/s: Not applicable Resolution: Won't Fix This issue is superseded by BEAM-9986. >

[jira] [Created] (BEAM-9986) Make --flink_submit_uber_jar the default.

2020-05-13 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9986: - Summary: Make --flink_submit_uber_jar the default. Key: BEAM-9986 URL: https://issues.apache.org/jira/browse/BEAM-9986 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-9976) FlinkSavepointTest timeout flake

2020-05-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106508#comment-17106508 ] Kyle Weaver commented on BEAM-9976: --- https://scans.gradle.com/s/6cokekk7btld4 > FlinkSavepointTest

[jira] [Created] (BEAM-9983) bigquery_read_it_test.ReadNewTypesTests.test_iobase_source failing

2020-05-13 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9983: - Summary: bigquery_read_it_test.ReadNewTypesTests.test_iobase_source failing Key: BEAM-9983 URL: https://issues.apache.org/jira/browse/BEAM-9983 Project: Beam

[jira] [Updated] (BEAM-9983) bigquery_read_it_test.ReadNewTypesTests.test_iobase_source failing

2020-05-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9983: -- Status: Open (was: Triage Needed) > bigquery_read_it_test.ReadNewTypesTests.test_iobase_source failing

[jira] [Commented] (BEAM-9934) Resolve differences in beam:metric:element_count:v1 implementations

2020-05-12 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105846#comment-17105846 ] Kyle Weaver commented on BEAM-9934: --- What's the status on this one? Are we going to try to fix this for

[jira] [Commented] (BEAM-9935) Resolve differences in allowed_split_point implementations

2020-05-12 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105842#comment-17105842 ] Kyle Weaver commented on BEAM-9935: --- https://github.com/apache/beam/pull/11671 solved this for Python,

[jira] [Updated] (BEAM-9935) Resolve differences in allowed_split_point implementations

2020-05-12 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9935: -- Fix Version/s: (was: 2.21.0) 2.22.0 > Resolve differences in allowed_split_point

[jira] [Resolved] (BEAM-9945) Use consistent element count for progress counter.

2020-05-12 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9945. --- Resolution: Fixed > Use consistent element count for progress counter. >

[jira] [Commented] (BEAM-9975) PortableRunnerTest flake "ParseError: Unexpected type for Value message."

2020-05-12 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105836#comment-17105836 ] Kyle Weaver commented on BEAM-9975: --- The error message makes it impossible to tell which option is

[jira] [Updated] (BEAM-9975) PortableRunnerTest flake "ParseError: Unexpected type for Value message."

2020-05-12 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9975: -- Description: Error looks similar to the one in BEAM-9907. Example from

[jira] [Created] (BEAM-9976) FlinkSavepointTest timeout flake

2020-05-12 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9976: - Summary: FlinkSavepointTest timeout flake Key: BEAM-9976 URL: https://issues.apache.org/jira/browse/BEAM-9976 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-9974) beam_PostRelease_NightlySnapshot failing

2020-05-12 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9974: - Summary: beam_PostRelease_NightlySnapshot failing Key: BEAM-9974 URL: https://issues.apache.org/jira/browse/BEAM-9974 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-9973) beam_PostCommit_Py_ValCont flakes (before running tests)

2020-05-12 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9973: - Summary: beam_PostCommit_Py_ValCont flakes (before running tests) Key: BEAM-9973 URL: https://issues.apache.org/jira/browse/BEAM-9973 Project: Beam Issue Type:

[jira] [Created] (BEAM-9971) beam_PostCommit_Java_PVR_Spark_Batch flakes (no such file)

2020-05-12 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9971: - Summary: beam_PostCommit_Java_PVR_Spark_Batch flakes (no such file) Key: BEAM-9971 URL: https://issues.apache.org/jira/browse/BEAM-9971 Project: Beam Issue Type:

[jira] [Created] (BEAM-9970) beam_PostRelease_NightlySnapshot failing

2020-05-12 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9970: - Summary: beam_PostRelease_NightlySnapshot failing Key: BEAM-9970 URL: https://issues.apache.org/jira/browse/BEAM-9970 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-9965) Explain direct runner running modes

2020-05-12 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9965: - Summary: Explain direct runner running modes Key: BEAM-9965 URL: https://issues.apache.org/jira/browse/BEAM-9965 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-9956) Bad formatting on environments page

2020-05-11 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9956: - Summary: Bad formatting on environments page Key: BEAM-9956 URL: https://issues.apache.org/jira/browse/BEAM-9956 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-9214) TypeError: GetJobMetrics() missing 1 required positional argument: 'context'

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9214. --- Fix Version/s: Not applicable Resolution: Duplicate > TypeError: GetJobMetrics() missing 1

[jira] [Resolved] (BEAM-9600) Implement GetJobMetrics in Flink uber jar job server

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9600. --- Fix Version/s: 2.22.0 Resolution: Fixed > Implement GetJobMetrics in Flink uber jar job server

[jira] [Resolved] (BEAM-9860) Make job_endpoint required for PortableRunner

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9860. --- Fix Version/s: 2.22.0 Resolution: Fixed > Make job_endpoint required for PortableRunner >

[jira] [Resolved] (BEAM-9875) PR11585 breaks python2PostCommit cross-lang suite

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9875. --- Fix Version/s: 2.22.0 Resolution: Fixed > PR11585 breaks python2PostCommit cross-lang suite >

[jira] [Commented] (BEAM-9164) [PreCommit_Java] [Flake] UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104924#comment-17104924 ] Kyle Weaver commented on BEAM-9164: --- Note that we are ignoring this test for now:

[jira] [Resolved] (BEAM-9835) test_multimap_multiside_input failing on Spark Python

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9835. --- Fix Version/s: 2.22.0 Resolution: Fixed > test_multimap_multiside_input failing on Spark

[jira] [Updated] (BEAM-9950) cannot find symbol javax.annotation.Generated

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9950: -- Description: This happens when I run through Intellij but not when I run the same command on the

[jira] [Commented] (BEAM-9950) cannot find symbol javax.annotation.Generated

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104876#comment-17104876 ] Kyle Weaver commented on BEAM-9950: --- I've tried clearing Gradle and Maven caches, but nothing works so

[jira] [Commented] (BEAM-9950) cannot find symbol javax.annotation.Generated

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104870#comment-17104870 ] Kyle Weaver commented on BEAM-9950: --- https://github.com/grpc/grpc-java/issues/3633 > cannot find symbol

[jira] [Resolved] (BEAM-9216) Unable to run job server

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9216. --- Fix Version/s: 2.22.0 Resolution: Fixed > Unable to run job server >

[jira] [Updated] (BEAM-9216) Unable to run job server

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9216: -- Status: Open (was: Triage Needed) > Unable to run job server > > >

[jira] [Commented] (BEAM-8219) crossLanguagePortableWordCount seems to be flaky for beam_PostCommit_Python2

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104761#comment-17104761 ] Kyle Weaver commented on BEAM-8219: --- Pablo, the error you are seeing is BEAM-9875. The links in the

[jira] [Created] (BEAM-9950) cannot find symbol javax.annotation.Generated

2020-05-11 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9950: - Summary: cannot find symbol javax.annotation.Generated Key: BEAM-9950 URL: https://issues.apache.org/jira/browse/BEAM-9950 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-9945) Use consistent element count for progress counter.

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-9945: - Assignee: Robert Bradshaw > Use consistent element count for progress counter. >

[jira] [Commented] (BEAM-9216) Unable to run job server

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104737#comment-17104737 ] Kyle Weaver commented on BEAM-9216: --- Thanks for investigating Borzoo. It seems the reason Katas have

[jira] [Commented] (BEAM-9872) Upgrade Spark Python validates runner tests to Python 3

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104714#comment-17104714 ] Kyle Weaver commented on BEAM-9872: --- Beam currently supports Python 2.7, 3.5, 3.6, and 3.7. Current

[jira] [Commented] (BEAM-9216) Unable to run job server

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104697#comment-17104697 ] Kyle Weaver commented on BEAM-9216: --- I was able to reproduce this error by running

[jira] [Updated] (BEAM-9948) Add Firefly to website

2020-05-11 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9948: -- Status: Open (was: Triage Needed) > Add Firefly to website > -- > >

[jira] [Created] (BEAM-9948) Add Firefly to website

2020-05-11 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9948: - Summary: Add Firefly to website Key: BEAM-9948 URL: https://issues.apache.org/jira/browse/BEAM-9948 Project: Beam Issue Type: New Feature Components:

[jira] [Commented] (BEAM-7219) Spark portable runner: support Spark metrics

2020-05-08 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102995#comment-17102995 ] Kyle Weaver commented on BEAM-7219: --- I'll consider this resolved when test_metrics passes

[jira] [Assigned] (BEAM-9835) test_multimap_multiside_input failing on Spark Python

2020-05-08 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-9835: - Assignee: Kyle Weaver > test_multimap_multiside_input failing on Spark Python >

[jira] [Updated] (BEAM-9835) test_multimap_multiside_input failing on Spark Python

2020-05-08 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9835: -- Status: Open (was: Triage Needed) > test_multimap_multiside_input failing on Spark Python >

[jira] [Issue Comment Deleted] (BEAM-9835) test_multimap_multiside_input failing on Spark Python

2020-05-08 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9835: -- Comment: was deleted (was: I am leaving this as a starter task for an incoming intern. The failure can

[jira] [Commented] (BEAM-9835) test_multimap_multiside_input failing on Spark Python

2020-05-08 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102843#comment-17102843 ] Kyle Weaver commented on BEAM-9835: --- I am leaving this as a starter task for an incoming intern. The

[jira] [Resolved] (BEAM-4782) Enforce KV coders for MultiMap side inputs

2020-05-08 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-4782. --- Fix Version/s: 2.14.0 Assignee: Udi Meiri (was: Robert Bradshaw) Resolution: Fixed >

[jira] [Commented] (BEAM-4782) Enforce KV coders for MultiMap side inputs

2020-05-08 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102815#comment-17102815 ] Kyle Weaver commented on BEAM-4782: --- Looks like this was fixed by

[jira] [Closed] (BEAM-9862) test_multimap_multiside_input breaks Spark python VR test

2020-05-07 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver closed BEAM-9862. - Fix Version/s: Not applicable Resolution: Duplicate > test_multimap_multiside_input breaks Spark

[jira] [Resolved] (BEAM-9908) Python components in release script are broken.

2020-05-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9908. --- Fix Version/s: Not applicable Resolution: Fixed > Python components in release script are

[jira] [Created] (BEAM-9908) Python components in release script are broken.

2020-05-06 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9908: - Summary: Python components in release script are broken. Key: BEAM-9908 URL: https://issues.apache.org/jira/browse/BEAM-9908 Project: Beam Issue Type: Bug

[jira] [Comment Edited] (BEAM-9888) @RequiresTimeSortedInput might feed data out of order

2020-05-05 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100351#comment-17100351 ] Kyle Weaver edited comment on BEAM-9888 at 5/6/20, 12:24 AM: - I have already

[jira] [Commented] (BEAM-9888) @RequiresTimeSortedInput might feed data out of order

2020-05-05 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100351#comment-17100351 ] Kyle Weaver commented on BEAM-9888: --- I have already mostly built the release candidate, so I'd prefer if

[jira] [Commented] (BEAM-9880) touch: build/target/third_party_licenses/skip: No such file or directory

2020-05-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099353#comment-17099353 ] Kyle Weaver commented on BEAM-9880: --- I am running all these commands from the Beam root directory by the

[jira] [Updated] (BEAM-9880) touch: build/target/third_party_licenses/skip: No such file or directory

2020-05-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9880: -- Status: Open (was: Triage Needed) > touch: build/target/third_party_licenses/skip: No such file or

[jira] [Commented] (BEAM-9880) touch: build/target/third_party_licenses/skip: No such file or directory

2020-05-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099346#comment-17099346 ] Kyle Weaver commented on BEAM-9880: --- Same error happens when I do ./gradlew :sdks:java:container:docker.

[jira] [Commented] (BEAM-9880) touch: build/target/third_party_licenses/skip: No such file or directory

2020-05-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099333#comment-17099333 ] Kyle Weaver commented on BEAM-9880: --- This happened on head.

[jira] [Resolved] (BEAM-9877) Eager size estimation of large group-by-key iterables cause expensive / duplicate reads

2020-05-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9877. --- Fix Version/s: 2.21.0 Resolution: Fixed > Eager size estimation of large group-by-key

[jira] [Closed] (BEAM-9843) Flink UnboundedSourceWrapperTest flaky due to a timeout

2020-05-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver closed BEAM-9843. - Fix Version/s: Not applicable Resolution: Duplicate > Flink UnboundedSourceWrapperTest flaky due

[jira] [Updated] (BEAM-9164) [PreCommit_Java] [Flake] UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest

2020-05-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9164: -- Issue Type: Bug (was: Improvement) > [PreCommit_Java] [Flake] >

[jira] [Created] (BEAM-9880) touch: build/target/third_party_licenses/skip: No such file or directory

2020-05-04 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9880: - Summary: touch: build/target/third_party_licenses/skip: No such file or directory Key: BEAM-9880 URL: https://issues.apache.org/jira/browse/BEAM-9880 Project: Beam

[jira] [Created] (BEAM-9878) Update ElementByteSizeObservableIterable

2020-05-04 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9878: - Summary: Update ElementByteSizeObservableIterable Key: BEAM-9878 URL: https://issues.apache.org/jira/browse/BEAM-9878 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-9870) Beam protos created without fn_api set incompatible with Dataflow on FnAPI.

2020-05-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-9870. --- Resolution: Fixed > Beam protos created without fn_api set incompatible with Dataflow on FnAPI. >

[jira] [Updated] (BEAM-9875) PR11585 breaks python2PostCommit cross-lang suite

2020-05-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9875: -- Status: Open (was: Triage Needed) > PR11585 breaks python2PostCommit cross-lang suite >

[jira] [Assigned] (BEAM-9875) PR11585 breaks python2PostCommit cross-lang suite

2020-05-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-9875: - Assignee: Kyle Weaver > PR11585 breaks python2PostCommit cross-lang suite >

[jira] [Created] (BEAM-9872) Upgrade Spark Python validates runner tests to Python 3

2020-05-01 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9872: - Summary: Upgrade Spark Python validates runner tests to Python 3 Key: BEAM-9872 URL: https://issues.apache.org/jira/browse/BEAM-9872 Project: Beam Issue Type:

[jira] [Updated] (BEAM-7246) Add Google Spanner IO on Python SDK

2020-05-01 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-7246: -- Fix Version/s: (was: 2.21.0) > Add Google Spanner IO on Python SDK >

[jira] [Updated] (BEAM-9840) Support for Parameterized Types when converting from HCatRecords to Rows in HCatalogIO

2020-05-01 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9840: -- Fix Version/s: (was: 2.21.0) > Support for Parameterized Types when converting from HCatRecords to

[jira] [Commented] (BEAM-9840) Support for Parameterized Types when converting from HCatRecords to Rows in HCatalogIO

2020-05-01 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097608#comment-17097608 ] Kyle Weaver commented on BEAM-9840: --- Removed fix version since 2.21 release branch is already cut and

[jira] [Updated] (BEAM-9822) SpannerIO: Reduce memory usage - especially when streaming

2020-05-01 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9822: -- Fix Version/s: (was: 2.21.0) > SpannerIO: Reduce memory usage - especially when streaming >

[jira] [Updated] (BEAM-9821) SpannerIO does not include all batching parameters in DisplayData.

2020-05-01 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9821: -- Fix Version/s: (was: 2.21.0) > SpannerIO does not include all batching parameters in DisplayData. >

[jira] [Assigned] (BEAM-9860) Make job_endpoint required for PortableRunner

2020-04-30 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-9860: - Assignee: Kyle Weaver > Make job_endpoint required for PortableRunner >

[jira] [Updated] (BEAM-9860) Make job_endpoint required for PortableRunner

2020-04-30 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9860: -- Status: Open (was: Triage Needed) > Make job_endpoint required for PortableRunner >

[jira] [Created] (BEAM-9857) Update Spark runner page to include Docker job server

2020-04-29 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9857: - Summary: Update Spark runner page to include Docker job server Key: BEAM-9857 URL: https://issues.apache.org/jira/browse/BEAM-9857 Project: Beam Issue Type:

[jira] [Updated] (BEAM-9857) Update Spark runner page to include Docker job server

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9857: -- Status: Open (was: Triage Needed) > Update Spark runner page to include Docker job server >

[jira] [Commented] (BEAM-7576) Automatically push flink job-server-container to hub.docker

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095809#comment-17095809 ] Kyle Weaver commented on BEAM-7576: --- Beam has published Flink job server images for the last several

[jira] [Resolved] (BEAM-7576) Automatically push flink job-server-container to hub.docker

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-7576. --- Fix Version/s: Not applicable Assignee: Kyle Weaver Resolution: Fixed > Automatically

[jira] [Resolved] (BEAM-6328) Provide environment option for JobServer container URL

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-6328. --- Fix Version/s: Not applicable Resolution: Fixed > Provide environment option for JobServer

[jira] [Updated] (BEAM-9745) [beam_PostCommit_Java_PortabilityApi] Various GCP IO tests failing, unable to deserialize Custom DoFns and Custom Coders.

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9745: -- Fix Version/s: (was: 2.21.0) > [beam_PostCommit_Java_PortabilityApi] Various GCP IO tests failing,

[jira] [Updated] (BEAM-9745) [beam_PostCommit_Java_PortabilityApi] Various GCP IO tests failing, unable to deserialize Custom DoFns and Custom Coders.

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9745: -- Priority: Major (was: Critical) > [beam_PostCommit_Java_PortabilityApi] Various GCP IO tests failing,

[jira] [Commented] (BEAM-9745) [beam_PostCommit_Java_PortabilityApi] Various GCP IO tests failing, unable to deserialize Custom DoFns and Custom Coders.

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095732#comment-17095732 ] Kyle Weaver commented on BEAM-9745: --- This was only marked with high priority out of an abundance of

[jira] [Commented] (BEAM-5397) Flink portable runner GRPC cleanup failure after user class loader was removed

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095728#comment-17095728 ] Kyle Weaver commented on BEAM-5397: --- Apparently this is still happening in 2.20.0:

[jira] [Updated] (BEAM-9852) C-ares status is not ARES_SUCCESS: Misformatted domain name

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9852: -- Parent: BEAM-9853 Issue Type: Sub-task (was: Bug) > C-ares status is not ARES_SUCCESS:

[jira] [Updated] (BEAM-9793) Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9793: -- Parent: BEAM-9853 Issue Type: Sub-task (was: Bug) > Method not found: >

[jira] [Updated] (BEAM-9082) "Socket closed" Spurious GRPC errors in Flink/Spark runner log output

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9082: -- Summary: "Socket closed" Spurious GRPC errors in Flink/Spark runner log output (was: Spurious GRPC

[jira] [Updated] (BEAM-9082) Spurious GRPC errors in Flink/Spark runner log output

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9082: -- Parent: BEAM-9853 Issue Type: Sub-task (was: Improvement) > Spurious GRPC errors in

[jira] [Created] (BEAM-9853) Remove spurious or irrelevant error messages from portable runner log output.

2020-04-29 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-9853: - Summary: Remove spurious or irrelevant error messages from portable runner log output. Key: BEAM-9853 URL: https://issues.apache.org/jira/browse/BEAM-9853 Project: Beam

[jira] [Updated] (BEAM-9852) C-ares status is not ARES_SUCCESS: Misformatted domain name

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9852: -- Description: This affects both Flink and Spark portable runners. It does not appear to cause pipelines

[jira] [Issue Comment Deleted] (BEAM-9793) Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService

2020-04-29 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-9793: -- Comment: was deleted (was: I'm not sure if ...ReverseArtifactRetrievalService is the root cause. There

<    1   2   3   4   5   6   7   8   9   10   >