[jira] [Resolved] (BEAM-8947) Change Jenkins jobs configuration to account for new Flink Docker image names

2019-12-19 Thread Michal Walenia (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Walenia resolved BEAM-8947. -- Fix Version/s: Not applicable Resolution: Fixed > Change Jenkins jobs configuration to

[jira] [Assigned] (BEAM-8941) Create a common place for Load Tests configuration

2019-12-19 Thread Pawel Pasterz (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Pasterz reassigned BEAM-8941: --- Assignee: Pawel Pasterz > Create a common place for Load Tests configuration >

[jira] [Created] (BEAM-9008) add readAll() method to CassandraIO

2019-12-19 Thread vincent marquez (Jira)
vincent marquez created BEAM-9008: - Summary: add readAll() method to CassandraIO Key: BEAM-9008 URL: https://issues.apache.org/jira/browse/BEAM-9008 Project: Beam Issue Type: New Feature

[jira] [Work logged] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?focusedWorklogId=361515=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-361515 ] ASF GitHub Bot logged work on BEAM-9005: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-9000) Java Test Assertions without toString for GenericJson subclasses

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomo Suzuki updated BEAM-9000: -- Description: As of now, there are many tests that assert on {{toString()}} of objects. {code:java}

[jira] [Updated] (BEAM-9000) Java Test Assertions without toString for GenericJson subclasses

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomo Suzuki updated BEAM-9000: -- Description: As of now, there are many tests that assert on {{toString()}} of objects. {code:java}

[jira] [Updated] (BEAM-9007) beam.DoFn setup() will call several times when using python subprocess

2019-12-19 Thread Hokuto Tateyama (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hokuto Tateyama updated BEAM-9007: -- Summary: beam.DoFn setup() will call several times when using python subprocess (was:

[jira] [Updated] (BEAM-9007) beam.ParDo setup() will call several times when using python subprocess

2019-12-19 Thread Hokuto Tateyama (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hokuto Tateyama updated BEAM-9007: -- Description: Hello. I`m trying to use a make command on dataflow to use OpenCV source written

[jira] [Created] (BEAM-9007) beam.ParDo setup() will call several times when using python subprocess

2019-12-19 Thread Hokuto Tateyama (Jira)
Hokuto Tateyama created BEAM-9007: - Summary: beam.ParDo setup() will call several times when using python subprocess Key: BEAM-9007 URL: https://issues.apache.org/jira/browse/BEAM-9007 Project: Beam

[jira] [Updated] (BEAM-9006) Meta space memory leak caused by the shutdown hook of ProcessManager

2019-12-19 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-9006: -- Fix Version/s: (was: 2.18.0) 2.19.0 > Meta space memory leak caused by the

[jira] [Created] (BEAM-9006) Meta space memory leak caused by the shutdown hook of ProcessManager

2019-12-19 Thread sunjincheng (Jira)
sunjincheng created BEAM-9006: - Summary: Meta space memory leak caused by the shutdown hook of ProcessManager Key: BEAM-9006 URL: https://issues.apache.org/jira/browse/BEAM-9006 Project: Beam

[jira] [Updated] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-9005: Summary: Go SDK post-commit failures due to

[jira] [Updated] (BEAM-9005) beam_PostCommit_Go_VR_Flink failure due to https://github.com/apache/beam/pull/10183

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-9005: Issue Type: Bug (was: Improvement) > beam_PostCommit_Go_VR_Flink

[jira] [Created] (BEAM-9005) beam_PostCommit_Go_VR_Flink failure due to https://github.com/apache/beam/pull/10183

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9005: --- Summary: beam_PostCommit_Go_VR_Flink failure due to https://github.com/apache/beam/pull/10183 Key: BEAM-9005 URL:

[jira] [Work logged] (BEAM-8944) Python SDK harness performance degradation with UnboundedThreadPoolExecutor

2019-12-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8944?focusedWorklogId=361501=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-361501 ] ASF GitHub Bot logged work on BEAM-8944: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-8269) IOTypehints.from_callable doesn't convert native type hints to Beam

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-8269. - Fix Version/s: Not applicable Resolution: Fixed > IOTypehints.from_callable doesn't convert native

[jira] [Created] (BEAM-9004) Update Mockito Matchers usage to ArgumentMatchers since Matchers is deprecated in Mockito 2

2019-12-19 Thread Luke Cwik (Jira)
Luke Cwik created BEAM-9004: --- Summary: Update Mockito Matchers usage to ArgumentMatchers since Matchers is deprecated in Mockito 2 Key: BEAM-9004 URL: https://issues.apache.org/jira/browse/BEAM-9004

[jira] [Resolved] (BEAM-8976) No default logging story for Pipeline construction time in Python

2019-12-19 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-8976. - Resolution: Fixed > No default logging story for Pipeline construction time in Python >

[jira] [Comment Edited] (BEAM-106) Native support for conditional iteration

2019-12-19 Thread Luke Cwik (Jira)
[ https://issues.apache.org/jira/browse/BEAM-106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000494#comment-17000494 ] Luke Cwik edited comment on BEAM-106 at 12/20/19 12:04 AM: --- [~nishant009]: Does

[jira] [Commented] (BEAM-106) Native support for conditional iteration

2019-12-19 Thread Luke Cwik (Jira)
[ https://issues.apache.org/jira/browse/BEAM-106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000494#comment-17000494 ] Luke Cwik commented on BEAM-106: [~nishant009]: Does using a glob expression for the path work when

[jira] [Commented] (BEAM-8968) portableWordCount test for Spark/Flink failing: jar not found

2019-12-19 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000492#comment-17000492 ] Valentyn Tymofieiev commented on BEAM-8968: --- This is still failing on

[jira] [Commented] (BEAM-9002) test_flatten_same_pcollections (apache_beam.transforms.ptransform_test.PTransformTest) does not work in Streaming VR suite on Dataflow

2019-12-19 Thread wendy liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000488#comment-17000488 ] wendy liu commented on BEAM-9002: - Hi Valentyn, I'm OK with sickbay it, but I don't think I'm the right

[jira] [Commented] (BEAM-8877) beam_PostCommit_Py_VR_Dataflow is timing out

2019-12-19 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000487#comment-17000487 ] Valentyn Tymofieiev commented on BEAM-8877: --- Thanks, [~liumomo315]. I filed individual failures

[jira] [Work logged] (BEAM-8877) beam_PostCommit_Py_VR_Dataflow is timing out

2019-12-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8877?focusedWorklogId=361497=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-361497 ] ASF GitHub Bot logged work on BEAM-8877: Author: ASF GitHub Bot

[jira] [Created] (BEAM-9003) test_reshuffle_preserves_timestamps (apache_beam.transforms.util_test.ReshuffleTest) does not work in Streaming VR suite on Dataflow

2019-12-19 Thread Valentyn Tymofieiev (Jira)
Valentyn Tymofieiev created BEAM-9003: - Summary: test_reshuffle_preserves_timestamps (apache_beam.transforms.util_test.ReshuffleTest) does not work in Streaming VR suite on Dataflow Key: BEAM-9003 URL:

[jira] [Updated] (BEAM-9002) test_flatten_same_pcollections (apache_beam.transforms.ptransform_test.PTransformTest) does not work in Streaming VR suite on Dataflow

2019-12-19 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-9002: -- Description: Per investigation in https://issues.apache.org/jira/browse/BEAM-8877, the

[jira] [Created] (BEAM-9002) test_flatten_same_pcollections (apache_beam.transforms.ptransform_test.PTransformTest) does not work in Streaming VR suite on Dataflow

2019-12-19 Thread Valentyn Tymofieiev (Jira)
Valentyn Tymofieiev created BEAM-9002: - Summary: test_flatten_same_pcollections (apache_beam.transforms.ptransform_test.PTransformTest) does not work in Streaming VR suite on Dataflow Key: BEAM-9002 URL:

[jira] [Updated] (BEAM-8994) add goVet to goPreCommit

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-8994: Labels: easy newbie starter (was: ) > add goVet to goPreCommit > > >

[jira] [Commented] (BEAM-8944) Python SDK harness performance degradation with UnboundedThreadPoolExecutor

2019-12-19 Thread Yichi Zhang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000448#comment-17000448 ] Yichi Zhang commented on BEAM-8944: --- then yeah, it'll affect python streaming jobs (which is only on

[jira] [Commented] (BEAM-8944) Python SDK harness performance degradation with UnboundedThreadPoolExecutor

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000445#comment-17000445 ] Udi Meiri commented on BEAM-8944: - The point of my question is to figure whether this issue is a 2.18

[jira] [Comment Edited] (BEAM-8695) Beam Dependency Update Request: com.google.http-client:google-http-client

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000402#comment-17000402 ] Tomo Suzuki edited comment on BEAM-8695 at 12/19/19 10:03 PM: -- Failures on

[jira] [Commented] (BEAM-8877) beam_PostCommit_Py_VR_Dataflow is timing out

2019-12-19 Thread wendy liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000444#comment-17000444 ] wendy liu commented on BEAM-8877: - I think the test_flatten_same_pcollections should be supported by both

[jira] [Commented] (BEAM-8944) Python SDK harness performance degradation with UnboundedThreadPoolExecutor

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000443#comment-17000443 ] Udi Meiri commented on BEAM-8944: - By current I don't mean the current Beam release but the current

[jira] [Comment Edited] (BEAM-8695) Beam Dependency Update Request: com.google.http-client:google-http-client

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000402#comment-17000402 ] Tomo Suzuki edited comment on BEAM-8695 at 12/19/19 9:37 PM: - Failures on

[jira] [Comment Edited] (BEAM-8695) Beam Dependency Update Request: com.google.http-client:google-http-client

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000402#comment-17000402 ] Tomo Suzuki edited comment on BEAM-8695 at 12/19/19 9:25 PM: - Failures on

[jira] [Commented] (BEAM-8695) Beam Dependency Update Request: com.google.http-client:google-http-client

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000402#comment-17000402 ] Tomo Suzuki commented on BEAM-8695: --- Failures on

[jira] [Updated] (BEAM-8695) Beam Dependency Update Request: com.google.http-client:google-http-client

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomo Suzuki updated BEAM-8695: -- Attachment: LengthPrefixUnknownCodersTest.testLengthPrefixUnknownCoders.png > Beam Dependency Update

[jira] [Created] (BEAM-9001) Allow setting environment ID to all transforms in the SDK

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9001: --- Summary: Allow setting environment ID to all transforms in the SDK Key: BEAM-9001 URL: https://issues.apache.org/jira/browse/BEAM-9001

[jira] [Comment Edited] (BEAM-8695) Beam Dependency Update Request: com.google.http-client:google-http-client

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999527#comment-16999527 ] Tomo Suzuki edited comment on BEAM-8695 at 12/19/19 9:11 PM: -

[jira] [Commented] (BEAM-8974) apache_beam.runners.worker.log_handler_test.FnApiLogRecordHandlerTest.test_exc_info is flaky

2019-12-19 Thread Jira
[ https://issues.apache.org/jira/browse/BEAM-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000368#comment-17000368 ] Ismaël Mejía commented on BEAM-8974: If I removed the tag probably it was because I misread that this

[jira] [Updated] (BEAM-8974) apache_beam.runners.worker.log_handler_test.FnApiLogRecordHandlerTest.test_exc_info is flaky

2019-12-19 Thread Jira
[ https://issues.apache.org/jira/browse/BEAM-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-8974: --- Fix Version/s: 2.18.0 >

[jira] [Updated] (BEAM-9000) Java Test Assertions without toString for GenericJson subclasses

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomo Suzuki updated BEAM-9000: -- Description: As of now, there are many tests that assert on {{toString()}} of objects. {code:java}

[jira] [Updated] (BEAM-9000) Java Test Assertions without toString for GenericJson subclasses

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomo Suzuki updated BEAM-9000: -- Description: As of now, there are many tests that assert on {{toString()}} of objects. {code:java}

[jira] [Updated] (BEAM-9000) Java Test Assertions without toString for GenericJson subclasses

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomo Suzuki updated BEAM-9000: -- Description: As of now, there are many tests that assert on {{toString()}} of objects. {code:java}

[jira] [Commented] (BEAM-8195) Quota exceeded for create requests

2019-12-19 Thread Alan Myrvold (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000346#comment-17000346 ] Alan Myrvold commented on BEAM-8195: Also, Quota for Job creation requests per minute per user has

[jira] [Work logged] (BEAM-8960) Add an option for user to be able to opt out of using insert id for BigQuery streaming insert.

2019-12-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8960?focusedWorklogId=361485=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-361485 ] ASF GitHub Bot logged work on BEAM-8960: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8195) Quota exceeded for create requests

2019-12-19 Thread Alan Myrvold (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000345#comment-17000345 ] Alan Myrvold commented on BEAM-8195: Yes, dataflow_v1b3_client.py is auto generated, so best not to

[jira] [Comment Edited] (BEAM-8944) Python SDK harness performance degradation with UnboundedThreadPoolExecutor

2019-12-19 Thread Yichi Zhang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000341#comment-17000341 ] Yichi Zhang edited comment on BEAM-8944 at 12/19/19 8:14 PM: - This bug doesn't

[jira] [Commented] (BEAM-8877) beam_PostCommit_Py_VR_Dataflow is timing out

2019-12-19 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000340#comment-17000340 ] Valentyn Tymofieiev commented on BEAM-8877: --- Both tests have recently been marked as

[jira] [Commented] (BEAM-8825) OOM when writing large numbers of 'narrow' rows

2019-12-19 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000338#comment-17000338 ] Ahmet Altay commented on BEAM-8825: --- Could this issue be closed? > OOM when writing large numbers of

[jira] [Commented] (BEAM-8877) beam_PostCommit_Py_VR_Dataflow is timing out

2019-12-19 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000335#comment-17000335 ] Valentyn Tymofieiev commented on BEAM-8877: ---   Ran gradlew

[jira] [Updated] (BEAM-9000) Java Test Assertions without toString for GenericJson subclasses

2019-12-19 Thread Tomo Suzuki (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomo Suzuki updated BEAM-9000: -- Description: As of now, there are many tests that assert on {{toString()}} of objects. {code:java}

[jira] [Commented] (BEAM-8195) Quota exceeded for create requests

2019-12-19 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000330#comment-17000330 ] Ahmet Altay commented on BEAM-8195: --- dataflow_v1b3_client.py is an auto generated file I believe. Is it

[jira] [Created] (BEAM-9000) Java Test Assertions without toString for GenericJson subclasses

2019-12-19 Thread Tomo Suzuki (Jira)
Tomo Suzuki created BEAM-9000: - Summary: Java Test Assertions without toString for GenericJson subclasses Key: BEAM-9000 URL: https://issues.apache.org/jira/browse/BEAM-9000 Project: Beam Issue

[jira] [Work logged] (BEAM-8977) apache_beam.runners.interactive.display.pcoll_visualization_test.PCollectionVisualizationTest.test_dynamic_plotting_update_same_display is flaky

2019-12-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8977?focusedWorklogId=361482=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-361482 ] ASF GitHub Bot logged work on BEAM-8977: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8944) Python SDK harness performance degradation with UnboundedThreadPoolExecutor

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000313#comment-17000313 ] Udi Meiri commented on BEAM-8944: - Does this bug affect current production runners (such as Dataflow

[jira] [Comment Edited] (BEAM-8195) Quota exceeded for create requests

2019-12-19 Thread Alan Myrvold (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000297#comment-17000297 ] Alan Myrvold edited comment on BEAM-8195 at 12/19/19 7:12 PM: -- I also see

[jira] [Assigned] (BEAM-8989) Backwards incompatible change in ParDo.getSideInputs (caught by failure when running Apache Nemo quickstart)

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-8989: --- Assignee: Reuven Lax > Backwards incompatible change in ParDo.getSideInputs (caught by failure when

[jira] [Commented] (BEAM-8989) Backwards incompatible change in ParDo.getSideInputs (caught by failure when running Apache Nemo quickstart)

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000308#comment-17000308 ] Udi Meiri commented on BEAM-8989: - Decided to push this back to 2.19 since 2.16 already has this

[jira] [Updated] (BEAM-8989) Backwards incompatible change in ParDo.getSideInputs (caught by failure when running Apache Nemo quickstart)

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-8989: Affects Version/s: 2.18.0 > Backwards incompatible change in ParDo.getSideInputs (caught by failure when >

[jira] [Updated] (BEAM-8989) Backwards incompatible change in ParDo.getSideInputs (caught by failure when running Apache Nemo quickstart)

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-8989: Fix Version/s: (was: 2.18.0) 2.19.0 > Backwards incompatible change in

[jira] [Work logged] (BEAM-8999) PGBKCVOperation does not respect timestamp combiners

2019-12-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8999?focusedWorklogId=361481=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-361481 ] ASF GitHub Bot logged work on BEAM-8999: Author: ASF GitHub Bot

[jira] [Comment Edited] (BEAM-8195) Quota exceeded for create requests

2019-12-19 Thread Alan Myrvold (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000297#comment-17000297 ] Alan Myrvold edited comment on BEAM-8195 at 12/19/19 6:48 PM: -- I also see

[jira] [Created] (BEAM-8999) PGBKCVOperation does not respect timestamp combiners

2019-12-19 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-8999: - Summary: PGBKCVOperation does not respect timestamp combiners Key: BEAM-8999 URL: https://issues.apache.org/jira/browse/BEAM-8999 Project: Beam Issue

[jira] [Commented] (BEAM-8882) Allow Dataflow to automatically choose portability or not.

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000300#comment-17000300 ] Udi Meiri commented on BEAM-8882: - Cherrypick has been merged to the release branch. Can this be closed?

[jira] [Comment Edited] (BEAM-8195) Quota exceeded for create requests

2019-12-19 Thread Alan Myrvold (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000297#comment-17000297 ] Alan Myrvold edited comment on BEAM-8195 at 12/19/19 6:47 PM: -- I also see

[jira] [Commented] (BEAM-8195) Quota exceeded for create requests

2019-12-19 Thread Alan Myrvold (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000297#comment-17000297 ] Alan Myrvold commented on BEAM-8195: I also see inconsistent retry behavior between the Python SDK and

[jira] [Commented] (BEAM-8991) RuntimeError in log_handler_test

2019-12-19 Thread Ning Kang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000296#comment-17000296 ] Ning Kang commented on BEAM-8991: - Got it, thanks!   I've also experienced something interesting when

[jira] [Commented] (BEAM-7405) Task :sdks:python:hdfsIntegrationTest is failing in Python PostCommits - docker-credential-gcloud not installed

2019-12-19 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000292#comment-17000292 ] Brian Hulette commented on BEAM-7405: - This happened again in 

[jira] [Reopened] (BEAM-7405) Task :sdks:python:hdfsIntegrationTest is failing in Python PostCommits - docker-credential-gcloud not installed

2019-12-19 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reopened BEAM-7405: - > Task :sdks:python:hdfsIntegrationTest is failing in Python PostCommits - >

[jira] [Commented] (BEAM-8976) No default logging story for Pipeline construction time in Python

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000289#comment-17000289 ] Udi Meiri commented on BEAM-8976: - Fix for 2.18.0 release in https://github.com/apache/beam/pull/10416

[jira] [Updated] (BEAM-8998) Avoid excessive bundle progress polling in Dataflow Runner

2019-12-19 Thread Yichi Zhang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yichi Zhang updated BEAM-8998: -- Description: Dataflow Java runner uses 0.1 secs interval for polling bundle progress from SDK Harness,

[jira] [Commented] (BEAM-8974) apache_beam.runners.worker.log_handler_test.FnApiLogRecordHandlerTest.test_exc_info is flaky

2019-12-19 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000283#comment-17000283 ] Valentyn Tymofieiev commented on BEAM-8974: --- These errors continue to happen. I see that 

[jira] [Updated] (BEAM-8998) Avoid excessive bundle progress polling in Dataflow Runner

2019-12-19 Thread Yichi Zhang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yichi Zhang updated BEAM-8998: -- Description: Dataflow Java runner uses 0.1 secs interval for polling bundle progress from SDK Harness,

[jira] [Updated] (BEAM-8998) Avoid excessive bundle progress polling in Dataflow Runner

2019-12-19 Thread Yichi Zhang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yichi Zhang updated BEAM-8998: -- Summary: Avoid excessive bundle progress polling in Dataflow Runner (was: Avoid excessive bundle

[jira] [Assigned] (BEAM-8989) Backwards incompatible change in ParDo.getSideInputs (caught by failure when running Apache Nemo quickstart)

2019-12-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-8989: --- Assignee: (was: Udi Meiri) > Backwards incompatible change in ParDo.getSideInputs (caught by

[jira] [Created] (BEAM-8998) Avoid excessive bundle progress polling in JRH

2019-12-19 Thread Yichi Zhang (Jira)
Yichi Zhang created BEAM-8998: - Summary: Avoid excessive bundle progress polling in JRH Key: BEAM-8998 URL: https://issues.apache.org/jira/browse/BEAM-8998 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-8997) Include Dataflow Job ID in console output

2019-12-19 Thread Kamil Wasilewski (Jira)
Kamil Wasilewski created BEAM-8997: -- Summary: Include Dataflow Job ID in console output Key: BEAM-8997 URL: https://issues.apache.org/jira/browse/BEAM-8997 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-8938) Tests end up leaving stale Dataflow jobs in apache-beam-testing project and exhaust GCP resources

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8938: --- Assignee: Kamil Wasilewski > Tests end up leaving stale Dataflow jobs in apache-beam-testing

[jira] [Commented] (BEAM-8938) Tests end up leaving stale Dataflow jobs in apache-beam-testing project and exhaust GCP resources

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000161#comment-17000161 ] Lukasz Gajowy commented on BEAM-8938: - [~kamilwu] I assigned you because this requires some care. Feel

[jira] [Commented] (BEAM-8424) Java Dataflow ValidatesRunner tests are timeouting

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000158#comment-17000158 ] Lukasz Gajowy commented on BEAM-8424: - There are still problem with Java11 tests (timeouting) > Java

[jira] [Assigned] (BEAM-8424) Java Dataflow ValidatesRunner tests are timeouting

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8424: --- Assignee: Michal Walenia > Java Dataflow ValidatesRunner tests are timeouting >

[jira] [Comment Edited] (BEAM-8424) Java Dataflow ValidatesRunner tests are timeouting

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000158#comment-17000158 ] Lukasz Gajowy edited comment on BEAM-8424 at 12/19/19 4:00 PM: --- There are

[jira] [Closed] (BEAM-7368) Run Python GBK load tests on portable Flink runner

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-7368. --- Fix Version/s: Not applicable Resolution: Fixed > Run Python GBK load tests on portable Flink

[jira] [Commented] (BEAM-7245) Encapsulate supplier, monitor and metric naming logic in some common TestMetric type

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000153#comment-17000153 ] Lukasz Gajowy commented on BEAM-7245: - [~mwalenia] is this ticket finished? > Encapsulate supplier,

[jira] [Comment Edited] (BEAM-7245) Encapsulate supplier, monitor and metric naming logic in some common TestMetric type

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000153#comment-17000153 ] Lukasz Gajowy edited comment on BEAM-7245 at 12/19/19 3:58 PM: --- [~mwalenia] 

[jira] [Commented] (BEAM-7115) TFRecordIOIT write_time metrics are allways 0.0

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000151#comment-17000151 ] Lukasz Gajowy commented on BEAM-7115: - [~pawel.pasterz] do you think you could take a look? >

[jira] [Commented] (BEAM-6969) Provide way to collect start/end read/write time inside the IOs

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000150#comment-17000150 ] Lukasz Gajowy commented on BEAM-6969: - [~pawel.pasterz] [~mwalenia] you might find this (historical)

[jira] [Resolved] (BEAM-6448) Enable SDK log messages in test log output

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-6448. - Fix Version/s: Not applicable Resolution: Fixed > Enable SDK log messages in test log

[jira] [Closed] (BEAM-6408) beam_Java_LoadTests_GroupByKey_Dataflow_Small timeouts

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-6408. --- Fix Version/s: Not applicable Resolution: Resolved >

[jira] [Closed] (BEAM-6349) Exceptions (IllegalArgumentException or NoClassDefFoundError) when running tests on Dataflow runner

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-6349. --- Fix Version/s: Not applicable Resolution: Fixed > Exceptions (IllegalArgumentException or

[jira] [Closed] (BEAM-4367) Phrase-triggered job (IOIT) never stopped running.

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-4367. --- Fix Version/s: Not applicable Resolution: Cannot Reproduce > Phrase-triggered job (IOIT) never

[jira] [Closed] (BEAM-3561) Provide kubernetes cluster instance for IOITs.

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-3561. --- Fix Version/s: Not applicable Resolution: Fixed > Provide kubernetes cluster instance for

[jira] [Resolved] (BEAM-4041) Performance tests fail due to kubernetes load balancer problems

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-4041. - Fix Version/s: Not applicable Resolution: Fixed > Performance tests fail due to kubernetes

[jira] [Assigned] (BEAM-8940) Load dataflow jobs using java 11 in Java 11 Dataflow tests

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8940: --- Assignee: Michal Walenia > Load dataflow jobs using java 11 in Java 11 Dataflow tests >

[jira] [Assigned] (BEAM-4420) Add KafkaIO Integration Tests

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-4420: --- Assignee: (was: Lukasz Gajowy) > Add KafkaIO Integration Tests >

[jira] [Assigned] (BEAM-8319) Errorprone 0.0.13 fails during JDK11 build

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8319: --- Assignee: (was: Lukasz Gajowy) > Errorprone 0.0.13 fails during JDK11 build >

[jira] [Assigned] (BEAM-8940) Load dataflow jobs using java 11 in Java 11 Dataflow tests

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8940: --- Assignee: (was: Lukasz Gajowy) > Load dataflow jobs using java 11 in Java 11 Dataflow

[jira] [Assigned] (BEAM-8559) Run Dataflow Nexmark suites with Java 11

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8559: --- Assignee: Michal Walenia (was: Lukasz Gajowy) > Run Dataflow Nexmark suites with Java 11 >

[jira] [Resolved] (BEAM-8003) Remove all mentions of PKB on Confluence / website docs

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-8003. - Fix Version/s: Not applicable Resolution: Fixed > Remove all mentions of PKB on Confluence

  1   2   >