[jira] [Updated] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6751: - Summary: KafkaIO's EOS mode does not work with FlinkRunner (was: KafkaIO blocks

[jira] [Updated] (BEAM-6759) CassandraIOTest failing in presubmit in multiple PRs

2019-03-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6759: - Issue Type: Test (was: New Feature) > CassandraIOTest failing in presubmit in multiple

[jira] [Closed] (BEAM-6759) CassandraIOTest failing in presubmit in multiple PRs

2019-03-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6759. Resolution: Duplicate Fix Version/s: Not applicable Duplicate of BEAM-6722. >

[jira] [Closed] (BEAM-6699) Docker iptables command fails while running :beam-sdks-python:portableWordCountBatch

2019-02-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6699. Resolution: Fixed Fix Version/s: 2.12.0 > Docker iptables command fails while

[jira] [Resolved] (BEAM-6676) Python timers only working with GlobalWindow

2019-02-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6676. -- Resolution: Fixed Assignee: Robert Bradshaw Fix Version/s: 2.12.0 >

[jira] [Commented] (BEAM-6714) Move runner-agnostic code out of FlinkJobServerDriver

2019-02-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773943#comment-16773943 ] Maximilian Michels commented on BEAM-6714: -- Yes, it looks like the Samza version does not

[jira] [Created] (BEAM-6722) :beam-sdks-java-io-cassandra:test is flaky

2019-02-21 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6722: Summary: :beam-sdks-java-io-cassandra:test is flaky Key: BEAM-6722 URL: https://issues.apache.org/jira/browse/BEAM-6722 Project: Beam Issue Type:

[jira] [Closed] (BEAM-6268) PreCommit fails in beam-sdks-java-io-hadoop-format:test

2019-02-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6268. Resolution: Fixed Fix Version/s: (was: 2.11.0) 2.12.0 >

[jira] [Commented] (BEAM-6268) PreCommit fails in beam-sdks-java-io-hadoop-format:test

2019-02-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773969#comment-16773969 ] Maximilian Michels commented on BEAM-6268: -- Ah, it is a different test, but the root cause seems

[jira] [Reopened] (BEAM-6268) PreCommit fails in beam-sdks-java-io-hadoop-format:test

2019-02-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reopened BEAM-6268: -- I think this is still a problem:

[jira] [Commented] (BEAM-6722) :beam-sdks-java-io-cassandra:test is flaky

2019-02-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774011#comment-16774011 ] Maximilian Michels commented on BEAM-6722: -- {noformat}

[jira] [Created] (BEAM-6731) Move Java ExpansionService into Flink JobServer

2019-02-22 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6731: Summary: Move Java ExpansionService into Flink JobServer Key: BEAM-6731 URL: https://issues.apache.org/jira/browse/BEAM-6731 Project: Beam Issue

[jira] [Commented] (BEAM-6728) Allow sharing of the job and artifact service address.

2019-02-22 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775012#comment-16775012 ] Maximilian Michels commented on BEAM-6728: -- That would be great. The less ports users have to

[jira] [Created] (BEAM-6733) Use Flink 1.6/1.7 prepareSnapshotPreBarrier to replace BufferedOutputManager

2019-02-22 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6733: Summary: Use Flink 1.6/1.7 prepareSnapshotPreBarrier to replace BufferedOutputManager Key: BEAM-6733 URL: https://issues.apache.org/jira/browse/BEAM-6733

[jira] [Updated] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6751: - Priority: Major (was: Critical) > KafkaIO's EOS mode does not work with FlinkRunner >

[jira] [Commented] (BEAM-2943) Beam Flink deployment results in ClassNotFoundException

2019-02-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16778229#comment-16778229 ] Maximilian Michels commented on BEAM-2943: -- [~marcojk] Are you sure that the file

[jira] [Closed] (BEAM-6731) Move Java ExpansionService into Flink JobServer

2019-02-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6731. Resolution: Fixed Fix Version/s: 2.12.0 > Move Java ExpansionService into Flink

[jira] [Resolved] (BEAM-6666) subprocess.Popen hangs after use of gRPC channel

2019-03-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-. -- Resolution: Fixed Fix Version/s: 2.12.0 > subprocess.Popen hangs after use of

[jira] [Commented] (BEAM-5440) Add option to mount a directory inside SDK harness containers

2019-03-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789354#comment-16789354 ] Maximilian Michels commented on BEAM-5440: -- {{java-fn-execution}} covers pretty much everything

[jira] [Resolved] (BEAM-6796) Portable Flink runner error in finish bundle timer processing

2019-03-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6796. -- Resolution: Fixed Fix Version/s: 2.12.0 > Portable Flink runner error in finish

[jira] [Updated] (BEAM-5440) Add option to mount a directory inside SDK harness containers

2019-03-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5440: - Component/s: sdk-java-core > Add option to mount a directory inside SDK harness

[jira] [Updated] (BEAM-5440) Add option to mount a directory inside SDK harness containers

2019-03-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5440: - Labels: portability portability-flink triaged (was: portability portability-flink) >

[jira] [Assigned] (BEAM-5495) PipelineResources algorithm is not working in most environments

2019-03-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5495: Assignee: (was: Amit Sela) > PipelineResources algorithm is not working in

[jira] [Commented] (BEAM-6868) Flink runner supports Bundle Finalization

2019-03-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797087#comment-16797087 ] Maximilian Michels commented on BEAM-6868: -- Could you elaborate on this? To my best knowledge the

[jira] [Assigned] (BEAM-4296) Defer window assignment in portable Flink runner to SDK

2019-03-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-4296: Assignee: Robert Bradshaw > Defer window assignment in portable Flink runner to

[jira] [Closed] (BEAM-4296) Defer window assignment in portable Flink runner to SDK

2019-03-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-4296. Resolution: Fixed Fix Version/s: 2.12.0 > Defer window assignment in portable Flink

[jira] [Commented] (BEAM-4296) Defer window assignment in portable Flink runner to SDK

2019-03-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797142#comment-16797142 ] Maximilian Michels commented on BEAM-4296: -- Fixed via https://github.com/apache/beam/pull/8058 >

[jira] [Commented] (BEAM-6868) Flink runner supports Bundle Finalization

2019-03-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797386#comment-16797386 ] Maximilian Michels commented on BEAM-6868: -- Thanks for clarifying. Indeed, the Flink Runner does

[jira] [Closed] (BEAM-5649) Remove deprecated primitive CREATE_VIEW transform from Runner API

2019-03-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-5649. Resolution: Fixed Assignee: Robert Bradshaw Fix Version/s: 2.9.0 Thanks for

[jira] [Closed] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-18 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6751. Resolution: Fixed > KafkaIO's EOS mode does not work with FlinkRunner >

[jira] [Closed] (BEAM-5359) Support @RequiresStableInput on Flink runner

2019-03-18 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-5359. Resolution: Fixed Fix Version/s: 2.12.0 > Support @RequiresStableInput on Flink

[jira] [Resolved] (BEAM-6754) Support multi core machines for python pipeline on flink for loopback environment

2019-03-12 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6754. -- Resolution: Fixed Fix Version/s: 2.12.0 Resolving. > Support multi core

[jira] [Assigned] (BEAM-6876) User state cleanup in portable Flink runner

2019-03-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6876: Assignee: Maximilian Michels > User state cleanup in portable Flink runner >

[jira] [Commented] (BEAM-6608) Flink Runner prepares to-be-staged file too late

2019-02-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761774#comment-16761774 ] Maximilian Michels commented on BEAM-6608: -- This does not affect execution through the

[jira] [Created] (BEAM-6608) Flink Runner prepares to-be-staged file too late

2019-02-06 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6608: Summary: Flink Runner prepares to-be-staged file too late Key: BEAM-6608 URL: https://issues.apache.org/jira/browse/BEAM-6608 Project: Beam Issue

[jira] [Created] (BEAM-6609) Default tempLocation in FlinkPipelineOptions to default tmp directory

2019-02-06 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6609: Summary: Default tempLocation in FlinkPipelineOptions to default tmp directory Key: BEAM-6609 URL: https://issues.apache.org/jira/browse/BEAM-6609 Project:

[jira] [Closed] (BEAM-6608) Flink Runner prepares to-be-staged file too late

2019-02-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6608. Resolution: Fixed > Flink Runner prepares to-be-staged file too late >

[jira] [Closed] (BEAM-6609) Default tempLocation in FlinkPipelineOptions to default tmp directory

2019-02-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6609. Resolution: Fixed Fix Version/s: 2.10.0 > Default tempLocation in

[jira] [Updated] (BEAM-6608) Flink Runner prepares to-be-staged file too late

2019-02-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6608: - Fix Version/s: 2.10.0 > Flink Runner prepares to-be-staged file too late >

[jira] [Commented] (BEAM-6650) FlinkRunner fails to checkpoint elements emitted during finishBundle

2019-02-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769141#comment-16769141 ] Maximilian Michels commented on BEAM-6650: -- [~altay] I would consider it a release blocker. The

[jira] [Commented] (BEAM-6698) Portable Validates Runner Tests on Flink flaky after update to gradle5

2019-02-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770399#comment-16770399 ] Maximilian Michels commented on BEAM-6698: -- In Flink this is configurable:

[jira] [Assigned] (BEAM-6699) Docker iptables command fails while running :beam-sdks-python:portableWordCountBatch

2019-02-18 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6699: Assignee: Maximilian Michels > Docker iptables command fails while running >

[jira] [Created] (BEAM-6650) FlinkRunner fails to checkpoint elements emitted during finishBundle

2019-02-11 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6650: Summary: FlinkRunner fails to checkpoint elements emitted during finishBundle Key: BEAM-6650 URL: https://issues.apache.org/jira/browse/BEAM-6650 Project:

[jira] [Created] (BEAM-6678) FlinkRunner does not checkpoint partition view of watermark holds

2019-02-15 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6678: Summary: FlinkRunner does not checkpoint partition view of watermark holds Key: BEAM-6678 URL: https://issues.apache.org/jira/browse/BEAM-6678 Project: Beam

[jira] [Updated] (BEAM-6678) FlinkRunner does not checkpoint partition view of watermark holds

2019-02-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6678: - Fix Version/s: 2.11.0 > FlinkRunner does not checkpoint partition view of watermark holds

[jira] [Commented] (BEAM-6714) Move runner-agnostic code out of FlinkJobServerDriver

2019-02-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772874#comment-16772874 ] Maximilian Michels commented on BEAM-6714: -- Sounds like a good idea to create a reusable

[jira] [Resolved] (BEAM-6640) Reshuffle not translated to Flink rebalance

2019-02-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6640. -- Resolution: Fixed Fix Version/s: 2.11.0 > Reshuffle not translated to Flink

[jira] [Resolved] (BEAM-622) Add checkpointing tests for DoFnOperator and WindowDoFnOperator

2019-02-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-622. - Resolution: Fixed Fix Version/s: 2.5.0 Closing because this has been fixed in the

[jira] [Assigned] (BEAM-6648) Metrics not shown in Flink 1.7.1

2019-02-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6648: Assignee: Ryan Williams (was: Maximilian Michels) > Metrics not shown in Flink

[jira] [Commented] (BEAM-6648) Metrics not shown in Flink 1.7.1

2019-02-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764942#comment-16764942 ] Maximilian Michels commented on BEAM-6648: -- Assigning this to [~rdub] for now, since Ryan has

[jira] [Resolved] (BEAM-6634) Fix "Run Portable_Python PreCommit" for gradle 5

2019-02-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6634. -- Resolution: Fixed Fix Version/s: 2.11.0 > Fix "Run Portable_Python PreCommit"

[jira] [Updated] (BEAM-6510) [beam_PostCommit_Java_Nexmark_Flink] Consistently timing out

2019-01-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6510: - Affects Version/s: 2.11.0 2.10.0 >

[jira] [Updated] (BEAM-6510) [beam_PostCommit_Java_Nexmark_Flink] Consistently timing out

2019-01-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6510: - Labels: SQL (was: SQL currently-failing) > [beam_PostCommit_Java_Nexmark_Flink]

[jira] [Closed] (BEAM-6510) [beam_PostCommit_Java_Nexmark_Flink] Consistently timing out

2019-01-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6510. Resolution: Fixed Fix Version/s: 2.11.0 > [beam_PostCommit_Java_Nexmark_Flink]

[jira] [Closed] (BEAM-6533) UnboundedSourceWrapper source log output should not be zero-based

2019-01-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6533. Resolution: Fixed Fixed with {{beb7abf09dc80406848dfc81e242ec25b7e6780e}}. >

[jira] [Commented] (BEAM-5442) PortableRunner swallows custom options for Runner

2019-01-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755967#comment-16755967 ] Maximilian Michels commented on BEAM-5442: -- This is great. Thank you for the following up [~thw].

[jira] [Commented] (BEAM-6543) Multiple PostCommit_Java_ValidatesRunner_Flink tests are failing due to AssertionError

2019-01-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755968#comment-16755968 ] Maximilian Michels commented on BEAM-6543: -- Thank you for reporting [~chamikara]. Looking into

[jira] [Created] (BEAM-6549) Make use of DescribePipelineOptionsRequest in Go SDK

2019-01-30 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6549: Summary: Make use of DescribePipelineOptionsRequest in Go SDK Key: BEAM-6549 URL: https://issues.apache.org/jira/browse/BEAM-6549 Project: Beam

[jira] [Closed] (BEAM-6543) Multiple PostCommit_Java_ValidatesRunner_Flink tests are failing due to AssertionError

2019-01-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6543. Resolution: Fixed Fix Version/s: Not applicable > Multiple

[jira] [Updated] (BEAM-5386) Flink Runner gets progressively stuck when Pubsub subscription is nearly empty

2019-01-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5386: - Affects Version/s: 2.7.0 2.8.0 2.9.0 >

[jira] [Resolved] (BEAM-6405) Improve PortableValidatesRunner test reliability on Jenkins

2019-01-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6405. -- Resolution: Fixed Fix Version/s: 2.11.0 > Improve PortableValidatesRunner test

[jira] [Commented] (BEAM-6473) Python Flink ValidatesRunner test_flattened_side_input fails

2019-01-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750702#comment-16750702 ] Maximilian Michels commented on BEAM-6473: -- This looks like an issue with the Python SDK or the

[jira] [Commented] (BEAM-6488) Portable Flink runner support for running cross-language transforms

2019-01-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750507#comment-16750507 ] Maximilian Michels commented on BEAM-6488: -- Thanks for picking this up [~heejong]. Multiple

[jira] [Updated] (BEAM-6473) Python Flink ValidatesRunner test_flattened_side_input fails

2019-01-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6473: - Priority: Major (was: Critical) > Python Flink ValidatesRunner test_flattened_side_input

[jira] [Commented] (BEAM-6508) Pipeline execution failed:

2019-01-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756214#comment-16756214 ] Maximilian Michels commented on BEAM-6508: -- [~ramesh...@gmail.com] Could you provide the complete

[jira] [Assigned] (BEAM-4520) No messages delivered after a while with PubsubIO

2019-01-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-4520: Assignee: Maximilian Michels > No messages delivered after a while with PubsubIO >

[jira] [Resolved] (BEAM-4520) No messages delivered after a while with PubsubIO

2019-01-31 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-4520. -- Resolution: Fixed > No messages delivered after a while with PubsubIO >

[jira] [Updated] (BEAM-5386) Flink Runner gets progressively stuck when Pubsub subscription is nearly empty

2019-01-31 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5386: - Fix Version/s: (was: 2.9.1) 2.7.1 > Flink Runner gets

[jira] [Updated] (BEAM-5971) Checkpointing fails for UnboundedSourceWrapper with no local Readers

2019-01-31 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5971: - Fix Version/s: 2.7.1 > Checkpointing fails for UnboundedSourceWrapper with no local

[jira] [Updated] (BEAM-4520) No messages delivered after a while with PubsubIO

2019-01-31 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-4520: - Fix Version/s: 2.11.0 2.7.1 > No messages delivered after a while with

[jira] [Updated] (BEAM-6460) Jackson Cache may hold on to Classloader after pipeline restart

2019-01-31 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6460: - Fix Version/s: 2.7.1 > Jackson Cache may hold on to Classloader after pipeline restart >

[jira] [Resolved] (BEAM-6230) Document Flink version support policy

2019-01-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6230. -- Resolution: Fixed Fix Version/s: Not applicable > Document Flink version support

[jira] [Commented] (BEAM-6361) Fix user-metric prefix detection for portable Flink metrics

2019-02-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759826#comment-16759826 ] Maximilian Michels commented on BEAM-6361: -- Can this be closed? > Fix user-metric prefix

[jira] [Resolved] (BEAM-6508) Pipeline execution failed:

2019-02-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6508. -- Resolution: Cannot Reproduce Fix Version/s: Not applicable Resolving for now

[jira] [Closed] (BEAM-6473) Python Flink ValidatesRunner test_flattened_side_input fails

2019-02-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6473. Resolution: Fixed Fix Version/s: 2.11.0 The follow-up to this is BEAM-6523. >

[jira] [Commented] (BEAM-6364) Warn on unsupported portable Flink metric types, instead of throwing

2019-02-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759824#comment-16759824 ] Maximilian Michels commented on BEAM-6364: -- Is this fixed already? > Warn on unsupported

[jira] [Assigned] (BEAM-6019) Portable streaming flink does not preserve original error message

2019-02-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6019: Assignee: Maximilian Michels > Portable streaming flink does not preserve original

[jira] [Created] (BEAM-6533) UnboundedSourceWrapper

2019-01-29 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6533: Summary: UnboundedSourceWrapper Key: BEAM-6533 URL: https://issues.apache.org/jira/browse/BEAM-6533 Project: Beam Issue Type: Improvement

[jira] [Closed] (BEAM-6518) Substring-matching bug in Python metrics filtering

2019-01-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6518. Resolution: Fixed Fix Version/s: 2.11.0 > Substring-matching bug in Python metrics

[jira] [Updated] (BEAM-6533) UnboundedSourceWrapper source log output should not be zero-based

2019-01-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6533: - Summary: UnboundedSourceWrapper source log output should not be zero-based (was:

[jira] [Commented] (BEAM-6510) [beam_PostCommit_Java_Nexmark_Flink] Consistently timing out

2019-01-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754825#comment-16754825 ] Maximilian Michels commented on BEAM-6510: -- {quote} I do notice that the lines 18:54:04 INFO:

[jira] [Assigned] (BEAM-6473) Python Flink ValidatesRunner test_flattened_side_input fails

2019-01-24 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6473: Assignee: Maximilian Michels > Python Flink ValidatesRunner

[jira] [Closed] (BEAM-6019) Portable streaming flink does not preserve original error message

2019-02-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6019. Resolution: Fixed Fix Version/s: 2.11.0 > Portable streaming flink does not preserve

[jira] [Assigned] (BEAM-5816) Flink runner starts new bundles while disposing operator

2019-02-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5816: Assignee: Maximilian Michels > Flink runner starts new bundles while disposing

[jira] [Resolved] (BEAM-4643) Allow to check early panes of a window

2019-02-05 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-4643. -- Resolution: Fixed Fix Version/s: 2.8.0 > Allow to check early panes of a window

[jira] [Commented] (BEAM-6501) [beam_PostCommit_Python_VR_Flink] [Flake] Java runtime runs out of memory.

2019-02-05 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761017#comment-16761017 ] Maximilian Michels commented on BEAM-6501: -- It looks like the issue here is insufficient memory

[jira] [Commented] (BEAM-4643) Allow to check early panes of a window

2019-02-05 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761003#comment-16761003 ] Maximilian Michels commented on BEAM-4643: -- Resolving this for 2.8.0 where this first appeared.

[jira] [Commented] (BEAM-7054) PortableRunner on Flink cluster crashes

2019-04-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815306#comment-16815306 ] Maximilian Michels commented on BEAM-7054: -- I agree that the docs should receive an update

[jira] [Commented] (BEAM-7054) PortableRunner on Flink cluster crashes

2019-04-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815300#comment-16815300 ] Maximilian Michels commented on BEAM-7054: -- Thanks for reporting. The way the

[jira] [Closed] (BEAM-7067) Flink job server: can't disable cleanArtifactsPerJob

2019-04-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-7067. Resolution: Fixed Fix Version/s: Not applicable > Flink job server: can't disable

[jira] [Created] (BEAM-7084) Support custom environment types when expanding external transforms

2019-04-16 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-7084: Summary: Support custom environment types when expanding external transforms Key: BEAM-7084 URL: https://issues.apache.org/jira/browse/BEAM-7084 Project:

[jira] [Created] (BEAM-7083) Remove non-functional pipeline option for default Java environment URL

2019-04-16 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-7083: Summary: Remove non-functional pipeline option for default Java environment URL Key: BEAM-7083 URL: https://issues.apache.org/jira/browse/BEAM-7083 Project:

[jira] [Commented] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818916#comment-16818916 ] Maximilian Michels commented on BEAM-7029: -- Status update: ReadFromKafka is implemented.

[jira] [Closed] (BEAM-7106) Mention Spark on portability webpage

2019-04-18 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-7106. Resolution: Fixed Fix Version/s: Not applicable > Mention Spark on portability

[jira] [Closed] (BEAM-7083) Remove non-functional pipeline option for default Java environment URL

2019-04-18 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-7083. Resolution: Fixed Fix Version/s: 2.13.0 > Remove non-functional pipeline option for

[jira] [Closed] (BEAM-7039) Spark portable runner: run validatesRunner tests

2019-04-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-7039. Resolution: Fixed Fix Version/s: 2.13.0 > Spark portable runner: run validatesRunner

[jira] [Assigned] (BEAM-6829) Duplicate metric warnings clutter log

2019-05-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6829: Assignee: Maximilian Michels > Duplicate metric warnings clutter log >

[jira] [Commented] (BEAM-7319) Multiple NeedsRunner tests break with Flink 'Cannot union streams of different types'

2019-05-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840699#comment-16840699 ] Maximilian Michels commented on BEAM-7319: -- This is blocked on BEAM-6523. > Multiple NeedsRunner

[jira] [Updated] (BEAM-7319) Multiple NeedsRunner tests break with Flink 'Cannot union streams of different types'

2019-05-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-7319: - Priority: Major (was: Critical) > Multiple NeedsRunner tests break with Flink 'Cannot

[jira] [Commented] (BEAM-7271) Adding StringUtf8Coder to ModelCoder in JavaSDK [REOPENED]

2019-05-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16842045#comment-16842045 ] Maximilian Michels commented on BEAM-7271: -- [~angoenka] The tests are passing because the release

<    1   2   3   4   5   6   7   8   9   10   >