[jira] [Commented] (BEAM-6227) FlinkRunner errors if GroupByKey contains null values (streaming mode only)

2018-12-13 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720186#comment-16720186 ] Maximilian Michels commented on BEAM-6227: -- It appears ValidatesRunner is correctly setup to run

[jira] [Commented] (BEAM-2873) Detect number of shards for file sink in Flink Streaming Runner

2018-12-13 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720192#comment-16720192 ] Maximilian Michels commented on BEAM-2873: -- Just found this related issue. I think we should go

[jira] [Resolved] (BEAM-2943) Beam Flink deployment results in ClassNotFoundException

2018-12-12 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-2943. -- Resolution: Fixed Assignee: Maximilian Michels (was: Aljoscha Krettek)

[jira] [Created] (BEAM-6263) FlinkJobServerDriver test setup is error-prone

2018-12-18 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6263: Summary: FlinkJobServerDriver test setup is error-prone Key: BEAM-6263 URL: https://issues.apache.org/jira/browse/BEAM-6263 Project: Beam Issue

[jira] [Created] (BEAM-6248) Add Flink 1.7.x build target to Flink Runner

2018-12-17 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6248: Summary: Add Flink 1.7.x build target to Flink Runner Key: BEAM-6248 URL: https://issues.apache.org/jira/browse/BEAM-6248 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-4128) Handle WindowInto transforms in portable Flink runner directly

2018-12-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-4128. -- Resolution: Not A Problem Fix Version/s: Not applicable To my best knowledge

[jira] [Created] (BEAM-6283) Convert PortableStateTimerTest and PortableExecutionTest to using PAssert

2018-12-20 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6283: Summary: Convert PortableStateTimerTest and PortableExecutionTest to using PAssert Key: BEAM-6283 URL: https://issues.apache.org/jira/browse/BEAM-6283

[jira] [Closed] (BEAM-108) Support multiple Scala versions on the Flink runner

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-108. --- Resolution: Won't Fix Fix Version/s: Not applicable Closing this. I think we are better

[jira] [Commented] (BEAM-2943) Beam Flink deployment results in ClassNotFoundException

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16717670#comment-16717670 ] Maximilian Michels commented on BEAM-2943: -- Thanks for the info [~adrishdas]. Verified that this

[jira] [Closed] (BEAM-6172) Flink metrics are not generated in standard format

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6172. Resolution: Fixed Fix Version/s: 2.10.0 > Flink metrics are not generated in

[jira] [Closed] (BEAM-6176) Flink Runner's master url does not support IPv6 addresses

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6176. Resolution: Fixed > Flink Runner's master url does not support IPv6 addresses >

[jira] [Commented] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-12-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721244#comment-16721244 ] Maximilian Michels commented on BEAM-5419: -- The error message implies that the jar has not been

[jira] [Comment Edited] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-12-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721244#comment-16721244 ] Maximilian Michels edited comment on BEAM-5419 at 12/14/18 10:59 AM: -

[jira] [Commented] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-12-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721110#comment-16721110 ] Maximilian Michels commented on BEAM-5419: -- This just has been merged to master. Unfortunately,

[jira] [Created] (BEAM-6242) PreCommit Portable WordCount is flaky

2018-12-17 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6242: Summary: PreCommit Portable WordCount is flaky Key: BEAM-6242 URL: https://issues.apache.org/jira/browse/BEAM-6242 Project: Beam Issue Type: Test

[jira] [Commented] (BEAM-3472) Create a callback triggered at the end of a batch in flink runner

2018-12-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722909#comment-16722909 ] Maximilian Michels commented on BEAM-3472: -- Makes sense. Thanks for clarifying. > Create a

[jira] [Commented] (BEAM-6242) PreCommit Portable WordCount is flaky

2018-12-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722890#comment-16722890 ] Maximilian Michels commented on BEAM-6242: -- CC [~angoenka] [~thw] > PreCommit Portable WordCount

[jira] [Commented] (BEAM-5865) Auto sharding of streaming sinks in FlinkRunner

2018-12-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722907#comment-16722907 ] Maximilian Michels commented on BEAM-5865: -- Just to restate the problem. You want to write your

[jira] [Commented] (BEAM-6242) PreCommit Portable WordCount is flaky

2018-12-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723099#comment-16723099 ] Maximilian Michels commented on BEAM-6242: -- Ah, because parallelism is only set to 1 for batch.

[jira] [Closed] (BEAM-2873) Detect number of shards for file sink in Flink Streaming Runner

2018-12-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-2873. Resolution: Fixed Fix Version/s: 2.10.0 Fixed with

[jira] [Created] (BEAM-6245) Add test for FlinkTransformOverrides

2018-12-17 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6245: Summary: Add test for FlinkTransformOverrides Key: BEAM-6245 URL: https://issues.apache.org/jira/browse/BEAM-6245 Project: Beam Issue Type: Test

[jira] [Commented] (BEAM-6242) PreCommit Portable WordCount is flaky

2018-12-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723092#comment-16723092 ] Maximilian Michels commented on BEAM-6242: -- {quote}It may be related to

[jira] [Assigned] (BEAM-6242) PreCommit Portable WordCount is flaky

2018-12-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6242: Assignee: Maximilian Michels > PreCommit Portable WordCount is flaky >

[jira] [Commented] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-12-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721392#comment-16721392 ] Maximilian Michels commented on BEAM-5419: -- No worries about asking questions! Thanks for trying

[jira] [Commented] (BEAM-6230) Document Flink version support policy

2018-12-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721454#comment-16721454 ] Maximilian Michels commented on BEAM-6230: -- I think we should aim to support the latest stable

[jira] [Updated] (BEAM-6218) TensorFlow Model Analysis Fails when using the portable Flink runner

2018-12-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6218: - Component/s: sdk-py-harness > TensorFlow Model Analysis Fails when using the portable

[jira] [Commented] (BEAM-6218) TensorFlow Model Analysis Fails when using the portable Flink runner

2018-12-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721459#comment-16721459 ] Maximilian Michels commented on BEAM-6218: -- This looks like an error from the Python SDK harness.

[jira] [Commented] (BEAM-4678) Support portable combiner lifting in Java Flink Runner

2018-12-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721570#comment-16721570 ] Maximilian Michels commented on BEAM-4678: -- Has been implemented for Python. AFAIK Go and Java do

[jira] [Commented] (BEAM-3472) Create a callback triggered at the end of a batch in flink runner

2018-12-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721464#comment-16721464 ] Maximilian Michels commented on BEAM-3472: -- It this still relevant? > Create a callback

[jira] [Closed] (BEAM-6187) Drop Scala suffix of FlinkRunner artifacts

2018-12-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6187. Resolution: Fixed The suffix has been dropped as part of upgrading to 1.6 with BEAM-5267.

[jira] [Commented] (BEAM-6216) Flink post commits are failing

2018-12-12 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16718997#comment-16718997 ] Maximilian Michels commented on BEAM-6216: -- I believe this can be fixed by setting the url to

[jira] [Closed] (BEAM-6283) Convert PortableStateTimerTest and PortableExecutionTest to using PAssert

2018-12-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6283. Resolution: Fixed > Convert PortableStateTimerTest and PortableExecutionTest to using

[jira] [Updated] (BEAM-6111) org.apache.beam.runners.flink.PortableTimersExecutionTest is very flakey 40/50 runs failed

2018-11-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6111: - Issue Type: Bug (was: Test) > org.apache.beam.runners.flink.PortableTimersExecutionTest

[jira] [Commented] (BEAM-6111) org.apache.beam.runners.flink.PortableTimersExecutionTest is very flakey 40/50 runs failed

2018-11-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704904#comment-16704904 ] Maximilian Michels commented on BEAM-6111: -- This is caused by executing the state completion

[jira] [Assigned] (BEAM-6032) Move PortableValidatesRunner configuration out of BeamModulePlugin

2018-11-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6032: Assignee: Maximilian Michels > Move PortableValidatesRunner configuration out of

[jira] [Commented] (BEAM-5865) Auto sharding of streaming sinks in FlinkRunner

2018-11-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701682#comment-16701682 ] Maximilian Michels commented on BEAM-5865: -- I think it would be fine to assume evenly distributed

[jira] [Commented] (BEAM-6077) Make UnboundedSource state rescale friendly

2018-11-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701665#comment-16701665 ] Maximilian Michels commented on BEAM-6077: -- Your observation concerning Flink is correct. The

[jira] [Updated] (BEAM-6130) RemoteExecutionTest testExecutionWithMultipleStages is flaky

2018-11-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6130: - Summary: RemoteExecutionTest testExecutionWithMultipleStages is flaky (was: Flink

[jira] [Commented] (BEAM-6101) java.lang.ArrayIndexOutOfBoundsException Error reading state

2018-11-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701708#comment-16701708 ] Maximilian Michels commented on BEAM-6101: -- Would be great if you could provide more insight

[jira] [Commented] (BEAM-5865) Auto sharding of streaming sinks in FlinkRunner

2018-11-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703642#comment-16703642 ] Maximilian Michels commented on BEAM-5865: -- I think the stable input is relevant for continuing

[jira] [Resolved] (BEAM-5937) Failure in portable Flink tests: org.apache.beam.runners.flink.PortableStateExecutionTest.testExecution

2018-11-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-5937. -- Resolution: Duplicate Fix Version/s: Not applicable > Failure in portable Flink

[jira] [Commented] (BEAM-6172) Flink metrics are not generated in standard format

2018-12-05 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709924#comment-16709924 ] Maximilian Michels commented on BEAM-6172: -- Beam on Flink is not the same as native Flink.

[jira] [Assigned] (BEAM-6172) Flink metrics are not generated in standard format

2018-12-05 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6172: Assignee: Maximilian Michels > Flink metrics are not generated in standard format

[jira] [Updated] (BEAM-6111) org.apache.beam.runners.flink.PortableTimersExecutionTest is very flakey 40/50 runs failed

2018-12-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6111: - Fix Version/s: 2.9.0 > org.apache.beam.runners.flink.PortableTimersExecutionTest is very

[jira] [Closed] (BEAM-1628) Flink runner: logic around --flinkMaster is error-prone

2018-12-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-1628. Resolution: Fixed Fix Version/s: 2.10.0 > Flink runner: logic around --flinkMaster

[jira] [Created] (BEAM-6176) Flink Runner's master url does not support IPv6 addresses

2018-12-04 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6176: Summary: Flink Runner's master url does not support IPv6 addresses Key: BEAM-6176 URL: https://issues.apache.org/jira/browse/BEAM-6176 Project: Beam

[jira] [Commented] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-12-05 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16710157#comment-16710157 ] Maximilian Michels commented on BEAM-5419: -- Since this gets asked for more and more, I will

[jira] [Resolved] (BEAM-6077) Make UnboundedSource state rescale friendly

2018-12-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6077. -- Resolution: Fixed Fix Version/s: 2.10.0 > Make UnboundedSource state rescale

[jira] [Commented] (BEAM-6172) Flink metrics are not generated in standard format

2018-12-07 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712689#comment-16712689 ] Maximilian Michels commented on BEAM-6172: -- I believe that should be fixed in the pending PR

[jira] [Closed] (BEAM-6111) org.apache.beam.runners.flink.PortableTimersExecutionTest is very flakey 40/50 runs failed

2018-12-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6111. Resolution: Fixed Fix Version/s: 2.10.0 >

[jira] [Closed] (BEAM-5937) Failure in portable Flink tests: org.apache.beam.runners.flink.PortableStateExecutionTest.testExecution

2018-12-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-5937. > Failure in portable Flink tests: >

[jira] [Commented] (BEAM-6111) org.apache.beam.runners.flink.PortableTimersExecutionTest is very flakey 40/50 runs failed

2018-12-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707101#comment-16707101 ] Maximilian Michels commented on BEAM-6111: -- Closing this as the underlying issue for test

[jira] [Created] (BEAM-6166) Allow Runners to configure parallelism of GrpcStateService

2018-12-03 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6166: Summary: Allow Runners to configure parallelism of GrpcStateService Key: BEAM-6166 URL: https://issues.apache.org/jira/browse/BEAM-6166 Project: Beam

[jira] [Closed] (BEAM-6129) Flink PortableExecutionTest testExecution is flaky or broken

2018-12-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6129. Resolution: Duplicate Fix Version/s: Not applicable Thanks for reporting. Closing

[jira] [Closed] (BEAM-6032) Move PortableValidatesRunner configuration out of BeamModulePlugin

2018-12-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6032. Resolution: Fixed Fix Version/s: 2.10.0 > Move PortableValidatesRunner configuration

[jira] [Assigned] (BEAM-1628) Flink runner: logic around --flinkMaster is error-prone

2018-12-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-1628: Assignee: Maximilian Michels > Flink runner: logic around --flinkMaster is

[jira] [Commented] (BEAM-1628) Flink runner: logic around --flinkMaster is error-prone

2018-12-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707493#comment-16707493 ] Maximilian Michels commented on BEAM-1628: -- [~Evgeniy_M] Taking this unless you are eager to fix.

[jira] [Created] (BEAM-6187) Drop Scala suffix of FlinkRunner artifacts

2018-12-06 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6187: Summary: Drop Scala suffix of FlinkRunner artifacts Key: BEAM-6187 URL: https://issues.apache.org/jira/browse/BEAM-6187 Project: Beam Issue Type:

[jira] [Commented] (BEAM-6187) Drop Scala suffix of FlinkRunner artifacts

2018-12-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711654#comment-16711654 ] Maximilian Michels commented on BEAM-6187: -- What do you think [~thw]? > Drop Scala suffix of

[jira] [Resolved] (BEAM-6146) Portable Flink End to end precommit test

2018-11-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6146. -- Resolution: Fixed Fix Version/s: 2.10.0 > Portable Flink End to end precommit

[jira] [Resolved] (BEAM-5978) portableWordCount gradle task not working

2018-11-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-5978. -- Resolution: Fixed Fix Version/s: 2.10.0 > portableWordCount gradle task not

[jira] [Commented] (BEAM-6077) Make UnboundedSource state rescale friendly

2018-11-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16697197#comment-16697197 ] Maximilian Michels commented on BEAM-6077: -- Correction: you need to use {{OperatorStateStore}}

[jira] [Comment Edited] (BEAM-6077) Make UnboundedSource state rescale friendly

2018-11-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16697197#comment-16697197 ] Maximilian Michels edited comment on BEAM-6077 at 11/23/18 2:23 PM:

[jira] [Resolved] (BEAM-5197) Flaky test: UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest

2018-11-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-5197. -- Resolution: Fixed Fix Version/s: 2.10.0 Should be resolved. Feel free to reopen

[jira] [Assigned] (BEAM-6009) PortableValidatesRunner runs only in batch mode

2018-11-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6009: Assignee: Ryan Williams > PortableValidatesRunner runs only in batch mode >

[jira] [Closed] (BEAM-6009) PortableValidatesRunner runs only in batch mode

2018-11-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6009. Resolution: Fixed Fix Version/s: 2.10.0 > PortableValidatesRunner runs only in batch

[jira] [Commented] (BEAM-6077) Make UnboundedSource state rescale friendly

2018-11-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696632#comment-16696632 ] Maximilian Michels commented on BEAM-6077: -- No worries! The {{ListState}} is part of Flink's API

[jira] [Closed] (BEAM-6116) Pushed back watermark never emitted in portable Flink runner

2018-11-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6116. Resolution: Fixed Thanks for fixing this and adding a test. Backported to release-2.9.0. >

[jira] [Commented] (BEAM-5865) Auto sharding of streaming sinks in FlinkRunner

2018-11-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696637#comment-16696637 ] Maximilian Michels commented on BEAM-5865: -- Would be great if you want to pick it up! As per

[jira] [Updated] (BEAM-5440) Add option to mount a directory inside SDK harness containers

2018-11-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5440: - Fix Version/s: (was: 2.9.0) 3.0.0 > Add option to mount a

[jira] [Updated] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-11-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5419: - Fix Version/s: (was: 2.9.0) 3.0.0 > Build multiple versions of the

[jira] [Assigned] (BEAM-5865) Auto sharding of streaming sinks in FlinkRunner

2018-11-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5865: Assignee: (was: Maximilian Michels) > Auto sharding of streaming sinks in

[jira] [Updated] (BEAM-5865) Auto sharding of streaming sinks in FlinkRunner

2018-11-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5865: - Fix Version/s: (was: 2.9.0) > Auto sharding of streaming sinks in FlinkRunner >

[jira] [Updated] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-11-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5419: - Fix Version/s: (was: 3.0.0) 2.10.0 > Build multiple versions of

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694748#comment-16694748 ] Maximilian Michels commented on BEAM-6102: -- Is this related to the previous serialization

[jira] [Commented] (BEAM-5467) Python Flink ValidatesRunner job issues

2018-11-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694756#comment-16694756 ] Maximilian Michels commented on BEAM-5467: -- Seems like this is still occasionally flaky. Could we

[jira] [Updated] (BEAM-5442) PortableRunner swallows custom options for Runner

2018-11-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5442: - Fix Version/s: (was: 2.9.0) 3.0.0 > PortableRunner swallows custom

[jira] [Commented] (BEAM-6111) org.apache.beam.runners.flink.PortableTimersExecutionTest is very flakey 40/50 runs failed

2018-11-22 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695744#comment-16695744 ] Maximilian Michels commented on BEAM-6111: -- Looking into this now. >

[jira] [Updated] (BEAM-6111) org.apache.beam.runners.flink.PortableTimersExecutionTest is very flakey 40/50 runs failed

2018-11-22 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6111: - Issue Type: Test (was: New Feature) >

[jira] [Commented] (BEAM-6077) Make UnboundedSource state rescale friendly

2018-11-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693239#comment-16693239 ] Maximilian Michels commented on BEAM-6077: -- [~JozoVilcek] Just saw this. You mentioned the wrong

[jira] [Commented] (BEAM-6055) CoderTypeSerializer#duplicate() should create a deep copy of the coder

2018-11-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693269#comment-16693269 ] Maximilian Michels commented on BEAM-6055: -- Thanks for reporting this [~srichter]. The wrapped

[jira] [Updated] (BEAM-6101) java.lang.ArrayIndexOutOfBoundsException Error reading state

2018-11-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6101: - Affects Version/s: 2.8.0 > java.lang.ArrayIndexOutOfBoundsException Error reading state >

[jira] [Moved] (BEAM-6101) java.lang.ArrayIndexOutOfBoundsException Error reading state

2018-11-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels moved FLINK-10860 to BEAM-6101: -- Component/s: (was: State Backends, Checkpointing)

[jira] [Closed] (BEAM-5284) Enable Java Portable Flink PostCommit Tests to Jenkins

2018-11-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-5284. Resolution: Fixed Fix Version/s: Not applicable Closing this since this has been

[jira] [Updated] (BEAM-6101) java.lang.ArrayIndexOutOfBoundsException Error reading state

2018-11-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6101: - Description: We have a pipeline running on Flink 1.5.4 cluster for while, using Apache

[jira] [Resolved] (BEAM-6055) CoderTypeSerializer#duplicate() should create a deep copy of the coder

2018-11-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6055. -- Resolution: Not A Problem Fix Version/s: Not applicable Closing and moving the

[jira] [Reopened] (BEAM-6101) java.lang.ArrayIndexOutOfBoundsException Error reading state

2018-11-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reopened BEAM-6101: -- Moved from FLINK to BEAM. > java.lang.ArrayIndexOutOfBoundsException Error reading state >

[jira] [Commented] (BEAM-5386) Flink Runner gets progressively stuck when Pubsub subscription is nearly empty

2018-11-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693345#comment-16693345 ] Maximilian Michels commented on BEAM-5386: -- [~chamikara] [~enchom] Thanks for reporting this.

[jira] [Commented] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-11-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693634#comment-16693634 ] Maximilian Michels commented on BEAM-5419: -- With the release cut coming up tomorrow, likely not.

[jira] [Commented] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-11-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699167#comment-16699167 ] Maximilian Michels commented on BEAM-5419: -- [~gstamatakis] The last time I tried it was only a

[jira] [Commented] (BEAM-5197) Flaky test: UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest

2018-11-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700223#comment-16700223 ] Maximilian Michels commented on BEAM-5197: -- I've only tested the fix on MacOS and on Jenkins

[jira] [Commented] (BEAM-6130) Flink RemoteExecutionTest testExecutionWithMultipleStages is flaky

2018-11-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700262#comment-16700262 ] Maximilian Michels commented on BEAM-6130: -- The test

[jira] [Updated] (BEAM-6130) Flink RemoteExecutionTest testExecutionWithMultipleStages is flaky

2018-11-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6130: - Component/s: (was: runner-flink) > Flink RemoteExecutionTest

[jira] [Commented] (BEAM-6060) Tensor flow Chicago taxi failing for 117MB data with IndexOutOfBoundException on Flink MemorySegment

2018-11-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700248#comment-16700248 ] Maximilian Michels commented on BEAM-6060: -- Thanks for letting me know. We have to look into why

[jira] [Commented] (BEAM-5197) Flaky test: UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest

2018-11-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700416#comment-16700416 ] Maximilian Michels commented on BEAM-5197: -- [~kenn] Taking this. Please consider testing the fix

[jira] [Assigned] (BEAM-5197) Flaky test: UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest

2018-11-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5197: Assignee: Maximilian Michels (was: Kenneth Knowles) > Flaky test:

[jira] [Commented] (BEAM-6129) Flink PortableExecutionTest testExecution is flaky or broken

2018-11-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700434#comment-16700434 ] Maximilian Michels commented on BEAM-6129: -- The cause of all these is the same as BEAM-6111. A

[jira] [Resolved] (BEAM-6101) java.lang.ArrayIndexOutOfBoundsException Error reading state

2018-11-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6101. -- Resolution: Cannot Reproduce Fix Version/s: Not applicable Thanks again for

[jira] [Reopened] (BEAM-5197) Flaky test: UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest

2018-11-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reopened BEAM-5197: -- Seems to be flaky again...reopening.

[jira] [Commented] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-11-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702408#comment-16702408 ] Maximilian Michels commented on BEAM-5419: -- [~gstamatakis] The above error is actually just a

<    1   2   3   4   5   6   7   8   9   10   >