[jira] [Commented] (BEAM-5816) Flink portable bundles can fail to close with "Already closed" exception

2018-10-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660270#comment-16660270 ] Maximilian Michels commented on BEAM-5816: -- [~thw] Didn't we already move the shutdown of the SDK

[jira] [Assigned] (BEAM-2918) Flink support for portable user state

2018-10-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-2918: Assignee: Maximilian Michels > Flink support for portable user state >

[jira] [Reopened] (BEAM-5793) Python sdk docs target fails in flink_streaming_impulse_source

2018-10-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reopened BEAM-5793: -- Assignee: Ahmet Altay (was: Micah Wylde) Now failing just on Jenkins after the fix,

[jira] [Assigned] (BEAM-5793) Python sdk docs target fails in flink_streaming_impulse_source

2018-10-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5793: Assignee: Maximilian Michels (was: Ahmet Altay) > Python sdk docs target fails in

[jira] [Assigned] (BEAM-5849) allow the users to anticipate the support of features in the targeted runner

2018-10-24 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5849: Assignee: (was: Kenneth Knowles) > allow the users to anticipate the support

[jira] [Resolved] (BEAM-1438) The default behavior for the Write transform doesn't work well with the Dataflow streaming runner

2018-10-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-1438. -- Resolution: Fixed Fix Version/s: 2.5.0 > The default behavior for the Write

[jira] [Updated] (BEAM-5267) Update Flink Runner to Flink 1.6.x

2018-10-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5267: - Fix Version/s: (was: 2.9.0) > Update Flink Runner to Flink 1.6.x >

[jira] [Updated] (BEAM-5917) Update Flink Runner to 1.5.5

2018-10-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5917: - Fix Version/s: (was: 2.8.0) 2.9.0 > Update Flink Runner to 1.5.5 >

[jira] [Updated] (BEAM-5917) Update Flink Runner to 1.5.5

2018-10-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5917: - Description: We should be on the latest hotfix version to ensure stability for users:

[jira] [Created] (BEAM-5917) Update Flink Runner to 1.5.5

2018-10-30 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-5917: Summary: Update Flink Runner to 1.5.5 Key: BEAM-5917 URL: https://issues.apache.org/jira/browse/BEAM-5917 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-5930) Java SDK harness fails to access state during timer callbacks

2018-11-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-5930. -- Resolution: Fixed Fix Version/s: 2.9.0 > Java SDK harness fails to access state

[jira] [Assigned] (BEAM-5026) Portable flink wordcount fails sometimes due to non-existent source path in FileBasedSink._check_state_for_finalize_write

2018-11-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5026: Assignee: (was: Ahmet Altay) > Portable flink wordcount fails sometimes due to

[jira] [Reopened] (BEAM-5026) Portable flink wordcount fails sometimes due to non-existent source path in FileBasedSink._check_state_for_finalize_write

2018-11-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reopened BEAM-5026: -- Assignee: Ahmet Altay (was: Ankur Goenka) I see this consistently failing with the

[jira] [Updated] (BEAM-5026) Portable flink wordcount fails sometimes due to non-existent source path in FileBasedSink._check_state_for_finalize_write

2018-11-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5026: - Fix Version/s: (was: 2.9.0) > Portable flink wordcount fails sometimes due to

[jira] [Closed] (BEAM-5026) Portable flink wordcount fails sometimes due to non-existent source path in FileBasedSink._check_state_for_finalize_write

2018-11-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-5026. Resolution: Fixed Assignee: Ankur Goenka > Portable flink wordcount fails sometimes

[jira] [Commented] (BEAM-5026) Portable flink wordcount fails sometimes due to non-existent source path in FileBasedSink._check_state_for_finalize_write

2018-11-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671618#comment-16671618 ] Maximilian Michels commented on BEAM-5026: -- Makes sense. Just had this reported by a user but was

[jira] [Updated] (BEAM-5026) Portable flink wordcount fails sometimes due to non-existent source path in FileBasedSink._check_state_for_finalize_write

2018-11-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5026: - Fix Version/s: 2.9.0 > Portable flink wordcount fails sometimes due to non-existent

[jira] [Commented] (BEAM-5026) Portable flink wordcount fails sometimes due to non-existent source path in FileBasedSink._check_state_for_finalize_write

2018-11-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671623#comment-16671623 ] Maximilian Michels commented on BEAM-5026: -- Will open a separate issue. > Portable flink

[jira] [Commented] (BEAM-5859) Improve Traceability of Pipeline translation

2018-10-25 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664073#comment-16664073 ] Maximilian Michels commented on BEAM-5859: -- Since we discussed about this: [~robertwb] [~thw]

[jira] [Commented] (BEAM-5859) Improve Traceability of Pipeline translation

2018-10-25 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664090#comment-16664090 ] Maximilian Michels commented on BEAM-5859: -- I think the first thing we should change is to use

[jira] [Created] (BEAM-5859) Improve Traceability of Pipeline translation

2018-10-25 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-5859: Summary: Improve Traceability of Pipeline translation Key: BEAM-5859 URL: https://issues.apache.org/jira/browse/BEAM-5859 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-2918) Flink support for portable user state

2018-10-25 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-2918. -- Resolution: Fixed Fix Version/s: 2.9.0 > Flink support for portable user state >

[jira] [Updated] (BEAM-5859) Improve Traceability of Pipeline translation

2018-10-25 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5859: - Description: Users often ask how they can reason about the pipeline translation. The

[jira] [Updated] (BEAM-5859) Improve Traceability of Pipeline translation

2018-10-25 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5859: - Attachment: wordcount.png > Improve Traceability of Pipeline translation >

[jira] [Commented] (BEAM-5467) Python Flink ValidatesRunner job issues

2018-11-05 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674946#comment-16674946 ] Maximilian Michels commented on BEAM-5467: -- Can we already bisect this to a particular commit?

[jira] [Created] (BEAM-5865) Auto sharding of streaming sinks in FlinkRunner

2018-10-26 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-5865: Summary: Auto sharding of streaming sinks in FlinkRunner Key: BEAM-5865 URL: https://issues.apache.org/jira/browse/BEAM-5865 Project: Beam Issue

[jira] [Created] (BEAM-5909) QueryablePipeline fails to lookup UserState with Timers

2018-10-29 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-5909: Summary: QueryablePipeline fails to lookup UserState with Timers Key: BEAM-5909 URL: https://issues.apache.org/jira/browse/BEAM-5909 Project: Beam

[jira] [Assigned] (BEAM-4681) Integrate support for timers using the portability APIs into Flink

2018-10-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-4681: Assignee: Maximilian Michels > Integrate support for timers using the portability

[jira] [Commented] (BEAM-3680) Revise code on state & timers blog posts

2018-10-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667440#comment-16667440 ] Maximilian Michels commented on BEAM-3680: --  I believe this can be closed, code looks fine:

[jira] [Commented] (BEAM-2472) Add documentation of state & timers for ParDo to the programming guide

2018-10-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667446#comment-16667446 ] Maximilian Michels commented on BEAM-2472: -- What is the state here (no pun intended)? This has

[jira] [Assigned] (BEAM-5760) Portable Flink support for maxBundleSize/maxBundleMillis

2018-10-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5760: Assignee: Thomas Weise (was: Maximilian Michels) > Portable Flink support for

[jira] [Assigned] (BEAM-5760) Portable Flink support for maxBundleSize/maxBundleMillis

2018-10-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5760: Assignee: Maximilian Michels (was: Thomas Weise) > Portable Flink support for

[jira] [Closed] (BEAM-5917) Update Flink Runner to 1.5.5

2018-11-05 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-5917. Resolution: Fixed > Update Flink Runner to 1.5.5 > > >

[jira] [Created] (BEAM-5971) Checkpointing fails for UnboundedSourceWrapper with no local Readers

2018-11-05 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-5971: Summary: Checkpointing fails for UnboundedSourceWrapper with no local Readers Key: BEAM-5971 URL: https://issues.apache.org/jira/browse/BEAM-5971 Project:

[jira] [Commented] (BEAM-6016) Tensor flow Chicago taxi failing for 256MB data

2018-11-08 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679614#comment-16679614 ] Maximilian Michels commented on BEAM-6016: -- This should be working when you set the following in

[jira] [Created] (BEAM-6020) Rework Docker-inside-Docker for JobServer container

2018-11-08 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6020: Summary: Rework Docker-inside-Docker for JobServer container Key: BEAM-6020 URL: https://issues.apache.org/jira/browse/BEAM-6020 Project: Beam Issue

[jira] [Commented] (BEAM-867) Support set/delete of timers by ID in Flink runner

2018-11-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688266#comment-16688266 ] Maximilian Michels commented on BEAM-867: - I'm fixing this in the course of completing BEAM-4681.

[jira] [Assigned] (BEAM-867) Support set/delete of timers by ID in Flink runner

2018-11-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-867: --- Assignee: Maximilian Michels (was: Aljoscha Krettek) > Support set/delete of timers

[jira] [Commented] (BEAM-6058) Support flink config directory for flink runner.

2018-11-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688521#comment-16688521 ] Maximilian Michels commented on BEAM-6058: -- I agree, if at all, the file should be shipped. Using

[jira] [Closed] (BEAM-5999) Proto error when running test_pardo_timers of Python PortableValidatesRunner

2018-11-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-5999. Resolution: Fixed Assignee: Robert Bradshaw > Proto error when running

[jira] [Resolved] (BEAM-5249) org.apache.beam.runners.flink.streaming.UnboundedSourceWrapperTest ParameterizedUnboundedSourceWrapperTest hangs

2018-11-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-5249. -- Resolution: Duplicate Fix Version/s: Not applicable I believe this has been

[jira] [Updated] (BEAM-4681) Integrate support for timers using the portability APIs into Flink

2018-11-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-4681: - Fix Version/s: 2.9.0 > Integrate support for timers using the portability APIs into Flink

[jira] [Commented] (BEAM-6058) Support flink config directory for flink runner.

2018-11-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689270#comment-16689270 ] Maximilian Michels commented on BEAM-6058: -- AFAIK _all_ job-related configuration is assembled

[jira] [Assigned] (BEAM-5197) Flaky test: UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest

2018-11-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5197: Assignee: Maximilian Michels (was: Aljoscha Krettek) > Flaky test:

[jira] [Created] (BEAM-5999) Proto error when running test_pardo_timers of Python PortableValidatesRunner

2018-11-06 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-5999: Summary: Proto error when running test_pardo_timers of Python PortableValidatesRunner Key: BEAM-5999 URL: https://issues.apache.org/jira/browse/BEAM-5999

[jira] [Commented] (BEAM-5999) Proto error when running test_pardo_timers of Python PortableValidatesRunner

2018-11-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677231#comment-16677231 ] Maximilian Michels commented on BEAM-5999: -- Probably a low-hanging fruit but haven't looked into

[jira] [Created] (BEAM-6009) PortableValidatesRunner runs only in batch mode

2018-11-07 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6009: Summary: PortableValidatesRunner runs only in batch mode Key: BEAM-6009 URL: https://issues.apache.org/jira/browse/BEAM-6009 Project: Beam Issue

[jira] [Closed] (BEAM-5931) Rollback PR/6899

2018-11-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-5931. Resolution: Fixed Fix Version/s: Not applicable > Rollback PR/6899 >

[jira] [Resolved] (BEAM-5299) Define max global window as a shared value in protos like URN enums.

2018-11-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-5299. -- Resolution: Fixed Fix Version/s: 2.9.0 > Define max global window as a shared

[jira] [Created] (BEAM-6032) Move PortableVaidatesRunner configuration out of BeamModulePlugin

2018-11-09 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6032: Summary: Move PortableVaidatesRunner configuration out of BeamModulePlugin Key: BEAM-6032 URL: https://issues.apache.org/jira/browse/BEAM-6032 Project: Beam

[jira] [Created] (BEAM-6329) State for portable timers can interfere with user state

2018-12-29 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6329: Summary: State for portable timers can interfere with user state Key: BEAM-6329 URL: https://issues.apache.org/jira/browse/BEAM-6329 Project: Beam

[jira] [Closed] (BEAM-6329) State for portable timers can interfere with user state

2018-12-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6329. Resolution: Fixed > State for portable timers can interfere with user state >

[jira] [Assigned] (BEAM-5396) Flink portable runner savepoint / upgrade support

2018-12-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5396: Assignee: Maximilian Michels (was: Thomas Weise) > Flink portable runner

[jira] [Commented] (BEAM-6315) CountingSource returns CheckpointMark with null date

2018-12-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16729763#comment-16729763 ] Maximilian Michels commented on BEAM-6315: -- >From UnboundedSource: {quote}May not be called

[jira] [Commented] (BEAM-6289) Running a join on two Cassandra tables using FlinkRunner fails

2018-12-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16729735#comment-16729735 ] Maximilian Michels commented on BEAM-6289: -- Thanks for reporting [~srfrnk]. Could you post the

[jira] [Updated] (BEAM-6315) CountingSource returns CheckpointMark with null date

2018-12-27 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6315: - Component/s: runner-flink > CountingSource returns CheckpointMark with null date >

[jira] [Closed] (BEAM-6440) FlinkTimerInternals memory leak

2019-01-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6440. Resolution: Fixed > FlinkTimerInternals memory leak > --- > >

[jira] [Commented] (BEAM-6440) FlinkTimerInternals memory leak

2019-01-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744189#comment-16744189 ] Maximilian Michels commented on BEAM-6440: -- We should consider backporting this to 2.9.0 if we do

[jira] [Assigned] (BEAM-6230) Document Flink version support policy

2019-01-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6230: Assignee: Maximilian Michels > Document Flink version support policy >

[jira] [Commented] (BEAM-6405) Improve PortableValidatesRunner test reliability on Jenkins

2019-01-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744608#comment-16744608 ] Maximilian Michels commented on BEAM-6405: -- Streaming execution looks very good:

[jira] [Created] (BEAM-6460) PipelineOptionsFactory may hold on to Classloader after pipeline restart

2019-01-17 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6460: Summary: PipelineOptionsFactory may hold on to Classloader after pipeline restart Key: BEAM-6460 URL: https://issues.apache.org/jira/browse/BEAM-6460

[jira] [Updated] (BEAM-6465) Flink: State accumulation during restoring from a savepoint

2019-01-18 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6465: - Issue Type: Bug (was: Test) > Flink: State accumulation during restoring from a

[jira] [Created] (BEAM-6469) Python ValidatesRunner tests fail due to missing module

2019-01-18 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6469: Summary: Python ValidatesRunner tests fail due to missing module Key: BEAM-6469 URL: https://issues.apache.org/jira/browse/BEAM-6469 Project: Beam

[jira] [Commented] (BEAM-6469) Python Flink ValidatesRunner tests fail due to missing module

2019-01-18 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746860#comment-16746860 ] Maximilian Michels commented on BEAM-6469: -- Thanks for investigating! > Python Flink

[jira] [Updated] (BEAM-6460) Jackson Cache may hold on to Classloader after pipeline restart

2019-01-18 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6460: - Summary: Jackson Cache may hold on to Classloader after pipeline restart (was:

[jira] [Updated] (BEAM-6469) Python Flink ValidatesRunner tests fail due to missing module

2019-01-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6469: - Fix Version/s: 2.11.0 > Python Flink ValidatesRunner tests fail due to missing module >

[jira] [Commented] (BEAM-6469) Python Flink ValidatesRunner tests fail due to missing module

2019-01-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747159#comment-16747159 ] Maximilian Michels commented on BEAM-6469: -- Also backported this to the {{release-2.10.0}}

[jira] [Commented] (BEAM-6470) python tenacity is breaks the Python validates runner flink tests

2019-01-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747142#comment-16747142 ] Maximilian Michels commented on BEAM-6470: -- This is a duplicate of BEAM-6469, but removing

[jira] [Closed] (BEAM-6469) Python Flink ValidatesRunner tests fail due to missing module

2019-01-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6469. Resolution: Fixed Thanks for the fix. Creating a new issue for the now visible failing

[jira] [Commented] (BEAM-6465) Flink: State accumulation during restoring from a savepoint

2019-01-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747168#comment-16747168 ] Maximilian Michels commented on BEAM-6465: -- Thank you for the detailed bug report. Like you

[jira] [Resolved] (BEAM-5396) Flink portable runner savepoint / upgrade support

2019-01-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-5396. -- Resolution: Fixed Fix Version/s: 2.11.0 Resolving. The initial scope of this

[jira] [Commented] (BEAM-6435) beam_PostCommit_Java_PVR_Flink_Batch regularly failing

2019-01-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743181#comment-16743181 ] Maximilian Michels commented on BEAM-6435: -- This is the same symptom we were seeing for parallel

[jira] [Assigned] (BEAM-6435) beam_PostCommit_Java_PVR_Flink_Batch regularly failing

2019-01-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-6435: Assignee: Maximilian Michels > beam_PostCommit_Java_PVR_Flink_Batch regularly

[jira] [Commented] (BEAM-6440) FlinkTimerInternals memory leak

2019-01-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743288#comment-16743288 ] Maximilian Michels commented on BEAM-6440: -- Thank you for the profiling. This was very helpful. I

[jira] [Resolved] (BEAM-6321) flinkCompatibilityMatrixBatchDOCKER out of memory

2019-01-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6321. -- Resolution: Fixed Fix Version/s: Not applicable Should be fixed by

[jira] [Closed] (BEAM-6234) [Flink Runner] Make failOnCheckpointingErrors setting available in FlinkPipelineOptions

2019-01-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6234. Resolution: Fixed Fix Version/s: (was: 2.8.0) 2.10.0 > [Flink

[jira] [Resolved] (BEAM-6418) beam_PreCommit_Java_Cron failing

2019-01-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-6418. -- Resolution: Fixed Fix Version/s: Not applicable Looks like the issue is

[jira] [Closed] (BEAM-6439) Move Python Flink VR tests to PreCommit

2019-01-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6439. Resolution: Fixed Assignee: Robert Bradshaw (was: Jason Kuster) Fix

[jira] [Commented] (BEAM-4176) Java: Portable batch runner passes all ValidatesRunner tests that non-portable runner passes

2019-01-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743486#comment-16743486 ] Maximilian Michels commented on BEAM-4176: -- Awesome, thanks for the info. > Java: Portable

[jira] [Commented] (BEAM-6460) Jackson Cache may hold on to Classloader after pipeline restart

2019-01-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748279#comment-16748279 ] Maximilian Michels commented on BEAM-6460: -- Update on this: Not a Beam issue. Flink leaks

[jira] [Updated] (BEAM-5396) Flink portable runner savepoint / upgrade support

2019-01-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-5396: - Fix Version/s: 2.10.0 > Flink portable runner savepoint / upgrade support >

[jira] [Commented] (BEAM-6470) python tenacity is breaks the Python validates runner flink tests

2019-01-22 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749274#comment-16749274 ] Maximilian Michels commented on BEAM-6470: -- We can, though it doesn't seem to be necessary. The

[jira] [Commented] (BEAM-4176) Java: Portable batch runner passes all ValidatesRunner tests that non-portable runner passes

2019-01-15 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743166#comment-16743166 ] Maximilian Michels commented on BEAM-4176: -- Small update on this, these are the categories still

[jira] [Created] (BEAM-6473) Python Flink ValidatesRunner test_flattened_side_input fails

2019-01-19 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6473: Summary: Python Flink ValidatesRunner test_flattened_side_input fails Key: BEAM-6473 URL: https://issues.apache.org/jira/browse/BEAM-6473 Project: Beam

[jira] [Commented] (BEAM-6469) Python Flink ValidatesRunner tests fail due to missing module

2019-01-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747170#comment-16747170 ] Maximilian Michels commented on BEAM-6469: -- Follow-up:

[jira] [Closed] (BEAM-6216) Flink post commits are failing

2018-12-12 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-6216. Resolution: Fixed Fix Version/s: Not applicable > Flink post commits are failing >

[jira] [Commented] (BEAM-4465) Enable Flink runner to run IOITs

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16717601#comment-16717601 ] Maximilian Michels commented on BEAM-4465: -- What is the state here? > Enable Flink runner to run

[jira] [Updated] (BEAM-6131) ElasticSearchIO is flaky: testRead, testWrite, testWritePartialUpdate classMethod

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6131: - Component/s: (was: runner-flink) io-java-elasticsearch >

[jira] [Updated] (BEAM-3897) Flink runners fails on multioutput portable pipeline

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-3897: - Description: When trying a Go pipeline with a 2-output DoFn on the hacking branch, I see:

[jira] [Resolved] (BEAM-3414) AfterProcessingTime trigger issue with Flink Runner

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-3414. -- Resolution: Duplicate Fix Version/s: Not applicable Looks like a duplicate of

[jira] [Commented] (BEAM-4520) No messages delivered after a while with PubsubIO

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16717597#comment-16717597 ] Maximilian Michels commented on BEAM-4520: -- We should at least WARN or throw an exception if the

[jira] [Commented] (BEAM-6187) Drop Scala suffix of FlinkRunner artifacts

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16717560#comment-16717560 ] Maximilian Michels commented on BEAM-6187: -- I think we will drop the _2.11 syntax beginning with

[jira] [Resolved] (BEAM-3919) checkpoint can not work with flink 1.4.1,1.4.2

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-3919. -- Resolution: Fixed Fix Version/s: Not applicable Closing because this is resolved

[jira] [Commented] (BEAM-4520) No messages delivered after a while with PubsubIO

2018-12-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16717596#comment-16717596 ] Maximilian Michels commented on BEAM-4520: -- It is correct that the acking only works when

[jira] [Closed] (BEAM-5267) Update Flink Runner to Flink 1.6.x

2018-12-12 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-5267. Resolution: Fixed Fix Version/s: 2.10.0 > Update Flink Runner to Flink 1.6.x >

[jira] [Closed] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-12-12 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-5419. Resolution: Fixed > Build multiple versions of the Flink Runner against different Flink

[jira] [Commented] (BEAM-5419) Build multiple versions of the Flink Runner against different Flink versions

2018-12-12 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719425#comment-16719425 ] Maximilian Michels commented on BEAM-5419: -- [~djharper] Thanks for the pointer to the AWS

[jira] [Commented] (BEAM-5267) Update Flink Runner to Flink 1.6.x

2018-12-12 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719426#comment-16719426 ] Maximilian Michels commented on BEAM-5267: -- Fixed via BEAM-5419. > Update Flink Runner to Flink

[jira] [Updated] (BEAM-6227) FlinkRunner errors if GroupByKey contains null values (streaming mode only)

2018-12-13 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-6227: - Description: Apparently this passed ValidatesRunner in streaming mode although this is a

[jira] [Created] (BEAM-6227) FlinkRunner errors if GroupByKey contains null values (streaming mode only)

2018-12-13 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-6227: Summary: FlinkRunner errors if GroupByKey contains null values (streaming mode only) Key: BEAM-6227 URL: https://issues.apache.org/jira/browse/BEAM-6227

  1   2   3   4   5   6   7   8   9   10   >