[jira] [Closed] (BEAM-5372) [Flink Runner] Make minPauseBetweenCheckpoints setting available in FlinkPipelineOptions

2018-09-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-5372. -- Resolution: Fixed > [Flink Runner] Make minPauseBetweenCheckpoints setting available in >

[jira] [Updated] (BEAM-5372) [Flink Runner] Make minPauseBetweenCheckpoints setting available in FlinkPipelineOptions

2018-09-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-5372: --- Fix Version/s: 2.7.0 > [Flink Runner] Make minPauseBetweenCheckpoints setting available in >

[jira] [Commented] (BEAM-3919) checkpoint can not work with flink 1.4.1,1.4.2

2018-08-22 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588744#comment-16588744 ] Aljoscha Krettek commented on BEAM-3919: Unfortunately, I don't think we can fix this right now

[jira] [Closed] (BEAM-4798) IndexOutOfBoundsException when Flink parallelism > 1

2018-08-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-4798. -- Resolution: Fixed > IndexOutOfBoundsException when Flink parallelism > 1 >

[jira] [Updated] (BEAM-4798) IndexOutOfBoundsException when Flink parallelism > 1

2018-08-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-4798: --- Fix Version/s: 2.7.0 > IndexOutOfBoundsException when Flink parallelism > 1 >

[jira] [Commented] (BEAM-2930) Flink support for portable side input

2018-07-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559894#comment-16559894 ] Aljoscha Krettek commented on BEAM-2930: Yes, that sounds like a good approach. I upgraded the

[jira] [Closed] (BEAM-4311) Enforce ErrorProne analysis in Flink runner project

2018-06-08 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-4311. -- Resolution: Fixed > Enforce ErrorProne analysis in Flink runner project >

[jira] [Updated] (BEAM-4311) Enforce ErrorProne analysis in Flink runner project

2018-06-08 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-4311: --- Fix Version/s: 2.6.0 > Enforce ErrorProne analysis in Flink runner project >

[jira] [Updated] (BEAM-3909) Add tests for Flink DoFnOperator side-input checkpointing

2018-04-30 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-3909: --- Fix Version/s: 2.5.0 > Add tests for Flink DoFnOperator side-input checkpointing >

[jira] [Closed] (BEAM-3909) Add tests for Flink DoFnOperator side-input checkpointing

2018-04-30 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3909. -- Resolution: Fixed > Add tests for Flink DoFnOperator side-input checkpointing >

[jira] [Assigned] (BEAM-4063) Flink runner supports cluster-wide artifact deployments through the Distributed Cache

2018-04-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-4063: -- Assignee: (was: Aljoscha Krettek) > Flink runner supports cluster-wide artifact

[jira] [Assigned] (BEAM-4067) Add portable Flink test runner

2018-04-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-4067: -- Assignee: (was: Aljoscha Krettek) > Add portable Flink test runner >

[jira] [Commented] (BEAM-2927) Python SDK support for portable side input

2018-04-03 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423602#comment-16423602 ] Aljoscha Krettek commented on BEAM-2927: The problematic piece is this:

[jira] [Closed] (BEAM-3087) Extend lock scope in Flink UnboundedSourceWrapper

2018-03-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3087. -- Resolution: Fixed Fix Version/s: 2.5.0 > Extend lock scope in Flink

[jira] [Closed] (BEAM-2393) BoundedSource is not fault-tolerant in FlinkRunner Streaming mode

2018-03-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2393. -- Resolution: Fixed Fix Version/s: 2.5.0 > BoundedSource is not fault-tolerant in

[jira] [Reopened] (BEAM-622) Add checkpointing tests for DoFnOperator and WindowDoFnOperator

2018-03-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened BEAM-622: --- > Add checkpointing tests for DoFnOperator and WindowDoFnOperator >

[jira] [Closed] (BEAM-622) Add checkpointing tests for DoFnOperator and WindowDoFnOperator

2018-03-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-622. - Resolution: Fixed Fix Version/s: 2.5.0 > Add checkpointing tests for DoFnOperator and

[jira] [Closed] (BEAM-3800) Set uids on Flink operators

2018-03-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3800. -- Resolution: Fixed Fix Version/s: 2.5.0 > Set uids on Flink operators >

[jira] [Assigned] (BEAM-3919) checkpoint can not work with flink 1.4.1,1.4.2

2018-03-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3919: -- Assignee: Harshal Tripathi > checkpoint can not work with flink 1.4.1,1.4.2 >

[jira] [Assigned] (BEAM-3919) checkpoint can not work with flink 1.4.1,1.4.2

2018-03-23 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3919: -- Assignee: (was: Aljoscha Krettek) > checkpoint can not work with flink 1.4.1,1.4.2

[jira] [Created] (BEAM-3909) Add tests for Flink DoFnOperator side-input checkpointing

2018-03-21 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-3909: -- Summary: Add tests for Flink DoFnOperator side-input checkpointing Key: BEAM-3909 URL: https://issues.apache.org/jira/browse/BEAM-3909 Project: Beam

[jira] [Created] (BEAM-3905) Update Flink Runner to Flink 1.5.0

2018-03-21 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-3905: -- Summary: Update Flink Runner to Flink 1.5.0 Key: BEAM-3905 URL: https://issues.apache.org/jira/browse/BEAM-3905 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-2393) BoundedSource is not fault-tolerant in FlinkRunner Streaming mode

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405185#comment-16405185 ] Aljoscha Krettek commented on BEAM-2393: Yes, it's very good to worry about those things!  I

[jira] [Commented] (BEAM-2393) BoundedSource is not fault-tolerant in FlinkRunner Streaming mode

2018-03-16 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402220#comment-16402220 ] Aljoscha Krettek commented on BEAM-2393: Ah, I think that explains it. This call in the source:

[jira] [Closed] (BEAM-3043) Set user-specified Transform names on Flink operations

2018-03-13 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3043. -- Resolution: Fixed > Set user-specified Transform names on Flink operations >

[jira] [Commented] (BEAM-2393) BoundedSource is not fault-tolerant in FlinkRunner Streaming mode

2018-03-13 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397890#comment-16397890 ] Aljoscha Krettek commented on BEAM-2393: Have you enabled DEBUG logging in Flink? What do the logs

[jira] [Assigned] (BEAM-3675) FlinkRunner: Logging server

2018-03-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3675: -- Assignee: (was: Aljoscha Krettek) > FlinkRunner: Logging server >

[jira] [Assigned] (BEAM-3673) FlinkRunner: Harness manager for connecting operators to SDK Harnesses

2018-03-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3673: -- Assignee: (was: Aljoscha Krettek) > FlinkRunner: Harness manager for connecting

[jira] [Closed] (BEAM-3753) Integration ITCase tests are not executed

2018-03-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3753. -- Resolution: Fixed Fix Version/s: (was: 2.4.0) 2.5.0 > Integration

[jira] [Reopened] (BEAM-3043) Set user-specified Transform names on Flink operations

2018-03-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened BEAM-3043: Reopen to change fixVersion > Set user-specified Transform names on Flink operations >

[jira] [Reopened] (BEAM-3753) Integration ITCase tests are not executed

2018-03-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened BEAM-3753: Reopen to change fixVersion. > Integration ITCase tests are not executed >

[jira] [Updated] (BEAM-3043) Set user-specified Transform names on Flink operations

2018-03-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-3043: --- Fix Version/s: (was: 2.4.0) 2.5.0 > Set user-specified Transform names

[jira] [Closed] (BEAM-3043) Set user-specified Transform names on Flink operations

2018-03-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3043. -- Resolution: Fixed Fix Version/s: 2.4.0 > Set user-specified Transform names on Flink

[jira] [Closed] (BEAM-3753) Integration ITCase tests are not executed

2018-03-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3753. -- Resolution: Fixed Fix Version/s: 2.4.0 > Integration ITCase tests are not executed >

[jira] [Closed] (BEAM-3768) Compile error for Flink translation

2018-03-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3768. -- Resolution: Fixed Assignee: Thomas Groh (was: Aljoscha Krettek) This was resolved via

[jira] [Updated] (BEAM-3768) Compile error for Flink translation

2018-03-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-3768: --- Issue Type: Bug (was: Test) > Compile error for Flink translation >

[jira] [Commented] (BEAM-3768) Compile error for Flink translation

2018-03-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383585#comment-16383585 ] Aljoscha Krettek commented on BEAM-3768: [~robertwb] & [~rmannibucau] I commented on the PR:

[jira] [Updated] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2018-02-23 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-2140: --- Fix Version/s: 2.4.0 > Fix SplittableDoFn ValidatesRunner tests in FlinkRunner >

[jira] [Closed] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2018-02-23 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2140. -- Resolution: Fixed > Fix SplittableDoFn ValidatesRunner tests in FlinkRunner >

[jira] [Assigned] (BEAM-3728) Failing ParDoTest for Flink Runner

2018-02-22 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3728: -- Assignee: (was: Aljoscha Krettek) > Failing ParDoTest for Flink Runner >

[jira] [Commented] (BEAM-3728) Failing ParDoTest for Flink Runner

2018-02-22 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372906#comment-16372906 ] Aljoscha Krettek commented on BEAM-3728: Also cc [~romain.manni-bucau] as the implementor. I

[jira] [Created] (BEAM-3728) Failing ParDoTest for Flink Runner

2018-02-22 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-3728: -- Summary: Failing ParDoTest for Flink Runner Key: BEAM-3728 URL: https://issues.apache.org/jira/browse/BEAM-3728 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-3673) FlinkRunner: Harness manager for connecting operators to SDK Harnesses

2018-02-09 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358208#comment-16358208 ] Aljoscha Krettek commented on BEAM-3673: [~bsidhom] Am I supposed to be assigned to all of those

[jira] [Created] (BEAM-3648) Support Splittable DoFn in Flink Batch Runner

2018-02-08 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-3648: -- Summary: Support Splittable DoFn in Flink Batch Runner Key: BEAM-3648 URL: https://issues.apache.org/jira/browse/BEAM-3648 Project: Beam Issue Type: New

[jira] [Commented] (BEAM-2806) support View.CreatePCollectionView in FlinkRunner

2018-02-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353712#comment-16353712 ] Aljoscha Krettek commented on BEAM-2806: [~jbonofre] I merged this in master in commit

[jira] [Updated] (BEAM-2806) support View.CreatePCollectionView in FlinkRunner

2018-02-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-2806: --- Fix Version/s: 2.3.0 > support View.CreatePCollectionView in FlinkRunner >

[jira] [Closed] (BEAM-2806) support View.CreatePCollectionView in FlinkRunner

2018-02-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2806. -- Resolution: Fixed > support View.CreatePCollectionView in FlinkRunner >

[jira] [Closed] (BEAM-3186) In-flight data loss when restoring from savepoint

2018-02-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3186. -- Resolution: Fixed > In-flight data loss when restoring from savepoint >

[jira] [Closed] (BEAM-3589) Flink runner breaks with ClassCastException on UnboundedSource

2018-02-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3589. -- Resolution: Fixed > Flink runner breaks with ClassCastException on UnboundedSource >

[jira] [Updated] (BEAM-3589) Flink runner breaks with ClassCastException on UnboundedSource

2018-02-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-3589: --- Fix Version/s: 2.3.0 > Flink runner breaks with ClassCastException on UnboundedSource >

[jira] [Commented] (BEAM-3589) Flink runner breaks with ClassCastException on UnboundedSource

2018-02-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352250#comment-16352250 ] Aljoscha Krettek commented on BEAM-3589: [~jbonofre] This was now fixed as part of another fix in

[jira] [Commented] (BEAM-3186) In-flight data loss when restoring from savepoint

2018-02-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352248#comment-16352248 ] Aljoscha Krettek commented on BEAM-3186: [~jbonofre] This was fixed on master in these commits:

[jira] [Commented] (BEAM-3589) Flink runner breaks with ClassCastException on UnboundedSource

2018-02-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348631#comment-16348631 ] Aljoscha Krettek commented on BEAM-3589: [~grzegorz_kolakowski] I think I'm too tired today but

[jira] [Assigned] (BEAM-2806) support View.CreatePCollectionView in FlinkRunner

2018-02-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-2806: -- Assignee: Grzegorz Kołakowski (was: Aljoscha Krettek) > support

[jira] [Assigned] (BEAM-3589) Flink runner breaks with ClassCastException on UnboundedSource

2018-02-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3589: -- Assignee: Grzegorz Kołakowski > Flink runner breaks with ClassCastException on

[jira] [Assigned] (BEAM-3186) In-flight data loss when restoring from savepoint

2018-02-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3186: -- Assignee: Dawid Wysakowicz (was: Aljoscha Krettek) > In-flight data loss when

[jira] [Commented] (BEAM-3414) AfterProcessingTime trigger issue with Flink Runner

2018-02-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348542#comment-16348542 ] Aljoscha Krettek commented on BEAM-3414: Still working on getting that PR in, yes. >

[jira] [Commented] (BEAM-3087) Extend lock scope in Flink UnboundedSourceWrapper

2018-01-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341059#comment-16341059 ] Aljoscha Krettek commented on BEAM-3087: There was one user that had a problem because of this but

[jira] [Comment Edited] (BEAM-3494) Snapshot state of aggregated data of apache beam project is not maintained in flink's checkpointing

2018-01-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341057#comment-16341057 ] Aljoscha Krettek edited comment on BEAM-3494 at 1/26/18 1:32 PM: - How are

[jira] [Commented] (BEAM-3494) Snapshot state of aggregated data of apache beam project is not maintained in flink's checkpointing

2018-01-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341057#comment-16341057 ] Aljoscha Krettek commented on BEAM-3494: How are you enabling checkpointing? Also, could you please

***UNCHECKED*** [jira] [Assigned] (BEAM-3472) Create a callback triggered at the end of a batch in flink runner

2018-01-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3472: -- Assignee: (was: Aljoscha Krettek) > Create a callback triggered at the end of a

[jira] [Assigned] (BEAM-3494) Snapshot state of aggregated data of apache beam project is not maintained in flink's checkpointing

2018-01-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3494: -- Assignee: (was: Aljoscha Krettek) > Snapshot state of aggregated data of apache

[jira] [Commented] (BEAM-3529) Side Input callbacks should fire after a window has expired in addition to when the trigger would fire

2018-01-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341044#comment-16341044 ] Aljoscha Krettek commented on BEAM-3529: There should probably also be {{ValidatesRunner}} tests

[jira] [Assigned] (BEAM-3370) Add ability to stage directories with compiled classes to Flink

2018-01-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3370: -- Assignee: (was: Aljoscha Krettek) > Add ability to stage directories with compiled

[jira] [Assigned] (BEAM-3359) Unable to change "flinkMaster" from "[auto]" in TestFlinkRunner

2018-01-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3359: -- Assignee: (was: Aljoscha Krettek) > Unable to change "flinkMaster" from "[auto]" in

[jira] [Commented] (BEAM-3379) PAssert not successful when running IOITs with Flink runner

2018-01-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313338#comment-16313338 ] Aljoscha Krettek commented on BEAM-3379: Could you check whether this PR fixes it?

[jira] [Commented] (BEAM-3414) AfterProcessingTime trigger issue with Flink Runner

2018-01-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313329#comment-16313329 ] Aljoscha Krettek commented on BEAM-3414: I openen a PR for a related bug and I think this issue

[jira] [Assigned] (BEAM-3043) Set user-specified Transform names on Flink operations

2018-01-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3043: -- Assignee: (was: Aljoscha Krettek) > Set user-specified Transform names on Flink

[jira] [Updated] (BEAM-2873) Detect number of shards for file sink in Flink Streaming Runner

2018-01-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-2873: --- Summary: Detect number of shards for file sink in Flink Streaming Runner (was: Detect number

[jira] [Assigned] (BEAM-2873) Detect number of sharsd for file sink in Flink Streaming Runner

2018-01-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-2873: -- Assignee: (was: Aljoscha Krettek) > Detect number of sharsd for file sink in Flink

[jira] [Closed] (BEAM-2377) Cross compile flink runner to scala 2.11

2018-01-04 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2377. -- Resolution: Invalid Fix Version/s: (was: 2.3.0) Not applicable Now

[jira] [Commented] (BEAM-1601) Flink Runner support for PerfKit Benchmarker

2017-11-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240093#comment-16240093 ] Aljoscha Krettek commented on BEAM-1601: I'm not aware of any work on this, no. > Flink Runner

[jira] [Created] (BEAM-3087) Extend lock scope in Flink UnboundedSourceWrapper

2017-10-21 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-3087: -- Summary: Extend lock scope in Flink UnboundedSourceWrapper Key: BEAM-3087 URL: https://issues.apache.org/jira/browse/BEAM-3087 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-3087) Extend lock scope in Flink UnboundedSourceWrapper

2017-10-21 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-3087: -- Assignee: (was: Aljoscha Krettek) > Extend lock scope in Flink

[jira] [Created] (BEAM-3043) Set user-specified Transform names on Flink operations

2017-10-11 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-3043: -- Summary: Set user-specified Transform names on Flink operations Key: BEAM-3043 URL: https://issues.apache.org/jira/browse/BEAM-3043 Project: Beam Issue

[jira] [Closed] (BEAM-3027) Output type of SourceID-stripper is not correctly set

2017-10-09 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3027. -- Resolution: Fixed > Output type of SourceID-stripper is not correctly set >

[jira] [Created] (BEAM-3027) Output type of SourceID-stripper is not correctly set

2017-10-06 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-3027: -- Summary: Output type of SourceID-stripper is not correctly set Key: BEAM-3027 URL: https://issues.apache.org/jira/browse/BEAM-3027 Project: Beam Issue

[jira] [Commented] (BEAM-2995) can't read/write hdfs in Flink CLUSTER(Standalone)

2017-09-28 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184169#comment-16184169 ] Aljoscha Krettek commented on BEAM-2995: How are you starting your cluster? There was also some

[jira] [Commented] (BEAM-2975) Results of ReadableState.read() should be snapshots of the underlying state

2017-09-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182151#comment-16182151 ] Aljoscha Krettek commented on BEAM-2975: These changes also broke the PostCommit tests for the

[jira] [Commented] (BEAM-2980) BagState.isEmpty needs a tighter spec

2017-09-22 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176119#comment-16176119 ] Aljoscha Krettek commented on BEAM-2980: I think this is a more specific version of BEAM-2975. >

[jira] [Reopened] (BEAM-2377) Cross compile flink runner to scala 2.11

2017-09-21 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened BEAM-2377: Commit was reverted. > Cross compile flink runner to scala 2.11 >

[jira] [Closed] (BEAM-2973) Jenkins PreCommit broken due to missing dependency

2017-09-21 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2973. -- Resolution: Fixed Fix Version/s: Not applicable This was fixed in the revert commit

[jira] [Closed] (BEAM-2377) Cross compile flink runner to scala 2.11

2017-09-20 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2377. -- Resolution: Fixed Fix Version/s: 2.2.0 Implemented in

[jira] [Closed] (BEAM-2948) Unable to find registrar when restoring flink job from savepoint

2017-09-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2948. -- Resolution: Fixed Fix Version/s: 2.2.0 Fixed in 14ea5abe3c3900e5cb423a8580fbdcc6e28fe376

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-09-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170437#comment-16170437 ] Aljoscha Krettek commented on BEAM-2140: As I commented on the PR, I have a solution that is

[jira] [Closed] (BEAM-1688) Getting listener timeout after waiting for [10000] ms from ElasticsearchIO

2017-09-15 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-1688. -- Resolution: Fixed Fix Version/s: 2.2.0 > Getting listener timeout after waiting for

[jira] [Commented] (BEAM-2712) SerializablePipelineOptions should not call FileSystems.setDefaultPipelineOptions.

2017-09-15 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167598#comment-16167598 ] Aljoscha Krettek commented on BEAM-2712: [~jkff] See my comment on BEAM-2948, I think for Flink we

[jira] [Commented] (BEAM-2948) Unable to find registrar when restoring flink job from savepoint

2017-09-15 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167532#comment-16167532 ] Aljoscha Krettek commented on BEAM-2948: Yes, that's true but we probably have to wait a few more

[jira] [Closed] (BEAM-2807) NullPointerException during checkpoint on FlinkRunner

2017-09-15 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2807. -- Resolution: Fixed Fix Version/s: 2.2.0 Fixed in 81d0c436691d33a7ea1bd808413e1aa08e1c4d10

[jira] [Commented] (BEAM-2943) Beam Flink deployment results in ClassNotFoundException

2017-09-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166276#comment-16166276 ] Aljoscha Krettek commented on BEAM-2943: Could you verify that

[jira] [Commented] (BEAM-2948) Unable to find registrar when restoring flink job from savepoint

2017-09-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166124#comment-16166124 ] Aljoscha Krettek commented on BEAM-2948: I think the problem is that Beam will only "instantiate"

[jira] [Created] (BEAM-2873) Detect number of sharsd for file sink in Flink Streaming Runner

2017-09-10 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-2873: -- Summary: Detect number of sharsd for file sink in Flink Streaming Runner Key: BEAM-2873 URL: https://issues.apache.org/jira/browse/BEAM-2873 Project: Beam

[jira] [Commented] (BEAM-2831) Possible bug in Beam+Flink memory management, disk spillover

2017-09-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150656#comment-16150656 ] Aljoscha Krettek commented on BEAM-2831: [~kenn] Do you think we can change {{SerializableCoder}}

[jira] [Comment Edited] (BEAM-2831) Possible bug in Beam+Flink memory management, disk spillover

2017-08-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148985#comment-16148985 ] Aljoscha Krettek edited comment on BEAM-2831 at 8/31/17 1:41 PM: - Could you

[jira] [Commented] (BEAM-2831) Possible bug in Beam+Flink memory management, disk spillover

2017-08-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148985#comment-16148985 ] Aljoscha Krettek commented on BEAM-2831: Could you try running it with this modified

[jira] [Commented] (BEAM-2457) Error: "Unable to find registrar for hdfs" - need to prevent/improve error message

2017-08-30 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146873#comment-16146873 ] Aljoscha Krettek commented on BEAM-2457: (This is on the Cloudera Quickstart VM) I noticed that

[jira] [Commented] (BEAM-2457) Error: "Unable to find registrar for hdfs" - need to prevent/improve error message

2017-08-29 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145017#comment-16145017 ] Aljoscha Krettek commented on BEAM-2457: The error in 2.2.0-SNAPSHOT occurs because we no longer

[jira] [Commented] (BEAM-2806) support View.CreatePCollectionView in FlinkRunner

2017-08-28 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143897#comment-16143897 ] Aljoscha Krettek commented on BEAM-2806: I tried this on the Flink Runner (both batch and

[jira] [Commented] (BEAM-2457) Error: "Unable to find registrar for hdfs" - need to prevent/improve error message

2017-08-28 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143846#comment-16143846 ] Aljoscha Krettek commented on BEAM-2457: Is there any update on this? I have a jar file that I

[jira] [Commented] (BEAM-2806) support View.CreatePCollectionView in FlinkRunner

2017-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141378#comment-16141378 ] Aljoscha Krettek commented on BEAM-2806: Could you please provide a complete minimal example that

  1   2   3   >