[jira] [Commented] (BEAM-1148) Port PAssert away from Aggregators

2016-12-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748240#comment-15748240 ] Aljoscha Krettek commented on BEAM-1148: Just out of curiosity, what are they going to be replaced

[jira] [Updated] (BEAM-1096) flink streaming side output optimization using SplitStream

2016-12-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-1096: --- Assignee: Alexey Diomin > flink streaming side output optimization using SplitStream >

[jira] [Updated] (BEAM-1095) Add support set config for reuse-object on flink

2016-12-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-1095: --- Assignee: Alexey Diomin > Add support set config for reuse-object on flink >

[jira] [Closed] (BEAM-1095) Add support set config for reuse-object on flink

2016-12-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-1095. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Add support set config for

[jira] [Commented] (BEAM-1107) Display user names for steps in the Flink Web UI

2016-12-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15730375#comment-15730375 ] Aljoscha Krettek commented on BEAM-1107: Yep, you're right but even in the black text the operation

[jira] [Closed] (BEAM-1102) Flink Batch Runner does not populate aggregator values

2016-12-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-1102. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Flink Batch Runner does not populate

[jira] [Created] (BEAM-1103) Add Tests For Aggregators in Flink Runner

2016-12-06 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-1103: -- Summary: Add Tests For Aggregators in Flink Runner Key: BEAM-1103 URL: https://issues.apache.org/jira/browse/BEAM-1103 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1102) Flink Batch Runner does not populate aggregator values

2016-12-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727742#comment-15727742 ] Aljoscha Krettek commented on BEAM-1102: The problem is this part in {{FlinkProcessContextBase}}:

[jira] [Issue Comment Deleted] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

2016-12-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-1092: --- Comment: was deleted (was: Is 1) necessary if we do 2). I think shading is very necessary

[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

2016-12-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727530#comment-15727530 ] Aljoscha Krettek commented on BEAM-1092: Is 1) necessary if we do 2)? I think shading is very

[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

2016-12-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727529#comment-15727529 ] Aljoscha Krettek commented on BEAM-1092: Is 1) necessary if we do 2). I think shading is very

[jira] [Closed] (BEAM-506) Fill in the documentation/runners/flink portion of the website

2016-12-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-506. - Resolution: Fixed Fix Version/s: Not applicable > Fill in the documentation/runners/flink

[jira] [Assigned] (BEAM-506) Fill in the documentation/runners/flink portion of the website

2016-11-29 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-506: - Assignee: Aljoscha Krettek (was: James Malone) > Fill in the documentation/runners/flink

[jira] [Closed] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari

2016-11-21 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-1007. -- Resolution: Fixed Fix Version/s: Not applicable > Runner Toggles in Quickstart.md Don't

[jira] [Updated] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari

2016-11-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-1007: --- Attachment: Screen Shot 2016-11-19 at 00.00.45.png > Runner Toggles in Quickstart.md Don't

[jira] [Commented] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari

2016-11-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678046#comment-15678046 ] Aljoscha Krettek commented on BEAM-1007: [~mabdullah353], I assigned to you because you initially

[jira] [Created] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari

2016-11-18 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-1007: -- Summary: Runner Toggles in Quickstart.md Don't Work in Safari Key: BEAM-1007 URL: https://issues.apache.org/jira/browse/BEAM-1007 Project: Beam Issue

[jira] [Closed] (BEAM-899) Flink quickstart instructions

2016-11-16 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-899. - Resolution: Fixed Fix Version/s: 0.4.0-incubating > Flink quickstart instructions >

[jira] [Closed] (BEAM-965) Source Transformations Don't Set Correct Output Type in Flink Streaming Runner

2016-11-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-965. - Resolution: Fixed > Source Transformations Don't Set Correct Output Type in Flink Streaming Runner

[jira] [Commented] (BEAM-899) Flink quickstart instructions

2016-11-12 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15659390#comment-15659390 ] Aljoscha Krettek commented on BEAM-899: --- Sorry for the delay, I'm working on this myself now. > Flink

[jira] [Created] (BEAM-965) Source Operations Don't Set Correct Output Type in Flink Streaming Runner

2016-11-11 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-965: - Summary: Source Operations Don't Set Correct Output Type in Flink Streaming Runner Key: BEAM-965 URL: https://issues.apache.org/jira/browse/BEAM-965 Project: Beam

[jira] [Created] (BEAM-956) Execute ReduceFnRunner Directly in Flink Runner

2016-11-10 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-956: - Summary: Execute ReduceFnRunner Directly in Flink Runner Key: BEAM-956 URL: https://issues.apache.org/jira/browse/BEAM-956 Project: Beam Issue Type:

[jira] [Closed] (BEAM-931) Findbugs doesn't pass in Flink runner

2016-11-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-931. - Resolution: Fixed Fix Version/s: 0.4.0-incubating > Findbugs doesn't pass in Flink runner >

[jira] [Updated] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2016-10-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-806: -- Fix Version/s: (was: 0.3.0-incubating) 0.4.0-incubating > Maven Release

[jira] [Created] (BEAM-864) Update to latest Apache Maven-Parent

2016-10-30 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-864: - Summary: Update to latest Apache Maven-Parent Key: BEAM-864 URL: https://issues.apache.org/jira/browse/BEAM-864 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-862) Flink PostCommit Fails On Jenkins

2016-10-28 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616689#comment-15616689 ] Aljoscha Krettek commented on BEAM-862: --- No problemo! > Flink PostCommit Fails On Jenkins >

[jira] [Closed] (BEAM-862) Flink PostCommit Fails On Jenkins

2016-10-28 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-862. - Resolution: Fixed > Flink PostCommit Fails On Jenkins > - > >

[jira] [Created] (BEAM-862) Flink PostCommit Fails On Jenkins

2016-10-28 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-862: - Summary: Flink PostCommit Fails On Jenkins Key: BEAM-862 URL: https://issues.apache.org/jira/browse/BEAM-862 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-843) Use New DoFn Directly in Flink Runner

2016-10-27 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-843: - Summary: Use New DoFn Directly in Flink Runner Key: BEAM-843 URL: https://issues.apache.org/jira/browse/BEAM-843 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602937#comment-15602937 ] Aljoscha Krettek commented on BEAM-696: --- Just a clarification, the Flink runner does not pre combine

[jira] [Updated] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2016-10-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-806: -- Priority: Blocker (was: Major) > Maven Release Plugin Does Not Set Archetype Versions >

[jira] [Created] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2016-10-24 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-806: - Summary: Maven Release Plugin Does Not Set Archetype Versions Key: BEAM-806 URL: https://issues.apache.org/jira/browse/BEAM-806 Project: Beam Issue Type:

[jira] [Closed] (BEAM-633) Be able to import Beam codebase in Eclipse and support m2e

2016-10-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-633. - Resolution: Duplicate Fix Version/s: (was: 0.3.0-incubating) Not

[jira] [Reopened] (BEAM-633) Be able to import Beam codebase in Eclipse and support m2e

2016-10-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened BEAM-633: --- Reopening to close as non-resolved so that it doesn't show up in the release notes. > Be able to

[jira] [Updated] (BEAM-102) Support Side Inputs in Flink Streaming Runner

2016-10-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-102: -- Summary: Support Side Inputs in Flink Streaming Runner (was: Side Inputs for Streaming) >

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-12 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569001#comment-15569001 ] Aljoscha Krettek commented on BEAM-696: --- Flink doesn't use bundles but it just keeps all the elements

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565001#comment-15565001 ] Aljoscha Krettek commented on BEAM-696: --- Just to make it clear what the Flink runner does for this:

[jira] [Updated] (BEAM-720) Running WindowedWordCount Integration Test in Flink

2016-10-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-720: -- Component/s: runner-flink > Running WindowedWordCount Integration Test in Flink >

[jira] [Assigned] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

2016-09-28 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-615: - Assignee: Aljoscha Krettek (was: Kenneth Knowles) > Add Support for Processing-Time

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522966#comment-15522966 ] Aljoscha Krettek commented on BEAM-644: --- [~kenn] I was referring to "two clusters of elements from two

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-23 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515875#comment-15515875 ] Aljoscha Krettek commented on BEAM-644: --- Yes, as a replacement for {{outputWithTimestamp}} and

[jira] [Commented] (BEAM-638) Add a Window function to create a bounded PCollection from an unbounded one

2016-09-20 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507706#comment-15507706 ] Aljoscha Krettek commented on BEAM-638: --- I don't think it's possible to provide such a function. What

[jira] [Commented] (BEAM-260) Know the getSideInputWindow upper bound so can gc side input state

2016-09-17 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498458#comment-15498458 ] Aljoscha Krettek commented on BEAM-260: --- The doc looks good, I'm not sure how many people will see

[jira] [Resolved] (BEAM-616) Update Flink Runner to 1.1.2

2016-09-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-616. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating > Update Flink Runner to 1.1.2 >

[jira] [Created] (BEAM-616) Update Flink Runner to 1.1.2

2016-09-06 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-616: - Summary: Update Flink Runner to 1.1.2 Key: BEAM-616 URL: https://issues.apache.org/jira/browse/BEAM-616 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

2016-09-02 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-615: - Summary: Add Support for Processing-Time Timers in FlinkRunner Window Operator Key: BEAM-615 URL: https://issues.apache.org/jira/browse/BEAM-615 Project: Beam

[jira] [Commented] (BEAM-485) Can't set Flink runner in code

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438508#comment-15438508 ] Aljoscha Krettek commented on BEAM-485: --- Hi [~ecesena], could you check whether this bug is still

[jira] [Resolved] (BEAM-253) Unify Flink Operator Wrappers

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-253. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating Implemented here:

[jira] [Resolved] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-315. --- Resolution: Fixed > Flink Runner compares keys unencoded which may produce incorrect results >

[jira] [Resolved] (BEAM-102) Side Inputs for Streaming

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-102. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating Implemented

[jira] [Commented] (BEAM-286) Reorganize flink runner directories

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436708#comment-15436708 ] Aljoscha Krettek commented on BEAM-286: --- Now that the PR is in I think the reorganization/cleanup can

[jira] [Created] (BEAM-581) Support Verifiers in TestFlinkRunner

2016-08-24 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-581: - Summary: Support Verifiers in TestFlinkRunner Key: BEAM-581 URL: https://issues.apache.org/jira/browse/BEAM-581 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402815#comment-15402815 ] Aljoscha Krettek commented on BEAM-321: --- I think we agreed a while back to only put the "fix version"

[jira] [Commented] (BEAM-322) Compare encoded keys in streaming mode

2016-08-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402355#comment-15402355 ] Aljoscha Krettek commented on BEAM-322: --- The fix for this is included in this commit of my side-input

[jira] [Commented] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402329#comment-15402329 ] Aljoscha Krettek commented on BEAM-321: --- This was fixed a while ago in master and is part of the

[jira] [Updated] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-321: -- Fix Version/s: (was: 0.3.0-incubating) 0.2.0-incubating > Hash encoded

[jira] [Updated] (BEAM-321) Hash encoded keys in Flink batch mode

2016-07-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-321: -- Fix Version/s: (was: 0.2.0-incubating) > Hash encoded keys in Flink batch mode >

[jira] [Updated] (BEAM-322) Compare encoded keys in streaming mode

2016-07-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-322: -- Fix Version/s: (was: 0.2.0-incubating) > Compare encoded keys in streaming mode >

[jira] [Assigned] (BEAM-322) Compare encoded keys in streaming mode

2016-07-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-322: - Assignee: Aljoscha Krettek > Compare encoded keys in streaming mode >

[jira] [Commented] (BEAM-242) Enable Checkstyle check and Javadoc build for the Flink Runner

2016-07-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382327#comment-15382327 ] Aljoscha Krettek commented on BEAM-242: --- The weekend before last weekend I worked on some stuff that

[jira] [Assigned] (BEAM-253) Unify Flink Operator Wrappers

2016-07-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-253: - Assignee: Aljoscha Krettek > Unify Flink Operator Wrappers > -

[jira] [Commented] (BEAM-438) Rename one of PTransform.apply and PInput.apply

2016-07-12 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372575#comment-15372575 ] Aljoscha Krettek commented on BEAM-438: --- +1 I've seen people do the former several times. > Rename

[jira] [Closed] (BEAM-300) Upgrade to Flink 1.0.3

2016-07-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-300. - Resolution: Duplicate Fix Version/s: 0.2.0-incubating Flink was updated to 1.0.3 a while

[jira] [Resolved] (BEAM-392) Update flink runner to use flink version 1.0.3

2016-07-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-392. --- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Update flink runner to use flink

[jira] [Resolved] (BEAM-321) Hash encoded keys in Flink batch mode

2016-06-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-321. --- Resolution: Fixed Fix Version/s: (was: 0.1.0-incubating)

[jira] [Resolved] (BEAM-297) version typo at README.md of flink runner

2016-06-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-297. --- Resolution: Fixed Fix Version/s: (was: 0.1.0-incubating)

[jira] [Commented] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-06-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312560#comment-15312560 ] Aljoscha Krettek commented on BEAM-315: --- Thanks for the updates! I'll keep investigating. > Flink

[jira] [Updated] (BEAM-322) Compare encoded keys in streaming mode

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-322: -- Description: Right now, hashing of keys happens on the value itself not on the encoded

[jira] [Updated] (BEAM-321) Hash encoded keys in Flink batch mode

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-321: -- Description: Right now, hashing of keys happens on the value itself not on the encoded

[jira] [Updated] (BEAM-321) Hash encoded keys in Flink batch mode

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-321: -- Summary: Hash encoded keys in Flink batch mode (was: Compare encoded keys in batch mode) > Hash

[jira] [Commented] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310277#comment-15310277 ] Aljoscha Krettek commented on BEAM-315: --- I think we should make this issue into two issues. Leave this

[jira] [Resolved] (BEAM-295) Flink Create Functions call Collector.close()

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-295. --- Resolution: Fixed Fix Version/s: 0.1.0-incubating > Flink Create Functions call

[jira] [Commented] (BEAM-315) GroupByKey/CoGroupByKey doesn't group correctly in batch mode of FlinkPipelineRunner

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309976#comment-15309976 ] Aljoscha Krettek commented on BEAM-315: --- I played around this morning and finally found the problem

[jira] [Assigned] (BEAM-315) GroupByKey/CoGroupByKey doesn't group correctly in batch mode of FlinkPipelineRunner

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-315: - Assignee: Aljoscha Krettek > GroupByKey/CoGroupByKey doesn't group correctly in batch mode

[jira] [Commented] (BEAM-315) GroupByKey/CoGroupByKey doesn't group correctly with FlinkPipelineRunner

2016-05-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307827#comment-15307827 ] Aljoscha Krettek commented on BEAM-315: --- I attached a version that uses a {{String}} as key. With

[jira] [Updated] (BEAM-315) GroupByKey/CoGroupByKey doesn't group correctly with FlinkPipelineRunner

2016-05-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-315: -- Attachment: CoGroupPipelineStringKey.java This is a version of the same program that uses a

[jira] [Commented] (BEAM-307) Upgrade/Test to Kafka 0.10

2016-05-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300147#comment-15300147 ] Aljoscha Krettek commented on BEAM-307: --- It might be that we have to create separate packages for

[jira] [Commented] (BEAM-286) Reorganize flink runner directories

2016-05-22 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15295691#comment-15295691 ] Aljoscha Krettek commented on BEAM-286: --- For the Flink runner there is already such a separation. The

[jira] [Resolved] (BEAM-258) Execute selected RunnableOnService tests with Flink runner

2016-05-20 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-258. --- Resolution: Fixed Fix Version/s: 0.1.0-incubating > Execute selected RunnableOnService

[jira] [Resolved] (BEAM-270) Support Timestamps/Windows in Flink Batch

2016-05-20 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-270. --- Resolution: Fixed Fix Version/s: 0.1.0-incubating > Support Timestamps/Windows in Flink

[jira] [Commented] (BEAM-297) version typo at README.md of flink runner

2016-05-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15290997#comment-15290997 ] Aljoscha Krettek commented on BEAM-297: --- Now that the issue is created could you please update your

[jira] [Created] (BEAM-295) Flink Create Functions call Collector.close()

2016-05-18 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-295: - Summary: Flink Create Functions call Collector.close() Key: BEAM-295 URL: https://issues.apache.org/jira/browse/BEAM-295 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-131) Write to jdbc/database

2016-05-17 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286673#comment-15286673 ] Aljoscha Krettek commented on BEAM-131: --- Can this one be closed now that it is superseded by the more

[jira] [Commented] (BEAM-273) Update Flink Runner version

2016-05-17 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286676#comment-15286676 ] Aljoscha Krettek commented on BEAM-273: --- Are there further steps towards updating the Flink version or

[jira] [Commented] (BEAM-48) BigQueryIO.Read reimplemented as BoundedSource

2016-05-17 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286670#comment-15286670 ] Aljoscha Krettek commented on BEAM-48: -- [~dhalp...@google.com] I saw that you merged the PR. Can we now

[jira] [Commented] (BEAM-291) PDone type translation fails

2016-05-17 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286608#comment-15286608 ] Aljoscha Krettek commented on BEAM-291: --- Also, I think {{PDone}} is never to be used as the return

[jira] [Commented] (BEAM-291) PDone type translation fails

2016-05-17 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286597#comment-15286597 ] Aljoscha Krettek commented on BEAM-291: --- Could you maybe post the code for the example? With my latest

[jira] [Commented] (BEAM-286) Reorganize flink runner directories

2016-05-17 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286468#comment-15286468 ] Aljoscha Krettek commented on BEAM-286: --- +1, I think the examples can be removed. AFAIK they are only

[jira] [Created] (BEAM-283) CheckpointMark.finalize() is not called in Flink Source Wrapper

2016-05-13 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-283: - Summary: CheckpointMark.finalize() is not called in Flink Source Wrapper Key: BEAM-283 URL: https://issues.apache.org/jira/browse/BEAM-283 Project: Beam

[jira] [Closed] (BEAM-236) Implement Windowing in batch execution

2016-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-236. - Resolution: Duplicate Superseded by BEAM-270 > Implement Windowing in batch execution >

[jira] [Assigned] (BEAM-270) Use WindowedValue in Flink Batch

2016-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-270: - Assignee: Aljoscha Krettek > Use WindowedValue in Flink Batch >

[jira] [Updated] (BEAM-270) Support Timestamps/Windows in Flink Batch

2016-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-270: -- Summary: Support Timestamps/Windows in Flink Batch (was: Use WindowedValue in Flink Batch) >

[jira] [Resolved] (BEAM-103) Make UnboundedSourceWrapper parallel

2016-05-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-103. --- Resolution: Fixed > Make UnboundedSourceWrapper parallel >

[jira] [Resolved] (BEAM-130) Checkpointing of custom sources and sinks

2016-05-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-130. --- Resolution: Fixed Resolved in this (closed) PR:

[jira] [Updated] (BEAM-270) Use WindowedValue in Flink Batch

2016-05-09 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-270: -- Issue Type: Sub-task (was: Improvement) Parent: BEAM-258 > Use WindowedValue in Flink

[jira] [Commented] (BEAM-260) Know the getSideInputWindow upper bound so can gc side input state

2016-05-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15275128#comment-15275128 ] Aljoscha Krettek commented on BEAM-260: --- I thought about this as well while working on the Flink

[jira] [Commented] (BEAM-242) Enable Checkstyle check for the Flink Runner

2016-05-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274971#comment-15274971 ] Aljoscha Krettek commented on BEAM-242: --- The PR is merged but checkstyle is not yet globally enabled,

[jira] [Commented] (BEAM-216) Create Storm Runner

2016-05-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274961#comment-15274961 ] Aljoscha Krettek commented on BEAM-216: --- Btw, this is a duplicate of BEAM-9. > Create Storm Runner >

[jira] [Commented] (BEAM-140) Improve examples provided with the Flink runner

2016-05-03 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268726#comment-15268726 ] Aljoscha Krettek commented on BEAM-140: --- +1 for unification > Improve examples provided with the

[jira] [Resolved] (BEAM-129) Support pubsub IO

2016-05-03 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-129. --- Resolution: Invalid Subsumed by BEAM-53 > Support pubsub IO > - > >

  1   2   >