[jira] [Reopened] (BEAM-196) Pipeline options must be available Context in DoFn.startBundle

2016-06-08 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reopened BEAM-196: - Still an issue. Pull request coming up. > Pipeline options must be available Context in

[jira] [Created] (BEAM-312) UnboundedSourceWrapper fails if CheckpointMarkCoder not available

2016-05-28 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-312: --- Summary: UnboundedSourceWrapper fails if CheckpointMarkCoder not available Key: BEAM-312 URL: https://issues.apache.org/jira/browse/BEAM-312 Project: Beam

[jira] [Updated] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-06-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-315: Summary: Flink Runner compares keys unencoded which may produce incorrect results (was:

[jira] [Updated] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results (batch)

2016-06-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-315: Summary: Flink Runner compares keys unencoded which may produce incorrect results (batch)

[jira] [Created] (BEAM-322) Compare encoded keys in streaming mode

2016-06-01 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-322: --- Summary: Compare encoded keys in streaming mode Key: BEAM-322 URL: https://issues.apache.org/jira/browse/BEAM-322 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-06-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-315: Summary: Flink Runner compares keys unencoded which may produce incorrect results (was:

[jira] [Created] (BEAM-321) Compare encoded keys in batch mode

2016-06-01 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-321: --- Summary: Compare encoded keys in batch mode Key: BEAM-321 URL: https://issues.apache.org/jira/browse/BEAM-321 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-06-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310297#comment-15310297 ] Maximilian Michels commented on BEAM-315: - I agree. Nice find [~aljoscha]! > Flink Runner compares

[jira] [Updated] (BEAM-315) GroupByKey/CoGroupByKey doesn't group correctly with FlinkPipelineRunner

2016-06-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-315: Summary: GroupByKey/CoGroupByKey doesn't group correctly with FlinkPipelineRunner (was:

[jira] [Commented] (BEAM-287) Add new beam groupIds

2016-06-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310445#comment-15310445 ] Maximilian Michels commented on BEAM-287: - All Apache big data projects I know of use flat group

[jira] [Commented] (BEAM-315) GroupByKey/CoGroupByKey doesn't group correctly with FlinkPipelineRunner

2016-05-31 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307796#comment-15307796 ] Maximilian Michels commented on BEAM-315: - Thanks for reporting! I'm assuming you're using the

[jira] [Updated] (BEAM-315) GroupByKey/CoGroupByKey doesn't group correctly in batch mode of FlinkPipelineRunner

2016-05-31 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-315: Summary: GroupByKey/CoGroupByKey doesn't group correctly in batch mode of FlinkPipelineRunner

[jira] [Commented] (BEAM-315) GroupByKey/CoGroupByKey doesn't group correctly in batch mode of FlinkPipelineRunner

2016-05-31 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307853#comment-15307853 ] Maximilian Michels commented on BEAM-315: - It appears this is only a problem in the batch execution

[jira] [Commented] (BEAM-365) TextIO withoutSharding causes Flink to throw IllegalStateException

2016-06-22 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344157#comment-15344157 ] Maximilian Michels commented on BEAM-365: - Thanks for reporting! Would you like to work on this

[jira] [Commented] (BEAM-365) TextIO withoutSharding causes Flink to throw IllegalStateException

2016-06-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15354834#comment-15354834 ] Maximilian Michels commented on BEAM-365: - Thanks for the notice! I'm glad we solved this

[jira] [Created] (BEAM-103) Make UnboundedSourceWrapper parallel

2016-03-09 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-103: --- Summary: Make UnboundedSourceWrapper parallel Key: BEAM-103 URL: https://issues.apache.org/jira/browse/BEAM-103 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-103) Make UnboundedSourceWrapper parallel

2016-03-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-103: Description: As of now {{UnboundedSource}} s are executed with a parallelism of 1 regardless

[jira] [Created] (BEAM-102) Side Inputs for Streaming

2016-03-09 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-102: --- Summary: Side Inputs for Streaming Key: BEAM-102 URL: https://issues.apache.org/jira/browse/BEAM-102 Project: Beam Issue Type: Improvement

[jira] [Closed] (BEAM-107) Support multiple Scala versions

2016-03-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-107. --- 45309caec4da583ea7a3f92dd33ed1133754dffc > Support multiple Scala versions >

[jira] [Created] (BEAM-107) Support multiple Scala versions

2016-03-11 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-107: --- Summary: Support multiple Scala versions Key: BEAM-107 URL: https://issues.apache.org/jira/browse/BEAM-107 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-116) Change runners artifactId to runners-parent

2016-03-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201317#comment-15201317 ] Maximilian Michels commented on BEAM-116: - Frankly, I don't think that is possible with Maven. Even

[jira] [Closed] (BEAM-126) KafkaWindowedWordCountExample fails with JobName invalid

2016-03-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-126. --- Resolution: Fixed Thank you for reporting! Fixed with 81d5ff5a561ebcf323caea5bdc4363353e5e60dd.

[jira] [Assigned] (BEAM-116) Change runners artifactId to runners-parent

2016-03-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-116: --- Assignee: Maximilian Michels > Change runners artifactId to runners-parent >

[jira] [Created] (BEAM-140) Improve examples provided with the Flink runner

2016-03-22 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-140: --- Summary: Improve examples provided with the Flink runner Key: BEAM-140 URL: https://issues.apache.org/jira/browse/BEAM-140 Project: Beam Issue Type:

[jira] [Created] (BEAM-139) Print mode (batch/streaming) during translation

2016-03-22 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-139: --- Summary: Print mode (batch/streaming) during translation Key: BEAM-139 URL: https://issues.apache.org/jira/browse/BEAM-139 Project: Beam Issue Type:

[jira] [Updated] (BEAM-130) Checkpointing of custom sources and sinks

2016-03-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-130: Assignee: Kostas Kloudas (was: Maximilian Michels) > Checkpointing of custom sources and

[jira] [Updated] (BEAM-131) Write to jdbc/database

2016-03-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-131: Assignee: Kostas Kloudas (was: Maximilian Michels) > Write to jdbc/database >

[jira] [Resolved] (BEAM-136) PipelineOptionsFactory should detect all runners

2016-03-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-136. - Resolution: Fixed Resolving this since the associated pull request has been merged:

[jira] [Closed] (BEAM-116) Change runners artifactId to runners-parent

2016-03-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-116. --- Resolution: Fixed Merged with fcc6f3cfd111ab222063e414579c966916299060. > Change runners

[jira] [Commented] (BEAM-132) Deploy Flink-dataflow to maven central / sonatype snapshots.

2016-03-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203459#comment-15203459 ] Maximilian Michels commented on BEAM-132: - Thanks for opening issue. How about we convert this one

[jira] [Commented] (BEAM-127) Support for Unbounded sinks in Streaming

2016-03-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202872#comment-15202872 ] Maximilian Michels commented on BEAM-127: - +1 Adding a simple wrapper should be fairly straight

[jira] [Commented] (BEAM-136) PipelineOptionsFactory should detect all runners

2016-03-24 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209990#comment-15209990 ] Maximilian Michels commented on BEAM-136: - A bit off topic: How do you make sure that the META-INF

[jira] [Closed] (BEAM-144) Reader in UnboundedSourceWrapper is not serializable

2016-03-24 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-144. --- Resolution: Fixed > Reader in UnboundedSourceWrapper is not serializable >

[jira] [Commented] (BEAM-98) Travis coverage broken due to too much logging

2016-03-08 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-98?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184788#comment-15184788 ] Maximilian Michels commented on BEAM-98: Sure, I'll have a look. > Travis coverage broken due to too

[jira] [Created] (BEAM-100) Update Flink Runner to 1.0.0

2016-03-08 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-100: --- Summary: Update Flink Runner to 1.0.0 Key: BEAM-100 URL: https://issues.apache.org/jira/browse/BEAM-100 Project: Beam Issue Type: Task

[jira] [Closed] (BEAM-100) Update Flink Runner to 1.0.0

2016-03-08 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-100. --- Resolution: Fixed Fixed in 1f9d02c775825f8f780c214f27baa19a9a21aa4b > Update Flink Runner to

[jira] [Commented] (BEAM-5) Import Flink Runner code

2016-03-07 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182760#comment-15182760 ] Maximilian Michels commented on BEAM-5: --- I think this issue can be closed now. > Import Flink Runner

[jira] [Assigned] (BEAM-5) Import Flink Runner code

2016-03-07 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-5: - Assignee: Maximilian Michels > Import Flink Runner code > > >

[jira] [Commented] (BEAM-132) Release process for Beam artifacts to Maven

2016-04-05 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225976#comment-15225976 ] Maximilian Michels commented on BEAM-132: - Great! Just saw it after I posted the comment. > Release

[jira] [Commented] (BEAM-136) PipelineOptionsFactory should detect all runners

2016-03-30 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217763#comment-15217763 ] Maximilian Michels commented on BEAM-136: - Thanks. Seems like we're already set up then. The user

[jira] [Created] (BEAM-158) Add support for bounded sources in streaming mode

2016-03-30 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-158: --- Summary: Add support for bounded sources in streaming mode Key: BEAM-158 URL: https://issues.apache.org/jira/browse/BEAM-158 Project: Beam Issue Type:

[jira] [Commented] (BEAM-208) Flaky test: org.apache.beam.runners.flink.streaming.GroupByNullKeyTest.testJob

2016-04-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252173#comment-15252173 ] Maximilian Michels commented on BEAM-208: - Thanks! > Flaky test:

[jira] [Created] (BEAM-236) Implement Windowing in batch execution

2016-04-28 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-236: --- Summary: Implement Windowing in batch execution Key: BEAM-236 URL: https://issues.apache.org/jira/browse/BEAM-236 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-235) Remove streaming flag

2016-04-28 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-235: --- Summary: Remove streaming flag Key: BEAM-235 URL: https://issues.apache.org/jira/browse/BEAM-235 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-236) Implement Windowing in batch execution

2016-04-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-236: Assignee: (was: Maximilian Michels) > Implement Windowing in batch execution >

[jira] [Commented] (BEAM-103) Make UnboundedSourceWrapper parallel

2016-04-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264013#comment-15264013 ] Maximilian Michels commented on BEAM-103: - Curious to know where I have mentioned that :) I believe

[jira] [Updated] (BEAM-139) Print mode (batch/streaming) during translation

2016-04-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-139: Component/s: (was: runner-core) > Print mode (batch/streaming) during translation >

[jira] [Commented] (BEAM-139) Print mode (batch/streaming) during translation

2016-04-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264001#comment-15264001 ] Maximilian Michels commented on BEAM-139: - I agree with the direction. Runners may still announce

[jira] [Commented] (BEAM-129) Support pubsub IO

2016-04-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15257826#comment-15257826 ] Maximilian Michels commented on BEAM-129: - Great, getting excited :) > Support pubsub IO >

[jira] [Commented] (BEAM-286) Reorganize flink runner directories

2016-05-20 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293080#comment-15293080 ] Maximilian Michels commented on BEAM-286: - The runner is composed of two submodules for a good

[jira] [Commented] (BEAM-286) Reorganize flink runner directories

2016-05-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296501#comment-15296501 ] Maximilian Michels commented on BEAM-286: - Exactly, the fact that the flink-runner is composed of

[jira] [Commented] (BEAM-291) PDone type translation fails

2016-05-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296537#comment-15296537 ] Maximilian Michels commented on BEAM-291: - Thanks for the insight [~kenn]! We've actually

[jira] [Commented] (BEAM-242) Enable Checkstyle check for the Flink Runner

2016-05-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279835#comment-15279835 ] Maximilian Michels commented on BEAM-242: - Are you still working on this [~jbonofre]? Would be nice

[jira] [Updated] (BEAM-100) Update Flink Runner to 1.0.0

2016-05-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-100: Issue Type: Sub-task (was: Task) Parent: BEAM-273 > Update Flink Runner to 1.0.0 >

[jira] [Commented] (BEAM-242) Enable Checkstyle check for the Flink Runner

2016-05-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279851#comment-15279851 ] Maximilian Michels commented on BEAM-242: - Great! > Enable Checkstyle check for the Flink Runner >

[jira] [Created] (BEAM-272) Flink Runner depends on Dataflow Runner

2016-05-11 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-272: --- Summary: Flink Runner depends on Dataflow Runner Key: BEAM-272 URL: https://issues.apache.org/jira/browse/BEAM-272 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-242) Enable Checkstyle check for the Flink Runner

2016-05-12 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281330#comment-15281330 ] Maximilian Michels commented on BEAM-242: - That's fine. We are thinking about some package

[jira] [Created] (BEAM-291) PDone type translation fails

2016-05-17 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-291: --- Summary: PDone type translation fails Key: BEAM-291 URL: https://issues.apache.org/jira/browse/BEAM-291 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-131) Write to jdbc/database

2016-05-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-131. - Resolution: Fixed Superceded by BEAM-244. > Write to jdbc/database >

[jira] [Commented] (BEAM-273) Update Flink Runner version

2016-05-17 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286812#comment-15286812 ] Maximilian Michels commented on BEAM-273: - The idea was that this parent issue stays open. If you

[jira] [Commented] (BEAM-124) Testing -- End to End WordCount Batch and Streaming Tests

2016-05-13 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282673#comment-15282673 ] Maximilian Michels commented on BEAM-124: - +1 Would be nice to have end-to-end tests for all

[jira] [Created] (BEAM-242) Enable Checkstyle check for the Flink Runner

2016-05-02 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-242: --- Summary: Enable Checkstyle check for the Flink Runner Key: BEAM-242 URL: https://issues.apache.org/jira/browse/BEAM-242 Project: Beam Issue Type:

[jira] [Closed] (BEAM-158) Add support for bounded sources in streaming mode

2016-04-18 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-158. --- Resolution: Fixed Merged with 56e28a90fe5b95c6d2c25149db1a3fe8c2205fb4. > Add support for

[jira] [Resolved] (BEAM-196) Pipeline options must be available Context in DoFn.startBundle

2016-04-19 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-196. - Resolution: Fixed Fixed in 43b5ec743718e63c2d9d9532e3ca55bc87370290. > Pipeline options

[jira] [Updated] (BEAM-128) The transform BigQueryIO.Read is currently not supported.

2016-04-21 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-128: Assignee: (was: Maximilian Michels) > The transform BigQueryIO.Read is currently not

[jira] [Updated] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-321: Fix Version/s: 0.3.0-incubating > Hash encoded keys in Flink batch mode >

[jira] [Updated] (BEAM-322) Compare encoded keys in streaming mode

2016-08-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-322: Fix Version/s: 0.3.0-incubating > Compare encoded keys in streaming mode >

[jira] [Commented] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402091#comment-15402091 ] Maximilian Michels commented on BEAM-321: - Added the new fix version. > Hash encoded keys in Flink

[jira] [Commented] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402084#comment-15402084 ] Maximilian Michels commented on BEAM-321: - Since the issue is of pretty high priority, could we add

[jira] [Updated] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-08-01 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-315: Fix Version/s: 0.3.0-incubating > Flink Runner compares keys unencoded which may produce

[jira] [Commented] (BEAM-242) Enable Checkstyle check and Javadoc build for the Flink Runner

2016-07-18 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382381#comment-15382381 ] Maximilian Michels commented on BEAM-242: - Sure, no need to rush this. > Enable Checkstyle check

[jira] [Commented] (BEAM-286) Reorganize flink runner directories

2016-08-25 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436459#comment-15436459 ] Maximilian Michels commented on BEAM-286: - +1 > Reorganize flink runner directories >

[jira] [Assigned] (BEAM-283) CheckpointMark.finalize() is not called in Flink Source Wrapper

2016-09-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-283: --- Assignee: Maximilian Michels > CheckpointMark.finalize() is not called in Flink Source

[jira] [Updated] (BEAM-616) Update Flink Runner to 1.1.2

2016-09-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-616: Issue Type: Sub-task (was: Improvement) Parent: BEAM-273 > Update Flink Runner to

[jira] [Assigned] (BEAM-333) Support "stop" for streaming pipelines

2016-09-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned BEAM-333: --- Assignee: Maximilian Michels > Support "stop" for streaming pipelines >

[jira] [Commented] (BEAM-593) Support cancel() and waitUntilFinish() in FlinkRunnerResult

2016-09-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467548#comment-15467548 ] Maximilian Michels commented on BEAM-593: - +1 These need to be supported. We need to change the

[jira] [Commented] (BEAM-333) Support "stop" for streaming pipelines

2016-09-06 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467560#comment-15467560 ] Maximilian Michels commented on BEAM-333: - You can use {{cancel()}} instead which should achieve the

[jira] [Created] (BEAM-619) UnboundedSourceWrapper snapshotting fails with IndexOutOfBoundsException

2016-09-07 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-619: --- Summary: UnboundedSourceWrapper snapshotting fails with IndexOutOfBoundsException Key: BEAM-619 URL: https://issues.apache.org/jira/browse/BEAM-619 Project:

[jira] [Closed] (BEAM-617) Allow setting of StateBackend on FlinkPipelineOptions

2016-09-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-617. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating > Allow setting of StateBackend on

[jira] [Closed] (BEAM-619) UnboundedSourceWrapper snapshotting fails with IndexOutOfBoundsException

2016-09-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-619. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating > UnboundedSourceWrapper snapshotting

[jira] [Resolved] (BEAM-333) Support "stop" for streaming pipelines

2016-09-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-333. - Resolution: Fixed Fix Version/s: 0.3.0-incubating Stop is also supported on the

[jira] [Created] (BEAM-623) Integate Flink's RestartStrategies in FlinkPipelineOptions

2016-09-09 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-623: --- Summary: Integate Flink's RestartStrategies in FlinkPipelineOptions Key: BEAM-623 URL: https://issues.apache.org/jira/browse/BEAM-623 Project: Beam

[jira] [Created] (BEAM-622) Add checkpointing tests for DoFnOperator and WindowDoFnOperator

2016-09-09 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-622: --- Summary: Add checkpointing tests for DoFnOperator and WindowDoFnOperator Key: BEAM-622 URL: https://issues.apache.org/jira/browse/BEAM-622 Project: Beam

[jira] [Resolved] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

2016-09-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-615. - Resolution: Fixed Added with a1acdca13f6902faad30f37a877c1e6fb218 > Add Support for

[jira] [Updated] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

2016-09-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-615: Fix Version/s: 0.3.0-incubating > Add Support for Processing-Time Timers in FlinkRunner

[jira] [Resolved] (BEAM-724) NullPointerException in Snapshot State

2016-10-08 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-724. - Resolution: Fixed Fix Version/s: 0.3.0-incubating Previously fixed with

[jira] [Commented] (BEAM-642) FlinkRunner does not support Detached Mode

2016-09-23 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515887#comment-15515887 ] Maximilian Michels commented on BEAM-642: - That's good to know. I added you as a contributor. >

[jira] [Resolved] (BEAM-642) FlinkRunner does not support Detached Mode

2016-09-22 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-642. - Resolution: Fixed Assignee: Sumit Chawla (was: Amit Sela) Fix Version/s:

[jira] [Commented] (BEAM-642) FlinkRunner does not support Detached Mode

2016-09-22 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513164#comment-15513164 ] Maximilian Michels commented on BEAM-642: - I was also wondering why you were assigned. Not that I

[jira] [Updated] (BEAM-635) Release 0.2.0-incubating - Support Flink Release Version 1.1.2

2016-09-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-635: Component/s: (was: beam-model) runner-flink > Release 0.2.0-incubating -

[jira] [Updated] (BEAM-235) Remove streaming flag

2016-09-16 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-235: Fix Version/s: (was: 0.3.0-incubating) 0.2.0-incubating > Remove

[jira] [Resolved] (BEAM-283) CheckpointMark.finalize() is not called in Flink Source Wrapper

2016-09-28 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-283. - Resolution: Fixed Fix Version/s: 0.3.0-incubating Fixed with

[jira] [Resolved] (BEAM-896) FileBasedSink swap to temp directory broke Flink postcommit

2016-11-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-896. - Resolution: Not A Problem Fix Version/s: 0.4.0-incubating Not a problem. The issue

[jira] [Commented] (BEAM-593) Support unblocking run() in FlinkRunner and cancel() and waitUntilFinish() in FlinkRunnerResult

2016-10-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575371#comment-15575371 ] Maximilian Michels commented on BEAM-593: - Until this is probably addressed on the Flink side, let

[jira] [Commented] (BEAM-896) FileBasedSink swap to temp directory broke Flink postcommit

2016-11-04 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635852#comment-15635852 ] Maximilian Michels commented on BEAM-896: - Sorry [~davor], didn't see you were already assigned. >

[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

2016-12-12 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15741575#comment-15741575 ] Maximilian Michels commented on BEAM-1092: -- Yes, Guava was just one example of a commonly used

[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

2016-12-07 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15729017#comment-15729017 ] Maximilian Michels commented on BEAM-1092: -- 2) is for avoiding user classes to clash with all

[jira] [Commented] (BEAM-506) Fill in the documentation/runners/flink portion of the website

2016-11-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705589#comment-15705589 ] Maximilian Michels commented on BEAM-506: - +1 > Fill in the documentation/runners/flink portion of