[jira] [Created] (BEAM-883) Make ApiSurfaceTest fail if something whitelisted is _not_ exposed

2016-11-02 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-883: Summary: Make ApiSurfaceTest fail if something whitelisted is _not_ exposed Key: BEAM-883 URL: https://issues.apache.org/jira/browse/BEAM-883 Project: Beam

[jira] [Commented] (BEAM-626) AvroCoder not deserializing correctly in Kryo

2016-10-31 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623023#comment-15623023 ] Kenneth Knowles commented on BEAM-626: -- In this case, we don't have to wait for the Runner API - coders

[jira] [Created] (BEAM-869) Support set/delete of timer by ID in Gearpump runner

2016-10-30 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-869: Summary: Support set/delete of timer by ID in Gearpump runner Key: BEAM-869 URL: https://issues.apache.org/jira/browse/BEAM-869 Project: Beam Issue Type

[jira] [Created] (BEAM-868) Support set/delete of timers by ID in Apex runner

2016-10-30 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-868: Summary: Support set/delete of timers by ID in Apex runner Key: BEAM-868 URL: https://issues.apache.org/jira/browse/BEAM-868 Project: Beam Issue Type: New

[jira] [Created] (BEAM-867) Support set/delete of timers by ID in Flink runner

2016-10-30 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-867: Summary: Support set/delete of timers by ID in Flink runner Key: BEAM-867 URL: https://issues.apache.org/jira/browse/BEAM-867 Project: Beam Issue Type: New

[jira] [Updated] (BEAM-866) Support set/delete of timer by ID in Spark runner

2016-10-30 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-866: - Description: This is a prerequisite for full support of BEAM-27, and related to BEAM-35. If I

[jira] [Updated] (BEAM-865) Support set/delete of timer by ID in DirectRunner

2016-10-30 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-865: - Description: This is a prerequisite for full support of BEAM-27, and related to BEAM-35. (Since I

[jira] [Created] (BEAM-865) Support set/delete of timer by ID in DirectRunner

2016-10-30 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-865: Summary: Support set/delete of timer by ID in DirectRunner Key: BEAM-865 URL: https://issues.apache.org/jira/browse/BEAM-865 Project: Beam Issue Type: New

[jira] [Commented] (BEAM-800) DoFnLifeCycleManager should hold DoFnInvoker, not DoFn/OldDoFn

2016-10-30 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621010#comment-15621010 ] Kenneth Knowles commented on BEAM-800: -- When a {{DoFn}} is cloned, the {{DoFnInvoker}} should

[jira] [Commented] (BEAM-862) Flink PostCommit Fails On Jenkins

2016-10-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616599#comment-15616599 ] Kenneth Knowles commented on BEAM-862: -- Oops! I must have run only the `-Plocal-runnable-on-service

[jira] [Updated] (BEAM-857) Beam's checkstyle.xml broken for Checkstyle-IDEA

2016-10-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-857: - Description: Because the suppressions file is specified by property, it is not a valid

[jira] [Commented] (BEAM-857) Beam's checkstyle.xml broken for Checkstyle-IDEA

2016-10-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15615515#comment-15615515 ] Kenneth Knowles commented on BEAM-857: -- [~swegner] assigned to you only because I am guessing you might

[jira] [Created] (BEAM-857) Beam's checkstyle.xml broken for Checkstyle-IDEA

2016-10-28 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-857: Summary: Beam's checkstyle.xml broken for Checkstyle-IDEA Key: BEAM-857 URL: https://issues.apache.org/jira/browse/BEAM-857 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-800) DoFnLifeCycleManager should hold DoFnInvoker, not DoFn/OldDoFn

2016-10-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15615389#comment-15615389 ] Kenneth Knowles commented on BEAM-800: -- Yes, I think it would have to be created sooner. But actually

[jira] [Commented] (BEAM-854) ReifyTimestampAndWindows explodes windows

2016-10-27 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613571#comment-15613571 ] Kenneth Knowles commented on BEAM-854: -- Ah, my mistake. You are correct. This needlessly harms

[jira] [Assigned] (BEAM-836) JavaDocs for DoFnRunner is not updated

2016-10-27 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-836: Assignee: Kenneth Knowles (was: Frances Perry) > JavaDocs for DoFnRunner is not upda

[jira] [Resolved] (BEAM-821) test_wordcount.sh uses Travis CI's default settings.xml, not ours

2016-10-27 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-821. -- Resolution: Fixed Fix Version/s: Not applicable > test_wordcount.sh uses Travis C

[jira] [Assigned] (BEAM-821) test_wordcount.sh uses Travis CI's default settings.xml, not ours

2016-10-27 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-821: Assignee: Kenneth Knowles (was: Jason Kuster) > test_wordcount.sh uses Travis CI's defa

[jira] [Resolved] (BEAM-820) Travis test_wordcount.sh retrieve snapshot from repo, not Maven reactor

2016-10-27 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-820. -- Resolution: Fixed Fix Version/s: Not applicable > Travis test_wordcount.sh retri

[jira] [Assigned] (BEAM-846) Decouple side input window mapping from WindowFn

2016-10-27 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-846: Assignee: Kenneth Knowles (was: Frances Perry) > Decouple side input window mapping f

[jira] [Updated] (BEAM-794) Defer combining in case of merging windows with sideInputs

2016-10-25 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-794: - Description: For background, see BEAM-696. If a Combine transformation is applied to a PCollection

[jira] [Created] (BEAM-834) Add HTML/md versions of technical reference docs

2016-10-25 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-834: Summary: Add HTML/md versions of technical reference docs Key: BEAM-834 URL: https://issues.apache.org/jira/browse/BEAM-834 Project: Beam Issue Type: New

[jira] [Commented] (BEAM-822) SDK build writes timestamp to source tree, causing spurious builds

2016-10-25 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606093#comment-15606093 ] Kenneth Knowles commented on BEAM-822: -- Addressed [#1179|https://github.com/apache/incubator-beam/pull

[jira] [Created] (BEAM-822) SDK build writes timestamp to source tree, causing spurious builds

2016-10-25 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-822: Summary: SDK build writes timestamp to source tree, causing spurious builds Key: BEAM-822 URL: https://issues.apache.org/jira/browse/BEAM-822 Project: Beam

[jira] [Commented] (BEAM-821) test_wordcount.sh uses Travis CI's default settings.xml, not ours

2016-10-25 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606086#comment-15606086 ] Kenneth Knowles commented on BEAM-821: -- Already addressed in [#1180|https://github.com/apache/incubator

[jira] [Created] (BEAM-821) test_wordcount.sh uses Travis CI's default settings.xml, not ours

2016-10-25 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-821: Summary: test_wordcount.sh uses Travis CI's default settings.xml, not ours Key: BEAM-821 URL: https://issues.apache.org/jira/browse/BEAM-821 Project: Beam

[jira] [Commented] (BEAM-820) Travis test_wordcount.sh retrieve snapshot from repo, not Maven reactor

2016-10-25 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606065#comment-15606065 ] Kenneth Knowles commented on BEAM-820: -- Already fixed in [#1181|https://github.com/apache/incubator

[jira] [Created] (BEAM-820) Travis test_wordcount.sh retrieve snapshot from repo, not Maven reactor

2016-10-25 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-820: Summary: Travis test_wordcount.sh retrieve snapshot from repo, not Maven reactor Key: BEAM-820 URL: https://issues.apache.org/jira/browse/BEAM-820 Project: Beam

[jira] [Commented] (BEAM-810) Beam's uses of archetypes are problematic

2016-10-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604022#comment-15604022 ] Kenneth Knowles commented on BEAM-810: -- Can you link to an example failure of the archetypes? Since I

[jira] [Comment Edited] (BEAM-810) Beam's uses of archetypes are problematic

2016-10-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604018#comment-15604018 ] Kenneth Knowles edited comment on BEAM-810 at 10/25/16 3:14 AM: PR [#1181

[jira] [Commented] (BEAM-810) Beam's uses of archetypes are problematic

2016-10-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604018#comment-15604018 ] Kenneth Knowles commented on BEAM-810: -- PR [#1181|https://github.com/apache/incubator-beam/pull/1181

[jira] [Commented] (BEAM-800) DoFnLifeCycleManager should hold DoFnInvoker, not DoFn/OldDoFn

2016-10-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602848#comment-15602848 ] Kenneth Knowles commented on BEAM-800: -- The porting of the DirectRunner occured on [#1157|https

[jira] [Commented] (BEAM-757) The SparkRunner should utilize the SDK's DoFnRunner instead of writing it's own.

2016-10-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602812#comment-15602812 ] Kenneth Knowles commented on BEAM-757: -- For the {{DoFn}} switch, you could open a new issue

[jira] [Updated] (BEAM-801) SplittableParDo must be a pseudo-primitive, not ParDo(OldDoFn)

2016-10-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-801: - Assignee: Eugene Kirpichov > SplittableParDo must be a pseudo-primitive, not ParDo(OldD

[jira] [Commented] (BEAM-757) The SparkRunner should utilize the SDK's DoFnRunner instead of writing it's own.

2016-10-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602638#comment-15602638 ] Kenneth Knowles commented on BEAM-757: -- Oh, and by the way the PR that merged that also fixed the issue

[jira] [Commented] (BEAM-757) The SparkRunner should utilize the SDK's DoFnRunner instead of writing it's own.

2016-10-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602623#comment-15602623 ] Kenneth Knowles commented on BEAM-757: -- Also related is BEAM-788 for executing {{ReduceFn}} directly

[jira] [Commented] (BEAM-757) The SparkRunner should utilize the SDK's DoFnRunner instead of writing it's own.

2016-10-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602617#comment-15602617 ] Kenneth Knowles commented on BEAM-757: -- I'd say you can probably go ahead with it now. Then when I

[jira] [Created] (BEAM-803) Maven configuration that easily launches examples IT tests on one specific runner

2016-10-23 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-803: Summary: Maven configuration that easily launches examples IT tests on one specific runner Key: BEAM-803 URL: https://issues.apache.org/jira/browse/BEAM-803 Project

[jira] [Commented] (BEAM-25) Add user-ready API for interacting with state

2016-10-23 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-25?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600345#comment-15600345 ] Kenneth Knowles commented on BEAM-25: - {{DirectRunner}} has {{ParDo}} tests that need to be un-ignored

[jira] [Created] (BEAM-800) DoFnLifeCycleManager should hold DoFnInvoker, not DoFn/OldDoFn

2016-10-23 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-800: Summary: DoFnLifeCycleManager should hold DoFnInvoker, not DoFn/OldDoFn Key: BEAM-800 URL: https://issues.apache.org/jira/browse/BEAM-800 Project: Beam

[jira] [Created] (BEAM-788) Execute ReduceFn directly, not via OldDoFn wrapper

2016-10-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-788: Summary: Execute ReduceFn directly, not via OldDoFn wrapper Key: BEAM-788 URL: https://issues.apache.org/jira/browse/BEAM-788 Project: Beam Issue Type

[jira] [Assigned] (BEAM-175) Don't leak garbage collection timers in GlobalWindow

2016-10-20 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-175: Assignee: Kenneth Knowles (was: Mark Shields) > Don't leak garbage collection tim

[jira] [Updated] (BEAM-755) beam-runners-core-java NeedsRunner tests not executing

2016-10-20 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-755: - Assignee: Luke Cwik (was: Kenneth Knowles) > beam-runners-core-java NeedsRunner te

[jira] [Commented] (BEAM-755) beam-runners-core-java NeedsRunner tests not executing

2016-10-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589182#comment-15589182 ] Kenneth Knowles commented on BEAM-755: -- Noting that the resolution is that `beam-runners-core-java

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589165#comment-15589165 ] Kenneth Knowles commented on BEAM-696: -- My preference would be to err on the side of matching

[jira] [Updated] (BEAM-774) Implement Metrics support for Spark runner

2016-10-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-774: - Summary: Implement Metrics support for Spark runner (was: Implement Metrics support for Spark

[jira] [Created] (BEAM-766) Trigger AST should use @AutoValue

2016-10-17 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-766: Summary: Trigger AST should use @AutoValue Key: BEAM-766 URL: https://issues.apache.org/jira/browse/BEAM-766 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-765) TriggerStateMachine does not need to be separate from OnceTriggerStateMachine

2016-10-17 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-765: Summary: TriggerStateMachine does not need to be separate from OnceTriggerStateMachine Key: BEAM-765 URL: https://issues.apache.org/jira/browse/BEAM-765 Project

[jira] [Commented] (BEAM-757) The SparkRunner should utilize the SDK's DoFnRunner instead of writing it's own.

2016-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583565#comment-15583565 ] Kenneth Knowles commented on BEAM-757: -- Just a note here that I'm going to have to refactor them a bit

[jira] [Commented] (BEAM-750) Remove StateTag

2016-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583376#comment-15583376 ] Kenneth Knowles commented on BEAM-750: -- To be quite explicit - state kinds do not exist in the Beam

[jira] [Commented] (BEAM-755) beam-runners-core-java NeedsRunner tests not executing

2016-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583350#comment-15583350 ] Kenneth Knowles commented on BEAM-755: -- Taking yet another look, these should actually be {{NeedsRunner

[jira] [Updated] (BEAM-755) beam-runners-core-java NeedsRunner tests not executing

2016-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-755: - Summary: beam-runners-core-java NeedsRunner tests not executing (was: beam-runners-core-java

[jira] [Commented] (BEAM-755) beam-runners-core-java RunnableOnService tests not executing

2016-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583158#comment-15583158 ] Kenneth Knowles commented on BEAM-755: -- I have reconsidered this. I assert that runners-core can have

[jira] [Commented] (BEAM-755) beam-runners-core-java RunnableOnService tests not executing

2016-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583078#comment-15583078 ] Kenneth Knowles commented on BEAM-755: -- I'll take a peek. This is a crufty corner of the poms. > b

[jira] [Assigned] (BEAM-755) beam-runners-core-java RunnableOnService tests not executing

2016-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-755: Assignee: Kenneth Knowles (was: Frances Perry) > beam-runners-core-java RunnableOnServ

[jira] [Updated] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-361: - Assignee: Geetha Bijjam > Batch Pub/Sub sink does not set idLa

[jira] [Commented] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-10-17 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15582752#comment-15582752 ] Kenneth Knowles commented on BEAM-361: -- Hi [~venbijjam]. I'll assign this to you. Have you read

[jira] [Comment Edited] (BEAM-741) Values transform does not use the correct output coder when values is an Iterable

2016-10-16 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581093#comment-15581093 ] Kenneth Knowles edited comment on BEAM-741 at 10/17/16 3:44 AM: Great

[jira] [Comment Edited] (BEAM-741) Values transform does not use the correct output coder when values is an Iterable

2016-10-16 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581093#comment-15581093 ] Kenneth Knowles edited comment on BEAM-741 at 10/17/16 3:44 AM: Great

[jira] [Reopened] (BEAM-741) Values transform does not use the correct output coder when values is an Iterable

2016-10-16 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reopened BEAM-741: -- > Values transform does not use the correct output coder when values is an > It

[jira] [Commented] (BEAM-741) Values transform does not use the correct output coder when values is an Iterable

2016-10-16 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581093#comment-15581093 ] Kenneth Knowles commented on BEAM-741: -- Great investigation. I actually think the SDK should also

[jira] [Commented] (BEAM-747) Text checksum verifier is not resilient to eventually consistent filesystems

2016-10-14 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574437#comment-15574437 ] Kenneth Knowles commented on BEAM-747: -- Side note: we should treat checksums as a shortcut for a quick

Re: Build failed in Jenkins: beam_PostCommit_MavenVerify #1522

2016-10-13 Thread Kenneth Knowles
FYI I am watching the subsequent results. This error was caused by the JVM on the Jenkins worker getting OOM-killed, did not seem to relate to recent changes. But I'll watch to make sure. On Thu, Oct 13, 2016 at 3:35 PM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < >

[jira] [Commented] (BEAM-741) Values transform does not use the correct output coder when values is an Iterable

2016-10-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566814#comment-15566814 ] Kenneth Knowles commented on BEAM-741: -- Actually, what you say makes me want to investigate further

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566305#comment-15566305 ] Kenneth Knowles commented on BEAM-696: -- I think there's some conflation of elements coming out

[jira] [Commented] (BEAM-741) Values transform does not use the correct output coder when values is an Iterable

2016-10-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566252#comment-15566252 ] Kenneth Knowles commented on BEAM-741: -- Can you provide a reproduction? This is fairly surprising

[jira] [Comment Edited] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546263#comment-15546263 ] Kenneth Knowles edited comment on BEAM-696 at 10/11/16 6:52 PM: The SDK

[jira] [Commented] (BEAM-735) PAssertStreaming should make sure the assertion happened.

2016-10-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560618#comment-15560618 ] Kenneth Knowles commented on BEAM-735: -- At a high level, this already describes the relationship

[jira] [Commented] (BEAM-726) Standardize naming of PipelineResult objects

2016-10-06 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553379#comment-15553379 ] Kenneth Knowles commented on BEAM-726: -- I've toyed with the idea that that API on this thing

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-04 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546473#comment-15546473 ] Kenneth Knowles commented on BEAM-696: -- Ben points out (in person) that this latter spec is already

[jira] [Resolved] (BEAM-703) SingletonViewFn might exhaust defaultValue if it's serialized after being used.

2016-10-04 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-703. -- Resolution: Fixed Fix Version/s: 0.3.0-incubating > SingletonViewFn might exha

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-04 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546263#comment-15546263 ] Kenneth Knowles commented on BEAM-696: -- The SDK needs to lay out a spec, which I think is what Pei

[jira] [Commented] (BEAM-703) SingletonViewFn might exhaust defaultValue if it's serialized after being used.

2016-10-04 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546196#comment-15546196 ] Kenneth Knowles commented on BEAM-703: -- I think that might have been an attempt to save memory

[jira] [Updated] (BEAM-685) TextIO path pattern error on Windows OS

2016-09-27 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-685: - Description: It seems that the pattern {{some-output-file-*}} is rejected on Windows, or at least

[jira] [Created] (BEAM-685) TextIO path pattern error on Windows OS

2016-09-27 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-685: Summary: TextIO path pattern error on Windows OS Key: BEAM-685 URL: https://issues.apache.org/jira/browse/BEAM-685 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-475) High-quality javadoc for Beam

2016-09-27 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526249#comment-15526249 ] Kenneth Knowles commented on BEAM-475: -- See also BEAM-385 for raising the visibility. > High-qual

[jira] [Updated] (BEAM-684) De-Dataflow Beam

2016-09-27 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-684: - Labels: easy easyfix starter (was: ) > De-Dataflow Beam > > >

[jira] [Commented] (BEAM-672) Figure out TestPipeline.create(PipelineOptions) / TestPipeline.fromOptions(PipelineOptions) story

2016-09-23 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517821#comment-15517821 ] Kenneth Knowles commented on BEAM-672: -- An important use case to consider (we talked offline about

[jira] [Assigned] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

2016-09-23 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-615: Assignee: Kenneth Knowles > Add Support for Processing-Time Timers in FlinkRunner Win

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-23 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15516981#comment-15516981 ] Kenneth Knowles commented on BEAM-644: -- [~aljoscha], are you referring to two clusters of output

[jira] [Updated] (BEAM-259) Execute selected RunnableOnService tests with Spark runner

2016-09-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-259: - Assignee: Jason Kuster (was: Kenneth Knowles) > Execute selected RunnableOnService te

[jira] [Commented] (BEAM-259) Execute selected RunnableOnService tests with Spark runner

2016-09-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514657#comment-15514657 ] Kenneth Knowles commented on BEAM-259: -- [~jasonkuster] any chance you can take a look at why this build

[jira] [Assigned] (BEAM-259) Execute selected RunnableOnService tests with Spark runner

2016-09-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-259: Assignee: Kenneth Knowles > Execute selected RunnableOnService tests with Spark run

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513859#comment-15513859 ] Kenneth Knowles commented on BEAM-644: -- I don't quite understand the comment [~aljoscha]. Can you say

[jira] [Updated] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-644: - Description: There is a general need, especially important in the presence of SplittableDoFn

[jira] [Updated] (BEAM-656) Add support for side inputs/outputs to Java 8 lambdas in MapElements

2016-09-21 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-656: - Description: Currently there's no way to use side inputs or outputs within Java 8 lambdas

[jira] [Commented] (BEAM-655) Rename @RunnableonService to something more descriptive

2016-09-20 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508687#comment-15508687 ] Kenneth Knowles commented on BEAM-655: -- Relevant proposal at [Capability Matrix Testing|https

[jira] [Created] (BEAM-654) When and how can merging windows "shrink" or "grow"?

2016-09-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-654: Summary: When and how can merging windows "shrink" or "grow"? Key: BEAM-654 URL: https://issues.apache.org/jira/browse/BEAM-654 Project: Beam

[jira] [Created] (BEAM-653) Refine specification for WindowFn.isCompatible()

2016-09-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-653: Summary: Refine specification for WindowFn.isCompatible() Key: BEAM-653 URL: https://issues.apache.org/jira/browse/BEAM-653 Project: Beam Issue Type: New

[jira] [Created] (BEAM-652) StateNamespaces.window() potentially unstable / stable encodings for windows

2016-09-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-652: Summary: StateNamespaces.window() potentially unstable / stable encodings for windows Key: BEAM-652 URL: https://issues.apache.org/jira/browse/BEAM-652 Project: Beam

[jira] [Updated] (BEAM-652) StateNamespaces.window() potentially unstable / stable encodings for windows

2016-09-20 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-652: - Issue Type: Improvement (was: New Feature) > StateNamespaces.window() potentially unsta

[jira] [Created] (BEAM-646) Get runners out of the apply()

2016-09-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-646: Summary: Get runners out of the apply() Key: BEAM-646 URL: https://issues.apache.org/jira/browse/BEAM-646 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-644: Summary: Primitive to shift the watermark while assigning timestamps Key: BEAM-644 URL: https://issues.apache.org/jira/browse/BEAM-644 Project: Beam Issue

[jira] [Commented] (BEAM-414) IntraBundleParallelization needs to be removed

2016-09-16 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497620#comment-15497620 ] Kenneth Knowles commented on BEAM-414: -- Awesome. One less OldDoFn situation sitting around

[jira] [Commented] (BEAM-260) Know the getSideInputWindow upper bound so can gc side input state

2016-09-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15494237#comment-15494237 ] Kenneth Knowles commented on BEAM-260: -- This came up again on the dev list in [this thread|http://mail

[jira] [Commented] (BEAM-259) Execute selected RunnableOnService tests with Spark runner

2016-09-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465798#comment-15465798 ] Kenneth Knowles commented on BEAM-259: -- Pretty sure I broke this recently. I'll get it fixed

[jira] [Updated] (BEAM-597) Provide type information from Coders

2016-08-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-597: - Component/s: (was: sdk-java-extensions) sdk-java-core > Provide t

[jira] [Commented] (BEAM-566) Implement proposal process

2016-08-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439431#comment-15439431 ] Kenneth Knowles commented on BEAM-566: -- In the website redesign, we lost the link to misc technical

[jira] [Assigned] (BEAM-576) ReduceFnRunner should GC based on current WM, not on a fired Timer

2016-08-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-576: Assignee: Kenneth Knowles (was: Davor Bonaci) > ReduceFnRunner should GC based on curr

[jira] [Resolved] (BEAM-479) Move RunnableOnService test executions to postcommit

2016-08-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-479. -- Resolution: Fixed Fix Version/s: Not applicable > Move RunnableOnService test executi

<    1   2   3   4   5   >