[jira] [Assigned] (BEAM-317) Implement PAssert without using Side Inputs

2016-06-08 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-317: Assignee: Kenneth Knowles (was: Thomas Groh) > Implement PAssert without using Side Inputs

[jira] [Created] (BEAM-328) CoderRegistry does not provide SerializableCoder for `T extends Serializable`

2016-06-07 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-328: Summary: CoderRegistry does not provide SerializableCoder for `T extends Serializable` Key: BEAM-328 URL: https://issues.apache.org/jira/browse/BEAM-328 Project:

[jira] [Commented] (BEAM-335) beam_PostCommit_RunnableOnService_GoogleCloudDataflow broken since #514

2016-06-12 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326732#comment-15326732 ] Kenneth Knowles commented on BEAM-335: -- Probably should run a PAssert on each runner in the presubmit.

[jira] [Commented] (BEAM-335) beam_PostCommit_RunnableOnService_GoogleCloudDataflow broken since #514

2016-06-12 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326694#comment-15326694 ] Kenneth Knowles commented on BEAM-335: -- Agreed as to likely cause. I'll take a look. >

[jira] [Updated] (BEAM-335) beam_PostCommit_RunnableOnService_GoogleCloudDataflow broken since #514

2016-06-12 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-335: - Description: The RunnableOnService+Dataflow postsubmit has been a little flaky recently, but

[jira] [Comment Edited] (BEAM-335) beam_PostCommit_RunnableOnService_GoogleCloudDataflow broken since #514

2016-06-12 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326732#comment-15326732 ] Kenneth Knowles edited comment on BEAM-335 at 6/13/16 1:55 AM: --- Probably

[jira] [Created] (BEAM-332) Matcher(s) for TableRow

2016-06-09 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-332: Summary: Matcher(s) for TableRow Key: BEAM-332 URL: https://issues.apache.org/jira/browse/BEAM-332 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-309) Need an UnboundedSourceFromHell to test runner's respect of its implied contract

2016-05-25 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300573#comment-15300573 ] Kenneth Knowles commented on BEAM-309: -- I think step 1 here might be to take that implied contract and

[jira] [Commented] (BEAM-306) Make java-only PubsubIO work in InProcessRunner

2016-05-25 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300583#comment-15300583 ] Kenneth Knowles commented on BEAM-306: -- I think there's a confusing ambiguity at [this line in

[jira] [Created] (BEAM-341) ReduceFnRunner allows GC time overflow

2016-06-14 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-341: Summary: ReduceFnRunner allows GC time overflow Key: BEAM-341 URL: https://issues.apache.org/jira/browse/BEAM-341 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-332) Matcher(s) for TableRow

2016-06-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331981#comment-15331981 ] Kenneth Knowles commented on BEAM-332: -- That would be nice, but it is outside Beam's immediate purview.

[jira] [Commented] (BEAM-170) Session windows should not be identified by their bounds

2016-05-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302336#comment-15302336 ] Kenneth Knowles commented on BEAM-170: -- Yes, creating a new type of window for sessions that includes a

[jira] [Updated] (BEAM-170) Session windows should not be identified by their bounds

2016-05-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-170: - Assignee: Ilya Ganelin (was: Davor Bonaci) > Session windows should not be identified by their

[jira] [Updated] (BEAM-170) Session windows should not be identified by their bounds

2016-05-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-170: - Assignee: Davor Bonaci > Session windows should not be identified by their bounds >

[jira] [Updated] (BEAM-261) Apache Apex Runner

2016-06-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-261: - Assignee: Thomas Weise > Apache Apex Runner > -- > > Key: BEAM-261

[jira] [Closed] (BEAM-346) When WindowFn not specified in Window.into(...), NullPointerException

2016-06-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-346. Resolution: Fixed > When WindowFn not specified in Window.into(...), NullPointerException >

[jira] [Created] (BEAM-346) When WindowFn not specified in Window.into(...), NullPointerException

2016-06-15 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-346: Summary: When WindowFn not specified in Window.into(...), NullPointerException Key: BEAM-346 URL: https://issues.apache.org/jira/browse/BEAM-346 Project: Beam

[jira] [Resolved] (BEAM-335) beam_PostCommit_RunnableOnService_GoogleCloudDataflow broken since #514

2016-06-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-335. -- Resolution: Fixed At this point we are back to the usual issues. >

[jira] [Resolved] (BEAM-243) Remove DirectPipelineRunner and keep only the InProcessPipelineRunner

2016-06-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-243. -- Resolution: Fixed Awesome. > Remove DirectPipelineRunner and keep only the

[jira] [Resolved] (BEAM-22) DirectPipelineRunner: support for unbounded collections

2016-06-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-22. - Resolution: Fixed Superb. > DirectPipelineRunner: support for unbounded collections >

[jira] [Resolved] (BEAM-345) When WindowFn not specified in Window.into(...), NullPointerException

2016-06-16 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-345. -- Resolution: Fixed > When WindowFn not specified in Window.into(...), NullPointerException >

[jira] [Resolved] (BEAM-269) Create BigDecimal Coder

2016-06-16 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-269. -- Resolution: Fixed > Create BigDecimal Coder > --- > > Key:

[jira] [Resolved] (BEAM-341) ReduceFnRunner allows GC time overflow

2016-06-16 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-341. -- Resolution: Fixed > ReduceFnRunner allows GC time overflow >

[jira] [Resolved] (BEAM-342) Change Filter#greaterThan, etc. to actually use Filter

2016-06-16 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-342. -- Resolution: Fixed > Change Filter#greaterThan, etc. to actually use Filter >

[jira] [Commented] (BEAM-328) CoderRegistry does not provide SerializableCoder for `T extends Serializable`

2016-06-16 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334478#comment-15334478 ] Kenneth Knowles commented on BEAM-328: -- Yes, I think you'll probably need to do some refactoring to use

[jira] [Updated] (BEAM-37) Run DoFnWithContext without conversion to vanilla DoFn

2016-06-23 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-37?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-37: Assignee: Ben Chambers (was: Kenneth Knowles) > Run DoFnWithContext without conversion to vanilla

[jira] [Assigned] (BEAM-302) Add Beam Scala DSL

2016-06-23 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-302: Assignee: Neville Li (was: James Malone) Here you go! I will go ahead and make the name a

[jira] [Updated] (BEAM-302) Add Scio Scala DSL to Beam

2016-06-23 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-302: - Summary: Add Scio Scala DSL to Beam (was: Add Beam Scala DSL) > Add Scio Scala DSL to Beam >

[jira] [Commented] (BEAM-373) CoGbkResult will crash after 10,000 elements on any runner that does not provide a Reiterator

2016-06-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15348524#comment-15348524 ] Kenneth Knowles commented on BEAM-373: -- False - just a readability issue. There is a {{break}} that is

[jira] [Resolved] (BEAM-146) WindowFn.AssingContext leaks implementation details about compressed WindowedValue representation

2016-06-23 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-146. -- Resolution: Fixed > WindowFn.AssingContext leaks implementation details about compressed >

[jira] [Updated] (BEAM-39) Audit trigger implementations to ensure they prefetch appropriately

2016-02-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-39?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-39: Assignee: Frances Perry (was: Kenneth Knowles) > Audit trigger implementations to ensure they

[jira] [Commented] (BEAM-12) Apply GroupByKey transforms on PCollection of normal type other than KV

2016-02-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-12?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15147522#comment-15147522 ] Kenneth Knowles commented on BEAM-12: - Note also that the SDK includes a very simple composite

[jira] [Created] (BEAM-26) Model for validation of user state upon pipeline update

2016-02-19 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-26: --- Summary: Model for validation of user state upon pipeline update Key: BEAM-26 URL: https://issues.apache.org/jira/browse/BEAM-26 Project: Beam Issue Type:

[jira] [Created] (BEAM-29) Bound Instant values used as timestamps at TIMESTAMP_MIN_VALUE and TIMESTAMP_MAX_VALUE

2016-02-19 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-29: --- Summary: Bound Instant values used as timestamps at TIMESTAMP_MIN_VALUE and TIMESTAMP_MAX_VALUE Key: BEAM-29 URL: https://issues.apache.org/jira/browse/BEAM-29

[jira] [Updated] (BEAM-30) In TriggerRunner, avoid reading the set of finished subtriggers when no subtrigger ever finishes.

2016-02-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-30?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-30: Component/s: runner-core > In TriggerRunner, avoid reading the set of finished subtriggers when no >

[jira] [Created] (BEAM-31) When triggers are changed via pipeline update, stale finished triggers data applied

2016-02-19 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-31: --- Summary: When triggers are changed via pipeline update, stale finished triggers data applied Key: BEAM-31 URL: https://issues.apache.org/jira/browse/BEAM-31 Project:

[jira] [Created] (BEAM-32) Consider not emitting empty ON_TIME pane unless requested

2016-02-19 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-32: --- Summary: Consider not emitting empty ON_TIME pane unless requested Key: BEAM-32 URL: https://issues.apache.org/jira/browse/BEAM-32 Project: Beam Issue Type:

[jira] [Created] (BEAM-38) Avoid repeated DoFn deserialization

2016-02-19 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-38: --- Summary: Avoid repeated DoFn deserialization Key: BEAM-38 URL: https://issues.apache.org/jira/browse/BEAM-38 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-39) Audit trigger implementations to ensure they prefetch appropriately

2016-02-19 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-39: --- Summary: Audit trigger implementations to ensure they prefetch appropriately Key: BEAM-39 URL: https://issues.apache.org/jira/browse/BEAM-39 Project: Beam

[jira] [Created] (BEAM-40) Replace rawtype lambda-incompatible uses of SerializableFunction with SimpleFunction (as appropriate)

2016-02-19 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-40: --- Summary: Replace rawtype lambda-incompatible uses of SerializableFunction with SimpleFunction (as appropriate) Key: BEAM-40 URL: https://issues.apache.org/jira/browse/BEAM-40

[jira] [Created] (BEAM-83) Beam SDK has some difficulties upon import to Eclipse as maven project

2016-02-29 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-83: --- Summary: Beam SDK has some difficulties upon import to Eclipse as maven project Key: BEAM-83 URL: https://issues.apache.org/jira/browse/BEAM-83 Project: Beam

[jira] [Created] (BEAM-82) Transitive dependencies in Beam pom.xml have conflicts that could result in old versions if reordered

2016-02-29 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-82: --- Summary: Transitive dependencies in Beam pom.xml have conflicts that could result in old versions if reordered Key: BEAM-82 URL: https://issues.apache.org/jira/browse/BEAM-82

[jira] [Updated] (BEAM-115) Beam Runner API

2016-03-14 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-115: - Description: The PipelineRunner API from the SDK is not ideal for the Beam technical vision. It

[jira] [Updated] (BEAM-115) Beam Runner API

2016-03-14 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-115: - Description: The PipelineRunner API from the SDK is not ideal for the Beam technical vision. It

[jira] [Created] (BEAM-115) Beam Runner API

2016-03-14 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-115: Summary: Beam Runner API Key: BEAM-115 URL: https://issues.apache.org/jira/browse/BEAM-115 Project: Beam Issue Type: Improvement Components:

[jira] [Updated] (BEAM-44) Return the input coder in NullableCoder.of() if it is a NullableCoder

2016-04-06 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-44?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-44: Description: {{NullableCoder.of(NullableCoder.of(foo))}} returns a nested {{NullableCoder}}, which

[jira] [Created] (BEAM-177) Integrate code coverage to build

2016-04-06 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-177: Summary: Integrate code coverage to build Key: BEAM-177 URL: https://issues.apache.org/jira/browse/BEAM-177 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-184) Using Merging Windows and/or Triggers without a downstream aggregation should fail

2016-04-12 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-184: - Description: Both merging windows (such as sessions) and triggering only actually happen at an

[jira] [Commented] (BEAM-184) Using Merging Windows and/or Triggers without a downstream aggregation should fail

2016-04-12 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15237500#comment-15237500 ] Kenneth Knowles commented on BEAM-184: -- I agree, for the short term. Long term, at least 1 & 3 should

[jira] [Created] (BEAM-188) Merging WindowFn + GBK + Write => InvalidWindows throws UnsupportedOperationException

2016-04-11 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-188: Summary: Merging WindowFn + GBK + Write => InvalidWindows throws UnsupportedOperationException Key: BEAM-188 URL: https://issues.apache.org/jira/browse/BEAM-188

[jira] [Commented] (BEAM-116) Change runners artifactId to runners-parent

2016-03-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197806#comment-15197806 ] Kenneth Knowles commented on BEAM-116: -- +1. I reverted it to "runners" but I am convinced by what you

[jira] [Created] (BEAM-145) OutputTimeFn#assignOutputTime overrides WindowFn#getOutputTime in unfortunate ways

2016-03-23 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-145: Summary: OutputTimeFn#assignOutputTime overrides WindowFn#getOutputTime in unfortunate ways Key: BEAM-145 URL: https://issues.apache.org/jira/browse/BEAM-145

[jira] [Commented] (BEAM-149) IntelliJ: Java 8 tests configuration

2016-03-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210583#comment-15210583 ] Kenneth Knowles commented on BEAM-149: -- When it was {{src/test/java}} and {{src/test/java8}}, then it

[jira] [Commented] (BEAM-85) DataflowAssert (BeamAssert ;) needs sanity check that it's used correctly

2016-03-01 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175127#comment-15175127 ] Kenneth Knowles commented on BEAM-85: - Yes, they are separable. > DataflowAssert (BeamAssert ;) needs

[jira] [Updated] (BEAM-170) Session windows should not be identified by their bounds

2016-04-04 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-170: - Description: Today, if two session windows for the same key have the same bounds, they are

[jira] [Updated] (BEAM-163) Warn the user when a PCollection (via Window.into) has smaller allowedLateness than upstream

2016-03-31 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-163: - Description: In this situation, data may be dropped downstream even though it was allowed upstream.

[jira] [Created] (BEAM-163) Warn the user when a PCollection (via Window.into) has smaller allowedLateness than upstream

2016-03-31 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-163: Summary: Warn the user when a PCollection (via Window.into) has smaller allowedLateness than upstream Key: BEAM-163 URL: https://issues.apache.org/jira/browse/BEAM-163

[jira] [Commented] (BEAM-162) assert fail using session windows

2016-03-31 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220403#comment-15220403 ] Kenneth Knowles commented on BEAM-162: -- I meant should in the normative sense, of course. > assert

[jira] [Commented] (BEAM-162) assert fail using session windows

2016-03-31 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220369#comment-15220369 ] Kenneth Knowles commented on BEAM-162: -- Elaborating on Ben's comment, only the trigger's {{onFire()}}

[jira] [Comment Edited] (BEAM-162) assert fail using session windows

2016-03-31 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220413#comment-15220413 ] Kenneth Knowles edited comment on BEAM-162 at 3/31/16 6:34 PM: --- I agree with

[jira] [Commented] (BEAM-162) assert fail using session windows

2016-03-31 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220413#comment-15220413 ] Kenneth Knowles commented on BEAM-162: -- I agree with your PR, but I think the cause is different than

[jira] [Created] (BEAM-170) Session windows should not be identified by their bounds

2016-04-04 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-170: Summary: Session windows should not be identified by their bounds Key: BEAM-170 URL: https://issues.apache.org/jira/browse/BEAM-170 Project: Beam Issue

[jira] [Created] (BEAM-169) Need serialized form and serialVersionUID for user-facing superclasses

2016-04-04 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-169: Summary: Need serialized form and serialVersionUID for user-facing superclasses Key: BEAM-169 URL: https://issues.apache.org/jira/browse/BEAM-169 Project: Beam

[jira] [Updated] (BEAM-224) Two assert fails with merging windows and closable triggers

2016-04-25 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-224: - Assignee: Mark Shields (was: Frances Perry) > Two assert fails with merging windows and closable

[jira] [Updated] (BEAM-216) Create Storm Runner

2016-04-20 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-216: - Component/s: runner-ideas Issue Type: New Feature (was: Improvement) > Create Storm Runner >

[jira] [Updated] (BEAM-216) Create Storm Runner

2016-04-20 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-216: - Summary: Create Storm Runner (was: Create Strom Runner ) > Create Storm Runner >

[jira] [Commented] (BEAM-189) The Spark runner uses valueInEmptyWindow which causes values to be dropped

2016-04-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258880#comment-15258880 ] Kenneth Knowles commented on BEAM-189: -- Follow-up to remove the problematic method entirely is

[jira] [Updated] (BEAM-237) Should use allowedLateness from downstream computations in ReduceFnRunner

2016-04-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-237: - Assignee: (was: Frances Perry) > Should use allowedLateness from downstream computations in

[jira] [Commented] (BEAM-122) GlobalWindow and allowedLateness can cause inconsistent timer interpretation

2016-04-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15262731#comment-15262731 ] Kenneth Knowles commented on BEAM-122: -- You have done this, yes? Or is it in a PR I just saw that isn't

[jira] [Commented] (BEAM-85) DataflowAssert (BeamAssert ;) needs sanity check that it's used correctly

2016-05-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292574#comment-15292574 ] Kenneth Knowles commented on BEAM-85: - BEAM-298 is not quite a dupe of this, but close. > DataflowAssert

[jira] [Commented] (BEAM-298) Make TestPipeline implement the TestRule interface

2016-05-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292575#comment-15292575 ] Kenneth Knowles commented on BEAM-298: -- This is one approach to one aspect of BEAM-85. > Make

[jira] [Commented] (BEAM-31) When triggers are changed via pipeline update, stale finished triggers data applied

2016-05-23 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-31?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297674#comment-15297674 ] Kenneth Knowles commented on BEAM-31: - No, BEAM-179 was one symptom, but this is the root cause. > When

[jira] [Assigned] (BEAM-191) Remove WindowedValue.valueInEmptyWindows

2016-05-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-191: Assignee: Kenneth Knowles > Remove WindowedValue.valueInEmptyWindows >

[jira] [Commented] (BEAM-279) Make sure we unit test bounded sessions

2016-05-12 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282023#comment-15282023 ] Kenneth Knowles commented on BEAM-279: -- Your final sentence is important. The best way to implement

[jira] [Created] (BEAM-280) TestPipeline should be constructible without a runner

2016-05-12 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-280: Summary: TestPipeline should be constructible without a runner Key: BEAM-280 URL: https://issues.apache.org/jira/browse/BEAM-280 Project: Beam Issue Type:

[jira] [Commented] (BEAM-291) PDone type translation fails

2016-05-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289216#comment-15289216 ] Kenneth Knowles commented on BEAM-291: -- High-level comment: This is probably related to

[jira] [Commented] (BEAM-241) Not easy for runners to get late-data dropping

2016-04-29 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264823#comment-15264823 ] Kenneth Knowles commented on BEAM-241: -- This is getting into the realm of providing a backend/worker

[jira] [Commented] (BEAM-233) Make Registering Avro Specific Records Easier

2016-05-03 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269199#comment-15269199 ] Kenneth Knowles commented on BEAM-233: -- I should also note two other options: # It is probably pretty

[jira] [Resolved] (BEAM-157) CombineTest.testGlobalCombineWithDefaultsAndTriggers is broken

2016-05-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-157. -- Resolution: Fixed > CombineTest.testGlobalCombineWithDefaultsAndTriggers is broken >

[jira] [Updated] (BEAM-177) Integrate code coverage to build and review process

2016-05-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-177: - Assignee: (was: Kenneth Knowles) > Integrate code coverage to build and review process >

[jira] [Resolved] (BEAM-82) Transitive dependencies in Beam pom.xml have conflicts that could result in old versions if reordered

2016-05-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-82?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-82. - Resolution: Fixed > Transitive dependencies in Beam pom.xml have conflicts that could result in >

[jira] [Created] (BEAM-258) Execute selected RunnableOnService tests with Flink runner

2016-05-05 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-258: Summary: Execute selected RunnableOnService tests with Flink runner Key: BEAM-258 URL: https://issues.apache.org/jira/browse/BEAM-258 Project: Beam Issue

[jira] [Created] (BEAM-246) Do not build source jar, javadoc, in default Maven profile.

2016-05-02 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-246: Summary: Do not build source jar, javadoc, in default Maven profile. Key: BEAM-246 URL: https://issues.apache.org/jira/browse/BEAM-246 Project: Beam Issue

[jira] [Updated] (BEAM-247) CombineFn's only definable/usable inside sdk.transforms package

2016-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-247: - Description: {code:java} public abstract static class CombineFn extends

[jira] [Commented] (BEAM-247) CombineFn's only definable/usable inside sdk.transforms package

2016-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267032#comment-15267032 ] Kenneth Knowles commented on BEAM-247: -- Aside from this making me :-( we should have a test that will

[jira] [Comment Edited] (BEAM-233) Make Registering Avro Specific Records Easier

2016-05-03 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269047#comment-15269047 ] Kenneth Knowles edited comment on BEAM-233 at 5/3/16 4:49 PM: -- This makes good

[jira] [Updated] (BEAM-233) Make Registering Avro Specific Records Easier

2016-05-03 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-233: - Assignee: (was: Kenneth Knowles) > Make Registering Avro Specific Records Easier >

[jira] [Comment Edited] (BEAM-233) Make Registering Avro Specific Records Easier

2016-05-03 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269047#comment-15269047 ] Kenneth Knowles edited comment on BEAM-233 at 5/3/16 4:48 PM: -- This makes good

[jira] [Commented] (BEAM-225) Create Class for Common TypeDescriptors

2016-05-03 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269022#comment-15269022 ] Kenneth Knowles commented on BEAM-225: -- Definitely a nice idea. Might you be up for it, [~eljefe6aa]?

[jira] [Updated] (BEAM-225) Create Class for Common TypeDescriptors

2016-05-03 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-225: - Labels: starter (was: ) > Create Class for Common TypeDescriptors >

[jira] [Updated] (BEAM-233) Make Registering Avro Specific Records Easier

2016-05-03 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-233: - Issue Type: Improvement (was: Bug) > Make Registering Avro Specific Records Easier >

[jira] [Resolved] (BEAM-34) Change default output timestamp for combined values to end of window

2016-05-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-34. - Resolution: Fixed > Change default output timestamp for combined values to end of window >

[jira] [Commented] (BEAM-205) An 'in process' runner optimized for efficiency rather than debugging

2016-04-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246121#comment-15246121 ] Kenneth Knowles commented on BEAM-205: -- I believe the forthcoming in-process runner meets the criteria

[jira] [Commented] (BEAM-210) Be consistent with emitting final empty panes

2016-04-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248479#comment-15248479 ] Kenneth Knowles commented on BEAM-210: -- Sounds like expected behavior for

[jira] [Commented] (BEAM-210) Be consistent with emitting final empty panes

2016-04-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248630#comment-15248630 ] Kenneth Knowles commented on BEAM-210: -- I don't really agree that adding this knob is what's most

[jira] [Commented] (BEAM-210) Be consistent with emitting final empty panes

2016-04-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248520#comment-15248520 ] Kenneth Knowles commented on BEAM-210: -- Today the [ON_TIME pane is hardcoded to be

[jira] [Commented] (BEAM-434) Limit the number of output files a beam-examples execution writes

2016-07-12 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373644#comment-15373644 ] Kenneth Knowles commented on BEAM-434: -- OK, I'm pretty convinced I was wrong, by the argument that

[jira] [Updated] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-14 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-445: - Assignee: Daniel Halperin (was: Scott Wegner) > Beam-examples-java build failed through local "mvn

[jira] [Updated] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-14 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-445: - Assignee: Scott Wegner (was: Daniel Halperin) > Beam-examples-java build failed through local "mvn

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-14 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378656#comment-15378656 ] Kenneth Knowles commented on BEAM-445: -- The build breakage itself is fixed - users are still required

  1   2   3   4   5   >