[jira] [Assigned] (BEAM-38) Avoid repeated DoFn deserialization

2016-06-06 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-38?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-38: --- Assignee: Thomas Groh > Avoid repeated DoFn deserialization > --- > >

[jira] [Created] (BEAM-310) Exercise splitIntoBundles/generateInitialSplits in the Direct Runner

2016-05-25 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-310: Summary: Exercise splitIntoBundles/generateInitialSplits in the Direct Runner Key: BEAM-310 URL: https://issues.apache.org/jira/browse/BEAM-310 Project: Beam Issue

[jira] [Created] (BEAM-344) Merge, Split, Delay, and Reorder bundles in the InProcessPipelineRunner

2016-06-15 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-344: Summary: Merge, Split, Delay, and Reorder bundles in the InProcessPipelineRunner Key: BEAM-344 URL: https://issues.apache.org/jira/browse/BEAM-344 Project: Beam

[jira] [Resolved] (BEAM-323) The InProcessPipelineRunner uses user objects for State and Timer lookups

2016-06-06 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-323. -- Resolution: Fixed > The InProcessPipelineRunner uses user objects for State and Timer lookups >

[jira] [Updated] (BEAM-317) Implement PAssert without using Side Inputs

2016-06-06 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-317: - Description: SideInputs are not supported equally by all runners. Implementing assertions as a main input

[jira] [Updated] (BEAM-85) PAssert needs sanity check that it's used correctly

2016-06-06 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-85?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-85: Summary: PAssert needs sanity check that it's used correctly (was: DataflowAssert (BeamAssert ;) needs sanity

[jira] [Assigned] (BEAM-298) Make TestPipeline implement the TestRule interface

2016-06-06 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-298: Assignee: (was: Thomas Groh) > Make TestPipeline implement the TestRule interface >

[jira] [Created] (BEAM-317) Implement PAssert#containsInAnyOrder and PAssert#satisfies without using Side Inputs

2016-05-31 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-317: Summary: Implement PAssert#containsInAnyOrder and PAssert#satisfies without using Side Inputs Key: BEAM-317 URL: https://issues.apache.org/jira/browse/BEAM-317 Project: Beam

[jira] [Created] (BEAM-323) The InProcessPipelineRunner uses user objects for State and Timer lookups

2016-06-01 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-323: Summary: The InProcessPipelineRunner uses user objects for State and Timer lookups Key: BEAM-323 URL: https://issues.apache.org/jira/browse/BEAM-323 Project: Beam

[jira] [Commented] (BEAM-33) Make DataflowAssert more window-aware

2016-06-22 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-33?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344715#comment-15344715 ] Thomas Groh commented on BEAM-33: - Effectively equivalent to https://issues.apache.org/jira/browse/BEAM-155

[jira] [Assigned] (BEAM-33) Make DataflowAssert more window-aware

2016-06-22 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-33: --- Assignee: Thomas Groh > Make DataflowAssert more window-aware > - >

[jira] [Resolved] (BEAM-234) Remove the word Pipeline from the name of all PipelineRunner implementations

2016-06-21 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-234. -- Resolution: Fixed > Remove the word Pipeline from the name of all PipelineRunner implementations >

[jira] [Commented] (BEAM-181) Make TextIOTest and AvroIOTest runner-agnostic

2016-06-17 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337323#comment-15337323 ] Thomas Groh commented on BEAM-181: -- The idea is to first convert all the reads and writes that use the Java

[jira] [Updated] (BEAM-358) JAXB Coder is not thread safe

2016-06-20 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-358: - Component/s: sdk-java-core > JAXB Coder is not thread safe > - > >

[jira] [Created] (BEAM-358) JAXB Coder is not thread safe

2016-06-20 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-358: Summary: JAXB Coder is not thread safe Key: BEAM-358 URL: https://issues.apache.org/jira/browse/BEAM-358 Project: Beam Issue Type: Bug Reporter: Thomas

[jira] [Commented] (BEAM-136) PipelineOptionsFactory should detect all runners

2016-03-19 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202429#comment-15202429 ] Thomas Groh commented on BEAM-136: -- The default collection of runners is obtained by using

[jira] [Resolved] (BEAM-94) CountingInput should be able to limit the rate at which output is produced

2016-03-30 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-94. - Resolution: Fixed https://github.com/apache/incubator-beam/pull/17 > CountingInput should be able to limit

[jira] [Resolved] (BEAM-44) Return the input coder in NullableCoder.of() if it is a NullableCoder

2016-04-06 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-44?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-44. - Resolution: Fixed > Return the input coder in NullableCoder.of() if it is a NullableCoder >

[jira] [Created] (BEAM-181) Make TextIOTest and AvroIOTest runner-agnostic

2016-04-07 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-181: Summary: Make TextIOTest and AvroIOTest runner-agnostic Key: BEAM-181 URL: https://issues.apache.org/jira/browse/BEAM-181 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-171) JAXBCoder ignores Context and inappropriately consumes input

2016-04-06 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-171. -- Resolution: Fixed > JAXBCoder ignores Context and inappropriately consumes input >

[jira] [Created] (BEAM-94) CountingInput should be able to limit the rate at which output is produced

2016-03-03 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-94: --- Summary: CountingInput should be able to limit the rate at which output is produced Key: BEAM-94 URL: https://issues.apache.org/jira/browse/BEAM-94 Project: Beam

[jira] [Created] (BEAM-155) Support asserting the contents of windows and panes in PAssert

2016-03-29 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-155: Summary: Support asserting the contents of windows and panes in PAssert Key: BEAM-155 URL: https://issues.apache.org/jira/browse/BEAM-155 Project: Beam Issue Type:

[jira] [Created] (BEAM-171) JAXBCoder ignores Context and inappropriately consumes input

2016-04-04 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-171: Summary: JAXBCoder ignores Context and inappropriately consumes input Key: BEAM-171 URL: https://issues.apache.org/jira/browse/BEAM-171 Project: Beam Issue Type:

[jira] [Created] (BEAM-234) Remove the word Pipeline from the name of all PipelineRunner implementations

2016-04-27 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-234: Summary: Remove the word Pipeline from the name of all PipelineRunner implementations Key: BEAM-234 URL: https://issues.apache.org/jira/browse/BEAM-234 Project: Beam

[jira] [Created] (BEAM-298) Make TestPipeline implement the TestRule interface

2016-05-19 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-298: Summary: Make TestPipeline implement the TestRule interface Key: BEAM-298 URL: https://issues.apache.org/jira/browse/BEAM-298 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

2016-05-12 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282308#comment-15282308 ] Thomas Groh commented on BEAM-22: - As of the merging of https://github.com/apache/incubator-beam/pull/319,

[jira] [Created] (BEAM-296) Retry failures in the DirectRunner

2016-05-18 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-296: Summary: Retry failures in the DirectRunner Key: BEAM-296 URL: https://issues.apache.org/jira/browse/BEAM-296 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-296) Retry failures in the DirectRunner

2016-05-18 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-296: - Component/s: runner-direct > Retry failures in the DirectRunner > -- > >

[jira] [Commented] (BEAM-208) Flaky test: org.apache.beam.runners.flink.streaming.GroupByNullKeyTest.testJob

2016-04-19 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248132#comment-15248132 ] Thomas Groh commented on BEAM-208: -- This flakiness occurs due to the combination of using

[jira] [Created] (BEAM-212) SparkPipelineRunner should support the Read Primitive

2016-04-19 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-212: Summary: SparkPipelineRunner should support the Read Primitive Key: BEAM-212 URL: https://issues.apache.org/jira/browse/BEAM-212 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-212) SparkPipelineRunner should support the Read Primitive

2016-04-19 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh closed BEAM-212. Resolution: Fixed > SparkPipelineRunner should support the Read Primitive >

[jira] [Created] (BEAM-230) Remove WindowedValue#valueInEmptyWindows

2016-04-26 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-230: Summary: Remove WindowedValue#valueInEmptyWindows Key: BEAM-230 URL: https://issues.apache.org/jira/browse/BEAM-230 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-448) Print Properties on validation failures in PipelineOptionsValidator

2016-07-13 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-448: Summary: Print Properties on validation failures in PipelineOptionsValidator Key: BEAM-448 URL: https://issues.apache.org/jira/browse/BEAM-448 Project: Beam Issue

[jira] [Created] (BEAM-447) Stop referring to types with Bound/Unbound

2016-07-13 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-447: Summary: Stop referring to types with Bound/Unbound Key: BEAM-447 URL: https://issues.apache.org/jira/browse/BEAM-447 Project: Beam Issue Type: Improvement

[jira] [Comment Edited] (BEAM-435) DirectRunner GBK -- task per key?

2016-07-14 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378247#comment-15378247 ] Thomas Groh edited comment on BEAM-435 at 7/14/16 7:59 PM: --- Yes. Bundle processing

[jira] [Commented] (BEAM-435) DirectRunner GBK -- task per key?

2016-07-14 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378247#comment-15378247 ] Thomas Groh commented on BEAM-435: -- Yes. Bundle processing is keyed after a GroupByKey to ensure that

[jira] [Created] (BEAM-452) Implement DoFn per-instance setup and teardown methods

2016-07-14 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-452: Summary: Implement DoFn per-instance setup and teardown methods Key: BEAM-452 URL: https://issues.apache.org/jira/browse/BEAM-452 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-155) Support asserting the contents of windows and panes in PAssert

2016-07-14 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-155. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating

[jira] [Commented] (BEAM-474) Tests which evaluate DisplayData but don't run a pipeline should be marked @NeedsRunner not @RunnableOnService

2016-07-29 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399690#comment-15399690 ] Thomas Groh commented on BEAM-474: -- Any test that does not execute a Pipeline in the Core SDK should not be

[jira] [Created] (BEAM-415) Use AutoAnnotation for SDK Annotations

2016-06-30 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-415: Summary: Use AutoAnnotation for SDK Annotations Key: BEAM-415 URL: https://issues.apache.org/jira/browse/BEAM-415 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-415) Use AutoAnnotation for SDK Annotations

2016-07-01 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh closed BEAM-415. Resolution: Invalid Fix Version/s: Not applicable We don't actually return any annotation type, so

[jira] [Created] (BEAM-560) In JAXBCoder, use a pair of ThreadLocals to cache Marshaller/Unmarshaller

2016-08-17 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-560: Summary: In JAXBCoder, use a pair of ThreadLocals to cache Marshaller/Unmarshaller Key: BEAM-560 URL: https://issues.apache.org/jira/browse/BEAM-560 Project: Beam

[jira] [Resolved] (BEAM-452) Implement DoFn per-instance setup and teardown methods

2016-08-29 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-452. -- Resolution: Fixed Fix Version/s: 0.3.0-incubating

[jira] [Commented] (BEAM-558) DataflowRunner does not support setup/teardown

2016-08-29 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447301#comment-15447301 ] Thomas Groh commented on BEAM-558: -- Resolved as of https://github.com/apache/incubator-beam/pull/876 >

[jira] [Created] (BEAM-609) Add Interface around Evaluator Caching

2016-08-31 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-609: Summary: Add Interface around Evaluator Caching Key: BEAM-609 URL: https://issues.apache.org/jira/browse/BEAM-609 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-608) Set EvaluationContext once in the TransformEvaluatorFactory instead of forApplication

2016-08-31 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-608: Summary: Set EvaluationContext once in the TransformEvaluatorFactory instead of forApplication Key: BEAM-608 URL: https://issues.apache.org/jira/browse/BEAM-608 Project:

[jira] [Resolved] (BEAM-608) Set EvaluationContext once in the TransformEvaluatorFactory instead of forApplication

2016-09-12 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-608. -- Resolution: Fixed Fix Version/s: 0.3.0-incubating

[jira] [Created] (BEAM-689) Remove getPCollection from (Un)CommittedBundle

2016-09-28 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-689: Summary: Remove getPCollection from (Un)CommittedBundle Key: BEAM-689 URL: https://issues.apache.org/jira/browse/BEAM-689 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-690) Backoff in the DirectRunner Monitor if no work is Available

2016-09-28 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-690: Summary: Backoff in the DirectRunner Monitor if no work is Available Key: BEAM-690 URL: https://issues.apache.org/jira/browse/BEAM-690 Project: Beam Issue Type:

[jira] [Updated] (BEAM-694) TriggerTester doesn't test timer firings

2016-09-29 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-694: - Description: (was: Discussion with [~tgroh] E: Are you familiar with TriggerTester in general? I'm

[jira] [Commented] (BEAM-694) TriggerTester doesn't test timer firings

2016-09-29 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15533505#comment-15533505 ] Thomas Groh commented on BEAM-694: -- Original Discussion (jkff, tgroh) E: Are you familiar with

[jira] [Created] (BEAM-732) Placing Timers into the global window causes tests to Flake

2016-10-07 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-732: Summary: Placing Timers into the global window causes tests to Flake Key: BEAM-732 URL: https://issues.apache.org/jira/browse/BEAM-732 Project: Beam Issue Type:

[jira] [Created] (BEAM-723) Provide a runner-internal ExecutorService for maintenance tasks

2016-10-06 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-723: Summary: Provide a runner-internal ExecutorService for maintenance tasks Key: BEAM-723 URL: https://issues.apache.org/jira/browse/BEAM-723 Project: Beam Issue

[jira] [Resolved] (BEAM-156) Implement Quiescence Signalling in the InProcessPipelineRunner

2016-08-18 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-156. -- Resolution: Fixed Fix Version/s: 0.3.0-incubating The DirectRunner drives progress via quiescence.

[jira] [Created] (BEAM-586) CombineFns with no inputs should produce no outputs when used as a main input

2016-08-25 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-586: Summary: CombineFns with no inputs should produce no outputs when used as a main input Key: BEAM-586 URL: https://issues.apache.org/jira/browse/BEAM-586 Project: Beam

[jira] [Created] (BEAM-576) ReduceFnRunner should GC based on current WM, not on a fired Timer

2016-08-22 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-576: Summary: ReduceFnRunner should GC based on current WM, not on a fired Timer Key: BEAM-576 URL: https://issues.apache.org/jira/browse/BEAM-576 Project: Beam Issue

[jira] [Updated] (BEAM-828) Remove PipelineOptions from BigQueryIO

2016-10-26 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-828: - Labels: backward-incompatible (was: ) > Remove PipelineOptions from BigQueryIO >

[jira] [Updated] (BEAM-826) Dynamically create subscriptions if unspecified in PubSubIO

2016-10-26 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-826: - Labels: backward-incompatible (was: ) > Dynamically create subscriptions if unspecified in PubSubIO >

[jira] [Created] (BEAM-818) Remove Pipeline.getPipelineOptions

2016-10-25 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-818: Summary: Remove Pipeline.getPipelineOptions Key: BEAM-818 URL: https://issues.apache.org/jira/browse/BEAM-818 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-826) Dynamically create subscriptions if unspecified in PubSubIO

2016-10-25 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-826: Summary: Dynamically create subscriptions if unspecified in PubSubIO Key: BEAM-826 URL: https://issues.apache.org/jira/browse/BEAM-826 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-811) DoFnLifecycleManager may call teardown on a DoFn multiple times

2016-10-25 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-811. -- Resolution: Fixed > DoFnLifecycleManager may call teardown on a DoFn multiple times >

[jira] [Created] (BEAM-827) Remove PipelineOptions from Write

2016-10-25 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-827: Summary: Remove PipelineOptions from Write Key: BEAM-827 URL: https://issues.apache.org/jira/browse/BEAM-827 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-819) The DirectRunner can complete before reporting the results of all ModelEnforcements

2016-10-25 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-819: Summary: The DirectRunner can complete before reporting the results of all ModelEnforcements Key: BEAM-819 URL: https://issues.apache.org/jira/browse/BEAM-819 Project: Beam

[jira] [Created] (BEAM-828) Remove PipelineOptions from BigQueryIO

2016-10-25 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-828: Summary: Remove PipelineOptions from BigQueryIO Key: BEAM-828 URL: https://issues.apache.org/jira/browse/BEAM-828 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-833) Exercise Dynamic Splitting in the DirectRunner

2016-10-25 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-833: - Description: (was: BoundedSource#splitIntoBundles and UnboundedSource#generateInitialSplits are the

[jira] [Created] (BEAM-839) The DirectRunner slows down significantly as the number of keys increases

2016-10-26 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-839: Summary: The DirectRunner slows down significantly as the number of keys increases Key: BEAM-839 URL: https://issues.apache.org/jira/browse/BEAM-839 Project: Beam

[jira] [Updated] (BEAM-833) Exercise Dynamic Splitting in the DirectRunner

2016-10-25 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-833: - Description: This primarily means calling the {{BoundedSource#splitAtFraction}} API during the evaluation

[jira] [Assigned] (BEAM-826) Dynamically create subscriptions if unspecified in PubSubIO

2016-10-27 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-826: Assignee: (was: Thomas Groh) > Dynamically create subscriptions if unspecified in PubSubIO >

[jira] [Assigned] (BEAM-826) Dynamically create subscriptions if unspecified in PubSubIO

2016-10-27 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-826: Assignee: Thomas Groh > Dynamically create subscriptions if unspecified in PubSubIO >

[jira] [Assigned] (BEAM-828) Remove PipelineOptions from BigQueryIO

2016-10-27 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-828: Assignee: (was: Thomas Groh) > Remove PipelineOptions from BigQueryIO >

[jira] [Resolved] (BEAM-847) Make DelegatingAggregator creation nonblocking

2016-10-28 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-847. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Make DelegatingAggregator creation nonblocking

[jira] [Resolved] (BEAM-310) Exercise splitIntoBundles/generateInitialSplits in the Direct Runner

2016-10-28 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-310. -- Resolution: Fixed Fix Version/s: 0.3.0-incubating > Exercise

[jira] [Created] (BEAM-937) The DirectRunner does not advance watermarks if reading from an empty reader

2016-11-07 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-937: Summary: The DirectRunner does not advance watermarks if reading from an empty reader Key: BEAM-937 URL: https://issues.apache.org/jira/browse/BEAM-937 Project: Beam

[jira] [Resolved] (BEAM-938) Break in direct.UnboundedReadEvaluatorFactoryTest.noElementsAvailableReaderIncludedInResidual

2016-11-08 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-938. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Break in >

[jira] [Commented] (BEAM-938) Break in direct.UnboundedReadEvaluatorFactoryTest.noElementsAvailableReaderIncludedInResidual

2016-11-08 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15648883#comment-15648883 ] Thomas Groh commented on BEAM-938: -- This was due to an incompletely updated test; Specifically, the

[jira] [Resolved] (BEAM-937) The DirectRunner does not advance watermarks if reading from an empty reader

2016-11-08 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-937. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > The DirectRunner does not advance watermarks

[jira] [Resolved] (BEAM-826) Dynamically create subscriptions if unspecified in PubSubIO

2016-11-09 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-826. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Dynamically create subscriptions if

[jira] [Created] (BEAM-950) DoFn Setup and Teardown methods should have access to PipelineOptions

2016-11-09 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-950: Summary: DoFn Setup and Teardown methods should have access to PipelineOptions Key: BEAM-950 URL: https://issues.apache.org/jira/browse/BEAM-950 Project: Beam

[jira] [Assigned] (BEAM-950) DoFn Setup and Teardown methods should have access to PipelineOptions

2016-11-10 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-950: Assignee: Thomas Groh (was: Davor Bonaci) > DoFn Setup and Teardown methods should have access to

[jira] [Resolved] (BEAM-796) Watermarks should be updated after all other changes have been committed

2016-11-04 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-796. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Watermarks should be updated after all other

[jira] [Resolved] (BEAM-903) Flatten Timer Deliveries in WatermarkManager

2016-11-04 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-903. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Flatten Timer Deliveries in WatermarkManager >

[jira] [Updated] (BEAM-655) Rename @RunnableOnService to something more descriptive

2016-10-18 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-655: - Summary: Rename @RunnableOnService to something more descriptive (was: Rename @RunnableonService to

[jira] [Updated] (BEAM-655) Rename @RunnableOnService to something more descriptive

2016-10-18 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-655: - Description: There are currently two categories for unit tests in the Core Beam Java SDK: {{NeedsRunner}}

[jira] [Created] (BEAM-770) Improve registered runner resolution

2016-10-18 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-770: Summary: Improve registered runner resolution Key: BEAM-770 URL: https://issues.apache.org/jira/browse/BEAM-770 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-796) Watermarks should be updated after all other changes have been committed

2016-10-21 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-796: Summary: Watermarks should be updated after all other changes have been committed Key: BEAM-796 URL: https://issues.apache.org/jira/browse/BEAM-796 Project: Beam

[jira] [Created] (BEAM-811) DoFnLifecycleManager may call teardown on a DoFn multiple times

2016-10-24 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-811: Summary: DoFnLifecycleManager may call teardown on a DoFn multiple times Key: BEAM-811 URL: https://issues.apache.org/jira/browse/BEAM-811 Project: Beam Issue

[jira] [Resolved] (BEAM-771) UnboundedReadEvaluator should reuse the input reader if it contains no elements

2016-10-18 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-771. -- Resolution: Fixed Fix Version/s: 0.3.0-incubating > UnboundedReadEvaluator should reuse the input

[jira] [Resolved] (BEAM-999) DirectRunner flake related to splitting

2016-11-21 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-999. -- Resolution: Fixed > DirectRunner flake related to splitting > --- > >

[jira] [Created] (BEAM-1056) Reference beam version only once in Archetypes

2016-11-28 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1056: - Summary: Reference beam version only once in Archetypes Key: BEAM-1056 URL: https://issues.apache.org/jira/browse/BEAM-1056 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-957) Flake in FlattenTest under DirectRunner

2016-11-16 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-957. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Flake in FlattenTest under DirectRunner >

[jira] [Resolved] (BEAM-839) The DirectRunner slows down significantly as the number of keys increases

2016-11-16 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-839. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating This was linear time (with regards to the number

[jira] [Resolved] (BEAM-833) Exercise Dynamic Splitting in the DirectRunner

2016-11-16 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-833. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Exercise Dynamic Splitting in the DirectRunner

[jira] [Resolved] (BEAM-924) Findbugs doesn't pass in Direct Runner

2016-11-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-924. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Findbugs doesn't pass in Direct Runner >

[jira] [Created] (BEAM-903) Flatten Timer Deliveries in WatermarkManager

2016-11-03 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-903: Summary: Flatten Timer Deliveries in WatermarkManager Key: BEAM-903 URL: https://issues.apache.org/jira/browse/BEAM-903 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-839) The DirectRunner slows down significantly as the number of keys increases

2016-10-27 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612429#comment-15612429 ] Thomas Groh commented on BEAM-839: -- The most severe issue is that

[jira] [Created] (BEAM-885) Move PipelineOptions from Pipeline.create() to Pipeline.run()

2016-11-02 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-885: Summary: Move PipelineOptions from Pipeline.create() to Pipeline.run() Key: BEAM-885 URL: https://issues.apache.org/jira/browse/BEAM-885 Project: Beam Issue Type:

[jira] [Updated] (BEAM-885) Move PipelineOptions from Pipeline.create() to Pipeline.run()

2016-11-02 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-885: - Labels: backward-incompatible (was: ) > Move PipelineOptions from Pipeline.create() to Pipeline.run() >

[jira] [Updated] (BEAM-839) The DirectRunner slows down significantly as the number of keys increases

2016-10-27 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-839: - Description: For example, running WordCount on KingLear takes approximately 10 seconds, while running

[jira] [Created] (BEAM-847) DelelgatingAggregator uses UUID.randomUUID, which is synchronized

2016-10-27 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-847: Summary: DelelgatingAggregator uses UUID.randomUUID, which is synchronized Key: BEAM-847 URL: https://issues.apache.org/jira/browse/BEAM-847 Project: Beam Issue

[jira] [Updated] (BEAM-847) DelelgatingAggregator uses UUID.randomUUID, which uses a synchronized Random method

2016-10-27 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh updated BEAM-847: - Summary: DelelgatingAggregator uses UUID.randomUUID, which uses a synchronized Random method (was:

  1   2   >