[jira] [Commented] (BEAM-377) BigQueryIO should validate a table or query to read from

2016-06-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349839#comment-15349839 ] ASF GitHub Bot commented on BEAM-377: - GitHub user bjchambers opened a pull request:

[GitHub] incubator-beam pull request #535: [BEAM-377] Validate BigQueryIO.Read is pro...

2016-06-25 Thread bjchambers
GitHub user bjchambers opened a pull request: https://github.com/apache/incubator-beam/pull/535 [BEAM-377] Validate BigQueryIO.Read is properly configured Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [*] Make sure

[jira] [Created] (BEAM-377) BigQueryIO should validate a table or query to read from

2016-06-25 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-377: - Summary: BigQueryIO should validate a table or query to read from Key: BEAM-377 URL: https://issues.apache.org/jira/browse/BEAM-377 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-159) Support fixed number of shards in sinks

2016-06-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349764#comment-15349764 ] ASF GitHub Bot commented on BEAM-159: - GitHub user dhalperi opened a pull request:

[GitHub] incubator-beam pull request #534: [BEAM-159][BEAM-92][BEAM-365] Write: add s...

2016-06-25 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/534 [BEAM-159][BEAM-92][BEAM-365] Write: add support for setting a fixed number of shards And remove special support in Dataflow and Direct runners for it. You can merge this pull request

[jira] [Assigned] (BEAM-365) TextIO withoutSharding causes Flink to throw IllegalStateException

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-365: Assignee: Daniel Halperin > TextIO withoutSharding causes Flink to throw

[jira] [Updated] (BEAM-350) beam_PostCommit_RunnableOnService_GoogleCloudDataflow flaky

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-350: - Fix Version/s: Not applicable > beam_PostCommit_RunnableOnService_GoogleCloudDataflow flaky >

[jira] [Updated] (BEAM-364) Integration Tests for Bigtable Read and Write

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-364: - Assignee: Ian Zhou (was: Daniel Halperin) > Integration Tests for Bigtable Read and Write >

[jira] [Updated] (BEAM-355) Update to Bigtable version 0.3.0

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-355: - Assignee: Ian Zhou (was: Daniel Halperin) > Update to Bigtable version 0.3.0 >

[jira] [Reopened] (BEAM-159) Support fixed number of shards in sinks

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reopened BEAM-159: -- Assignee: Daniel Halperin > Support fixed number of shards in sinks >

[jira] [Updated] (BEAM-240) Add display data link URLs for sources / sinks

2016-06-25 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-240: -- Fix Version/s: (was: 0.1.0-incubating) Not applicable > Add display data link URLs

[jira] [Updated] (BEAM-322) Compare encoded keys in streaming mode

2016-06-25 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-322: -- Fix Version/s: (was: 0.1.0-incubating) 0.2.0-incubating > Compare encoded keys in

[jira] [Updated] (BEAM-366) Support Display Data on Composite Transforms

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-366: - Issue Type: Improvement (was: Bug) > Support Display Data on Composite Transforms >

[jira] [Updated] (BEAM-206) FileBasedSink does serial renames

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-206: - Priority: Major (was: Critical) > FileBasedSink does serial renames >

[jira] [Updated] (BEAM-374) Enable dependency-plugin and failOnWarning at global level

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-374: - Priority: Minor (was: Major) > Enable dependency-plugin and failOnWarning at global level >

[jira] [Updated] (BEAM-78) Rename Dataflow to Beam

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-78?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-78: Fix Version/s: 0.1.0-incubating > Rename Dataflow to Beam > > >

[jira] [Updated] (BEAM-203) Travis Build is Broken

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-203: - Fix Version/s: Not applicable > Travis Build is Broken > -- > >

[jira] [Updated] (BEAM-149) IntelliJ: Java 8 tests configuration

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-149: - Fix Version/s: Not applicable > IntelliJ: Java 8 tests configuration >

[jira] [Updated] (BEAM-213) Fix README to use refactored package names and use AutoService for Registrar

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-213: - Fix Version/s: Not applicable > Fix README to use refactored package names and use AutoService for

[jira] [Updated] (BEAM-208) Flaky test: org.apache.beam.runners.flink.streaming.GroupByNullKeyTest.testJob

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-208: - Fix Version/s: Not applicable > Flaky test:

[jira] [Updated] (BEAM-133) Test flakiness in the Spark runner

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-133: - Component/s: (was: project-management) testing > Test flakiness in the Spark

[jira] [Updated] (BEAM-143) Add test for UnboundedSourceWrapper

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-143: - Fix Version/s: Not applicable > Add test for UnboundedSourceWrapper >

[jira] [Updated] (BEAM-133) Test flakiness in the Spark runner

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-133: - Fix Version/s: Not applicable > Test flakiness in the Spark runner >

[jira] [Updated] (BEAM-118) Add DisplayData to SDK

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-118: - Fix Version/s: 0.1.0-incubating > Add DisplayData to SDK > -- > >

[jira] [Updated] (BEAM-189) The Spark runner uses valueInEmptyWindow which causes values to be dropped

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-189: - Fix Version/s: 0.1.0-incubating > The Spark runner uses valueInEmptyWindow which causes values to

[jira] [Updated] (BEAM-173) Publish DisplayData for PipelineOptions

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-173: - Fix Version/s: 0.1.0-incubating > Publish DisplayData for PipelineOptions >

[jira] [Updated] (BEAM-247) CombineFn's only definable/usable inside sdk.transforms package

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-247: - Fix Version/s: Not applicable > CombineFn's only definable/usable inside sdk.transforms package >

[jira] [Updated] (BEAM-204) truncateStackTrace fails with empty stack trace

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-204: - Fix Version/s: 0.1.0-incubating > truncateStackTrace fails with empty stack trace >

[jira] [Updated] (BEAM-199) Improve fluent interface for manipulating DisplayData.Items

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-199: - Fix Version/s: 0.1.0-incubating > Improve fluent interface for manipulating DisplayData.Items >

[jira] [Updated] (BEAM-231) Remove ClassForDisplay infrastructure class.

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-231: - Fix Version/s: 0.1.0-incubating > Remove ClassForDisplay infrastructure class. >

[jira] [Updated] (BEAM-168) IntervalBoundedExponentialBackOff change broke Beam-on-Dataflow

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-168: - Fix Version/s: 0.1.0-incubating > IntervalBoundedExponentialBackOff change broke Beam-on-Dataflow >

[jira] [Updated] (BEAM-154) Provide Maven BOM

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-154: - Fix Version/s: 0.1.0-incubating > Provide Maven BOM > - > > Key:

[jira] [Updated] (BEAM-272) Flink Runner depends on Dataflow Runner

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-272: - Fix Version/s: 0.1.0-incubating > Flink Runner depends on Dataflow Runner >

[jira] [Updated] (BEAM-48) BigQueryIO.Read reimplemented as BoundedSource

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-48?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-48: Fix Version/s: 0.1.0-incubating > BigQueryIO.Read reimplemented as BoundedSource >

[jira] [Updated] (BEAM-128) The transform BigQueryIO.Read is currently not supported.

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-128: - Fix Version/s: Not applicable > The transform BigQueryIO.Read is currently not supported. >

[jira] [Resolved] (BEAM-128) The transform BigQueryIO.Read is currently not supported.

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-128. -- Resolution: Fixed Now that BEAM-48 is fixed and Flink supports Read transform, should be good! >

[jira] [Updated] (BEAM-36) TimestampedValueInMultipleWindows should use a more compact set representation

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-36?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-36: Fix Version/s: Not applicable > TimestampedValueInMultipleWindows should use a more compact set

[jira] [Updated] (BEAM-99) Travis: Execute Maven "verify" phase

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-99?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-99: Fix Version/s: Not applicable > Travis: Execute Maven "verify" phase >

[jira] [Updated] (BEAM-12) Apply GroupByKey transforms on PCollection of normal type other than KV

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-12?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-12: Fix Version/s: Not applicable > Apply GroupByKey transforms on PCollection of normal type other than

[jira] [Updated] (BEAM-164) Dynamic splitting for unbounded sources

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-164: - Fix Version/s: Not applicable > Dynamic splitting for unbounded sources >

[jira] [Updated] (BEAM-180) Add English labels for registered display data

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-180: - Fix Version/s: Not applicable > Add English labels for registered display data >

[jira] [Updated] (BEAM-224) Two assert fails with merging windows and closable triggers

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-224: - Fix Version/s: Not applicable > Two assert fails with merging windows and closable triggers >

[jira] [Updated] (BEAM-205) An 'in process' runner optimized for efficiency rather than debugging

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-205: - Fix Version/s: Not applicable > An 'in process' runner optimized for efficiency rather than

[jira] [Updated] (BEAM-139) Print mode (batch/streaming) during translation

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-139: - Fix Version/s: Not applicable > Print mode (batch/streaming) during translation >

[jira] [Updated] (BEAM-230) Remove WindowedValue#valueInEmptyWindows

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-230: - Fix Version/s: Not applicable > Remove WindowedValue#valueInEmptyWindows >

[jira] [Updated] (BEAM-227) Log sdk version in worker-startup logs

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-227: - Fix Version/s: Not applicable > Log sdk version in worker-startup logs >

[jira] [Updated] (BEAM-185) XmlSink output file pattern missing "." in extension

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-185: - Fix Version/s: Not applicable > XmlSink output file pattern missing "." in extension >

[jira] [Updated] (BEAM-236) Implement Windowing in batch execution

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-236: - Fix Version/s: Not applicable > Implement Windowing in batch execution >

[jira] [Updated] (BEAM-183) Update package name for DisplayData types

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-183: - Fix Version/s: Not applicable > Update package name for DisplayData types >

[jira] [Updated] (BEAM-216) Create Storm Runner

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-216: - Fix Version/s: Not applicable > Create Storm Runner > > >

[jira] [Updated] (BEAM-291) PDone type translation fails

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-291: - Fix Version/s: Not applicable > PDone type translation fails > > >

[jira] [Updated] (BEAM-211) When using Create.of use it's #withCoder method instead of the created PCollection's #setCoder

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-211: - Fix Version/s: 0.1.0-incubating > When using Create.of use it's #withCoder method instead of the

[jira] [Updated] (BEAM-77) Reorganize Directory structure

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-77: Fix Version/s: 0.1.0-incubating > Reorganize Directory structure > -- > >

[jira] [Updated] (BEAM-250) Exclude TextSource.minBundleSize default value from display data.

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-250: - Fix Version/s: 0.1.0-incubating > Exclude TextSource.minBundleSize default value from display data.

[jira] [Updated] (BEAM-249) Combine.GroupedValues re-wraps combineFn from Combine.PerKey and loses identity for DisplayData

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-249: - Fix Version/s: 0.1.0-incubating > Combine.GroupedValues re-wraps combineFn from Combine.PerKey and

[jira] [Updated] (BEAM-251) Exclude PipelineOptions with @JsonIgnore from display data

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-251: - Fix Version/s: 0.1.0-incubating > Exclude PipelineOptions with @JsonIgnore from display data >

[jira] [Updated] (BEAM-292) TextIO.Write.to Empty Files

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-292: - Issue Type: Improvement (was: Bug) > TextIO.Write.to Empty Files > --- > >

[jira] [Updated] (BEAM-248) Register DisplayData from anonymous implementation PTransforms

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-248: - Fix Version/s: 0.1.0-incubating > Register DisplayData from anonymous implementation PTransforms >

[jira] [Updated] (BEAM-52) KafkaIO - bounded/unbounded, source/sink

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-52: Fix Version/s: 0.1.0-incubating > KafkaIO - bounded/unbounded, source/sink >

[jira] [Updated] (BEAM-288) Improve javadoc for UnboundedSource

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-288: - Issue Type: Improvement (was: Bug) > Improve javadoc for UnboundedSource >

[jira] [Updated] (BEAM-288) Improve javadoc for UnboundedSource

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-288: - Fix Version/s: 0.2.0-incubating > Improve javadoc for UnboundedSource >

[jira] [Updated] (BEAM-240) Add display data link URLs for sources / sinks

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-240: - Fix Version/s: 0.1.0-incubating > Add display data link URLs for sources / sinks >

[jira] [Updated] (BEAM-159) Support fixed number of shards in sinks

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-159: - Fix Version/s: Not applicable > Support fixed number of shards in sinks >

[jira] [Updated] (BEAM-243) Remove DirectPipelineRunner and keep only the InProcessPipelineRunner

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-243: - Fix Version/s: 0.2.0-incubating > Remove DirectPipelineRunner and keep only the

[jira] [Updated] (BEAM-22) DirectPipelineRunner: support for unbounded collections

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-22: Fix Version/s: 0.2.0-incubating > DirectPipelineRunner: support for unbounded collections >

[jira] [Updated] (BEAM-33) Make DataflowAssert more window-aware

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-33: Fix Version/s: Not applicable > Make DataflowAssert more window-aware >

[jira] [Updated] (BEAM-234) Remove the word Pipeline from the name of all PipelineRunner implementations

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-234: - Issue Type: Improvement (was: Bug) > Remove the word Pipeline from the name of all PipelineRunner

[jira] [Updated] (BEAM-280) TestPipeline should be constructible without a runner

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-280: - Issue Type: Improvement (was: Bug) > TestPipeline should be constructible without a runner >

[jira] [Updated] (BEAM-234) Remove the word Pipeline from the name of all PipelineRunner implementations

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-234: - Fix Version/s: 0.2.0-incubating > Remove the word Pipeline from the name of all PipelineRunner

[jira] [Updated] (BEAM-280) TestPipeline should be constructible without a runner

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-280: - Fix Version/s: 0.2.0-incubating > TestPipeline should be constructible without a runner >

[jira] [Updated] (BEAM-146) WindowFn.AssignContext leaks implementation details about compressed WindowedValue representation

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-146: - Fix Version/s: 0.2.0-incubating > WindowFn.AssignContext leaks implementation details about

[jira] [Updated] (BEAM-45) Unbounded source for Google Cloud Bigtable

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-45?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-45: Fix Version/s: Not applicable > Unbounded source for Google Cloud Bigtable >

[jira] [Updated] (BEAM-146) WindowFn.AssignContext leaks implementation details about compressed WindowedValue representation

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-146: - Summary: WindowFn.AssignContext leaks implementation details about compressed WindowedValue

[jira] [Updated] (BEAM-304) Build break: maven is picking up Kafka snapshots

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-304: - Fix Version/s: 0.1.0-incubating > Build break: maven is picking up Kafka snapshots >

[jira] [Updated] (BEAM-305) In Spark runner tests - When using Create.of use it's #withCoder method instead of the created PCollection's #setCoder

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-305: - Fix Version/s: 0.1.0-incubating > In Spark runner tests - When using Create.of use it's #withCoder

[jira] [Updated] (BEAM-323) The InProcessPipelineRunner uses user objects for State and Timer lookups

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-323: - Fix Version/s: 0.2.0-incubating > The InProcessPipelineRunner uses user objects for State and Timer

[jira] [Updated] (BEAM-327) Dataflow runner should have configuration for System.out/err handling

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-327: - Fix Version/s: 0.2.0-incubating > Dataflow runner should have configuration for System.out/err

[jira] [Updated] (BEAM-330) Maven exec warning message on Dataflow WordCount Example

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-330: - Fix Version/s: 0.2.0-incubating > Maven exec warning message on Dataflow WordCount Example >

[jira] [Updated] (BEAM-331) WindowedWordCount.AddTimestampFn has nondeterministic timestamp bounds

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-331: - Fix Version/s: 0.2.0-incubating > WindowedWordCount.AddTimestampFn has nondeterministic timestamp

[jira] [Updated] (BEAM-343) DisplayData error in AfterWatermark

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-343: - Fix Version/s: 0.2.0-incubating > DisplayData error in AfterWatermark >

[jira] [Updated] (BEAM-341) ReduceFnRunner allows GC time overflow

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-341: - Fix Version/s: 0.2.0-incubating > ReduceFnRunner allows GC time overflow >

[jira] [Updated] (BEAM-342) Change Filter#greaterThan, etc. to actually use Filter

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-342: - Fix Version/s: 0.2.0-incubating > Change Filter#greaterThan, etc. to actually use Filter >

[jira] [Updated] (BEAM-346) When WindowFn not specified in Window.into(...), NullPointerException

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-346: - Fix Version/s: Not applicable > When WindowFn not specified in Window.into(...),

[jira] [Updated] (BEAM-358) JAXB Coder is not thread safe

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-358: - Fix Version/s: 0.2.0-incubating > JAXB Coder is not thread safe > - > >

[jira] [Updated] (BEAM-353) Correct the licenses

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-353: - Fix Version/s: Not applicable > Correct the licenses > > >

[jira] [Updated] (BEAM-367) GetFractionConsumed() inaccurate for non-uniform records

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-367: - Fix Version/s: 0.2.0-incubating > GetFractionConsumed() inaccurate for non-uniform records >

[jira] [Updated] (BEAM-348) Clean temp_dir usage in _stage_extra_packages

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-348: - Fix Version/s: Not applicable > Clean temp_dir usage in _stage_extra_packages >

[jira] [Updated] (BEAM-373) CoGbkResult will crash after 10,000 elements on any runner that does not provide a Reiterator

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-373: - Fix Version/s: Not applicable > CoGbkResult will crash after 10,000 elements on any runner that

[jira] [Updated] (BEAM-159) Support fixed number of shards in sinks

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-159: - Summary: Support fixed number of shards in sinks (was: Support fixed number of shards in custom

[jira] [Updated] (BEAM-374) Enable dependency-plugin and failOnWarning at global level

2016-06-25 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-374: -- Component/s: project-management > Enable dependency-plugin and failOnWarning at global level >

[jira] [Updated] (BEAM-331) WindowedWordCount.AddTimestampFn has nondeterministic timestamp bounds

2016-06-25 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-331: -- Component/s: sdk-java-core > WindowedWordCount.AddTimestampFn has nondeterministic timestamp bounds >

[jira] [Updated] (BEAM-212) SparkPipelineRunner should support the Read Primitive

2016-06-25 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-212: -- Component/s: runner-spark > SparkPipelineRunner should support the Read Primitive >

[jira] [Updated] (BEAM-159) Support fixed number of shards in custom sinks

2016-06-25 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-159: -- Component/s: sdk-java-core beam-model > Support fixed number of shards in custom sinks >

[jira] [Updated] (BEAM-340) Use Avro coder for KafkaIO

2016-06-25 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-340: -- Component/s: sdk-java-extensions > Use Avro coder for KafkaIO > --- > >

[jira] [Resolved] (BEAM-376) Correct Python pip install target

2016-06-25 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-376. --- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Correct Python pip install target >

[jira] [Commented] (BEAM-376) Correct Python pip install target

2016-06-25 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349705#comment-15349705 ] Davor Bonaci commented on BEAM-376: --- Fixed? > Correct Python pip install target >

[jira] [Commented] (BEAM-375) HadoopIO and runners-spark conflict with hadoop.version

2016-06-25 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349483#comment-15349483 ] Amit Sela commented on BEAM-375: But do we want Beam Hadoop components to support multiple Hadoop versions ?