[jira] [Commented] (BEAM-91) Retractions

[ https://issues.apache.org/jira/browse/BEAM-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342094#comment-15342094 ] Luke Cwik commented on BEAM-91: --- Matt, do you have something you can share that goes into more detail? >

[jira] [Updated] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-372: --- Description: Add a test to CoderProperties that does the following: 1. Encode a value using the Coder in the

[jira] [Commented] (BEAM-137) Add implicit conf/pipeline-default.conf options file

[ https://issues.apache.org/jira/browse/BEAM-137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204657#comment-15204657 ] Luke Cwik commented on BEAM-137: The original design of PipelineOptions took into account the need for a

[jira] [Created] (BEAM-95) Compress DoFn's / SerializableCoder / ... when serializing objects

Luke Cwik created BEAM-95: - Summary: Compress DoFn's / SerializableCoder / ... when serializing objects Key: BEAM-95 URL: https://issues.apache.org/jira/browse/BEAM-95 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-95) Compress DoFn's / SerializableCoder / ... when serializing objects

[ https://issues.apache.org/jira/browse/BEAM-95?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-95: -- Issue Type: Improvement (was: Bug) > Compress DoFn's / SerializableCoder / ... when serializing objects >

[jira] [Commented] (BEAM-76) FileBasedSource should take a list of files/globs

[ https://issues.apache.org/jira/browse/BEAM-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180435#comment-15180435 ] Luke Cwik commented on BEAM-76: --- What if instead of a FileBasedSource taking a list of files/globs, we support

[jira] [Commented] (BEAM-167) TextIO can't read concatenated gzip files

[ https://issues.apache.org/jira/browse/BEAM-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225007#comment-15225007 ] Luke Cwik commented on BEAM-167: Produced PR: https://github.com/apache/incubator-beam/pull/114 Assigned to

[jira] [Assigned] (BEAM-167) TextIO can't read concatenated gzip files

[ https://issues.apache.org/jira/browse/BEAM-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-167: -- Assignee: Luke Cwik > TextIO can't read concatenated gzip files >

[jira] [Commented] (BEAM-167) TextIO can't read concatenated gzip files

[ https://issues.apache.org/jira/browse/BEAM-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225167#comment-15225167 ] Luke Cwik commented on BEAM-167: Merged PR, also backported to DataflowJavaSDK. > TextIO can't read

[jira] [Commented] (BEAM-190) Dead-letter drop for bad BigQuery records

[ https://issues.apache.org/jira/browse/BEAM-190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239815#comment-15239815 ] Luke Cwik commented on BEAM-190: >From Dan Halperin: I thought that we were under the impression that rather

[jira] [Commented] (BEAM-151) Create Dataflow Runner Package

[ https://issues.apache.org/jira/browse/BEAM-151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15261297#comment-15261297 ] Luke Cwik commented on BEAM-151: Note there are a few more objects that could move over such as CloudObject

[jira] [Resolved] (BEAM-151) Create Dataflow Runner Package

[ https://issues.apache.org/jira/browse/BEAM-151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-151. Resolution: Fixed > Create Dataflow Runner Package > -- > > Key:

[jira] [Created] (BEAM-202) Remove YYYCoderBase

Luke Cwik created BEAM-202: -- Summary: Remove YYYCoderBase Key: BEAM-202 URL: https://issues.apache.org/jira/browse/BEAM-202 Project: Beam Issue Type: Improvement Components: sdk-java-core

[jira] [Commented] (BEAM-205) An 'in process' runner optimized for efficiency rather than debugging

[ https://issues.apache.org/jira/browse/BEAM-205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246065#comment-15246065 ] Luke Cwik commented on BEAM-205: >From my understanding, both Flink and Spark support running locally. How

[jira] [Commented] (BEAM-151) Create Dataflow Runner Package

[ https://issues.apache.org/jira/browse/BEAM-151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240134#comment-15240134 ] Luke Cwik commented on BEAM-151: No, I still need to update package-info.java and make another pass over the

[jira] [Updated] (BEAM-446) Improve IOChannelUtils.resolve() to accept multiple paths at once

[ https://issues.apache.org/jira/browse/BEAM-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-446: --- Assignee: Mark Liu > Improve IOChannelUtils.resolve() to accept multiple paths at once >

[jira] [Resolved] (BEAM-339) Archetype project version shouldn't be coupled to Beam version

[ https://issues.apache.org/jira/browse/BEAM-339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-339. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Archetype project version shouldn't be coupled to

[jira] [Assigned] (BEAM-496) Remove the notion of a Fake subscription from PubsubIO

[ https://issues.apache.org/jira/browse/BEAM-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-496: -- Assignee: Daniel Halperin (was: Davor Bonaci) > Remove the notion of a Fake subscription from PubsubIO

[jira] [Created] (BEAM-496) Remove the notion of a Fake subscription from PubsubIO

Luke Cwik created BEAM-496: -- Summary: Remove the notion of a Fake subscription from PubsubIO Key: BEAM-496 URL: https://issues.apache.org/jira/browse/BEAM-496 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-490) Swap to using CoGBK as grouping primitive instead of GBK

Luke Cwik created BEAM-490: -- Summary: Swap to using CoGBK as grouping primitive instead of GBK Key: BEAM-490 URL: https://issues.apache.org/jira/browse/BEAM-490 Project: Beam Issue Type:

[jira] [Updated] (BEAM-474) Tests which evaluate DisplayData but don't run a pipeline should be marked @NeedsRunner not @RunnableOnService

[ https://issues.apache.org/jira/browse/BEAM-474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-474: --- Priority: Minor (was: Major) > Tests which evaluate DisplayData but don't run a pipeline should be marked >

[jira] [Commented] (BEAM-474) Tests which evaluate DisplayData but don't run a pipeline should be marked @NeedsRunner not @RunnableOnService

[ https://issues.apache.org/jira/browse/BEAM-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394061#comment-15394061 ] Luke Cwik commented on BEAM-474: The issue is that none of the display data tests execute the pipeline and

[jira] [Resolved] (BEAM-446) Improve IOChannelUtils.resolve() to accept multiple paths at once

[ https://issues.apache.org/jira/browse/BEAM-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-446. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Improve IOChannelUtils.resolve() to accept

[jira] [Resolved] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-372. Resolution: Fixed Fix Version/s: 0.2.0-incubating > CoderProperties: Test that the coder doesn't

[jira] [Updated] (BEAM-464) HolderCoder should be a StandardCoder and not a CustomCoder

[ https://issues.apache.org/jira/browse/BEAM-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-464: --- Description: The issue is that the coder does not report component encodings which prevents effective runner

[jira] [Created] (BEAM-464) HolderCoder should be a Stn

Luke Cwik created BEAM-464: -- Summary: HolderCoder should be a Stn Key: BEAM-464 URL: https://issues.apache.org/jira/browse/BEAM-464 Project: Beam Issue Type: Bug Reporter: Luke Cwik

[jira] [Assigned] (BEAM-464) HolderCoder should be a Stn

[ https://issues.apache.org/jira/browse/BEAM-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-464: -- Assignee: Luke Cwik > HolderCoder should be a Stn > --- > > Key:

[jira] [Updated] (BEAM-464) HolderCoder should be a StandardCoder and not a CustomCoder

[ https://issues.apache.org/jira/browse/BEAM-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-464: --- Priority: Minor (was: Major) Component/s: sdk-java-core > HolderCoder should be a StandardCoder and not

[jira] [Updated] (BEAM-464) HolderCoder should be a StandardCoder and not a CustomCoder

[ https://issues.apache.org/jira/browse/BEAM-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-464: --- Summary: HolderCoder should be a StandardCoder and not a CustomCoder (was: HolderCoder should be a Stn) >

[jira] [Created] (BEAM-465) OutgoingMessageCoder should be an AtomicCoder

Luke Cwik created BEAM-465: -- Summary: OutgoingMessageCoder should be an AtomicCoder Key: BEAM-465 URL: https://issues.apache.org/jira/browse/BEAM-465 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-466) QuantileStateCoder should be a StandardCoder

Luke Cwik created BEAM-466: -- Summary: QuantileStateCoder should be a StandardCoder Key: BEAM-466 URL: https://issues.apache.org/jira/browse/BEAM-466 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-465) OutgoingMessageCoder should be an AtomicCoder

[ https://issues.apache.org/jira/browse/BEAM-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-465: --- Priority: Minor (was: Major) > OutgoingMessageCoder should be an AtomicCoder >

[jira] [Created] (BEAM-462) Replace MonitoringUtil.PrintHandler with a handler that utilizes a Java logger

Luke Cwik created BEAM-462: -- Summary: Replace MonitoringUtil.PrintHandler with a handler that utilizes a Java logger Key: BEAM-462 URL: https://issues.apache.org/jira/browse/BEAM-462 Project: Beam

[jira] [Created] (BEAM-463) BoundedHeapCoder should be a StandardCoder and not a CustomCoder

Luke Cwik created BEAM-463: -- Summary: BoundedHeapCoder should be a StandardCoder and not a CustomCoder Key: BEAM-463 URL: https://issues.apache.org/jira/browse/BEAM-463 Project: Beam Issue Type:

[jira] [Updated] (BEAM-463) BoundedHeapCoder should be a StandardCoder and not a CustomCoder

[ https://issues.apache.org/jira/browse/BEAM-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-463: --- Assignee: Davor Bonaci (was: Luke Cwik) > BoundedHeapCoder should be a StandardCoder and not a CustomCoder >

[jira] [Reopened] (BEAM-463) BoundedHeapCoder should be a StandardCoder and not a CustomCoder

[ https://issues.apache.org/jira/browse/BEAM-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-463: > BoundedHeapCoder should be a StandardCoder and not a CustomCoder >

[jira] [Resolved] (BEAM-462) Replace MonitoringUtil.PrintHandler with a handler that utilizes a Java logger

[ https://issues.apache.org/jira/browse/BEAM-462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-462. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Replace MonitoringUtil.PrintHandler with a handler

[jira] [Resolved] (BEAM-463) BoundedHeapCoder should be a StandardCoder and not a CustomCoder

[ https://issues.apache.org/jira/browse/BEAM-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-463. Resolution: Fixed Fix Version/s: 0.2.0-incubating > BoundedHeapCoder should be a StandardCoder and not

[jira] [Created] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

Luke Cwik created BEAM-469: -- Summary: NullableCoder should encode using the context given and not always use the nested context Key: BEAM-469 URL: https://issues.apache.org/jira/browse/BEAM-469 Project:

[jira] [Updated] (BEAM-466) QuantileStateCoder should be a StandardCoder

[ https://issues.apache.org/jira/browse/BEAM-466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-466: --- Assignee: Davor Bonaci (was: Luke Cwik) > QuantileStateCoder should be a StandardCoder >

[jira] [Updated] (BEAM-468) NullableCoder should not ask valueCoder isRegisterByteSizeObserverCheap when value is null

[ https://issues.apache.org/jira/browse/BEAM-468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-468: --- Description: The value coder may assume that the given value is always non-null and it would be an error to

[jira] [Created] (BEAM-468) NullableCoder should not ask valueCoder isRegisterByteSizeObserverCheap when value is null

Luke Cwik created BEAM-468: -- Summary: NullableCoder should not ask valueCoder isRegisterByteSizeObserverCheap when value is null Key: BEAM-468 URL: https://issues.apache.org/jira/browse/BEAM-468 Project:

[jira] [Resolved] (BEAM-465) OutgoingMessageCoder should be an AtomicCoder

[ https://issues.apache.org/jira/browse/BEAM-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-465. Resolution: Fixed Fix Version/s: 0.2.0-incubating > OutgoingMessageCoder should be an AtomicCoder >

[jira] [Assigned] (BEAM-468) NullableCoder should not ask valueCoder isRegisterByteSizeObserverCheap when value is null

[ https://issues.apache.org/jira/browse/BEAM-468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-468: -- Assignee: Luke Cwik (was: Davor Bonaci) > NullableCoder should not ask valueCoder

[jira] [Created] (BEAM-474) Tests which evaluate DisplayData but don't run a pipeline should be marked @NeedsRunner not @RunnableOnService

Luke Cwik created BEAM-474: -- Summary: Tests which evaluate DisplayData but don't run a pipeline should be marked @NeedsRunner not @RunnableOnService Key: BEAM-474 URL: https://issues.apache.org/jira/browse/BEAM-474

[jira] [Resolved] (BEAM-457) Upgrade Avro

[ https://issues.apache.org/jira/browse/BEAM-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-457. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Upgrade Avro > > >

[jira] [Resolved] (BEAM-405) BigQueryIO$StreamingWriteFn uses inefficient keySet iterator

[ https://issues.apache.org/jira/browse/BEAM-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-405. Resolution: Fixed Fix Version/s: 0.2.0-incubating > BigQueryIO$StreamingWriteFn uses inefficient

[jira] [Resolved] (BEAM-408) ProxyInvocationHandler uses inefficient Math.random() for random int

[ https://issues.apache.org/jira/browse/BEAM-408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-408. Resolution: Fixed Fix Version/s: 0.2.0-incubating > ProxyInvocationHandler uses inefficient

[jira] [Resolved] (BEAM-422) AvroSource hits various IOException when using Snappy codec

[ https://issues.apache.org/jira/browse/BEAM-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-422. Resolution: Fixed Fix Version/s: 0.2.0-incubating > AvroSource hits various IOException when using

[jira] [Resolved] (BEAM-397) Format string uses \n rather than %n

[ https://issues.apache.org/jira/browse/BEAM-397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-397. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Format string uses \n rather than %n >

[jira] [Resolved] (BEAM-142) BigQueryIO: don't unnecessarily initialize an ExecutorService to validate parameters

[ https://issues.apache.org/jira/browse/BEAM-142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-142. Resolution: Fixed Fix Version/s: 0.2.0-incubating > BigQueryIO: don't unnecessarily initialize an

[jira] [Created] (BEAM-414) IntraBundleParallelization needs to be removed

Luke Cwik created BEAM-414: -- Summary: IntraBundleParallelization needs to be removed Key: BEAM-414 URL: https://issues.apache.org/jira/browse/BEAM-414 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-557) Test-scoped dependencies should be excluded from shading package relocation

[ https://issues.apache.org/jira/browse/BEAM-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-557. Resolution: Fixed Fix Version/s: 0.3.0-incubating > Test-scoped dependencies should be excluded from

[jira] [Created] (BEAM-567) FlinkRunner pollutes beam-examples-java[8] modules with SLF4J backend dependencies which are not optional (e.g. test/provided/system scoped, or marked optional)

Luke Cwik created BEAM-567: -- Summary: FlinkRunner pollutes beam-examples-java[8] modules with SLF4J backend dependencies which are not optional (e.g. test/provided/system scoped, or marked optional) Key: BEAM-567 URL:

[jira] [Issue Comment Deleted] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-469: --- Comment: was deleted (was: That doesn't work with nesting. Imagine I have a KV coder with both the key and

[jira] [Commented] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15423000#comment-15423000 ] Luke Cwik commented on BEAM-469: That doesn't work with nesting. Imagine I have a KV coder with both the key

[jira] [Reopened] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-469: Assignee: (was: Luke Cwik) Re-opening because I believe Dan is correct about passing contexts around.

[jira] [Issue Comment Deleted] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-469: --- Comment: was deleted (was: Re-opening because I believe Dan is correct about passing contexts around.) >

[jira] [Commented] (BEAM-583) Auto Register TestDataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435766#comment-15435766 ] Luke Cwik commented on BEAM-583: It would make sense for me for testing reasons that they should really use

[jira] [Commented] (BEAM-583) Auto Register TestDataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435727#comment-15435727 ] Luke Cwik commented on BEAM-583: I understand what is being done, I'm asking is this something that we

[jira] [Commented] (BEAM-583) Auto Register TestDataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435793#comment-15435793 ] Luke Cwik commented on BEAM-583: SGTM > Auto Register TestDataflowRunner >

[jira] [Commented] (BEAM-583) Auto Register TestDataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435742#comment-15435742 ] Luke Cwik commented on BEAM-583: When would a pipeline author try and use the TestDataflowRunner? Why

[jira] [Created] (BEAM-611) Add support for MapValues

Luke Cwik created BEAM-611: -- Summary: Add support for MapValues Key: BEAM-611 URL: https://issues.apache.org/jira/browse/BEAM-611 Project: Beam Issue Type: Improvement Components:

[jira] [Updated] (BEAM-544) Add header/footer support to TextIO.Write

[ https://issues.apache.org/jira/browse/BEAM-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-544: --- Assignee: Stas Levin > Add header/footer support to TextIO.Write > - >

[jira] [Updated] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-604: --- Issue Type: Improvement (was: Bug) > Use Watermark Check Streaming Job Finish in TestDataflowRunner >

[jira] [Updated] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-604: --- Priority: Minor (was: Major) > Use Watermark Check Streaming Job Finish in TestDataflowRunner >

[jira] [Commented] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449366#comment-15449366 ] Luke Cwik commented on BEAM-604: Would be better if the Dataflow service just shutdown jobs that hit max

[jira] [Resolved] (BEAM-544) Add header/footer support to TextIO.Write

[ https://issues.apache.org/jira/browse/BEAM-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-544. Resolution: Fixed Fix Version/s: 0.3.0-incubating > Add header/footer support to TextIO.Write >

[jira] [Assigned] (BEAM-414) IntraBundleParallelization needs to be removed

[ https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-414: -- Assignee: Pei He (was: Luke Cwik) > IntraBundleParallelization needs to be removed >

[jira] [Resolved] (BEAM-414) IntraBundleParallelization needs to be removed

[ https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-414. Resolution: Fixed Fix Version/s: 0.3.0-incubating > IntraBundleParallelization needs to be removed >

[jira] [Commented] (BEAM-414) IntraBundleParallelization needs to be removed

[ https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490774#comment-15490774 ] Luke Cwik commented on BEAM-414: https://github.com/apache/incubator-beam/pull/957 >

[jira] [Created] (BEAM-672) Figure out TestPipeline.create(PipelineOptions) / TestPipeline.fromOptions(PipelineOptions) story

Luke Cwik created BEAM-672: -- Summary: Figure out TestPipeline.create(PipelineOptions) / TestPipeline.fromOptions(PipelineOptions) story Key: BEAM-672 URL: https://issues.apache.org/jira/browse/BEAM-672

[jira] [Updated] (BEAM-672) Figure out TestPipeline.create(PipelineOptions) / TestPipeline.fromOptions(PipelineOptions) story

[ https://issues.apache.org/jira/browse/BEAM-672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-672: --- Component/s: sdk-java-core > Figure out TestPipeline.create(PipelineOptions) / >

[jira] [Commented] (BEAM-726) Standardize naming of PipelineResult objects

[ https://issues.apache.org/jira/browse/BEAM-726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553364#comment-15553364 ] Luke Cwik commented on BEAM-726: Is PipelineResult the appropriate suffix? If I support a non-blocking mode

[jira] [Updated] (BEAM-725) Remove legacy credentials flags related to GCP and adopt application default credentials as only supported default flow

[ https://issues.apache.org/jira/browse/BEAM-725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-725: --- Description: Drop the following GcpOptions and use ADC

[jira] [Created] (BEAM-725) Remove legacy credentials flags related to GCP and adopt application default credentials as only supported default flow

Luke Cwik created BEAM-725: -- Summary: Remove legacy credentials flags related to GCP and adopt application default credentials as only supported default flow Key: BEAM-725 URL:

[jira] [Created] (BEAM-705) Migrate AvroIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-705: -- Summary: Migrate AvroIO to use AutoValue to reduce boilerplate Key: BEAM-705 URL: https://issues.apache.org/jira/browse/BEAM-705 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-709) Migrate CountingSource to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-709: -- Summary: Migrate CountingSource to use AutoValue to reduce boilerplate Key: BEAM-709 URL: https://issues.apache.org/jira/browse/BEAM-709 Project: Beam Issue Type:

[jira] [Created] (BEAM-710) Migrate Read to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-710: -- Summary: Migrate Read to use AutoValue to reduce boilerplate Key: BEAM-710 URL: https://issues.apache.org/jira/browse/BEAM-710 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-707) Migrate PubsubIO/PubsubUnboundedSource/PubsubUnboundedSink to use AutoValue to reduce boilerplate

[ https://issues.apache.org/jira/browse/BEAM-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-707: --- Summary: Migrate PubsubIO/PubsubUnboundedSource/PubsubUnboundedSink to use AutoValue to reduce boilerplate

[jira] [Created] (BEAM-708) Migrate BoundedReadFromUnboundedSource to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-708: -- Summary: Migrate BoundedReadFromUnboundedSource to use AutoValue to reduce boilerplate Key: BEAM-708 URL: https://issues.apache.org/jira/browse/BEAM-708 Project: Beam

[jira] [Created] (BEAM-707) Migrate PubsubIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-707: -- Summary: Migrate PubsubIO to use AutoValue to reduce boilerplate Key: BEAM-707 URL: https://issues.apache.org/jira/browse/BEAM-707 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-706) Migrate TextIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-706: -- Summary: Migrate TextIO to use AutoValue to reduce boilerplate Key: BEAM-706 URL: https://issues.apache.org/jira/browse/BEAM-706 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-711) Migrate XmlSource/XmlSink to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-711: -- Summary: Migrate XmlSource/XmlSink to use AutoValue to reduce boilerplate Key: BEAM-711 URL: https://issues.apache.org/jira/browse/BEAM-711 Project: Beam Issue Type:

[jira] [Created] (BEAM-712) Migrate BigQueryIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-712: -- Summary: Migrate BigQueryIO to use AutoValue to reduce boilerplate Key: BEAM-712 URL: https://issues.apache.org/jira/browse/BEAM-712 Project: Beam Issue Type:

[jira] [Created] (BEAM-714) Migrate DatastoreV1 to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-714: -- Summary: Migrate DatastoreV1 to use AutoValue to reduce boilerplate Key: BEAM-714 URL: https://issues.apache.org/jira/browse/BEAM-714 Project: Beam Issue Type:

[jira] [Created] (BEAM-718) Migrate KinesisIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-718: -- Summary: Migrate KinesisIO to use AutoValue to reduce boilerplate Key: BEAM-718 URL: https://issues.apache.org/jira/browse/BEAM-718 Project: Beam Issue Type:

[jira] [Updated] (BEAM-709) Migrate CountingSource/CountingInput to use AutoValue to reduce boilerplate

[ https://issues.apache.org/jira/browse/BEAM-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-709: --- Summary: Migrate CountingSource/CountingInput to use AutoValue to reduce boilerplate (was: Migrate

[jira] [Updated] (BEAM-710) Migrate Read/Write to use AutoValue to reduce boilerplate

[ https://issues.apache.org/jira/browse/BEAM-710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-710: --- Summary: Migrate Read/Write to use AutoValue to reduce boilerplate (was: Migrate Read to use AutoValue to

[jira] [Created] (BEAM-713) Migrate BigTableIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-713: -- Summary: Migrate BigTableIO to use AutoValue to reduce boilerplate Key: BEAM-713 URL: https://issues.apache.org/jira/browse/BEAM-713 Project: Beam Issue Type:

[jira] [Created] (BEAM-715) Migrate AvroHDFSFileSource/HDFSFileSource/HDFSFileSink to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-715: -- Summary: Migrate AvroHDFSFileSource/HDFSFileSource/HDFSFileSink to use AutoValue to reduce boilerplate Key: BEAM-715 URL: https://issues.apache.org/jira/browse/BEAM-715 Project:

[jira] [Created] (BEAM-717) Migrate KafkaIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-717: -- Summary: Migrate KafkaIO to use AutoValue to reduce boilerplate Key: BEAM-717 URL: https://issues.apache.org/jira/browse/BEAM-717 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-716) Migrate JmsIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-716: -- Summary: Migrate JmsIO to use AutoValue to reduce boilerplate Key: BEAM-716 URL: https://issues.apache.org/jira/browse/BEAM-716 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-660) CalendarWindows compares DateTimes with ==

[ https://issues.apache.org/jira/browse/BEAM-660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-660. Resolution: Duplicate Fix Version/s: Not applicable Duplicate of

[jira] [Reopened] (BEAM-661) CalendarWindows#isCompatibleWith should use equals instead of ==

[ https://issues.apache.org/jira/browse/BEAM-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-661: Assignee: (was: Davor Bonaci) > CalendarWindows#isCompatibleWith should use equals instead of == >

[jira] [Created] (BEAM-670) FluentBackoff incorrectly handles nextBackOff millis

Luke Cwik created BEAM-670: -- Summary: FluentBackoff incorrectly handles nextBackOff millis Key: BEAM-670 URL: https://issues.apache.org/jira/browse/BEAM-670 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-670) BigQuery TableRow inserter incorrectly handles nextBackOff millis

[ https://issues.apache.org/jira/browse/BEAM-670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-670: --- Summary: BigQuery TableRow inserter incorrectly handles nextBackOff millis (was: FluentBackoff incorrectly

[jira] [Commented] (BEAM-414) IntraBundleParallelization needs to be removed

[ https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425597#comment-15425597 ] Luke Cwik commented on BEAM-414: [~pei...@gmail.com] was working on some refactoring of the examples which

[jira] [Commented] (BEAM-592) StackOverflowError Failed example/java/WordCount When Using SparkRunner

[ https://issues.apache.org/jira/browse/BEAM-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439743#comment-15439743 ] Luke Cwik commented on BEAM-592: Unless runners shade all their dependencies it will be near impossible to

[jira] [Updated] (BEAM-589) Making IO.Read transformations to extend PTransform<PBegin, PCollection>

[ https://issues.apache.org/jira/browse/BEAM-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-589: --- Assignee: Luke Cwik > Making IO.Read transformations to extend PTransform >

  1   2   >