[jira] [Created] (BEAM-95) Compress DoFn's / SerializableCoder / ... when serializing objects

2016-03-04 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-95: - Summary: Compress DoFn's / SerializableCoder / ... when serializing objects Key: BEAM-95 URL: https://issues.apache.org/jira/browse/BEAM-95 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-95) Compress DoFn's / SerializableCoder / ... when serializing objects

2016-03-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-95?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-95: -- Issue Type: Improvement (was: Bug) > Compress DoFn's / SerializableCoder / ... when serializing objects >

[jira] [Commented] (BEAM-76) FileBasedSource should take a list of files/globs

2016-03-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180435#comment-15180435 ] Luke Cwik commented on BEAM-76: --- What if instead of a FileBasedSource taking a list of files/gl

[jira] [Resolved] (BEAM-95) Compress DoFn's / SerializableCoder / ... when serializing objects

2016-03-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-95?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-95. --- Resolution: Fixed > Compress DoFn's / SerializableCoder / ... when serializing objects >

[jira] [Updated] (BEAM-106) Native support for conditional iteration

2016-03-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-106: --- Assignee: James Malone (was: Luke Cwik) > Native support for conditional iteration > --

[jira] [Created] (BEAM-106) Native support for conditional iteration

2016-03-10 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-106: -- Summary: Native support for conditional iteration Key: BEAM-106 URL: https://issues.apache.org/jira/browse/BEAM-106 Project: Beam Issue Type: New Feature Compo

[jira] [Commented] (BEAM-137) Add implicit conf/pipeline-default.conf options file

2016-03-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204657#comment-15204657 ] Luke Cwik commented on BEAM-137: The original design of PipelineOptions took into account th

[jira] [Commented] (BEAM-142) BigQueryIO: don't unnecessarily initialize an ExecutorService to validate parameters

2016-03-22 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15207317#comment-15207317 ] Luke Cwik commented on BEAM-142: If you use the executor service from PipelineOptions, it ha

[jira] [Commented] (BEAM-136) PipelineOptionsFactory should detect all runners

2016-03-25 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212378#comment-15212378 ] Luke Cwik commented on BEAM-136: I double checked that the meta-inf services specification i

[jira] [Created] (BEAM-151) Create Dataflow Runner Package

2016-03-25 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-151: -- Summary: Create Dataflow Runner Package Key: BEAM-151 URL: https://issues.apache.org/jira/browse/BEAM-151 Project: Beam Issue Type: Improvement Components: run

[jira] [Commented] (BEAM-151) Create Dataflow Runner Package

2016-03-25 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212502#comment-15212502 ] Luke Cwik commented on BEAM-151: The plan is to create a java-dataflow runner maven module a

[jira] [Commented] (BEAM-151) Create Dataflow Runner Package

2016-03-25 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212503#comment-15212503 ] Luke Cwik commented on BEAM-151: To be able to start moving this stuff out, there are severa

[jira] [Assigned] (BEAM-167) TextIO can't read concatenated gzip files

2016-04-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-167: -- Assignee: Luke Cwik > TextIO can't read concatenated gzip files > ---

[jira] [Commented] (BEAM-167) TextIO can't read concatenated gzip files

2016-04-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15224990#comment-15224990 ] Luke Cwik commented on BEAM-167: Will produce PR. > TextIO can't read concatenated gzip fil

[jira] [Commented] (BEAM-167) TextIO can't read concatenated gzip files

2016-04-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225007#comment-15225007 ] Luke Cwik commented on BEAM-167: Produced PR: https://github.com/apache/incubator-beam/pull/

[jira] [Commented] (BEAM-167) TextIO can't read concatenated gzip files

2016-04-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225167#comment-15225167 ] Luke Cwik commented on BEAM-167: Merged PR, also backported to DataflowJavaSDK. > TextIO ca

[jira] [Resolved] (BEAM-167) TextIO can't read concatenated gzip files

2016-04-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-167. Resolution: Fixed > TextIO can't read concatenated gzip files > - > >

[jira] [Commented] (BEAM-170) Session windows should not be identified by their bounds

2016-04-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225194#comment-15225194 ] Luke Cwik commented on BEAM-170: Don't session windows need another key of some kind? So tim

[jira] [Commented] (BEAM-190) Dead-letter drop for bad BigQuery records

2016-04-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15239701#comment-15239701 ] Luke Cwik commented on BEAM-190: I believe this can easily extend beyond BigQuery to having

[jira] [Commented] (BEAM-190) Dead-letter drop for bad BigQuery records

2016-04-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15239815#comment-15239815 ] Luke Cwik commented on BEAM-190: >From Dan Halperin: I thought that we were under the impres

[jira] [Commented] (BEAM-151) Create Dataflow Runner Package

2016-04-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240134#comment-15240134 ] Luke Cwik commented on BEAM-151: No, I still need to update package-info.java and make anoth

[jira] [Created] (BEAM-202) Remove YYYCoderBase

2016-04-15 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-202: -- Summary: Remove YYYCoderBase Key: BEAM-202 URL: https://issues.apache.org/jira/browse/BEAM-202 Project: Beam Issue Type: Improvement Components: sdk-java-core

[jira] [Resolved] (BEAM-202) Remove YYYCoderBase

2016-04-18 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-202. Resolution: Fixed > Remove YYYCoderBase > --- > > Key: BEAM-202 >

[jira] [Commented] (BEAM-205) An 'in process' runner optimized for efficiency rather than debugging

2016-04-18 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15246065#comment-15246065 ] Luke Cwik commented on BEAM-205: >From my understanding, both Flink and Spark support runnin

[jira] [Commented] (BEAM-211) When using Create.of use it's #withCoder method instead of the created PCollection's #setCoder

2016-04-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248632#comment-15248632 ] Luke Cwik commented on BEAM-211: The output PCollection from applying Create.of(...).withCod

[jira] [Commented] (BEAM-217) BoundedSource.splitAtFraction should be splitAfterFraction

2016-04-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252132#comment-15252132 ] Luke Cwik commented on BEAM-217: The TextSource supports variable length delimiters which ar

[jira] [Commented] (BEAM-226) Upload JARs to Maven Central

2016-04-25 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256814#comment-15256814 ] Luke Cwik commented on BEAM-226: There is a nightly snapshot on the Apache snapshots repo: h

[jira] [Resolved] (BEAM-151) Create Dataflow Runner Package

2016-04-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-151. Resolution: Fixed > Create Dataflow Runner Package > -- > > Key: B

[jira] [Commented] (BEAM-151) Create Dataflow Runner Package

2016-04-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261297#comment-15261297 ] Luke Cwik commented on BEAM-151: Note there are a few more objects that could move over such

[jira] [Created] (BEAM-496) Remove the notion of a Fake subscription from PubsubIO

2016-07-28 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-496: -- Summary: Remove the notion of a Fake subscription from PubsubIO Key: BEAM-496 URL: https://issues.apache.org/jira/browse/BEAM-496 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-496) Remove the notion of a Fake subscription from PubsubIO

2016-07-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-496: -- Assignee: Daniel Halperin (was: Davor Bonaci) > Remove the notion of a Fake subscription from PubsubIO >

[jira] [Updated] (BEAM-544) Add header/footer support to TextIO.Write

2016-08-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-544: --- Description: Being able to add a header/footer to each file that is written via TextIO would cover several simp

[jira] [Created] (BEAM-544) Add header/footer support to TextIO.Write

2016-08-10 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-544: -- Summary: Add header/footer support to TextIO.Write Key: BEAM-544 URL: https://issues.apache.org/jira/browse/BEAM-544 Project: Beam Issue Type: New Feature Comp

[jira] [Commented] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-08-16 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422872#comment-15422872 ] Luke Cwik commented on BEAM-469: When your in the outer context you can inspect the stream b

[jira] [Resolved] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-08-16 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-469. Resolution: Invalid Assignee: Luke Cwik Fix Version/s: Not applicable > NullableCoder should e

[jira] [Commented] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-08-16 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15423000#comment-15423000 ] Luke Cwik commented on BEAM-469: That doesn't work with nesting. Imagine I have a KV coder w

[jira] [Issue Comment Deleted] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-08-16 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-469: --- Comment: was deleted (was: That doesn't work with nesting. Imagine I have a KV coder with both the key and valu

[jira] [Reopened] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-08-16 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-469: Assignee: (was: Luke Cwik) Re-opening because I believe Dan is correct about passing contexts around. >

[jira] [Issue Comment Deleted] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-08-16 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-469: --- Comment: was deleted (was: When your in the outer context you can inspect the stream by reading ahead since you

[jira] [Commented] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-08-16 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15423023#comment-15423023 ] Luke Cwik commented on BEAM-469: So this is about using the passed in context and not always

[jira] [Issue Comment Deleted] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-08-16 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-469: --- Comment: was deleted (was: Re-opening because I believe Dan is correct about passing contexts around.) > Nulla

[jira] [Commented] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-08-16 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15423049#comment-15423049 ] Luke Cwik commented on BEAM-469: If your happy to make the change, I can assign the issue to

[jira] [Resolved] (BEAM-557) Test-scoped dependencies should be excluded from shading package relocation

2016-08-17 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-557. Resolution: Fixed Fix Version/s: 0.3.0-incubating > Test-scoped dependencies should be excluded from sh

[jira] [Commented] (BEAM-414) IntraBundleParallelization needs to be removed

2016-08-17 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425597#comment-15425597 ] Luke Cwik commented on BEAM-414: [~pei...@gmail.com] was working on some refactoring of the

[jira] [Created] (BEAM-567) FlinkRunner pollutes beam-examples-java[8] modules with SLF4J backend dependencies which are not optional (e.g. test/provided/system scoped, or marked optional)

2016-08-18 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-567: -- Summary: FlinkRunner pollutes beam-examples-java[8] modules with SLF4J backend dependencies which are not optional (e.g. test/provided/system scoped, or marked optional) Key: BEAM-567 URL: h

[jira] [Commented] (BEAM-582) Allow usage of the new GCP service account JSON key

2016-08-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435554#comment-15435554 ] Luke Cwik commented on BEAM-582: Adopting gcloud-java-core would give us this instead of usi

[jira] [Commented] (BEAM-583) Auto Register TestDataflowRunner

2016-08-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435667#comment-15435667 ] Luke Cwik commented on BEAM-583: Would a pipeline author actually use the TestDataflowRunner

[jira] [Commented] (BEAM-583) Auto Register TestDataflowRunner

2016-08-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435727#comment-15435727 ] Luke Cwik commented on BEAM-583: I understand what is being done, I'm asking is this somethi

[jira] [Commented] (BEAM-583) Auto Register TestDataflowRunner

2016-08-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435742#comment-15435742 ] Luke Cwik commented on BEAM-583: When would a pipeline author try and use the TestDataflowRu

[jira] [Commented] (BEAM-583) Auto Register TestDataflowRunner

2016-08-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435766#comment-15435766 ] Luke Cwik commented on BEAM-583: It would make sense for me for testing reasons that they sh

[jira] [Commented] (BEAM-583) Auto Register TestDataflowRunner

2016-08-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435793#comment-15435793 ] Luke Cwik commented on BEAM-583: SGTM > Auto Register TestDataflowRunner > ---

[jira] [Commented] (BEAM-592) StackOverflowError Failed example/java/WordCount When Using SparkRunner

2016-08-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439743#comment-15439743 ] Luke Cwik commented on BEAM-592: Unless runners shade all their dependencies it will be near

[jira] [Updated] (BEAM-589) Making IO.Read transformations to extend PTransform>

2016-08-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-589: --- Assignee: Luke Cwik > Making IO.Read transformations to extend PTransform> > ---

[jira] [Commented] (BEAM-589) Making IO.Read transformations to extend PTransform>

2016-08-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15440110#comment-15440110 ] Luke Cwik commented on BEAM-589: I added you to the contributors list on the project so you

[jira] [Resolved] (BEAM-589) Making IO.Read transformations to extend PTransform>

2016-08-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-589. Resolution: Fixed Fix Version/s: 0.3.0-incubating > Making IO.Read transformations to extend PTransform

[jira] [Updated] (BEAM-589) Making IO.Read transformations to extend PTransform>

2016-08-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-589: --- Assignee: gaurav gupta (was: Luke Cwik) > Making IO.Read transformations to extend PTransform> > --

[jira] [Updated] (BEAM-589) Making IO.Read transformations to extend PTransform>

2016-08-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-589: --- Priority: Minor (was: Major) > Making IO.Read transformations to extend PTransform> > -

[jira] [Commented] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner

2016-08-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449366#comment-15449366 ] Luke Cwik commented on BEAM-604: Would be better if the Dataflow service just shutdown jobs

[jira] [Updated] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner

2016-08-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-604: --- Priority: Minor (was: Major) > Use Watermark Check Streaming Job Finish in TestDataflowRunner > --

[jira] [Updated] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner

2016-08-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-604: --- Issue Type: Improvement (was: Bug) > Use Watermark Check Streaming Job Finish in TestDataflowRunner >

[jira] [Created] (BEAM-611) Add support for MapValues

2016-08-31 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-611: -- Summary: Add support for MapValues Key: BEAM-611 URL: https://issues.apache.org/jira/browse/BEAM-611 Project: Beam Issue Type: Improvement Components: sdk-idea

[jira] [Updated] (BEAM-544) Add header/footer support to TextIO.Write

2016-09-06 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-544: --- Assignee: Stas Levin > Add header/footer support to TextIO.Write > - > >

[jira] [Resolved] (BEAM-544) Add header/footer support to TextIO.Write

2016-09-07 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-544. Resolution: Fixed Fix Version/s: 0.3.0-incubating > Add header/footer support to TextIO.Write > ---

[jira] [Resolved] (BEAM-630) DataflowRunnableOnService test suite is broken

2016-09-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-630. Resolution: Fixed Fix Version/s: 0.3.0-incubating > DataflowRunnableOnService test suite is broken > --

[jira] [Assigned] (BEAM-414) IntraBundleParallelization needs to be removed

2016-09-14 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-414: -- Assignee: Pei He (was: Luke Cwik) > IntraBundleParallelization needs to be removed > ---

[jira] [Commented] (BEAM-414) IntraBundleParallelization needs to be removed

2016-09-14 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15490774#comment-15490774 ] Luke Cwik commented on BEAM-414: https://github.com/apache/incubator-beam/pull/957 > IntraB

[jira] [Resolved] (BEAM-414) IntraBundleParallelization needs to be removed

2016-09-14 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-414. Resolution: Fixed Fix Version/s: 0.3.0-incubating > IntraBundleParallelization needs to be removed > --

[jira] [Resolved] (BEAM-660) CalendarWindows compares DateTimes with ==

2016-09-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-660. Resolution: Duplicate Fix Version/s: Not applicable Duplicate of https://issues.apache.org/jira/browse/

[jira] [Reopened] (BEAM-661) CalendarWindows#isCompatibleWith should use equals instead of ==

2016-09-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-661: Assignee: (was: Davor Bonaci) > CalendarWindows#isCompatibleWith should use equals instead of == > -

[jira] [Created] (BEAM-670) FluentBackoff incorrectly handles nextBackOff millis

2016-09-22 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-670: -- Summary: FluentBackoff incorrectly handles nextBackOff millis Key: BEAM-670 URL: https://issues.apache.org/jira/browse/BEAM-670 Project: Beam Issue Type: Bug C

[jira] [Updated] (BEAM-670) BigQuery TableRow inserter incorrectly handles nextBackOff millis

2016-09-22 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-670: --- Summary: BigQuery TableRow inserter incorrectly handles nextBackOff millis (was: FluentBackoff incorrectly hand

[jira] [Created] (BEAM-672) Figure out TestPipeline.create(PipelineOptions) / TestPipeline.fromOptions(PipelineOptions) story

2016-09-23 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-672: -- Summary: Figure out TestPipeline.create(PipelineOptions) / TestPipeline.fromOptions(PipelineOptions) story Key: BEAM-672 URL: https://issues.apache.org/jira/browse/BEAM-672 Proje

[jira] [Updated] (BEAM-672) Figure out TestPipeline.create(PipelineOptions) / TestPipeline.fromOptions(PipelineOptions) story

2016-09-23 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-672: --- Component/s: sdk-java-core > Figure out TestPipeline.create(PipelineOptions) / > TestPipeline.fromOptions(Pipel

[jira] [Updated] (BEAM-672) Figure out TestPipeline.create(PipelineOptions) / TestPipeline.fromOptions(PipelineOptions) story

2016-09-23 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-672: --- Labels: test (was: ) > Figure out TestPipeline.create(PipelineOptions) / > TestPipeline.fromOptions(PipelineOp

[jira] [Commented] (BEAM-679) Bigtable IO integration tests are failing

2016-09-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15526527#comment-15526527 ] Luke Cwik commented on BEAM-679: I believe this pull request with an updated Apache Beam for

[jira] [Created] (BEAM-686) Integration tests should create/destroy resources required for running

2016-09-27 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-686: -- Summary: Integration tests should create/destroy resources required for running Key: BEAM-686 URL: https://issues.apache.org/jira/browse/BEAM-686 Project: Beam Issue Ty

[jira] [Commented] (BEAM-679) Bigtable IO integration tests are failing

2016-09-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15526647#comment-15526647 ] Luke Cwik commented on BEAM-679: Trying to rerun the integration test locally to verify. >

[jira] [Comment Edited] (BEAM-679) Bigtable IO integration tests are failing

2016-09-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15526647#comment-15526647 ] Luke Cwik edited comment on BEAM-679 at 9/27/16 4:51 PM: - Trying to

[jira] [Commented] (BEAM-679) Bigtable IO integration tests are failing

2016-09-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15526790#comment-15526790 ] Luke Cwik commented on BEAM-679: Got permissions, BigtableWriteIT passed. Next postcommit sh

[jira] [Commented] (BEAM-679) Bigtable IO integration tests are failing

2016-09-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15526816#comment-15526816 ] Luke Cwik commented on BEAM-679: Thanks for finding the issue JB > Bigtable IO integration

[jira] [Commented] (BEAM-679) Bigtable IO integration tests are failing

2016-09-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527323#comment-15527323 ] Luke Cwik commented on BEAM-679: It turned out that the worker images for Dataflow weren't p

[jira] [Commented] (BEAM-679) Bigtable IO integration tests are failing

2016-09-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527348#comment-15527348 ] Luke Cwik commented on BEAM-679: https://builds.apache.org/view/Beam/job/beam_PostCommit_Mav

[jira] [Resolved] (BEAM-679) Bigtable IO integration tests are failing

2016-09-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-679. Resolution: Fixed Assignee: Luke Cwik (was: Jean-Baptiste Onofré) Fix Version/s: 0.3.0-incubat

[jira] [Resolved] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner

2016-09-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-604. Resolution: Fixed Fix Version/s: 0.3.0-incubating > Use Watermark Check Streaming Job Finish in TestDat

[jira] [Created] (BEAM-695) DisplayData for PipelineOptions fails to correctly toString array types

2016-09-30 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-695: -- Summary: DisplayData for PipelineOptions fails to correctly toString array types Key: BEAM-695 URL: https://issues.apache.org/jira/browse/BEAM-695 Project: Beam Issue T

[jira] [Commented] (BEAM-91) Retractions

2016-06-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15342094#comment-15342094 ] Luke Cwik commented on BEAM-91: --- Matt, do you have something you can share that goes into more

[jira] [Updated] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

2016-06-23 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-372: --- Description: Add a test to CoderProperties that does the following: 1. Encode a value using the Coder in the ne

[jira] [Resolved] (BEAM-142) BigQueryIO: don't unnecessarily initialize an ExecutorService to validate parameters

2016-06-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-142. Resolution: Fixed Fix Version/s: 0.2.0-incubating > BigQueryIO: don't unnecessarily initialize an Execu

[jira] [Created] (BEAM-414) IntraBundleParallelization needs to be removed

2016-06-30 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-414: -- Summary: IntraBundleParallelization needs to be removed Key: BEAM-414 URL: https://issues.apache.org/jira/browse/BEAM-414 Project: Beam Issue Type: Bug Compone

[jira] [Commented] (BEAM-424) Create UDP/TCP SocketIO

2016-07-06 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364190#comment-15364190 ] Luke Cwik commented on BEAM-424: Which version of SocketIO? Wikimedia RCStreams is only com

[jira] [Resolved] (BEAM-405) BigQueryIO$StreamingWriteFn uses inefficient keySet iterator

2016-07-06 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-405. Resolution: Fixed Fix Version/s: 0.2.0-incubating > BigQueryIO$StreamingWriteFn uses inefficient keySet

[jira] [Resolved] (BEAM-397) Format string uses \n rather than %n

2016-07-06 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-397. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Format string uses \n rather than %n >

[jira] [Resolved] (BEAM-422) AvroSource hits various IOException when using Snappy codec

2016-07-06 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-422. Resolution: Fixed Fix Version/s: 0.2.0-incubating > AvroSource hits various IOException when using Snap

[jira] [Resolved] (BEAM-408) ProxyInvocationHandler uses inefficient Math.random() for random int

2016-07-07 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-408. Resolution: Fixed Fix Version/s: 0.2.0-incubating > ProxyInvocationHandler uses inefficient Math.random

[jira] [Commented] (BEAM-442) Examples demonstrate code, but not project configuration

2016-07-12 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372949#comment-15372949 ] Luke Cwik commented on BEAM-442: How is this different from the Maven archetypes that you ca

[jira] [Commented] (BEAM-446) Improve IOChannelUtils.resolve() to accept multiple paths at once

2016-07-12 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374129#comment-15374129 ] Luke Cwik commented on BEAM-446: Mark, do you have an account on issues.apache.org? I can't

[jira] [Updated] (BEAM-446) Improve IOChannelUtils.resolve() to accept multiple paths at once

2016-07-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-446: --- Assignee: Mark Liu > Improve IOChannelUtils.resolve() to accept multiple paths at once > ---

[jira] [Resolved] (BEAM-446) Improve IOChannelUtils.resolve() to accept multiple paths at once

2016-07-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-446. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Improve IOChannelUtils.resolve() to accept multiple

[jira] [Resolved] (BEAM-339) Archetype project version shouldn't be coupled to Beam version

2016-07-14 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-339. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Archetype project version shouldn't be coupled to B

[jira] [Resolved] (BEAM-457) Upgrade Avro

2016-07-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-457. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Upgrade Avro > > > Key

  1   2   3   >