[jira] [Created] (BEAM-2220) Move org.apache.beam.sdk.util within google-cloud-platform-core to org.apache.beam.runners.dataflow

2017-05-08 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2220: --- Summary: Move org.apache.beam.sdk.util within google-cloud-platform-core to org.apache.beam.runners.dataflow Key: BEAM-2220 URL: https://issues.apache.org/jira/browse/BEAM-2220

[jira] [Commented] (BEAM-2113) Apex Runner is not able to submit any job to YARN

2017-05-06 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15999476#comment-15999476 ] Luke Cwik commented on BEAM-2113: - For the examples, I think we do want some kind of binding for the user

[jira] [Resolved] (BEAM-2187) SparkRuntimeContextTest fails to compile

2017-05-05 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2187. - Resolution: Fixed Fix Version/s: First stable release > SparkRuntimeContextTest fails to compile >

[jira] [Created] (BEAM-2187) SparkRuntimeContextTest fails to compile

2017-05-05 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2187: --- Summary: SparkRuntimeContextTest fails to compile Key: BEAM-2187 URL: https://issues.apache.org/jira/browse/BEAM-2187 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-2174) Allow coder factories to create Coders for a wider range of types

2017-05-05 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2174. - Resolution: Fixed > Allow coder factories to create Coders for a wider range of types >

[jira] [Resolved] (BEAM-2165) Support custom user Jackson modules for PipelineOptions

2017-05-05 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2165. - Resolution: Fixed Fix Version/s: First stable release > Support custom user Jackson modules for

[jira] [Updated] (BEAM-2174) Allow coder factories to create Coders for a wider range of types

2017-05-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2174: Description: By allowing the CoderFactory to see they type it can look at annotations on the type allowing:

[jira] [Resolved] (BEAM-2067) Add support for generic CoderProvider -> CoderFactory mapping with CoderRegistrar

2017-05-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2067. - Resolution: Duplicate Duplicate of https://issues.apache.org/jira/browse/BEAM-2174 > Add support for

[jira] [Updated] (BEAM-2174) Allow coder factories to create Coders for a wider range of types

2017-05-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2174: Fix Version/s: First stable release > Allow coder factories to create Coders for a wider range of types >

[jira] [Updated] (BEAM-2174) Allow coder factories to create Coders for a wider range of types

2017-05-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2174: Description: By allowing the CoderFactory to see they type it can look at annotations on the type allowing:

[jira] [Created] (BEAM-2174) Allow coder factories to create Coders for a wider range of types

2017-05-04 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2174: --- Summary: Allow coder factories to create Coders for a wider range of types Key: BEAM-2174 URL: https://issues.apache.org/jira/browse/BEAM-2174 Project: Beam Issue

[jira] [Resolved] (BEAM-1491) HadoopFileSystemOptions should be able to read the HADOOP_CONF_DIR(YARN_CONF_DIR) environment variable

2017-05-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-1491. - Resolution: Fixed Assignee: wyp (was: Jean-Baptiste Onofré) Fix Version/s: First stable

[jira] [Updated] (BEAM-1491) HadoopFileSystemOptions should be able to read the HADOOP_CONF_DIR(YARN_CONF_DIR) environment variable

2017-05-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-1491: Description: Currently, if we want to read file store on HDFS, we will do it as follow: {code} Configuration

[jira] [Updated] (BEAM-1491) HadoopFileSystemOptions should be able to read the HADOOP_CONF_DIR(YARN_CONF_DIR) environment variable

2017-05-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-1491: Summary: HadoopFileSystemOptions should be able to read the HADOOP_CONF_DIR(YARN_CONF_DIR) environment

[jira] [Resolved] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2157. - Resolution: Fixed Fix Version/s: First stable release > HadoopFileSystemModuleTest Failed in Some

[jira] [Created] (BEAM-2165) Support custom user Jackson modules for PipelineOptions

2017-05-03 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2165: --- Summary: Support custom user Jackson modules for PipelineOptions Key: BEAM-2165 URL: https://issues.apache.org/jira/browse/BEAM-2165 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995617#comment-15995617 ] Luke Cwik commented on BEAM-2157: - It might be something simple like "contains" -> "containsInAnyOrder" on

[jira] [Resolved] (BEAM-2139) Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner

2017-05-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2139. - Resolution: Fixed Fix Version/s: First stable release > Disable SplittableDoFn ValidatesRunner

[jira] [Resolved] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2135. - Resolution: Fixed Fix Version/s: First stable release > Rename hdfs module to hadoop-file-system,

[jira] [Assigned] (BEAM-2063) type DATE/TIME/TIMESTAMP support

2017-05-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2063: --- Assignee: Luke Cwik > type DATE/TIME/TIMESTAMP support > > >

[jira] [Assigned] (BEAM-2063) type DATE/TIME/TIMESTAMP support

2017-05-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2063: --- Assignee: James Xu (was: Luke Cwik) > type DATE/TIME/TIMESTAMP support >

[jira] [Created] (BEAM-2138) Support atomic rename within FileSystem to replace inefficient Hadoop copy

2017-05-02 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2138: --- Summary: Support atomic rename within FileSystem to replace inefficient Hadoop copy Key: BEAM-2138 URL: https://issues.apache.org/jira/browse/BEAM-2138 Project: Beam

[jira] [Created] (BEAM-2137) Hadoop: Handle multiple Hadoop configurations within Hadoop FileSystem

2017-05-01 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2137: --- Summary: Hadoop: Handle multiple Hadoop configurations within Hadoop FileSystem Key: BEAM-2137 URL: https://issues.apache.org/jira/browse/BEAM-2137 Project: Beam

[jira] [Resolved] (BEAM-2030) Implement beam FileSystem's copy()

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2030. - Resolution: Fixed > Implement beam FileSystem's copy() > -- > >

[jira] [Resolved] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2005. - Resolution: Fixed > Add a Hadoop FileSystem implementation of Beam's FileSystem >

[jira] [Resolved] (BEAM-2033) Implement ResourceIds for HadoopFileSystem

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2033. - Resolution: Fixed > Implement ResourceIds for HadoopFileSystem >

[jira] [Resolved] (BEAM-2032) Implement delete

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2032. - Resolution: Fixed > Implement delete > > > Key: BEAM-2032 >

[jira] [Resolved] (BEAM-2070) Implement match for HadoopFileSystem

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2070. - Resolution: Fixed > Implement match for HadoopFileSystem > > >

[jira] [Resolved] (BEAM-2031) Hadoop FileSystem needs to receive Hadoop Configuration

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2031. - Resolution: Fixed > Hadoop FileSystem needs to receive Hadoop Configuration >

[jira] [Commented] (BEAM-2136) AvroCoderTest.testTwoClassLoaders fails on beam_PostCommit_Java_ValidatesRunner_Dataflow

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992124#comment-15992124 ] Luke Cwik commented on BEAM-2136: - Yes, I marked it minor and not part of first stable release for those

[jira] [Created] (BEAM-2136) AvroCoderTest.testTwoClassLoaders fails on beam_PostCommit_Java_ValidatesRunner_Dataflow

2017-05-01 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2136: --- Summary: AvroCoderTest.testTwoClassLoaders fails on beam_PostCommit_Java_ValidatesRunner_Dataflow Key: BEAM-2136 URL: https://issues.apache.org/jira/browse/BEAM-2136 Project:

[jira] [Created] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-01 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2135: --- Summary: Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core Key: BEAM-2135 URL: https://issues.apache.org/jira/browse/BEAM-2135 Project:

[jira] [Resolved] (BEAM-712) Migrate BigQueryIO to use AutoValue to reduce boilerplate

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-712. Resolution: Duplicate Fix Version/s: Not applicable Duplicate of BEAM-1427 > Migrate BigQueryIO to

[jira] [Resolved] (BEAM-711) Migrate XmlSource/XmlSink to use AutoValue to reduce boilerplate

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-711. Resolution: Duplicate Assignee: (was: Davor Bonaci) Fix Version/s: Not applicable

[jira] [Resolved] (BEAM-718) Migrate KinesisIO to use AutoValue to reduce boilerplate

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-718. Resolution: Duplicate Fix Version/s: Not applicable Duplicate of BEAM-1428 > Migrate KinesisIO to use

[jira] [Resolved] (BEAM-713) Migrate BigTableIO to use AutoValue to reduce boilerplate

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-713. Resolution: Duplicate Fix Version/s: Not applicable Duplicate of BEAM-1427 > Migrate BigTableIO to

[jira] [Resolved] (BEAM-705) Migrate AvroIO/AvroSource to use AutoValue to reduce boilerplate

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-705. Resolution: Duplicate Fix Version/s: Not applicable Duplicate of BEAM-1402 > Migrate

[jira] [Resolved] (BEAM-706) Migrate TextIO to use AutoValue to reduce boilerplate

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-706. Resolution: Duplicate Fix Version/s: Not applicable This is a duplicate of BEAM-1402 > Migrate TextIO

[jira] [Resolved] (BEAM-2130) Ensure options id is never null

2017-05-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2130. - Resolution: Fixed Fix Version/s: First stable release > Ensure options id is never null >

[jira] [Created] (BEAM-2131) Google application default credentials always found, need tests run outside of Google environments

2017-05-01 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2131: --- Summary: Google application default credentials always found, need tests run outside of Google environments Key: BEAM-2131 URL: https://issues.apache.org/jira/browse/BEAM-2131

[jira] [Created] (BEAM-2130) Ensure options id is never null

2017-04-30 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2130: --- Summary: Ensure options id is never null Key: BEAM-2130 URL: https://issues.apache.org/jira/browse/BEAM-2130 Project: Beam Issue Type: Bug Components:

[jira] [Commented] (BEAM-1970) Cannot run UserScore on Flink runner due to AvroCoder classload issues

2017-04-29 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990139#comment-15990139 ] Luke Cwik commented on BEAM-1970: - The issue in Avro/Flink seems to be that they use class caches for

[jira] [Assigned] (BEAM-2070) Implement match for HadoopFileSystem

2017-04-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2070: --- Assignee: Luke Cwik (was: Stephen Sisk) > Implement match for HadoopFileSystem >

[jira] [Assigned] (BEAM-2030) Implement beam FileSystem's copy()

2017-04-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2030: --- Assignee: Luke Cwik (was: Stephen Sisk) > Implement beam FileSystem's copy() >

[jira] [Assigned] (BEAM-2033) Implement ResourceIds for HadoopFileSystem

2017-04-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2033: --- Assignee: Luke Cwik (was: Stephen Sisk) > Implement ResourceIds for HadoopFileSystem >

[jira] [Assigned] (BEAM-2032) Implement delete

2017-04-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2032: --- Assignee: Luke Cwik (was: Stephen Sisk) > Implement delete > > >

[jira] [Resolved] (BEAM-2119) FileSystems doesn't install the local filesystem on intialization by default

2017-04-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2119. - Resolution: Fixed Fix Version/s: First stable release > FileSystems doesn't install the local

[jira] [Created] (BEAM-2119) FileSystems doesn't install the local filesystem on intialization by default

2017-04-28 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2119: --- Summary: FileSystems doesn't install the local filesystem on intialization by default Key: BEAM-2119 URL: https://issues.apache.org/jira/browse/BEAM-2119 Project: Beam

[jira] [Assigned] (BEAM-2031) Hadoop FileSystem needs to receive Hadoop Configuration

2017-04-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2031: --- Assignee: Luke Cwik (was: Stephen Sisk) > Hadoop FileSystem needs to receive Hadoop Configuration >

[jira] [Assigned] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

2017-04-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2005: --- Assignee: Luke Cwik (was: Stephen Sisk) > Add a Hadoop FileSystem implementation of Beam's

[jira] [Commented] (BEAM-1491) HDFSFileSource should be able to read the HADOOP_CONF_DIR(YARN_CONF_DIR) environment variable

2017-04-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988997#comment-15988997 ] Luke Cwik commented on BEAM-1491: - Until there is support for a default filesystem which isn't the local

[jira] [Commented] (BEAM-2101) Reading public GCS files requires authentication

2017-04-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987151#comment-15987151 ] Luke Cwik commented on BEAM-2101: - No, if we fail to get application default credentials, just continue

[jira] [Closed] (BEAM-2071) AttributeError in dataflow_metrics

2017-04-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-2071. --- Resolution: Fixed Fix Version/s: First stable release > AttributeError in dataflow_metrics >

[jira] [Comment Edited] (BEAM-2101) (Potential) Reading public GCS files requires authentication

2017-04-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987056#comment-15987056 ] Luke Cwik edited comment on BEAM-2101 at 4/27/17 5:13 PM: -- We ran into the same

[jira] [Commented] (BEAM-2101) (Potential) Reading public GCS files requires authentication

2017-04-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987056#comment-15987056 ] Luke Cwik commented on BEAM-2101: - We ran into the same problem within the Java code base, the issue is

[jira] [Resolved] (BEAM-2062) EventHandler jaxb unmarshaller should be optional

2017-04-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2062. - Resolution: Fixed Fix Version/s: First stable release > EventHandler jaxb unmarshaller should be

[jira] [Assigned] (BEAM-659) WindowFn#isCompatible should provide a meaningful reason

2017-04-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-659: -- Assignee: Huafeng Wang > WindowFn#isCompatible should provide a meaningful reason >

[jira] [Assigned] (BEAM-2062) EventHandler jaxb unmarshaller should be optional

2017-04-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2062: --- Assignee: Damien GOUYETTE > EventHandler jaxb unmarshaller should be optional >

[jira] [Resolved] (BEAM-2077) Remove AvroCoder#createDatum(Reader/Writer)

2017-04-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2077. - Resolution: Fixed This was fixed with

[jira] [Assigned] (BEAM-2077) Remove AvroCoder#createDatum(Reader/Writer)

2017-04-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2077: --- Assignee: Luke Cwik (was: Thomas Groh) > Remove AvroCoder#createDatum(Reader/Writer) >

[jira] [Resolved] (BEAM-1877) Use Iterables.isEmpty in GroupIntoBatches

2017-04-25 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-1877. - Resolution: Fixed Fix Version/s: First stable release > Use Iterables.isEmpty in GroupIntoBatches >

[jira] [Assigned] (BEAM-1877) Use Iterables.isEmpty in GroupIntoBatches

2017-04-25 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-1877: --- Assignee: Gergely Novák > Use Iterables.isEmpty in GroupIntoBatches >

[jira] [Created] (BEAM-2067) Add support for generic CoderProvider -> CoderFactory mapping with CoderRegistrar

2017-04-24 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2067: --- Summary: Add support for generic CoderProvider -> CoderFactory mapping with CoderRegistrar Key: BEAM-2067 URL: https://issues.apache.org/jira/browse/BEAM-2067 Project: Beam

[jira] [Updated] (BEAM-463) BoundedHeapCoder should be a StandardCoder and not a CustomCoder

2017-04-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-463: --- Fix Version/s: (was: First stable release) > BoundedHeapCoder should be a StandardCoder and not a

[jira] [Updated] (BEAM-760) Validation needs to exist that ValidatesRunner tests execute

2017-04-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-760: --- Fix Version/s: (was: First stable release) > Validation needs to exist that ValidatesRunner tests execute >

[jira] [Updated] (BEAM-464) HolderCoder should be a StandardCoder and not a CustomCoder

2017-04-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-464: --- Affects Version/s: (was: First stable release) > HolderCoder should be a StandardCoder and not a

[jira] [Updated] (BEAM-466) QuantileStateCoder should be a StandardCoder

2017-04-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-466: --- Fix Version/s: (was: First stable release) > QuantileStateCoder should be a StandardCoder >

[jira] [Assigned] (BEAM-2054) Upgrade dataflow.version to v1b3-rev196-1.22.0

2017-04-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2054: --- Assignee: David Rieber (was: Davor Bonaci) > Upgrade dataflow.version to v1b3-rev196-1.22.0 >

[jira] [Resolved] (BEAM-2054) Upgrade dataflow.version to v1b3-rev196-1.22.0

2017-04-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2054. - Resolution: Fixed Fix Version/s: First stable release > Upgrade dataflow.version to

[jira] [Commented] (BEAM-2061) Hint to template job creation in DataflowRunner / DataflowPipelineOptions

2017-04-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981375#comment-15981375 ] Luke Cwik commented on BEAM-2061: - If you would like to take on this task, feel free to assign the issue to

[jira] [Assigned] (BEAM-2020) Move CloudObject to Dataflow runner

2017-04-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2020: --- Assignee: Thomas Groh (was: Luke Cwik) > Move CloudObject to Dataflow runner >

[jira] [Updated] (BEAM-2045) Add ValidatesRunner Tests for Custom Windows, WindowCoders that do not define good equals methods

2017-04-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2045: Description: This exercises a good portion of the runner logic which should only compare windows based on

[jira] [Resolved] (BEAM-2040) Occasional build failures caused by AutoValue

2017-04-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2040. - Resolution: Fixed Fix Version/s: First stable release > Occasional build failures caused by

[jira] [Comment Edited] (BEAM-2021) Fix Java's Coder class hierarchy

2017-04-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977613#comment-15977613 ] Luke Cwik edited comment on BEAM-2021 at 4/20/17 9:49 PM: -- Won't core construction

[jira] [Commented] (BEAM-2021) Fix Java's Coder class hierarchy

2017-04-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977613#comment-15977613 ] Luke Cwik commented on BEAM-2021: - Won't core construction have proto shaded and then shaded proto versions

[jira] [Resolved] (BEAM-1786) AutoService registration of coders, like we do with PipelineRunners

2017-04-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-1786. - Resolution: Fixed > AutoService registration of coders, like we do with PipelineRunners >

[jira] [Commented] (BEAM-1786) AutoService registration of coders, like we do with PipelineRunners

2017-04-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977572#comment-15977572 ] Luke Cwik commented on BEAM-1786: - Users should look at

[jira] [Commented] (BEAM-2021) Fix Java's Coder class hierarchy

2017-04-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977506#comment-15977506 ] Luke Cwik commented on BEAM-2021: - I believe CoderEncoder interface lives in core construction (or another

[jira] [Commented] (BEAM-2026) High performance direct runner

2017-04-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977210#comment-15977210 ] Luke Cwik commented on BEAM-2026: - The python equivalent of the java direct runner is currently not in a

[jira] [Created] (BEAM-2034) Embed example/test data within jars instead of using world readable Google Cloud Storage paths

2017-04-20 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2034: --- Summary: Embed example/test data within jars instead of using world readable Google Cloud Storage paths Key: BEAM-2034 URL: https://issues.apache.org/jira/browse/BEAM-2034

[jira] [Commented] (BEAM-2021) Fix Java's Coder class hierarchy

2017-04-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976987#comment-15976987 ] Luke Cwik commented on BEAM-2021: - We can just use Java serialization for all CustomCoder payloads and we

[jira] [Commented] (BEAM-2026) High performance direct runner

2017-04-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976979#comment-15976979 ] Luke Cwik commented on BEAM-2026: - Some runners have local execution modes like Flink and Spark, would this

[jira] [Commented] (BEAM-2030) Implement beam FileSystem's copy()

2017-04-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976973#comment-15976973 ] Luke Cwik commented on BEAM-2030: - What about concat with a single src path?

[jira] [Updated] (BEAM-1786) AutoService registration of coders, like we do with PipelineRunners

2017-04-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-1786: Fix Version/s: First stable release > AutoService registration of coders, like we do with PipelineRunners >

[jira] [Commented] (BEAM-1786) AutoService registration of coders, like we do with PipelineRunners

2017-04-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975814#comment-15975814 ] Luke Cwik commented on BEAM-1786: - This is needed to thin out the Java SDK core BEAM-1871 otherwise we are

[jira] [Assigned] (BEAM-1786) AutoService registration of coders, like we do with PipelineRunners

2017-04-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-1786: --- Assignee: Luke Cwik > AutoService registration of coders, like we do with PipelineRunners >

[jira] [Resolved] (BEAM-2013) Upgrade to Jackson 2.8.8

2017-04-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2013. - Resolution: Fixed Fix Version/s: First stable release > Upgrade to Jackson 2.8.8 >

[jira] [Resolved] (BEAM-2014) Upgrade to Google Auth 0.6.1

2017-04-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2014. - Resolution: Fixed Fix Version/s: First stable release > Upgrade to Google Auth 0.6.1 >

[jira] [Resolved] (BEAM-2015) Dataflow PostCommit has been failing since build #2814

2017-04-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2015. - Resolution: Fixed Fix Version/s: Not applicable > Dataflow PostCommit has been failing since build

[jira] [Commented] (BEAM-2015) Dataflow PostCommit has been failing since build #2814

2017-04-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975390#comment-15975390 ] Luke Cwik commented on BEAM-2015: - Tests are now passing again:

[jira] [Updated] (BEAM-2015) Dataflow PostCommit has been failing since build #2814

2017-04-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2015: Description: https://builds.apache.org/view/Beam/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/2814/

[jira] [Created] (BEAM-2015) Dataflow PostCommit has been failing since build #2814

2017-04-19 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2015: --- Summary: Dataflow PostCommit has been failing since build #2814 Key: BEAM-2015 URL: https://issues.apache.org/jira/browse/BEAM-2015 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-1871) Thin Java SDK Core

2017-04-17 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-1871: --- Assignee: Luke Cwik > Thin Java SDK Core > -- > > Key: BEAM-1871 >

[jira] [Commented] (BEAM-1970) Cannot run UserScore on Flink runner

2017-04-14 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969234#comment-15969234 ] Luke Cwik commented on BEAM-1970: - The workaround wasn't need on other runners (tried Direct, Spark local

[jira] [Commented] (BEAM-1970) Cannot run UserScore on Flink runner

2017-04-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968254#comment-15968254 ] Luke Cwik commented on BEAM-1970: - The work around is to use a different coder then Avro like

[jira] [Created] (BEAM-1953) Google Credential refresh failures aren't consistently retried

2017-04-12 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-1953: --- Summary: Google Credential refresh failures aren't consistently retried Key: BEAM-1953 URL: https://issues.apache.org/jira/browse/BEAM-1953 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1930) Abstract Coder translation from Runner API Protos

2017-04-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964647#comment-15964647 ] Luke Cwik commented on BEAM-1930: - I think with Jackson/ObjectMapper you could do the same thing and have

[jira] [Commented] (BEAM-463) BoundedHeapCoder should be a StandardCoder and not a CustomCoder

2017-04-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963790#comment-15963790 ] Luke Cwik commented on BEAM-463: The motivation was about getting introspection into the coder components,

[jira] [Assigned] (BEAM-464) HolderCoder should be a StandardCoder and not a CustomCoder

2017-04-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-464: -- Assignee: (was: Luke Cwik) > HolderCoder should be a StandardCoder and not a CustomCoder >

[jira] [Updated] (BEAM-490) Swap to using CoGBK as grouping primitive instead of GBK

2017-04-07 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-490: --- Labels: backwards-incompatible (was: ) > Swap to using CoGBK as grouping primitive instead of GBK >

<    4   5   6   7   8   9   10   >