[jira] [Updated] (BEAM-2448) FileBasedSink writing to incorrect path when path prefixe has no file component in path (e.g. /tmp/)

2017-06-14 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2448: Description: This was reported by a user on dev@, original report:

[jira] [Updated] (BEAM-2448) FileBasedSink writing to incorrect path when path prefixe has no file component in path (e.g. /tmp/)

2017-06-14 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2448: Affects Version/s: 2.1.0 2.0.0 Description: This was reported by a user on

[jira] [Created] (BEAM-2448) FileBasedSink writing to incorrect path when path prefixe has no file component in path (e.g. /tmp/)

2017-06-14 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2448: --- Summary: FileBasedSink writing to incorrect path when path prefixe has no file component in path (e.g. /tmp/) Key: BEAM-2448 URL: https://issues.apache.org/jira/browse/BEAM-2448

[jira] [Commented] (BEAM-1314) DoFn per-key lifecycle (Setup/Teardown)

2017-06-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048581#comment-16048581 ] Luke Cwik commented on BEAM-1314: - I believe this is more of an implementation detail of how the Java SDK

[jira] [Comment Edited] (BEAM-1314) DoFn per-key lifecycle (Setup/Teardown)

2017-06-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048581#comment-16048581 ] Luke Cwik edited comment on BEAM-1314 at 6/14/17 1:35 AM: -- I believe this is more

[jira] [Commented] (BEAM-2445) DSL SQL to use service locator pattern to automatically register UDFs

2017-06-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048295#comment-16048295 ] Luke Cwik commented on BEAM-2445: - This could be used to register tables as well but I'm not sure if there

[jira] [Updated] (BEAM-2445) DSL SQL to use service locator pattern to automatically register UDFs

2017-06-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2445: Labels: dsl_sql_merge (was: ) > DSL SQL to use service locator pattern to automatically register UDFs >

[jira] [Created] (BEAM-2445) DSL SQL to use service locator pattern to automatically register UDFs

2017-06-13 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2445: --- Summary: DSL SQL to use service locator pattern to automatically register UDFs Key: BEAM-2445 URL: https://issues.apache.org/jira/browse/BEAM-2445 Project: Beam

[jira] [Created] (BEAM-2444) DSL SQL: Use standard java exceptions instead of custom ones

2017-06-13 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2444: --- Summary: DSL SQL: Use standard java exceptions instead of custom ones Key: BEAM-2444 URL: https://issues.apache.org/jira/browse/BEAM-2444 Project: Beam Issue Type:

[jira] [Created] (BEAM-2443) BeamSqlRecordType should migrate to using a builder pattern via AutoValue/AutoBuilder

2017-06-13 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2443: --- Summary: BeamSqlRecordType should migrate to using a builder pattern via AutoValue/AutoBuilder Key: BEAM-2443 URL: https://issues.apache.org/jira/browse/BEAM-2443 Project:

[jira] [Updated] (BEAM-2441) DSL SQL maven module location and name

2017-06-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2441: Description: The current maven module location is *dsl/sql*, unfortunately this occludes the fact that this

[jira] [Updated] (BEAM-2441) DSL SQL maven module location and name

2017-06-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2441: Description: The current maven module location is *dsl/sql*, unfortunately this occludes the fact that this

[jira] [Updated] (BEAM-2441) DSL SQL maven module location and name

2017-06-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2441: Summary: DSL SQL maven module location and name (was: Maven module location and name) > DSL SQL maven

[jira] [Created] (BEAM-2441) Maven module location and name

2017-06-13 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2441: --- Summary: Maven module location and name Key: BEAM-2441 URL: https://issues.apache.org/jira/browse/BEAM-2441 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-2440) DSL SQL: Reduce visibility to simplify backwards compatibility

2017-06-13 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2440: --- Summary: DSL SQL: Reduce visibility to simplify backwards compatibility Key: BEAM-2440 URL: https://issues.apache.org/jira/browse/BEAM-2440 Project: Beam Issue Type:

[jira] [Created] (BEAM-2442) DSL SQL: Public classes/methods should not expose/use calcite types

2017-06-13 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2442: --- Summary: DSL SQL: Public classes/methods should not expose/use calcite types Key: BEAM-2442 URL: https://issues.apache.org/jira/browse/BEAM-2442 Project: Beam Issue

[jira] [Updated] (BEAM-2440) DSL SQL: Reduce visibility to simplify backwards compatibility

2017-06-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2440: Labels: dsl_sql_merge (was: ) > DSL SQL: Reduce visibility to simplify backwards compatibility >

[jira] [Resolved] (BEAM-685) TextIO path pattern error on Windows OS

2017-06-08 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-685. Resolution: Duplicate Assignee: Luke Cwik Fix Version/s: Not applicable Since Java TextIO is

[jira] [Commented] (BEAM-2421) Migrate Dataflow to use impulse primitive as the only root primitive

2017-06-07 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041677#comment-16041677 ] Luke Cwik commented on BEAM-2421: - This is still in the prototyping phase so no tiny doc or discussion

[jira] [Created] (BEAM-2422) Migrate DecodeAndEmitDoFn to be a SplittableDoFn

2017-06-07 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2422: --- Summary: Migrate DecodeAndEmitDoFn to be a SplittableDoFn Key: BEAM-2422 URL: https://issues.apache.org/jira/browse/BEAM-2422 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-1231) Use well known coder types in Java for WindowedValue, GlobalWindow, and LengthPrefix

2017-06-07 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-1231. - Resolution: Fixed Fix Version/s: (was: Not applicable) 2.1.0 > Use well

[jira] [Updated] (BEAM-2421) Migrate Dataflow to use impulse primitive as the only root primitive

2017-06-07 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2421: Component/s: (was: sdk-py) (was: sdk-java-core) runner-dataflow >

[jira] [Reopened] (BEAM-1231) Use well known coder types in Java for WindowedValue, GlobalWindow, and LengthPrefix

2017-06-07 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-1231: - We missed adding support for kind:bytes > Use well known coder types in Java for WindowedValue, GlobalWindow,

[jira] [Commented] (BEAM-2418) Datastore IO does not work out of the box

2017-06-07 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040457#comment-16040457 ] Luke Cwik commented on BEAM-2418: - The way in which you are building your jar file is broken since it

[jira] [Resolved] (BEAM-2418) Datastore IO does not work out of the box

2017-06-07 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2418. - Resolution: Not A Problem Assignee: Luke Cwik (was: Vikas Kedigehalli) Fix Version/s:

[jira] [Commented] (BEAM-2418) Datastore IO does not work out of the box

2017-06-06 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039838#comment-16039838 ] Luke Cwik commented on BEAM-2418: - [~bookman_google] Does build/libs/*.jar contain a jar representing

[jira] [Commented] (BEAM-2392) Avoid use of proto builder clone

2017-06-05 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037687#comment-16037687 ] Luke Cwik commented on BEAM-2392: - Looking at the generated source for *clone*, it seems like using it here

[jira] [Assigned] (BEAM-2392) Avoid use of proto builder clone

2017-05-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2392: --- Assignee: Nigel Kilmer (was: Daniel Halperin) > Avoid use of proto builder clone >

[jira] [Commented] (BEAM-2392) Avoid use of proto builder clone

2017-05-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030453#comment-16030453 ] Luke Cwik commented on BEAM-2392: - How did clone not work for you? If it seems like a bug, we would gladly

[jira] [Created] (BEAM-2391) Migrate to gcloud java core for default GCP project id detection

2017-05-30 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2391: --- Summary: Migrate to gcloud java core for default GCP project id detection Key: BEAM-2391 URL: https://issues.apache.org/jira/browse/BEAM-2391 Project: Beam Issue

[jira] [Commented] (BEAM-2379) SpannerIO tests are failing

2017-05-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029903#comment-16029903 ] Luke Cwik commented on BEAM-2379: - Decided to keep this open to fix the SpannerIO test issue and instead

[jira] [Reopened] (BEAM-2379) SpannerIO tests are failing

2017-05-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-2379: - > SpannerIO tests are failing > --- > > Key: BEAM-2379 >

[jira] [Resolved] (BEAM-2379) SpannerIO tests are failing

2017-05-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2379. - Resolution: Duplicate Fix Version/s: Not applicable > SpannerIO tests are failing >

[jira] [Updated] (BEAM-2131) Need Jenkins tests run outside of Google environments

2017-05-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2131: Description: Now that TravisCI no longer runs, we no longer have coverage for running tests which execute

[jira] [Updated] (BEAM-2131) Need Jenkins tests run outside of Google environments

2017-05-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2131: Summary: Need Jenkins tests run outside of Google environments (was: Google application default credentials

[jira] [Updated] (BEAM-2369) HadoopFileSystem: NullPointerException on match of non existing resource

2017-05-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2369: Fix Version/s: 2.1.0 Component/s: (was: sdk-java-core) sdk-java-extensions >

[jira] [Assigned] (BEAM-2369) HadoopFileSystem: NullPointerException on match of non existing resource

2017-05-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2369: --- Assignee: Michael Luckey (was: Davor Bonaci) > HadoopFileSystem: NullPointerException on match of

[jira] [Commented] (BEAM-2283) Consider using actual URIs instead of Strings/ResourceIds in relation to FileSystems

2017-05-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026609#comment-16026609 ] Luke Cwik commented on BEAM-2283: - Michael Lucky / adude3...@gmail.com reported the following about how

[jira] [Commented] (BEAM-2358) "/test-your-pipeline" example code results in an exception

2017-05-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023132#comment-16023132 ] Luke Cwik commented on BEAM-2358: - It seems as though docs should be telling people to being using

[jira] [Comment Edited] (BEAM-2358) "/test-your-pipeline" example code results in an exception

2017-05-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023132#comment-16023132 ] Luke Cwik edited comment on BEAM-2358 at 5/24/17 3:58 PM: -- It seems as though docs

[jira] [Assigned] (BEAM-2328) Introduce Apache Tika Input component

2017-05-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2328: --- Assignee: Sergey Beryozkin (was: Davor Bonaci) > Introduce Apache Tika Input component >

[jira] [Assigned] (BEAM-2354) Add streaming support to Python DataflowRunner

2017-05-23 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2354: --- Assignee: Ahmet Altay (was: Luke Cwik) > Add streaming support to Python DataflowRunner >

[jira] [Created] (BEAM-2354) Add streaming support to Python DataflowRunner

2017-05-23 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2354: --- Summary: Add streaming support to Python DataflowRunner Key: BEAM-2354 URL: https://issues.apache.org/jira/browse/BEAM-2354 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-2334) OutOfMemoryError in RandomAccessData.java:350

2017-05-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2334. - Resolution: Fixed Fix Version/s: 2.1.0 > OutOfMemoryError in RandomAccessData.java:350 >

[jira] [Resolved] (BEAM-2253) maven archetype poms should have versions controlled automatically based upon root pom.xml versions

2017-05-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2253. - Resolution: Fixed Fix Version/s: 2.1.0 > maven archetype poms should have versions controlled

[jira] [Updated] (BEAM-2293) Top.Largest and Top.Smallest naming is counter-intuitive

2017-05-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2293: Component/s: (was: sdk-java-core) > Top.Largest and Top.Smallest naming is counter-intuitive >

[jira] [Commented] (BEAM-2293) Top.Largest and Top.Smallest naming is counter-intuitive

2017-05-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018024#comment-16018024 ] Luke Cwik commented on BEAM-2293: - This has been fixed in Java SDK with #3139 > Top.Largest and

[jira] [Updated] (BEAM-2293) Top.Largest and Top.Smallest naming is counter-intuitive

2017-05-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2293: Component/s: sdk-py > Top.Largest and Top.Smallest naming is counter-intuitive >

[jira] [Assigned] (BEAM-2293) Top.Largest and Top.Smallest naming is counter-intuitive

2017-05-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2293: --- Assignee: Wesley Tanaka (was: Davor Bonaci) > Top.Largest and Top.Smallest naming is

[jira] [Assigned] (BEAM-2334) OutOfMemoryError in RandomAccessData.java:350

2017-05-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2334: --- Assignee: Romain Yon (was: Kenneth Knowles) > OutOfMemoryError in RandomAccessData.java:350 >

[jira] [Resolved] (BEAM-2252) maven-shade-plugin should be defined in pluginManagement instead of plugins so that the plugin execution order defined by the root pom.xml is used

2017-05-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2252. - Resolution: Fixed Fix Version/s: 2.1.0 > maven-shade-plugin should be defined in pluginManagement

[jira] [Created] (BEAM-2327) Name yyy.version properties using the artifactId instead of an arbitrary name in all pom.xml

2017-05-19 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2327: --- Summary: Name yyy.version properties using the artifactId instead of an arbitrary name in all pom.xml Key: BEAM-2327 URL: https://issues.apache.org/jira/browse/BEAM-2327

[jira] [Commented] (BEAM-1348) Model the Fn Api

2017-05-18 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016590#comment-16016590 ] Luke Cwik commented on BEAM-1348: - Beam Fn API overview: https://s.apache.org/beam-fn-api And for those

[jira] [Assigned] (BEAM-2253) maven archetype poms should have versions controlled automatically based upon root pom.xml versions

2017-05-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2253: --- Assignee: Luke Cwik > maven archetype poms should have versions controlled automatically based upon

[jira] [Assigned] (BEAM-2252) maven-shade-plugin should be defined in pluginManagement instead of plugins so that the plugin execution order defined by the root pom.xml is used

2017-05-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2252: --- Assignee: Luke Cwik > maven-shade-plugin should be defined in pluginManagement instead of plugins >

[jira] [Updated] (BEAM-2298) Java WordCount doesn't work in Window OS for glob expressions or file: prefixed paths

2017-05-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2298: Fix Version/s: 2.1.0 > Java WordCount doesn't work in Window OS for glob expressions or file: > prefixed

[jira] [Updated] (BEAM-2298) Java WordCount doesn't work in Window OS for glob expressions or file: prefixed paths

2017-05-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2298: Summary: Java WordCount doesn't work in Window OS for glob expressions or file: prefixed paths (was: Java

[jira] [Comment Edited] (BEAM-2298) Java WordCount doesn't work in Window OS

2017-05-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010724#comment-16010724 ] Luke Cwik edited comment on BEAM-2298 at 5/15/17 3:36 PM: -- When used with RC4

[jira] [Commented] (BEAM-2298) Java WordCount doesn't work in Window OS

2017-05-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010724#comment-16010724 ] Luke Cwik commented on BEAM-2298: - When used with RC4 release candidate: mvn archetype:generate --debug

[jira] [Comment Edited] (BEAM-2283) Consider using actual URIs instead of Strings/ResourceIds in relation to FileSystems

2017-05-12 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008833#comment-16008833 ] Luke Cwik edited comment on BEAM-2283 at 5/12/17 10:32 PM: --- One proposal is to: *

[jira] [Commented] (BEAM-2283) Consider using actual URIs instead of Strings/ResourceIds in relation to FileSystems

2017-05-12 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008833#comment-16008833 ] Luke Cwik commented on BEAM-2283: - One proposal is to: * read().from("string path") represents an unescaped

[jira] [Resolved] (BEAM-2095) The hasNext method of the iterator returned by SourceRDD#compute is not idempotent

2017-05-12 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2095. - Resolution: Fixed Fix Version/s: (was: 2.1.0) Was cherry picked into release 2.0.0 branch >

[jira] [Created] (BEAM-2283) Consider using actual URIs instead of Strings/ResourceIds in relation to FileSystems

2017-05-12 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2283: --- Summary: Consider using actual URIs instead of Strings/ResourceIds in relation to FileSystems Key: BEAM-2283 URL: https://issues.apache.org/jira/browse/BEAM-2283 Project: Beam

[jira] [Commented] (BEAM-2277) IllegalArgumentException when using Hadoop file system for WordCount example.

2017-05-12 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008367#comment-16008367 ] Luke Cwik commented on BEAM-2277: - The issue with the design is that internal portions of

[jira] [Commented] (BEAM-2095) The hasNext method of the iterator returned by SourceRDD#compute is not idempotent

2017-05-12 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008319#comment-16008319 ] Luke Cwik commented on BEAM-2095: - Cherry-picked into the release. > The hasNext method of the iterator

[jira] [Resolved] (BEAM-2275) SerializableCoder fails to serialize when used with a generic type token

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2275. - Resolution: Fixed Fix Version/s: 2.0.0 > SerializableCoder fails to serialize when used with a

[jira] [Updated] (BEAM-2275) SerializableCoder fails to serialize when used with a generic type token

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2275: Attachment: SerTest.java stacktrace.txt I tried the users supplied code before and after the

[jira] [Updated] (BEAM-2265) Python word count with DirectRunner gets stuck during application termination on Windows

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2265: Attachment: SerTest.java stacktrace.txt I attempted the users test before and after the fix

[jira] [Issue Comment Deleted] (BEAM-2265) Python word count with DirectRunner gets stuck during application termination on Windows

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2265: Comment: was deleted (was: I attempted the users test before and after the fix and can confirm that fixing

[jira] [Updated] (BEAM-2265) Python word count with DirectRunner gets stuck during application termination on Windows

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2265: Attachment: (was: SerTest.java) > Python word count with DirectRunner gets stuck during application

[jira] [Updated] (BEAM-2265) Python word count gets stuck during application termination on Windows

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2265: Affects Version/s: 2.0.0 Priority: Minor (was: Major) > Python word count gets stuck during

[jira] [Updated] (BEAM-2265) Python word count with DirectRunner gets stuck during application termination on Windows

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2265: Summary: Python word count with DirectRunner gets stuck during application termination on Windows (was:

[jira] [Updated] (BEAM-2265) Python word count gets stuck during application termination on Windows

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2265: Description: Using virtualenv 15 + python 2.7.13 + pip 9.0.1 on Windows 2016 Example logs from

[jira] [Commented] (BEAM-2265) Python word count gets stuck during application termination on Windows

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007460#comment-16007460 ] Luke Cwik commented on BEAM-2265: - Turns out I tried 3 more times and was unable to reproduce with

[jira] [Updated] (BEAM-2275) SerializableCoder fails to serialize when used with a generic type token

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2275: Priority: Blocker (was: Major) > SerializableCoder fails to serialize when used with a generic type token >

[jira] [Created] (BEAM-2275) SerializableCoder fails to serialize when used with a generic type token

2017-05-11 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2275: --- Summary: SerializableCoder fails to serialize when used with a generic type token Key: BEAM-2275 URL: https://issues.apache.org/jira/browse/BEAM-2275 Project: Beam

[jira] [Created] (BEAM-2269) Apex Runner unable to launch local cluster on Windows

2017-05-11 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2269: --- Summary: Apex Runner unable to launch local cluster on Windows Key: BEAM-2269 URL: https://issues.apache.org/jira/browse/BEAM-2269 Project: Beam Issue Type: Bug

[jira] [Comment Edited] (BEAM-2265) Python word count gets stuck during application termination on Windows

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007279#comment-16007279 ] Luke Cwik edited comment on BEAM-2265 at 5/11/17 10:05 PM: --- Yes, DataflowRunner

[jira] [Updated] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2264: Description: We should cache the credential used within a Pipeline and re-use it instead of generating a

[jira] [Created] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2017-05-11 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2264: --- Summary: Re-use credential instead of generating a new one one each GCS call Key: BEAM-2264 URL: https://issues.apache.org/jira/browse/BEAM-2264 Project: Beam Issue

[jira] [Resolved] (BEAM-2263) DataflowRunner job json is logged at INFO level

2017-05-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2263. - Resolution: Duplicate Fix Version/s: 0.6.0 > DataflowRunner job json is logged at INFO level >

[jira] [Created] (BEAM-2263) DataflowRunner job json is logged at INFO level

2017-05-11 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2263: --- Summary: DataflowRunner job json is logged at INFO level Key: BEAM-2263 URL: https://issues.apache.org/jira/browse/BEAM-2263 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-2251) Create an examples/java and examples/java8 uber jar that doesn't contain a runner

2017-05-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2251: Description: In addition to the regular artifact examples/java and examples/java8 that are produced,

[jira] [Updated] (BEAM-2251) Create an examples/java and examples/java8 uber jar that doesn't contain a runner

2017-05-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2251: Description: In addition to the regular artifact examples/java and examples/java8 that are produced,

[jira] [Created] (BEAM-2253) maven archetype poms should have versions controlled automatically based upon root pom.xml versions

2017-05-10 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2253: --- Summary: maven archetype poms should have versions controlled automatically based upon root pom.xml versions Key: BEAM-2253 URL: https://issues.apache.org/jira/browse/BEAM-2253

[jira] [Assigned] (BEAM-2252) maven-shade-plugin should be defined in pluginManagement instead of plugins so that the plugin execution order defined by the root pom.xml is used

2017-05-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2252: --- Assignee: (was: Daniel Halperin) > maven-shade-plugin should be defined in pluginManagement

[jira] [Created] (BEAM-2252) maven-shade-plugin should be defined in pluginManagement instead of plugins so that the plugin execution order defined by the root pom.xml is used

2017-05-10 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2252: --- Summary: maven-shade-plugin should be defined in pluginManagement instead of plugins so that the plugin execution order defined by the root pom.xml is used Key: BEAM-2252 URL:

[jira] [Assigned] (BEAM-2251) Create an examples/java and examples/java8 uber jar that doesn't contain a runner

2017-05-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2251: --- Assignee: (was: Frances Perry) > Create an examples/java and examples/java8 uber jar that doesn't

[jira] [Updated] (BEAM-2251) Create an examples/java and examples/java8 uber jar that doesn't contain a runner

2017-05-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2251: Summary: Create an examples/java and examples/java8 uber jar that doesn't contain a runner (was: Create an

[jira] [Created] (BEAM-2251) Create an examples/java and examples/java8 uber jar

2017-05-10 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2251: --- Summary: Create an examples/java and examples/java8 uber jar Key: BEAM-2251 URL: https://issues.apache.org/jira/browse/BEAM-2251 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-2251) Create an examples/java and examples/java8 uber jar

2017-05-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2251: Description: In addition to the regular artifact examples/java and examples/java8 that are produced,

[jira] [Commented] (BEAM-2242) Apache Beam Java modules do not correctly shade test artifacts

2017-05-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005213#comment-16005213 ] Luke Cwik commented on BEAM-2242: - [~vikasrk] #2688 looks like a valuable change to prevent a class of

[jira] [Commented] (BEAM-849) Redesign PipelineResult API

2017-05-10 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004977#comment-16004977 ] Luke Cwik commented on BEAM-849: [~echauchot] Yes, when the output watermark of all the PCollections

[jira] [Created] (BEAM-2243) org.apache.beam.GcpCoreApiSurfaceTest.testApiSurface fails at release-2.0.0 head

2017-05-09 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2243: --- Summary: org.apache.beam.GcpCoreApiSurfaceTest.testApiSurface fails at release-2.0.0 head Key: BEAM-2243 URL: https://issues.apache.org/jira/browse/BEAM-2243 Project: Beam

[jira] [Updated] (BEAM-2242) Apache Beam Java modules do not correctly shade test artifacts

2017-05-09 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2242: Description: javap dump of TextIOTest.class Not the unshaded references to org.apache.commons.compress.*

[jira] [Created] (BEAM-2242) Apache Beam Java modules do not correctly shade test artifacts

2017-05-09 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2242: --- Summary: Apache Beam Java modules do not correctly shade test artifacts Key: BEAM-2242 URL: https://issues.apache.org/jira/browse/BEAM-2242 Project: Beam Issue Type:

[jira] [Issue Comment Deleted] (BEAM-2238) TestPipeline / PipelineOptionsFactory crashes on to unregistered options

2017-05-09 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2238: Comment: was deleted (was: I'm going to take a stab at this.) > TestPipeline / PipelineOptionsFactory

[jira] [Assigned] (BEAM-2238) TestPipeline / PipelineOptionsFactory crashes on to unregistered options

2017-05-09 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2238: --- Assignee: (was: Luke Cwik) > TestPipeline / PipelineOptionsFactory crashes on to unregistered

[jira] [Commented] (BEAM-2238) TestPipeline / PipelineOptionsFactory crashes on to unregistered options

2017-05-09 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003646#comment-16003646 ] Luke Cwik commented on BEAM-2238: - I'm going to take a stab at this. > TestPipeline /

[jira] [Assigned] (BEAM-2238) TestPipeline / PipelineOptionsFactory crashes on to unregistered options

2017-05-09 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2238: --- Assignee: Luke Cwik > TestPipeline / PipelineOptionsFactory crashes on to unregistered options >

<    3   4   5   6   7   8   9   10   >