[jira] [Commented] (BEAM-5710) Compatibility issues with netty 4.1.28 + tcnative 2.0.12 in beam 2.7.0 on dataflow

2018-10-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650610#comment-16650610 ] Luke Cwik commented on BEAM-5710: - This story is slowly being improved and should be better supported with

[jira] [Resolved] (BEAM-5366) Vendor gRPC and Protobuf separately from beam-model-* Java packages

2018-10-18 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-5366. - Resolution: Fixed Fix Version/s: 2.9.0 > Vendor gRPC and Protobuf separately from beam-model-*

[jira] [Created] (BEAM-5798) Add support for dynamic destinations when writing to Kafka

2018-10-19 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-5798: --- Summary: Add support for dynamic destinations when writing to Kafka Key: BEAM-5798 URL: https://issues.apache.org/jira/browse/BEAM-5798 Project: Beam Issue Type: New

[jira] [Comment Edited] (BEAM-5439) StringUtf8Coder is slower than expected

2018-10-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657550#comment-16657550 ] Luke Cwik edited comment on BEAM-5439 at 10/19/18 11:18 PM: The decoding seems

[jira] [Comment Edited] (BEAM-5439) StringUtf8Coder is slower than expected

2018-10-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657550#comment-16657550 ] Luke Cwik edited comment on BEAM-5439 at 10/19/18 11:19 PM: The decoding seems

[jira] [Comment Edited] (BEAM-5439) StringUtf8Coder is slower than expected

2018-10-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657550#comment-16657550 ] Luke Cwik edited comment on BEAM-5439 at 10/19/18 11:18 PM: The decoding seems

[jira] [Commented] (BEAM-5439) StringUtf8Coder is slower than expected

2018-10-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657550#comment-16657550 ] Luke Cwik commented on BEAM-5439: - The decoding seems to have a bug, it needs to loop around the

[jira] [Comment Edited] (BEAM-5439) StringUtf8Coder is slower than expected

2018-10-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657550#comment-16657550 ] Luke Cwik edited comment on BEAM-5439 at 10/19/18 11:17 PM: The decoding seems

[jira] [Updated] (BEAM-5798) Add support for dynamic destinations when writing to Kafka

2018-10-19 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-5798: Labels: newbie starter (was: ) > Add support for dynamic destinations when writing to Kafka >

[jira] [Resolved] (BEAM-5496) MqttIO fails to deserialize checkpoint

2018-10-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-5496. - Resolution: Fixed Fix Version/s: 2.9.0 > MqttIO fails to deserialize checkpoint >

[jira] [Commented] (BEAM-5439) StringUtf8Coder is slower than expected

2018-10-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662934#comment-16662934 ] Luke Cwik commented on BEAM-5439: - Great > StringUtf8Coder is slower than expected >

[jira] [Resolved] (BEAM-5439) StringUtf8Coder is slower than expected

2018-10-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-5439. - Resolution: Fixed Fix Version/s: 2.9.0 > StringUtf8Coder is slower than expected >

[jira] [Assigned] (BEAM-5930) Java SDK harness fails to access state during timer callbacks

2018-10-31 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-5930: --- Assignee: Luke Cwik > Java SDK harness fails to access state during timer callbacks >

[jira] [Updated] (BEAM-5930) Java SDK harness fails to access state during timer callbacks

2018-10-31 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-5930: Labels: portability (was: ) > Java SDK harness fails to access state during timer callbacks >

[jira] [Commented] (BEAM-5919) Build breaks when including Multi-release Jars

2018-10-31 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670519#comment-16670519 ] Luke Cwik commented on BEAM-5919: - Note that

[jira] [Updated] (BEAM-5931) Rollback PR/6899

2018-10-31 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-5931: Description: To rollback this change, one must either: 1) Update nexmark / perf test framework to use

[jira] [Created] (BEAM-5931) Rollback PR/6899

2018-10-31 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-5931: --- Summary: Rollback PR/6899 Key: BEAM-5931 URL: https://issues.apache.org/jira/browse/BEAM-5931 Project: Beam Issue Type: Task Components: beam-model,

[jira] [Commented] (BEAM-5919) Build breaks when including Multi-release Jars

2018-10-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668922#comment-16668922 ] Luke Cwik commented on BEAM-5919: - The error is because after shading we check that all class files are

[jira] [Commented] (BEAM-5881) Compile did not fail when Guava dep was left out

2018-10-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669370#comment-16669370 ] Luke Cwik commented on BEAM-5881: - This is working as intended. You first compile your code using a

[jira] [Resolved] (BEAM-5881) Compile did not fail when Guava dep was left out

2018-10-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-5881. - Resolution: Not A Problem Fix Version/s: Not applicable > Compile did not fail when Guava dep was

[jira] [Assigned] (BEAM-5875) Nexmark perf tests fail due to NoClassDefFoundError for Iterables.

2018-10-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-5875: --- Assignee: Luke Cwik (was: Kenneth Knowles) > Nexmark perf tests fail due to NoClassDefFoundError

[jira] [Commented] (BEAM-5875) Nexmark perf tests fail due to NoClassDefFoundError for Iterables.

2018-10-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669371#comment-16669371 ] Luke Cwik commented on BEAM-5875: - I posted this on the subsequent bug that Kenn cut (BEAM-5881) but

[jira] [Comment Edited] (BEAM-5881) Compile did not fail when Guava dep was left out

2018-10-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669370#comment-16669370 ] Luke Cwik edited comment on BEAM-5881 at 10/30/18 9:43 PM: --- This is working as

[jira] [Assigned] (BEAM-5931) Rollback PR/6899

2018-11-01 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-5931: --- Assignee: Ruoyun Huang > Rollback PR/6899 > > > Key: BEAM-5931 >

[jira] [Commented] (BEAM-308) PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages

2018-10-29 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667591#comment-16667591 ] Luke Cwik commented on BEAM-308: The fix will break users pipelines. Instead I have gone with making this a

[jira] [Updated] (BEAM-308) PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages

2018-10-29 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-308: --- Labels: backwards-incompatible (was: ) > PipelineOptions throws when using package-private PipelineOptions

[jira] [Created] (BEAM-5974) Migrate ByteKeyRangeTracker to use tryClaim(ByteKey.EMPTY) as end of range claim instead of markDone

2018-11-05 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-5974: --- Summary: Migrate ByteKeyRangeTracker to use tryClaim(ByteKey.EMPTY) as end of range claim instead of markDone Key: BEAM-5974 URL: https://issues.apache.org/jira/browse/BEAM-5974

[jira] [Updated] (BEAM-3743) Support for SDF splitting protocol in ULR

2018-11-06 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-3743: Component/s: runner-direct > Support for SDF splitting protocol in ULR >

[jira] [Reopened] (BEAM-3743) Support for SDF splitting protocol in ULR

2018-11-06 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-3743: - Assignee: (was: Eugene Kirpichov) > Support for SDF splitting protocol in ULR >

[jira] [Created] (BEAM-6013) Reduce verbose logging within SerializableCoder

2018-11-07 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-6013: --- Summary: Reduce verbose logging within SerializableCoder Key: BEAM-6013 URL: https://issues.apache.org/jira/browse/BEAM-6013 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-6013) Reduce verbose logging within SerializableCoder

2018-11-08 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6013. - Resolution: Fixed Fix Version/s: 2.9.0 > Reduce verbose logging within SerializableCoder >

[jira] [Updated] (BEAM-6056) Migrate gRPC to use vendoring library and vendoring format

2018-11-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-6056: Description: This thread discusses the work:

[jira] [Resolved] (BEAM-6050) SplittableDoFnTest is failing for many runners

2018-11-13 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6050. - Resolution: Fixed Fix Version/s: Not applicable > SplittableDoFnTest is failing for many runners >

[jira] [Created] (BEAM-6056) Migrate gRPC to use vendoring library and vendoring format

2018-11-13 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-6056: --- Summary: Migrate gRPC to use vendoring library and vendoring format Key: BEAM-6056 URL: https://issues.apache.org/jira/browse/BEAM-6056 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-6067) Dataflow runner should include portable pipeline coder id in CloudObject coder representation

2018-11-14 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-6067: --- Assignee: Craig Chambers (was: Kenneth Knowles) > Dataflow runner should include portable pipeline

[jira] [Assigned] (BEAM-2939) Fn API streaming SDF support

2018-11-14 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2939: --- Assignee: Luke Cwik (was: Eugene Kirpichov) > Fn API streaming SDF support >

[jira] [Resolved] (BEAM-5446) SplittableDoFn: Remove runner time execution information from public API surface

2018-11-12 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-5446. - Resolution: Fixed Fix Version/s: 2.9.0 > SplittableDoFn: Remove runner time execution information

[jira] [Commented] (BEAM-5221) Complile error: invalid LOC header (bad signature)

2018-11-12 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684453#comment-16684453 ] Luke Cwik commented on BEAM-5221: - Shantaru, have you tried deleting

[jira] [Updated] (BEAM-6157) SplittableParDoViaKeyedWorkItems sets another timer when receiving ProcessContinuation#STOP

2018-11-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-6157: Component/s: runner-direct > SplittableParDoViaKeyedWorkItems sets another timer when receiving >

[jira] [Updated] (BEAM-6157) SplittableParDoViaKeyedWorkItems sets another timer when receiving ProcessContinuation#STOP

2018-11-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-6157: Description:

[jira] [Commented] (BEAM-6157) SplittableParDoViaKeyedWorkItems sets another timer when receiving ProcessContinuation#STOP

2018-11-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705015#comment-16705015 ] Luke Cwik commented on BEAM-6157: - Assigning to you Scott for visibility. >

[jira] [Created] (BEAM-6157) SplittableParDoViaKeyedWorkItems sets another timer when receiving ProcessContinuation#STOP

2018-11-30 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-6157: --- Summary: SplittableParDoViaKeyedWorkItems sets another timer when receiving ProcessContinuation#STOP Key: BEAM-6157 URL: https://issues.apache.org/jira/browse/BEAM-6157

[jira] [Assigned] (BEAM-6157) SplittableParDoViaKeyedWorkItems sets another timer when receiving ProcessContinuation#STOP

2018-11-30 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-6157: --- Assignee: Scott Wegner (was: Kenneth Knowles) > SplittableParDoViaKeyedWorkItems sets another timer

[jira] [Assigned] (BEAM-3836) Java SDK harness should understand a BundleSplitRequest and respond with a BundleSplit before bundle finishes

2018-12-05 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-3836: --- Assignee: Luke Cwik (was: Eugene Kirpichov) > Java SDK harness should understand a

[jira] [Closed] (BEAM-6056) Migrate gRPC to use vendoring library and vendoring format

2018-12-07 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-6056. --- Resolution: Fixed Fix Version/s: 2.10.0 > Migrate gRPC to use vendoring library and vendoring format >

[jira] [Commented] (BEAM-6157) SplittableParDoViaKeyedWorkItems sets another timer when receiving ProcessContinuation#STOP

2018-12-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707568#comment-16707568 ] Luke Cwik commented on BEAM-6157: - Not blocking, just good to understand since there is likely a bug here

[jira] [Comment Edited] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695158#comment-16695158 ] Luke Cwik edited comment on BEAM-6102 at 11/21/18 7:29 PM: --- [~mxm] Other then

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695097#comment-16695097 ] Luke Cwik commented on BEAM-6102: - I looked at a failing job and extracted a copy of the

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695123#comment-16695123 ] Luke Cwik commented on BEAM-6102: - I pulled down the

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695157#comment-16695157 ] Luke Cwik commented on BEAM-6102: - Note that the WindowingStrategy.class does not have either of the two

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695158#comment-16695158 ] Luke Cwik commented on BEAM-6102: - [~mxm] Other then its a WindowingStrategy.class that is impacted,

[jira] [Updated] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-6102: Attachment: WindowingStrategy.class > Dataflow cannot deserialize DoFns - incompatible serialVersionUID

[jira] [Comment Edited] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695157#comment-16695157 ] Luke Cwik edited comment on BEAM-6102 at 11/21/18 8:14 PM: --- Note that the

[jira] [Assigned] (BEAM-6102) Wordcount broken on master

2018-11-20 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-6102: --- Assignee: Luke Cwik (was: Kenneth Knowles) > Wordcount broken on master >

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700698#comment-16700698 ] Luke Cwik commented on BEAM-6102: - I pulled it from beam-model-pipeline. For some reason I did not see

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700741#comment-16700741 ] Luke Cwik commented on BEAM-6102: - I'm looking at the shading rules for the worker to see if I can fix

[jira] [Created] (BEAM-6136) Shade conscrypt within the Dataflow legacy worker jar

2018-11-27 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-6136: --- Summary: Shade conscrypt within the Dataflow legacy worker jar Key: BEAM-6136 URL: https://issues.apache.org/jira/browse/BEAM-6136 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-6137) Move DataflowRunnerHarness class underneath org.apache.beam namespace

2018-11-27 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-6137: --- Summary: Move DataflowRunnerHarness class underneath org.apache.beam namespace Key: BEAM-6137 URL: https://issues.apache.org/jira/browse/BEAM-6137 Project: Beam

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701173#comment-16701173 ] Luke Cwik commented on BEAM-6102: - I fixed a bunch more shading issues with the worker and added

[jira] [Created] (BEAM-6142) Improve ByteBuddy DoFnInvoker implementation wrt SplittableDoFns / BundleFinalization

2018-11-27 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-6142: --- Summary: Improve ByteBuddy DoFnInvoker implementation wrt SplittableDoFns / BundleFinalization Key: BEAM-6142 URL: https://issues.apache.org/jira/browse/BEAM-6142 Project:

[jira] [Comment Edited] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701173#comment-16701173 ] Luke Cwik edited comment on BEAM-6102 at 11/28/18 2:20 AM: --- I fixed a bunch more

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-27 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701312#comment-16701312 ] Luke Cwik commented on BEAM-6102: - PR has been merged, need to get this into google so a new worker can be

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695377#comment-16695377 ] Luke Cwik commented on BEAM-6102: - I pushed up some changes fixing some of the Dataflow worker shading

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-21 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695376#comment-16695376 ] Luke Cwik commented on BEAM-6102: - I pushed up some changes fixing some of the Dataflow worker shading

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699792#comment-16699792 ] Luke Cwik commented on BEAM-6102: - I have attached the [^RunnerApi$BeamConstants$Constants.class] class

[jira] [Updated] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-6102: Attachment: RunnerApi$BeamConstants$Constants.class > Dataflow cannot deserialize DoFns - incompatible

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699788#comment-16699788 ] Luke Cwik commented on BEAM-6102: - Building my own container after attempting to fix shading with PR 7116

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699787#comment-16699787 ] Luke Cwik commented on BEAM-6102: - The string version of a serialized DoFnInfo that is placed within the

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702375#comment-16702375 ] Luke Cwik commented on BEAM-6102: - Charles, can you rebuild the dataflow worker after the code is imported

[jira] [Assigned] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-28 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-6102: --- Assignee: Charles Chen (was: Luke Cwik) > Dataflow cannot deserialize DoFns - incompatible

[jira] [Commented] (BEAM-6102) Dataflow cannot deserialize DoFns - incompatible serialVersionUID (JDK or code version mismatch)

2018-11-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699553#comment-16699553 ] Luke Cwik commented on BEAM-6102: - Curiously, when running WordCount using --streaming, the error is:

[jira] [Assigned] (BEAM-6947) TestGCSIO.test_last_updated (gcsio_test.py) fails when the current timezone offset and the timezone offset on 2nd of Jan 1970 differ

2019-04-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-6947: --- Assignee: Csaba Kassai > TestGCSIO.test_last_updated (gcsio_test.py) fails when the current timezone

[jira] [Resolved] (BEAM-6502) SplittableDoFn: Re-Remove runner time execution information from public API surface

2019-04-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6502. - Resolution: Fixed Fix Version/s: 2.13.0 > SplittableDoFn: Re-Remove runner time execution

[jira] [Work started] (BEAM-6502) SplittableDoFn: Re-Remove runner time execution information from public API surface

2019-04-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-6502 started by Luke Cwik. --- > SplittableDoFn: Re-Remove runner time execution information from public API > surface >

[jira] [Updated] (BEAM-6979) Make the standard double coder well known within the Java SDK

2019-04-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-6979: Issue Type: Sub-task (was: Improvement) Parent: BEAM-2939 > Make the standard double coder well

[jira] [Created] (BEAM-6979) Make the standard double coder well known within the Java SDK

2019-04-02 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-6979: --- Summary: Make the standard double coder well known within the Java SDK Key: BEAM-6979 URL: https://issues.apache.org/jira/browse/BEAM-6979 Project: Beam Issue Type:

[jira] [Created] (BEAM-6978) Make Dataflow service receive required restriction encoding parameter on SplittableParDo

2019-04-02 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-6978: --- Summary: Make Dataflow service receive required restriction encoding parameter on SplittableParDo Key: BEAM-6978 URL: https://issues.apache.org/jira/browse/BEAM-6978 Project:

[jira] [Updated] (BEAM-2939) Fn API SDF support

2019-04-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2939: Summary: Fn API SDF support (was: Fn API streaming SDF support) > Fn API SDF support > --

[jira] [Commented] (BEAM-2947) SDK harnesses should be able to indicate panic in FnAPI

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809086#comment-16809086 ] Luke Cwik commented on BEAM-2947: - No but there has been some discussion [~rohdesam] about a health

[jira] [Updated] (BEAM-2220) Move org.apache.beam.sdk.util within google-cloud-platform-core to underneath GCP namespace

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2220: Summary: Move org.apache.beam.sdk.util within google-cloud-platform-core to underneath GCP namespace (was:

[jira] [Assigned] (BEAM-6548) Improve PULL_REQUEST.md template's (user mentions suggestion)

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-6548: --- Assignee: Lukasz Gajowy (was: Luke Cwik) > Improve PULL_REQUEST.md template's (user mentions

[jira] [Resolved] (BEAM-6548) Improve PULL_REQUEST.md template's (user mentions suggestion)

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6548. - Resolution: Fixed Fix Version/s: Not applicable > Improve PULL_REQUEST.md template's (user

[jira] [Resolved] (BEAM-5149) Add support to the Java SDK harness to merge windows

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-5149. - Resolution: Fixed Fix Version/s: 2.12.0 > Add support to the Java SDK harness to merge windows >

[jira] [Resolved] (BEAM-5221) Complile error: invalid LOC header (bad signature)

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-5221. - Resolution: Cannot Reproduce Fix Version/s: Not applicable Closing obsolete issue due to no

[jira] [Commented] (BEAM-2620) Revisit GroupByKey.createWithFewKeys

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809184#comment-16809184 ] Luke Cwik commented on BEAM-2620: - This seems very doable by a runner looking at execution time metrics

[jira] [Assigned] (BEAM-4863) Implement consistentWithEquals/structuralValue on FullWindowedValueCoder

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-4863: --- Assignee: (was: Luke Cwik) > Implement consistentWithEquals/structuralValue on

[jira] [Commented] (BEAM-4863) Implement consistentWithEquals/structuralValue on FullWindowedValueCoder

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809269#comment-16809269 ] Luke Cwik commented on BEAM-4863: - This is blocked until Dataflow has an update strategy where we can

[jira] [Work stopped] (BEAM-4863) Implement consistentWithEquals/structuralValue on FullWindowedValueCoder

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-4863 stopped by Luke Cwik. --- > Implement consistentWithEquals/structuralValue on FullWindowedValueCoder >

[jira] [Commented] (BEAM-6975) Merge portability status into capability matrix

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808873#comment-16808873 ] Luke Cwik commented on BEAM-6975: - >From the user point of view, they should be listed as features, e.g.

[jira] [Assigned] (BEAM-5433) Cleanup Environment.url from beam_runner_api.proto

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-5433: --- Assignee: Luke Cwik (was: Ankur Goenka) > Cleanup Environment.url from beam_runner_api.proto >

[jira] [Assigned] (BEAM-308) PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-308: -- Assignee: Luke Cwik > PipelineOptions throws when using package-private PipelineOptions interfaces >

[jira] [Created] (BEAM-7000) Consider adding support for batching state requests

2019-04-03 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-7000: --- Summary: Consider adding support for batching state requests Key: BEAM-7000 URL: https://issues.apache.org/jira/browse/BEAM-7000 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-7004) Prevent the definition of a Java package from occurring multiple times across multiple artifacts

2019-04-03 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-7004: --- Summary: Prevent the definition of a Java package from occurring multiple times across multiple artifacts Key: BEAM-7004 URL: https://issues.apache.org/jira/browse/BEAM-7004

[jira] [Resolved] (BEAM-308) PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-308. Resolution: Fixed Fix Version/s: 2.13.0 > PipelineOptions throws when using package-private

[jira] [Commented] (BEAM-6519) java extension must not use org.apache.beam.sdk.util

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809375#comment-16809375 ] Luke Cwik commented on BEAM-6519: - I created BEAM-7004 and linked it here as a follow on task to add a

[jira] [Commented] (BEAM-6519) java extension must not use org.apache.beam.sdk.util

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809372#comment-16809372 ] Luke Cwik commented on BEAM-6519: - I ran the following at apache/master with and without PR 8217 {code}

[jira] [Assigned] (BEAM-6519) java extension must not use org.apache.beam.sdk.util

2019-04-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-6519: --- Assignee: Luke Cwik (was: Romain Manni-Bucau) > java extension must not use

[jira] [Resolved] (BEAM-6519) java extension must not use org.apache.beam.sdk.util

2019-04-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6519. - Resolution: Fixed Fix Version/s: 2.13.0 > java extension must not use org.apache.beam.sdk.util >

[jira] [Resolved] (BEAM-2220) Move org.apache.beam.sdk.util within google-cloud-platform-core to underneath GCP namespace

2019-04-04 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2220. - Resolution: Fixed Fix Version/s: 2.13.0 > Move org.apache.beam.sdk.util within

[jira] [Created] (BEAM-7011) Replace "urn:beam:sideinput:materialization:multimap:0.1" with standard side input type materialization

2019-04-04 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-7011: --- Summary: Replace "urn:beam:sideinput:materialization:multimap:0.1" with standard side input type materialization Key: BEAM-7011 URL: https://issues.apache.org/jira/browse/BEAM-7011

  1   2   3   4   5   6   7   8   9   >