[jira] [Commented] (BEAM-9999) Remove support for EOLed runners (Apex, etc.)

2020-05-14 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107792#comment-17107792 ] Thomas Weise commented on BEAM-: Apache Apex itself has moved to attic and there are no users of

[jira] [Commented] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-25 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092348#comment-17092348 ] Thomas Weise commented on BEAM-9811: Last build was successful: 

[jira] [Resolved] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-25 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-9811. Fix Version/s: Not applicable Resolution: Fixed > beam_Release_NightlySnapshot failing due

[jira] [Closed] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-25 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-9811. -- > beam_Release_NightlySnapshot failing due to "Failed to publish publication > 'mavenJava'" >

[jira] [Commented] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091792#comment-17091792 ] Thomas Weise commented on BEAM-9811: Due to the dynamic construction of publish tasks with target

[jira] [Comment Edited] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091605#comment-17091605 ] Thomas Weise edited comment on BEAM-9811 at 4/24/20, 2:07 PM: -- Build still

[jira] [Commented] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091605#comment-17091605 ] Thomas Weise commented on BEAM-9811: Build still fails with this change, I will take another look. >

[jira] [Comment Edited] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-23 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090948#comment-17090948 ] Thomas Weise edited comment on BEAM-9811 at 4/23/20, 9:36 PM: -- ./gradlew

[jira] [Commented] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-23 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090948#comment-17090948 ] Thomas Weise commented on BEAM-9811: ./gradlew

[jira] [Commented] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-23 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090934#comment-17090934 ] Thomas Weise commented on BEAM-9811: First failing build: 

[jira] [Resolved] (BEAM-9474) Environment cleanup is not robust enough and may leak resources

2020-03-11 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-9474. Fix Version/s: 2.21.0 Resolution: Fixed > Environment cleanup is not robust enough and may

[jira] [Commented] (BEAM-9298) Drop support for Flink 1.7

2020-02-11 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034809#comment-17034809 ] Thomas Weise commented on BEAM-9298: [~iemejia] yes, this should be on the mailing list. IMO good to

[jira] [Resolved] (BEAM-9060) Flink suppresses stdout/stderr during JobGraph generation from JAR

2020-01-08 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-9060. Fix Version/s: 2.19.0 Resolution: Fixed > Flink suppresses stdout/stderr during JobGraph

[jira] [Resolved] (BEAM-8962) FlinkMetricContainer causes churn in the JobManager and lets the web frontend malfunction

2019-12-27 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-8962. Resolution: Fixed > FlinkMetricContainer causes churn in the JobManager and lets the web frontend

[jira] [Resolved] (BEAM-8816) Load balance bundle processing w/ multiple SDK workers

2019-12-16 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-8816. Fix Version/s: 2.19.0 Resolution: Fixed > Load balance bundle processing w/ multiple SDK

[jira] [Commented] (BEAM-8959) Boolean pipeline options which default to true cannot be set to false

2019-12-12 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994909#comment-16994909 ] Thomas Weise commented on BEAM-8959:

[jira] [Resolved] (BEAM-8815) Portable pipeline execution without artifact staging

2019-12-03 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-8815. Resolution: Fixed > Portable pipeline execution without artifact staging >

[jira] [Commented] (BEAM-8815) Portable pipeline execution without artifact staging

2019-11-26 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982811#comment-16982811 ] Thomas Weise commented on BEAM-8815: [~Ardagan] I'm marking this ticket for 2.17 just so that you see

[jira] [Updated] (BEAM-8815) Portable pipeline execution without artifact staging

2019-11-26 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8815: --- Fix Version/s: 2.17.0 > Portable pipeline execution without artifact staging >

[jira] [Assigned] (BEAM-8815) Portable pipeline execution without artifact staging

2019-11-23 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-8815: -- Assignee: Thomas Weise > Portable pipeline execution without artifact staging >

[jira] [Updated] (BEAM-8816) Load balance bundle processing w/ multiple SDK workers

2019-11-23 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8816: --- Description: We found skewed utilization of SDK workers causing excessive latency with

[jira] [Created] (BEAM-8816) Load balance bundle processing w/ multiple SDK workers

2019-11-23 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8816: -- Summary: Load balance bundle processing w/ multiple SDK workers Key: BEAM-8816 URL: https://issues.apache.org/jira/browse/BEAM-8816 Project: Beam Issue Type:

[jira] [Created] (BEAM-8815) Portable pipeline execution without artifact staging

2019-11-23 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8815: -- Summary: Portable pipeline execution without artifact staging Key: BEAM-8815 URL: https://issues.apache.org/jira/browse/BEAM-8815 Project: Beam Issue Type: Task

[jira] [Updated] (BEAM-8471) Flink native job submission for portable pipelines

2019-11-18 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8471: --- Fix Version/s: (was: 2.18.0) 2.17.0 > Flink native job submission for portable

[jira] [Closed] (BEAM-8670) Manage environment parallelism in DefaultJobBundleFactory

2019-11-15 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-8670. -- Fix Version/s: 2.18.0 Resolution: Fixed > Manage environment parallelism in

[jira] [Created] (BEAM-8670) Manage environment parallelism in DefaultJobBundleFactory

2019-11-14 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8670: -- Summary: Manage environment parallelism in DefaultJobBundleFactory Key: BEAM-8670 URL: https://issues.apache.org/jira/browse/BEAM-8670 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8656) flink_master_url usage in flink_runner.py

2019-11-13 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8656: --- Issue Type: Bug (was: Improvement) > flink_master_url usage in flink_runner.py >

[jira] [Commented] (BEAM-8656) flink_master_url usage in flink_runner.py

2019-11-13 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973934#comment-16973934 ] Thomas Weise commented on BEAM-8656: +1 for updating the website, there are several more things that

[jira] [Commented] (BEAM-8591) Exception is thrown while running Beam Pipeline on Kubernetes Flink Cluster.

2019-11-12 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972922#comment-16972922 ] Thomas Weise commented on BEAM-8591: Please see the following email thread and linked doc for options

[jira] [Commented] (BEAM-5187) Create a ProcessJobBundleFactory for non-dockerized SDK harness

2019-11-12 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972715#comment-16972715 ] Thomas Weise commented on BEAM-5187: The process environment factory that is part of Beam expects the

[jira] [Comment Edited] (BEAM-7870) Externally configured KafkaIO / PubsubIO consumer causes coder problems

2019-11-03 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966364#comment-16966364 ] Thomas Weise edited comment on BEAM-7870 at 11/4/19 2:25 AM: - Thanks for the

[jira] [Commented] (BEAM-7870) Externally configured KafkaIO / PubsubIO consumer causes coder problems

2019-11-03 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966364#comment-16966364 ] Thomas Weise commented on BEAM-7870: Thanks for the update. I would also prefer the specific record

[jira] [Commented] (BEAM-8243) Document behavior of FlinkRunner

2019-11-01 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965163#comment-16965163 ] Thomas Weise commented on BEAM-8243: I meant older Beam releases, we should probably only advertise

[jira] [Commented] (BEAM-8243) Document behavior of FlinkRunner

2019-11-01 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965112#comment-16965112 ] Thomas Weise commented on BEAM-8243: There are IMO enough other reasons to not keep instructions

[jira] [Commented] (BEAM-8243) Document behavior of FlinkRunner

2019-10-31 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964541#comment-16964541 ] Thomas Weise commented on BEAM-8243: Looking forward to see the gradle commands disappear from 

[jira] [Commented] (BEAM-8243) Document behavior of FlinkRunner

2019-10-31 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964534#comment-16964534 ] Thomas Weise commented on BEAM-8243: [~ibzib] [~robertwb] is this going to cover documentation for 

[jira] [Updated] (BEAM-8372) Allow submission of Flink UberJar directly to flink cluster.

2019-10-31 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8372: --- Fix Version/s: 2.17.0 > Allow submission of Flink UberJar directly to flink cluster. >

[jira] [Updated] (BEAM-8372) Allow submission of Flink UberJar directly to flink cluster.

2019-10-31 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8372: --- Labels: portability portability-flink (was: ) > Allow submission of Flink UberJar directly to flink

[jira] [Created] (BEAM-8518) Pipeline options translation fails silently with incompatible jackson-core library

2019-10-29 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8518: -- Summary: Pipeline options translation fails silently with incompatible jackson-core library Key: BEAM-8518 URL: https://issues.apache.org/jira/browse/BEAM-8518 Project:

[jira] [Commented] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-28 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961628#comment-16961628 ] Thomas Weise commented on BEAM-8471: If anyone is interested to try this using curl with a local Flink

[jira] [Closed] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-28 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-8471. -- Fix Version/s: 2.18.0 Resolution: Implemented > Flink native job submission for portable

[jira] [Issue Comment Deleted] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-28 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8471: --- Comment: was deleted (was: CC: [~robertwb], [~ibzib], [~mxm] I'm going to upstream this: 

[jira] [Updated] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8471: --- Description: There are currently two methods to run a portable pipeline written in a non-JVM

[jira] [Created] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-24 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8471: -- Summary: Flink native job submission for portable pipelines Key: BEAM-8471 URL: https://issues.apache.org/jira/browse/BEAM-8471 Project: Beam Issue Type:

[jira] [Closed] (BEAM-8417) Expose ExternalWorkerHandler hostname

2019-10-17 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-8417. -- Fix Version/s: 2.17.0 Resolution: Fixed > Expose ExternalWorkerHandler hostname >

[jira] [Resolved] (BEAM-8387) Remove sdk-worker-parallelism option from JobServerDriver

2019-10-14 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-8387. Fix Version/s: 2.17.0 Resolution: Fixed > Remove sdk-worker-parallelism option from

[jira] [Updated] (BEAM-8387) Remove sdk-worker-parallelism option from JobServerDriver

2019-10-14 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8387: --- Status: Open (was: Triage Needed) > Remove sdk-worker-parallelism option from JobServerDriver >

[jira] [Resolved] (BEAM-8183) Optionally bundle multiple pipelines into a single Flink jar

2019-10-11 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-8183. Fix Version/s: 2.17.0 Resolution: Implemented > Optionally bundle multiple pipelines into a

[jira] [Created] (BEAM-8387) Remove sdk-worker-parallelism option from JobServerDriver

2019-10-11 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8387: -- Summary: Remove sdk-worker-parallelism option from JobServerDriver Key: BEAM-8387 URL: https://issues.apache.org/jira/browse/BEAM-8387 Project: Beam Issue Type:

[jira] [Commented] (BEAM-8115) Overwrite portable Flink application jar pipeline options at runtime

2019-10-11 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949726#comment-16949726 ] Thomas Weise commented on BEAM-8115: The first case will allow to change all runner and SDK worker

[jira] [Closed] (BEAM-7980) External environment with containerized worker pool

2019-10-08 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-7980. -- Resolution: Implemented > External environment with containerized worker pool >

[jira] [Reopened] (BEAM-7980) External environment with containerized worker pool

2019-10-08 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reopened BEAM-7980: > External environment with containerized worker pool >

[jira] [Resolved] (BEAM-6829) Duplicate metric warnings clutter log

2019-10-08 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-6829. Fix Version/s: 2.17.0 Resolution: Fixed > Duplicate metric warnings clutter log >

[jira] [Assigned] (BEAM-8351) Support passing in arbitrary KV pairs to sdk worker via external environment config

2019-10-04 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-8351: -- Assignee: Wanqi Lyu > Support passing in arbitrary KV pairs to sdk worker via external

[jira] [Commented] (BEAM-8183) Optionally bundle multiple pipelines into a single Flink jar

2019-10-03 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943638#comment-16943638 ] Thomas Weise commented on BEAM-8183: BEAM-8115 is indeed orthogonal and applicable for the cases where

[jira] [Commented] (BEAM-8183) Optionally bundle multiple pipelines into a single Flink jar

2019-10-02 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943170#comment-16943170 ] Thomas Weise commented on BEAM-8183: {quote}The major issue to me seems to be that we need to execute

[jira] [Commented] (BEAM-8183) Optionally bundle multiple pipelines into a single Flink jar

2019-10-02 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943015#comment-16943015 ] Thomas Weise commented on BEAM-8183: For context: 

[jira] [Commented] (BEAM-8183) Optionally bundle multiple pipelines into a single Flink jar

2019-09-27 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939795#comment-16939795 ] Thomas Weise commented on BEAM-8183: Hi Kyle, I have setup my Flink image build to use the jar file

[jira] [Commented] (BEAM-6733) Use Flink 1.6/1.7 prepareSnapshotPreBarrier to replace BufferedOutputManager

2019-09-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936920#comment-16936920 ] Thomas Weise commented on BEAM-6733: This has an effect on checkpointing that is probably worth

[jira] [Commented] (BEAM-8157) Key encoding for state requests is not consistent across SDKs

2019-09-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936835#comment-16936835 ] Thomas Weise commented on BEAM-8157: I would probably not backport since 2.16 doesn't have this issue

[jira] [Resolved] (BEAM-7722) Simplify running of Beam Python on Flink

2019-09-11 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-7722. Fix Version/s: 2.16.0 Resolution: Implemented > Simplify running of Beam Python on Flink >

[jira] [Updated] (BEAM-7962) Drop support for Flink 1.5 and 1.6

2019-09-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7962: --- Issue Type: Task (was: Bug) > Drop support for Flink 1.5 and 1.6 >

[jira] [Commented] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-09-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926685#comment-16926685 ] Thomas Weise commented on BEAM-7730: Removing 2.16 fix version, this is not a release blocker.   >

[jira] [Updated] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-09-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7730: --- Fix Version/s: (was: 2.16.0) > Add Flink 1.9 build target and Make FlinkRunner compatible with

[jira] [Commented] (BEAM-7962) Drop support for Flink 1.5 and 1.6

2019-09-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926684#comment-16926684 ] Thomas Weise commented on BEAM-7962: [~markflyhigh] this issue does not block the 2.16 release. I

[jira] [Updated] (BEAM-7962) Drop support for Flink 1.5 and 1.6

2019-09-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7962: --- Fix Version/s: (was: 2.16.0) > Drop support for Flink 1.5 and 1.6 >

[jira] [Resolved] (BEAM-7980) External environment with containerized worker pool

2019-09-03 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-7980. Fix Version/s: 2.16.0 Resolution: Incomplete > External environment with containerized

[jira] [Created] (BEAM-8137) Worker pool option for Java SDK container

2019-09-03 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8137: -- Summary: Worker pool option for Java SDK container Key: BEAM-8137 URL: https://issues.apache.org/jira/browse/BEAM-8137 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-8115) Overwrite portable Flink application jar pipeline options at runtime

2019-08-30 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919657#comment-16919657 ] Thomas Weise commented on BEAM-8115: I believe this is would have to include support for user pipeline

[jira] [Closed] (BEAM-8038) Python Precommit fail: 'BeamFnExternalWorkerPoolServicer' has no attribute '_worker_processes'

2019-08-22 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-8038. -- Fix Version/s: Not applicable Resolution: Fixed > Python Precommit fail:

[jira] [Commented] (BEAM-8038) Python Precommit fail: 'BeamFnExternalWorkerPoolServicer' has no attribute '_worker_processes'

2019-08-22 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913571#comment-16913571 ] Thomas Weise commented on BEAM-8038: Ouch, there is a self. missing. Will send a PR now. > Python

[jira] [Updated] (BEAM-7980) External environment with containerized worker pool

2019-08-14 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7980: --- Description: Augment Beam Python docker image and boot.go so that it can be used to launch

[jira] [Created] (BEAM-7980) External environment with containerized worker pool

2019-08-14 Thread Thomas Weise (JIRA)
Thomas Weise created BEAM-7980: -- Summary: External environment with containerized worker pool Key: BEAM-7980 URL: https://issues.apache.org/jira/browse/BEAM-7980 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-7141) Expose kv and window parameters for on_timer

2019-08-04 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-7141. Resolution: Fixed Fix Version/s: 2.14.0 > Expose kv and window parameters for on_timer >

[jira] [Commented] (BEAM-7868) Hidden Flink Runner parameters are dropped in python pipelines

2019-07-31 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897703#comment-16897703 ] Thomas Weise commented on BEAM-7868: What means "hidden" and what do you expect to happen?   >

[jira] [Closed] (BEAM-7597) Typo: Correct "it's" to "its"

2019-06-20 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-7597. -- Resolution: Fixed Fix Version/s: Not applicable Thanks for the contribution!   > Typo: Correct

[jira] [Commented] (BEAM-1318) PipelineOptions should warn if there are unused options

2019-06-16 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865001#comment-16865001 ] Thomas Weise commented on BEAM-1318: A warning is now logged when options are discarded: 

[jira] [Closed] (BEAM-1318) PipelineOptions should warn if there are unused options

2019-06-16 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-1318. -- Resolution: Done Fix Version/s: 2.11.0 > PipelineOptions should warn if there are unused options

[jira] [Resolved] (BEAM-7348) Option to expire SDK worker environments

2019-05-23 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-7348. Resolution: Implemented Fix Version/s: 2.14.0 > Option to expire SDK worker environments >

[jira] [Commented] (BEAM-2591) Python shim for submitting to FlinkRunner

2019-05-22 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846080#comment-16846080 ] Thomas Weise commented on BEAM-2591: It is possible to spin up a job server and run Flink in embedded

[jira] [Closed] (BEAM-2591) Python shim for submitting to FlinkRunner

2019-05-22 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-2591. -- Resolution: Resolved Fix Version/s: Not applicable Runners are implicitly identified through the

[jira] [Work started] (BEAM-7348) Option to expire SDK worker environments

2019-05-17 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-7348 started by Thomas Weise. -- > Option to expire SDK worker environments >

[jira] [Updated] (BEAM-7348) Option to expire SDK worker environments

2019-05-17 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7348: --- Status: Open (was: Triage Needed) > Option to expire SDK worker environments >

[jira] [Created] (BEAM-7348) Option to expire SDK worker environments

2019-05-17 Thread Thomas Weise (JIRA)
Thomas Weise created BEAM-7348: -- Summary: Option to expire SDK worker environments Key: BEAM-7348 URL: https://issues.apache.org/jira/browse/BEAM-7348 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-7126) Double encoding of state keys in portable Flink runner

2019-05-14 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839595#comment-16839595 ] Thomas Weise commented on BEAM-7126: [~mxm] should the fix version be 2.14 or are you going to add

[jira] [Updated] (BEAM-7171) New bundles may start within snapshotState

2019-04-29 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7171: --- Labels: portability-flink (was: ) > New bundles may start within snapshotState >

[jira] [Commented] (BEAM-7171) New bundles may start within snapshotState

2019-04-29 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829270#comment-16829270 ] Thomas Weise commented on BEAM-7171: A possible solution is to replace the "finish bundle callback"

[jira] [Created] (BEAM-7171) New bundles may start within snapshotState

2019-04-29 Thread Thomas Weise (JIRA)
Thomas Weise created BEAM-7171: -- Summary: New bundles may start within snapshotState Key: BEAM-7171 URL: https://issues.apache.org/jira/browse/BEAM-7171 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-7141) Expose kv and window parameters for on_timer

2019-04-24 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825522#comment-16825522 ] Thomas Weise commented on BEAM-7141: WindowedValue passed from Flink side:  

[jira] [Created] (BEAM-7141) Expose kv and window parameters for on_timer

2019-04-24 Thread Thomas Weise (JIRA)
Thomas Weise created BEAM-7141: -- Summary: Expose kv and window parameters for on_timer Key: BEAM-7141 URL: https://issues.apache.org/jira/browse/BEAM-7141 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-7015) Have only a single definition of standard_coders.yaml

2019-04-24 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-7015. Resolution: Fixed Fix Version/s: 2.13.0 > Have only a single definition of

[jira] [Commented] (BEAM-7058) Python SDK metric process_bundle_msecs reported as zero

2019-04-24 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825149#comment-16825149 ] Thomas Weise commented on BEAM-7058: [~ajam...@google.com] any update? > Python SDK metric

[jira] [Commented] (BEAM-7127) Timer parameter not supported in timer callback

2019-04-22 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823642#comment-16823642 ] Thomas Weise commented on BEAM-7127: [~altay] the issue can be reproduced with the Flink runner: 

[jira] [Commented] (BEAM-7127) Timer parameter not supported in timer callback

2019-04-21 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822730#comment-16822730 ] Thomas Weise commented on BEAM-7127: {code:java}   File

[jira] [Created] (BEAM-7127) Timer parameter not supported in timer callback

2019-04-21 Thread Thomas Weise (JIRA)
Thomas Weise created BEAM-7127: -- Summary: Timer parameter not supported in timer callback Key: BEAM-7127 URL: https://issues.apache.org/jira/browse/BEAM-7127 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-6876) User state cleanup in portable Flink runner

2019-04-20 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822584#comment-16822584 ] Thomas Weise commented on BEAM-6876: Bumped the fix version since this is still broken in 2.12 > User

[jira] [Updated] (BEAM-6876) User state cleanup in portable Flink runner

2019-04-20 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-6876: --- Fix Version/s: (was: 2.12.0) 2.13.0 > User state cleanup in portable Flink

[jira] [Created] (BEAM-7126) Double encoding of state keys in portable Flink runner

2019-04-20 Thread Thomas Weise (JIRA)
Thomas Weise created BEAM-7126: -- Summary: Double encoding of state keys in portable Flink runner Key: BEAM-7126 URL: https://issues.apache.org/jira/browse/BEAM-7126 Project: Beam Issue Type:

[jira] [Created] (BEAM-7112) State cleanup interferes with user timer callback

2019-04-18 Thread Thomas Weise (JIRA)
Thomas Weise created BEAM-7112: -- Summary: State cleanup interferes with user timer callback Key: BEAM-7112 URL: https://issues.apache.org/jira/browse/BEAM-7112 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-7035) Clear() method of OutputTimer is inconsistent

2019-04-18 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7035: --- Component/s: (was: beam-model) sdk-py-harness > Clear() method of OutputTimer is

  1   2   3   >