[jira] [Commented] (BEAM-8337) Add Flink job server container images to release process

2019-12-12 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995271#comment-16995271 ] Kyle Weaver commented on BEAM-8337: --- PRs adding Flink containers to the container publishing scripts

[jira] [Resolved] (BEAM-8867) sparkValidatesRunner - python post commit flaky

2019-12-12 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8867. --- Fix Version/s: Not applicable Resolution: Fixed > sparkValidatesRunner - python post commit

[jira] [Resolved] (BEAM-8139) Execute portable Spark application jar

2019-12-12 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8139. --- Fix Version/s: 2.19.0 Resolution: Fixed > Execute portable Spark application jar >

[jira] [Resolved] (BEAM-8870) beam_PostCommit_Python_VR_Spark is permanently failing

2019-12-09 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8870. --- Fix Version/s: Not applicable Resolution: Fixed > beam_PostCommit_Python_VR_Spark is

[jira] [Commented] (BEAM-8274) Remove dependency on experiments=beam_fn_api flag from PortableRunner

2019-12-09 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992061#comment-16992061 ] Kyle Weaver commented on BEAM-8274: --- Do we still want to do this? Enabling beam_fn_api by default seems

[jira] [Commented] (BEAM-8512) Add integration tests for Python "flink_runner.py"

2019-12-09 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992050#comment-16992050 ] Kyle Weaver commented on BEAM-8512: --- For the record: 1) was because the classes that needed to do the

[jira] [Commented] (BEAM-8915) Run flink_runner_test and spark_runner_test using tox

2019-12-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990266#comment-16990266 ] Kyle Weaver commented on BEAM-8915: --- cc [~udim] > Run flink_runner_test and spark_runner_test using tox

[jira] [Created] (BEAM-8915) Run flink_runner_test and spark_runner_test using tox

2019-12-06 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8915: - Summary: Run flink_runner_test and spark_runner_test using tox Key: BEAM-8915 URL: https://issues.apache.org/jira/browse/BEAM-8915 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8915) Run flink_runner_test and spark_runner_test using tox

2019-12-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8915: -- Status: Open (was: Triage Needed) > Run flink_runner_test and spark_runner_test using tox >

[jira] [Commented] (BEAM-8914) state handlerNotFound exception

2019-12-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990253#comment-16990253 ] Kyle Weaver commented on BEAM-8914: --- When I rebuilt the job server container (./gradlew

[jira] [Closed] (BEAM-8914) state handlerNotFound exception

2019-12-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver closed BEAM-8914. - Fix Version/s: Not applicable Resolution: Workaround > state handlerNotFound exception >

[jira] [Created] (BEAM-8914) state handlerNotFound exception

2019-12-06 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8914: - Summary: state handlerNotFound exception Key: BEAM-8914 URL: https://issues.apache.org/jira/browse/BEAM-8914 Project: Beam Issue Type: Bug Components:

[jira] [Comment Edited] (BEAM-8912) PreCommit_Python2_PVR_Flink_Commit flaky

2019-12-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990196#comment-16990196 ] Kyle Weaver edited comment on BEAM-8912 at 12/6/19 10:24 PM: - Running

[jira] [Commented] (BEAM-8912) PreCommit_Python2_PVR_Flink_Commit flaky

2019-12-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990196#comment-16990196 ] Kyle Weaver commented on BEAM-8912: --- Running

[jira] [Commented] (BEAM-8912) PreCommit_Python2_PVR_Flink_Commit flaky

2019-12-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990194#comment-16990194 ] Kyle Weaver commented on BEAM-8912: --- I also see errors like: ValueError: OffsetRestrictionTracker is

[jira] [Commented] (BEAM-8912) PreCommit_Python2_PVR_Flink_Commit flaky

2019-12-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990184#comment-16990184 ] Kyle Weaver commented on BEAM-8912: --- Looks like the runner can't connect to the (loopback) worker

[jira] [Commented] (BEAM-8912) PreCommit_Python2_PVR_Flink_Commit flaky

2019-12-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990180#comment-16990180 ] Kyle Weaver commented on BEAM-8912: --- "Failed to remove job staging directory" is not the root cause --

[jira] [Updated] (BEAM-8912) PreCommit_Python2_PVR_Flink_Commit flaky

2019-12-06 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8912: -- Status: Open (was: Triage Needed) > PreCommit_Python2_PVR_Flink_Commit flaky >

[jira] [Commented] (BEAM-8835) Artifact retrieval fails with FlinkUberJarJobServer

2019-12-05 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989314#comment-16989314 ] Kyle Weaver commented on BEAM-8835: --- No, just covered over when we hid FlinkUberJarJobServer behind a

[jira] [Assigned] (BEAM-8835) Artifact retrieval fails with FlinkUberJarJobServer

2019-12-05 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-8835: - Assignee: Kyle Weaver > Artifact retrieval fails with FlinkUberJarJobServer >

[jira] [Updated] (BEAM-8835) Artifact retrieval fails with FlinkUberJarJobServer

2019-12-05 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8835: -- Status: Open (was: Triage Needed) > Artifact retrieval fails with FlinkUberJarJobServer >

[jira] [Created] (BEAM-8899) Artifact retrieval failure logs at info level

2019-12-05 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8899: - Summary: Artifact retrieval failure logs at info level Key: BEAM-8899 URL: https://issues.apache.org/jira/browse/BEAM-8899 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-8891) Create and submit Spark portable jar in Python

2019-12-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8891: -- Status: Open (was: Triage Needed) > Create and submit Spark portable jar in Python >

[jira] [Created] (BEAM-8891) Create and submit Spark portable jar in Python

2019-12-04 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8891: - Summary: Create and submit Spark portable jar in Python Key: BEAM-8891 URL: https://issues.apache.org/jira/browse/BEAM-8891 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-8628) testDefaultGcpTempLocationDoesNotExist is environment-dependent

2019-12-04 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8628. --- Fix Version/s: Not applicable Resolution: Fixed > testDefaultGcpTempLocationDoesNotExist is

[jira] [Updated] (BEAM-8883) downgrade "Failed to remove job staging directory" log level

2019-12-03 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8883: -- Status: Open (was: Triage Needed) > downgrade "Failed to remove job staging directory" log level >

[jira] [Created] (BEAM-8883) downgrade "Failed to remove job staging directory" log level

2019-12-03 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8883: - Summary: downgrade "Failed to remove job staging directory" log level Key: BEAM-8883 URL: https://issues.apache.org/jira/browse/BEAM-8883 Project: Beam Issue

[jira] [Commented] (BEAM-8867) sparkValidatesRunner - python post commit flaky

2019-12-03 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987355#comment-16987355 ] Kyle Weaver commented on BEAM-8867: --- Doesn't look like "Failed to remove job staging directory" is the

[jira] [Commented] (BEAM-8870) beam_PostCommit_Python_VR_Spark is permanently failing

2019-12-03 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987344#comment-16987344 ] Kyle Weaver commented on BEAM-8870: --- There are two tests that are consistently failing:

[jira] [Closed] (BEAM-8863) correct/clarify docs -- "Custom images are not yet supported"

2019-12-02 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver closed BEAM-8863. - Fix Version/s: Not applicable Resolution: Fixed > correct/clarify docs -- "Custom images are not

[jira] [Commented] (BEAM-8512) Add integration tests for Python "flink_runner.py"

2019-12-02 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986409#comment-16986409 ] Kyle Weaver commented on BEAM-8512: --- > I think these two are release blockers, what do you think?

[jira] [Updated] (BEAM-8870) beam_PostCommit_Python_VR_Spark is permanently failing

2019-12-02 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8870: -- Status: Open (was: Triage Needed) > beam_PostCommit_Python_VR_Spark is permanently failing >

[jira] [Updated] (BEAM-8867) sparkValidatesRunner - python post commit flaky

2019-12-02 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8867: -- Status: Open (was: Triage Needed) > sparkValidatesRunner - python post commit flaky >

[jira] [Commented] (BEAM-8870) beam_PostCommit_Python_VR_Spark is permanently failing

2019-12-02 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986391#comment-16986391 ] Kyle Weaver commented on BEAM-8870: --- I wasn't previously aware of this issue; will look into it. Looks

[jira] [Commented] (BEAM-7219) Spark portable runner: support Spark metrics

2019-12-02 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986374#comment-16986374 ] Kyle Weaver commented on BEAM-7219: --- Linking this here for my reference:

[jira] [Assigned] (BEAM-8863) correct/clarify docs -- "Custom images are not yet supported"

2019-12-02 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-8863: - Assignee: Kyle Weaver > correct/clarify docs -- "Custom images are not yet supported" >

[jira] [Updated] (BEAM-8863) correct/clarify docs -- "Custom images are not yet supported"

2019-12-02 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8863: -- Description: 'I tried following https://beam .apache.org/documentation/runtime/environments/ but get a

[jira] [Created] (BEAM-8863) correct/clarify docs -- "Custom images are not yet supported"

2019-12-02 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8863: - Summary: correct/clarify docs -- "Custom images are not yet supported" Key: BEAM-8863 URL: https://issues.apache.org/jira/browse/BEAM-8863 Project: Beam Issue

[jira] [Commented] (BEAM-8512) Add integration tests for Python "flink_runner.py"

2019-11-26 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983039#comment-16983039 ] Kyle Weaver commented on BEAM-8512: --- I set up tests, but I am getting a couple errors with

[jira] [Created] (BEAM-8835) Artifact retrieval fails with FlinkUberJarJobServer

2019-11-26 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8835: - Summary: Artifact retrieval fails with FlinkUberJarJobServer Key: BEAM-8835 URL: https://issues.apache.org/jira/browse/BEAM-8835 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-8834) setDefaultPipelineOptions causes seg fault

2019-11-26 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8834: - Summary: setDefaultPipelineOptions causes seg fault Key: BEAM-8834 URL: https://issues.apache.org/jira/browse/BEAM-8834 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-8512) Add integration tests for Python "flink_runner.py"

2019-11-26 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982803#comment-16982803 ] Kyle Weaver commented on BEAM-8512: --- Thanks Max, it is working now :) > Add integration tests for

[jira] [Comment Edited] (BEAM-8512) Add integration tests for Python "flink_runner.py"

2019-11-25 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982047#comment-16982047 ] Kyle Weaver edited comment on BEAM-8512 at 11/26/19 1:56 AM: - I'm trying to

[jira] [Commented] (BEAM-8512) Add integration tests for Python "flink_runner.py"

2019-11-25 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982047#comment-16982047 ] Kyle Weaver commented on BEAM-8512: --- I'm trying to get the MiniCluster to work with

[jira] [Updated] (BEAM-8793) installGcpTest task flakes (python setup.py egg_info fails)

2019-11-25 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8793: -- Summary: installGcpTest task flakes (python setup.py egg_info fails) (was: installGcpTest task flakes)

[jira] [Updated] (BEAM-8793) installGcpTest task flakes

2019-11-25 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8793: -- Description: This seems to affect the installGcpTest task for all python versions. There are a few

[jira] [Created] (BEAM-8813) Java updateOfflineRepository fails

2019-11-22 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8813: - Summary: Java updateOfflineRepository fails Key: BEAM-8813 URL: https://issues.apache.org/jira/browse/BEAM-8813 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-8813) Java updateOfflineRepository fails

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8813: -- Issue Type: Bug (was: Improvement) > Java updateOfflineRepository fails >

[jira] [Commented] (BEAM-6763) Publish Portability artifacts

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980552#comment-16980552 ] Kyle Weaver commented on BEAM-6763: --- 2. and 3. from the description are complete, so I will mark this as

[jira] [Resolved] (BEAM-6763) Publish Portability artifacts

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-6763. --- Fix Version/s: Not applicable Resolution: Fixed > Publish Portability artifacts >

[jira] [Updated] (BEAM-8337) Add Flink job server container images to release process

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8337: -- Summary: Add Flink job server container images to release process (was: Publish Flink job server

[jira] [Assigned] (BEAM-8337) Publish Flink job server container images

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-8337: - Assignee: Kyle Weaver > Publish Flink job server container images >

[jira] [Updated] (BEAM-8337) Publish Flink job server container images

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8337: -- Component/s: (was: runner-spark) > Publish Flink job server container images >

[jira] [Updated] (BEAM-8337) Publish Flink job server container images

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8337: -- Summary: Publish Flink job server container images (was: Consider publishing portable job server

[jira] [Commented] (BEAM-8337) Consider publishing portable job server container images

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980549#comment-16980549 ] Kyle Weaver commented on BEAM-8337: --- As part of the effort to make the Flink runner Kubernetes-friendly,

[jira] [Resolved] (BEAM-8796) Optionally configure static job port for JavaJarJobServer

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8796. --- Fix Version/s: 2.18.0 Resolution: Fixed > Optionally configure static job port for

[jira] [Resolved] (BEAM-8781) FlinkUberJarJobServer should respect --flink_job_server_jar

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8781. --- Fix Version/s: 2.18.0 Resolution: Fixed > FlinkUberJarJobServer should respect

[jira] [Resolved] (BEAM-8658) Optionally set artifact staging port in FlinkUberJarJobServer

2019-11-22 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8658. --- Fix Version/s: 2.18.0 Resolution: Fixed > Optionally set artifact staging port in

[jira] [Created] (BEAM-8805) Remove obsolete worker_threads experiment in tests

2019-11-21 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8805: - Summary: Remove obsolete worker_threads experiment in tests Key: BEAM-8805 URL: https://issues.apache.org/jira/browse/BEAM-8805 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8805) Remove obsolete worker_threads experiment in tests

2019-11-21 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8805: -- Status: Open (was: Triage Needed) > Remove obsolete worker_threads experiment in tests >

[jira] [Assigned] (BEAM-8512) Add integration tests for Python "flink_runner.py"

2019-11-21 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-8512: - Assignee: Kyle Weaver (was: Robert Bradshaw) > Add integration tests for Python

[jira] [Created] (BEAM-8797) Add artifactEndpoint to PortablePipelineOptions.java

2019-11-20 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8797: - Summary: Add artifactEndpoint to PortablePipelineOptions.java Key: BEAM-8797 URL: https://issues.apache.org/jira/browse/BEAM-8797 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8797) Add artifactEndpoint to PortablePipelineOptions.java

2019-11-20 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8797: -- Status: Open (was: Triage Needed) > Add artifactEndpoint to PortablePipelineOptions.java >

[jira] [Resolved] (BEAM-8795) runners:spark:compileJava broken on master

2019-11-20 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8795. --- Fix Version/s: Not applicable Resolution: Fixed > runners:spark:compileJava broken on master >

[jira] [Updated] (BEAM-8796) Optionally configure static job port for JavaJarJobServer

2019-11-20 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8796: -- Status: Open (was: Triage Needed) > Optionally configure static job port for JavaJarJobServer >

[jira] [Created] (BEAM-8796) Optionally configure static job port for JavaJarJobServer

2019-11-20 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8796: - Summary: Optionally configure static job port for JavaJarJobServer Key: BEAM-8796 URL: https://issues.apache.org/jira/browse/BEAM-8796 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8793) installGcpTest task flakes

2019-11-20 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8793: -- Description: I've also seen this happen with :sdks:python:test-suites:portable:py37:installGcpTest.

[jira] [Updated] (BEAM-8795) runners:spark:compileJava broken on master

2019-11-20 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8795: -- Status: Open (was: Triage Needed) > runners:spark:compileJava broken on master >

[jira] [Created] (BEAM-8795) runners:spark:compileJava broken on master

2019-11-20 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8795: - Summary: runners:spark:compileJava broken on master Key: BEAM-8795 URL: https://issues.apache.org/jira/browse/BEAM-8795 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-8793) installGcpTest task flakes

2019-11-20 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8793: -- Summary: installGcpTest task flakes (was: :sdks:python:test-suites:direct:py3x:installGcpTest flakes)

[jira] [Updated] (BEAM-8793) :sdks:python:test-suites:direct:py3x:installGcpTest flakes

2019-11-20 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8793: -- Description: I've also seen this happen with :sdks:python:test-suites:portable:py37:installGcpTest.

[jira] [Created] (BEAM-8793) :sdks:python:test-suites:direct:py3x:installGcpTest flakes

2019-11-20 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8793: - Summary: :sdks:python:test-suites:direct:py3x:installGcpTest flakes Key: BEAM-8793 URL: https://issues.apache.org/jira/browse/BEAM-8793 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8781) FlinkUberJarJobServer should respect --flink_job_server_jar

2019-11-19 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8781: -- Status: Open (was: Triage Needed) > FlinkUberJarJobServer should respect --flink_job_server_jar >

[jira] [Created] (BEAM-8781) FlinkUberJarJobServer should respect --flink_job_server_jar

2019-11-19 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8781: - Summary: FlinkUberJarJobServer should respect --flink_job_server_jar Key: BEAM-8781 URL: https://issues.apache.org/jira/browse/BEAM-8781 Project: Beam Issue

[jira] [Commented] (BEAM-8277) Make docker build quicker

2019-11-19 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977912#comment-16977912 ] Kyle Weaver commented on BEAM-8277: --- Build times have gotten slower still: 11m 48s on current master. >

[jira] [Resolved] (BEAM-8660) Override returned artifact staging endpoint

2019-11-19 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8660. --- Fix Version/s: 2.18.0 Resolution: Fixed > Override returned artifact staging endpoint >

[jira] [Commented] (BEAM-8668) TypeError: _create_function() takes from 2 to 6 positional arguments but 7 were given

2019-11-19 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977750#comment-16977750 ] Kyle Weaver commented on BEAM-8668: --- Linking [https://github.com/uqfoundation/dill/issues/341] here for

[jira] [Updated] (BEAM-8668) TypeError: _create_function() takes from 2 to 6 positional arguments but 7 were given

2019-11-15 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8668: -- Description: This error looks to me a lot like a mismatch between SDK versions (Dill dependencies),

[jira] [Commented] (BEAM-8668) TypeError: _create_function() takes from 2 to 6 positional arguments but 7 were given

2019-11-15 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975491#comment-16975491 ] Kyle Weaver commented on BEAM-8668: --- cc [~tvalentyn] > TypeError: _create_function() takes from 2 to 6

[jira] [Commented] (BEAM-8372) Allow submission of Flink UberJar directly to flink cluster.

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974778#comment-16974778 ] Kyle Weaver commented on BEAM-8372: --- Should this be marked as completed, or do we consider BEAM-8512 a

[jira] [Created] (BEAM-8668) TypeError: _create_function() takes from 2 to 6 positional arguments but 7 were given

2019-11-14 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8668: - Summary: TypeError: _create_function() takes from 2 to 6 positional arguments but 7 were given Key: BEAM-8668 URL: https://issues.apache.org/jira/browse/BEAM-8668 Project:

[jira] [Updated] (BEAM-8668) TypeError: _create_function() takes from 2 to 6 positional arguments but 7 were given

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8668: -- Status: Open (was: Triage Needed) > TypeError: _create_function() takes from 2 to 6 positional

[jira] [Resolved] (BEAM-4615) Flink job server driver wrapper

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-4615. --- Fix Version/s: Not applicable Resolution: Fixed > Flink job server driver wrapper >

[jira] [Commented] (BEAM-4615) Flink job server driver wrapper

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974769#comment-16974769 ] Kyle Weaver commented on BEAM-4615: --- Just stumbled across this issue in a search. The second part sounds

[jira] [Commented] (BEAM-8591) Exception is thrown while running Beam Pipeline on Kubernetes Flink Cluster.

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974729#comment-16974729 ] Kyle Weaver commented on BEAM-8591: --- Hi Mingliang, as Thomas indicated, this behavior is expected for

[jira] [Updated] (BEAM-8591) Exception is thrown while running Beam Pipeline on Kubernetes Flink Cluster.

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8591: -- Status: Open (was: Triage Needed) > Exception is thrown while running Beam Pipeline on Kubernetes

[jira] [Assigned] (BEAM-8591) Exception is thrown while running Beam Pipeline on Kubernetes Flink Cluster.

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reassigned BEAM-8591: - Assignee: Kyle Weaver > Exception is thrown while running Beam Pipeline on Kubernetes Flink

[jira] [Commented] (BEAM-8481) Python 3.7 Postcommit test -- frequent timeouts

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974689#comment-16974689 ] Kyle Weaver commented on BEAM-8481: --- Dataflow workers. > Python 3.7 Postcommit test -- frequent

[jira] [Commented] (BEAM-8481) Python 3.7 Postcommit test -- frequent timeouts

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974668#comment-16974668 ] Kyle Weaver commented on BEAM-8481: --- I looked at a couple of the aborted jobs and saw that workers are

[jira] [Resolved] (BEAM-8649) Eat stderr from subprocess in _get_default_gcp_region

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8649. --- Fix Version/s: Not applicable Resolution: Fixed > Eat stderr from subprocess in

[jira] [Commented] (BEAM-8512) Add integration tests for Python "flink_runner.py"

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974525#comment-16974525 ] Kyle Weaver commented on BEAM-8512: --- Based on recent discussion, re-opening this and assigning to

[jira] [Reopened] (BEAM-8512) Add integration tests for Python "flink_runner.py"

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver reopened BEAM-8512: --- Assignee: Robert Bradshaw (was: Kyle Weaver) > Add integration tests for Python "flink_runner.py"

[jira] [Updated] (BEAM-8512) Add integration tests for Python "flink_runner.py"

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8512: -- Status: Open (was: Triage Needed) > Add integration tests for Python "flink_runner.py" >

[jira] [Comment Edited] (BEAM-8658) Optionally set artifact staging port in FlinkUberJarJobServer

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974468#comment-16974468 ] Kyle Weaver edited comment on BEAM-8658 at 11/14/19 6:14 PM: - Another option

[jira] [Commented] (BEAM-8658) Optionally set artifact staging port in FlinkUberJarJobServer

2019-11-14 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974468#comment-16974468 ] Kyle Weaver commented on BEAM-8658: --- Another option to consider is making the artifact staging server

[jira] [Updated] (BEAM-8660) Override returned artifact staging endpoint

2019-11-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8660: -- Status: Open (was: Triage Needed) > Override returned artifact staging endpoint >

[jira] [Created] (BEAM-8660) Override returned artifact staging endpoint

2019-11-13 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8660: - Summary: Override returned artifact staging endpoint Key: BEAM-8660 URL: https://issues.apache.org/jira/browse/BEAM-8660 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-8658) Optionally set artifact staging port in FlinkUberJarJobServer

2019-11-13 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8658: - Summary: Optionally set artifact staging port in FlinkUberJarJobServer Key: BEAM-8658 URL: https://issues.apache.org/jira/browse/BEAM-8658 Project: Beam Issue

[jira] [Updated] (BEAM-8658) Optionally set artifact staging port in FlinkUberJarJobServer

2019-11-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8658: -- Status: Open (was: Triage Needed) > Optionally set artifact staging port in FlinkUberJarJobServer >

[jira] [Updated] (BEAM-8656) flink_master_url usage in flink_runner.py

2019-11-13 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-8656: -- Description: flink_master_url was replaced with flink_master in flink_runner.py without preserving

<    1   2   3   4   5   6   7   8   9   10   >