[jira] [Commented] (BEAM-8584) Remove TestPipelineOptions

2020-01-21 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020457#comment-17020457 ] Mark Liu commented on BEAM-8584: I found more context in

[jira] [Commented] (BEAM-9120) Deprecate onSuccessMatcher, onCreateMatcher

2020-01-21 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020454#comment-17020454 ] Mark Liu commented on BEAM-9120: Found more context in

[jira] [Comment Edited] (BEAM-8584) Remove TestPipelineOptions

2020-01-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017357#comment-17017357 ] Mark Liu edited comment on BEAM-8584 at 1/16/20 5:54 PM: - Can you give more

[jira] [Commented] (BEAM-8584) Remove TestPipelineOptions

2020-01-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017357#comment-17017357 ] Mark Liu commented on BEAM-8584: Can you give more context on why we want to do it? > Remove

[jira] [Commented] (BEAM-8936) BigQuery related ITs are failing in PostCommit: quota exceeded

2019-12-20 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001261#comment-17001261 ] Mark Liu commented on BEAM-8936: Error details: _Project apache-beam-testing has insufficient quota(s) to

[jira] [Resolved] (BEAM-8936) BigQuery related ITs are failing in PostCommit: quota exceeded

2019-12-20 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-8936. Fix Version/s: Not applicable Resolution: Fixed > BigQuery related ITs are failing in PostCommit:

[jira] [Updated] (BEAM-8780) Improve publish_docker_images.sh

2019-11-19 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8780: --- Parent: BEAM-7887 Issue Type: Sub-task (was: Improvement) > Improve publish_docker_images.sh >

[jira] [Created] (BEAM-8780) Improve publish_docker_images.sh

2019-11-19 Thread Mark Liu (Jira)
Mark Liu created BEAM-8780: -- Summary: Improve publish_docker_images.sh Key: BEAM-8780 URL: https://issues.apache.org/jira/browse/BEAM-8780 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-8119) The python RC validation script need cleanup the pubsub resources after finish.

2019-11-19 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-8119: -- Assignee: Mark Liu > The python RC validation script need cleanup the pubsub resources after >

[jira] [Closed] (BEAM-8346) Failure: beam_PostRelease_Python_Candidate timeout

2019-11-19 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-8346. -- > Failure: beam_PostRelease_Python_Candidate timeout > -- > >

[jira] [Resolved] (BEAM-8346) Failure: beam_PostRelease_Python_Candidate timeout

2019-11-19 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-8346. Fix Version/s: Not applicable Resolution: Fixed > Failure: beam_PostRelease_Python_Candidate timeout

[jira] [Updated] (BEAM-8345) Add missing validations to run_rc_validation.sh

2019-11-19 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8345: --- Description: Missing Java Mobile Gaming on DirectRunner :runners:direct-java:runMobileGamingJavaDirect

[jira] [Updated] (BEAM-8345) Add missing validations to run_rc_validation.sh

2019-11-19 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8345: --- Description: * Missing Java Mobile Gaming on DirectRunner :runners:direct-java:runMobileGamingJavaDirect

[jira] [Resolved] (BEAM-7620) Make release scripts non-interactive

2019-11-13 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-7620. Fix Version/s: Not applicable Resolution: Duplicate > Make release scripts non-interactive >

[jira] [Resolved] (BEAM-8079) Move verify_release_build.sh to Jenkins job

2019-11-13 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-8079. Fix Version/s: Not applicable Resolution: Done > Move verify_release_build.sh to Jenkins job >

[jira] [Closed] (BEAM-8079) Move verify_release_build.sh to Jenkins job

2019-11-13 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-8079. -- > Move verify_release_build.sh to Jenkins job > --- > >

[jira] [Resolved] (BEAM-6544) Python wheel release process must not require inputting credentials to third party sites

2019-10-08 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-6544. Fix Version/s: Not applicable Resolution: Fixed > Python wheel release process must not require

[jira] [Commented] (BEAM-6544) Python wheel release process must not require inputting credentials to third party sites

2019-10-08 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947080#comment-16947080 ] Mark Liu commented on BEAM-6544: Auto push from beam-wheels works for me in 2.16 release. I think this

[jira] [Updated] (BEAM-8363) Nexmark regression in direct runner in streaming mode

2019-10-07 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8363: --- Summary: Nexmark regression in direct runner in streaming mode (was: Nexmark regress in direct runner in

[jira] [Updated] (BEAM-8363) Nexmark regress in direct runner in streaming mode

2019-10-07 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8363: --- Attachment: regression_screenshot.png > Nexmark regress in direct runner in streaming mode >

[jira] [Updated] (BEAM-8363) Nexmark regress in direct runner in streaming mode

2019-10-07 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8363: --- Attachment: (was: FOVNvhnzCdO.png) > Nexmark regress in direct runner in streaming mode >

[jira] [Created] (BEAM-8363) Nexmark regress in direct runner in streaming mode

2019-10-07 Thread Mark Liu (Jira)
Mark Liu created BEAM-8363: -- Summary: Nexmark regress in direct runner in streaming mode Key: BEAM-8363 URL: https://issues.apache.org/jira/browse/BEAM-8363 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-7907) Support customized container

2019-10-04 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944655#comment-16944655 ] Mark Liu commented on BEAM-7907: The major tasks are closed in 2.16. The only one left is documentation

[jira] [Resolved] (BEAM-7907) Support customized container

2019-10-04 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-7907. Resolution: Fixed > Support customized container > > > Key:

[jira] [Commented] (BEAM-8209) Document custom docker containers

2019-10-04 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944654#comment-16944654 ] Mark Liu commented on BEAM-8209: Move this issue to 2.17 since it's a documentation change which should

[jira] [Updated] (BEAM-8209) Document custom docker containers

2019-10-04 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8209: --- Fix Version/s: (was: 2.16.0) 2.17.0 > Document custom docker containers >

[jira] [Created] (BEAM-8349) Cleanup Bigquery dataset after Python Mobile Game validation

2019-10-03 Thread Mark Liu (Jira)
Mark Liu created BEAM-8349: -- Summary: Cleanup Bigquery dataset after Python Mobile Game validation Key: BEAM-8349 URL: https://issues.apache.org/jira/browse/BEAM-8349 Project: Beam Issue Type:

[jira] [Created] (BEAM-8346) Failure: beam_PostRelease_Python_Candidate timeout

2019-10-03 Thread Mark Liu (Jira)
Mark Liu created BEAM-8346: -- Summary: Failure: beam_PostRelease_Python_Candidate timeout Key: BEAM-8346 URL: https://issues.apache.org/jira/browse/BEAM-8346 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-8345) Add missing validations to run_rc_validation.sh

2019-10-03 Thread Mark Liu (Jira)
Mark Liu created BEAM-8345: -- Summary: Add missing validations to run_rc_validation.sh Key: BEAM-8345 URL: https://issues.apache.org/jira/browse/BEAM-8345 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-8339) Fix bugs in automation scripts

2019-10-02 Thread Mark Liu (Jira)
Mark Liu created BEAM-8339: -- Summary: Fix bugs in automation scripts Key: BEAM-8339 URL: https://issues.apache.org/jira/browse/BEAM-8339 Project: Beam Issue Type: Sub-task Components:

[jira] [Commented] (BEAM-8303) Filesystems not properly registered using FileIO.write()

2019-09-30 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941407#comment-16941407 ] Mark Liu commented on BEAM-8303: Looks like this issue happened in 2.15.0, thus it's not a regression for

[jira] [Updated] (BEAM-8303) Filesystems not properly registered using FileIO.write()

2019-09-30 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8303: --- Fix Version/s: (was: 2.16.0) 2.17.0 > Filesystems not properly registered using

[jira] [Commented] (BEAM-8303) Filesystems not properly registered using FileIO.write()

2019-09-30 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941177#comment-16941177 ] Mark Liu commented on BEAM-8303: Do you have ETA for the fix? I'm ready to cut a RC. > Filesystems not

[jira] [Updated] (BEAM-8198) Investigate possible performance regression of Wordcount 1GB batch benchmark on Py3.

2019-09-25 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8198: --- Fix Version/s: (was: 2.16.0) 2.17.0 > Investigate possible performance regression of

[jira] [Resolved] (BEAM-8299) Upgrade Jackson to version 2.9.10

2019-09-24 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-8299. Resolution: Fixed > Upgrade Jackson to version 2.9.10 > - > >

[jira] [Commented] (BEAM-8311) Fix python mongodbio display data type

2019-09-24 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937188#comment-16937188 ] Mark Liu commented on BEAM-8311: https://github.com/apache/beam/pull/9601 is original fix to master > Fix

[jira] [Commented] (BEAM-8311) Fix python mongodbio display data type

2019-09-24 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937187#comment-16937187 ] Mark Liu commented on BEAM-8311: https://github.com/apache/beam/pull/9655 for cherry-pick to release >

[jira] [Assigned] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-24 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-7060: -- Assignee: Mark Liu (was: Udi Meiri) > Design Py3-compatible typehints annotation support in Beam 3. >

[jira] [Resolved] (BEAM-8279) temporarily disable IOTypeHints.from_callable

2019-09-24 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-8279. Resolution: Fixed > temporarily disable IOTypeHints.from_callable >

[jira] [Updated] (BEAM-8290) Fixed comment typo

2019-09-19 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8290: --- Fix Version/s: (was: 2.15.0) 2.17.0 > Fixed comment typo > -- > >

[jira] [Commented] (BEAM-8165) Change image name and add images to release process

2019-09-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930983#comment-16930983 ] Mark Liu commented on BEAM-8165: Can you be more specific what action is required in order to unblock 2.16

[jira] [Updated] (BEAM-5539) Beam Dependency Update Request: google-cloud-pubsub

2019-09-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-5539: --- Fix Version/s: (was: Not applicable) 2.16.0 > Beam Dependency Update Request:

[jira] [Closed] (BEAM-8223) Version number need to be updated in gradle.properties during release

2019-09-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-8223. -- > Version number need to be updated in gradle.properties during release >

[jira] [Resolved] (BEAM-8223) Version number need to be updated in gradle.properties during release

2019-09-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-8223. Resolution: Fixed > Version number need to be updated in gradle.properties during release >

[jira] [Assigned] (BEAM-8226) Python Streaming Pipeline getting stuck in dataflow

2019-09-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-8226: -- Assignee: Yichi Zhang > Python Streaming Pipeline getting stuck in dataflow >

[jira] [Resolved] (BEAM-8217) py3 sdk harness status server does not print thread stack

2019-09-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-8217. Resolution: Fixed > py3 sdk harness status server does not print thread stack >

[jira] [Commented] (BEAM-8217) py3 sdk harness status server does not print thread stack

2019-09-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930893#comment-16930893 ] Mark Liu commented on BEAM-8217: https://github.com/apache/beam/pull/9559 is cherry-licked to release

[jira] [Assigned] (BEAM-8217) py3 sdk harness status server does not print thread stack

2019-09-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-8217: -- Assignee: Hannah Jiang > py3 sdk harness status server does not print thread stack >

[jira] [Closed] (BEAM-8217) py3 sdk harness status server does not print thread stack

2019-09-16 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-8217. -- > py3 sdk harness status server does not print thread stack >

[jira] [Updated] (BEAM-8223) Version number need to be updated in gradle.properties during release

2019-09-12 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8223: --- Fix Version/s: 2.16.0 > Version number need to be updated in gradle.properties during release >

[jira] [Created] (BEAM-8223) Version number need to be updated in gradle.properties during release

2019-09-12 Thread Mark Liu (Jira)
Mark Liu created BEAM-8223: -- Summary: Version number need to be updated in gradle.properties during release Key: BEAM-8223 URL: https://issues.apache.org/jira/browse/BEAM-8223 Project: Beam Issue

[jira] [Commented] (BEAM-8217) py3 sdk harness status server does not print thread stack

2019-09-12 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928839#comment-16928839 ] Mark Liu commented on BEAM-8217: https://github.com/apache/beam/pull/9559 is out to cherry-pick this

[jira] [Comment Edited] (BEAM-8209) Document custom docker containers

2019-09-12 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928611#comment-16928611 ] Mark Liu edited comment on BEAM-8209 at 9/12/19 3:05 PM: - What work needs to be

[jira] [Comment Edited] (BEAM-8209) Document custom docker containers

2019-09-12 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928611#comment-16928611 ] Mark Liu edited comment on BEAM-8209 at 9/12/19 3:04 PM: - What work needs to be

[jira] [Commented] (BEAM-7611) Python BigTableIO IT is not running in any test suites

2019-09-12 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928614#comment-16928614 ] Mark Liu commented on BEAM-7611: https://github.com/apache/beam/pull/9491 is merged. Does it require cp to

[jira] [Commented] (BEAM-8209) Document custom docker containers

2019-09-12 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928611#comment-16928611 ] Mark Liu commented on BEAM-8209: What work needs to done here? Can you update on daily base since 2.16

[jira] [Updated] (BEAM-8157) [Flink Runner 1.9] State requests return wrong state in timers when encoded key is length-prefixed

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8157: --- Fix Version/s: (was: 2.16.0) 2.17.0 > [Flink Runner 1.9] State requests return wrong

[jira] [Commented] (BEAM-8157) [Flink Runner 1.9] State requests return wrong state in timers when encoded key is length-prefixed

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928062#comment-16928062 ] Mark Liu commented on BEAM-8157: [~mxm] 2.16 release branch is cut. I'll move it to 2.17. If you really

[jira] [Commented] (BEAM-7945) Allow runner to configure "semi_persist_dir" which is used in the SDK harness

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928057#comment-16928057 ] Mark Liu commented on BEAM-7945: 2.16 release branch is cut. I'll move it to 2.17. If you really want to

[jira] [Updated] (BEAM-7945) Allow runner to configure "semi_persist_dir" which is used in the SDK harness

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-7945: --- Fix Version/s: (was: 2.16.0) 2.17.0 > Allow runner to configure "semi_persist_dir"

[jira] [Commented] (BEAM-7951) Allow runner to configure customization WindowedValue coder such as ValueOnlyWindowedValueCoder

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928056#comment-16928056 ] Mark Liu commented on BEAM-7951: 2.16 release branch is cut. I'll move this jira to 2.17. If you really

[jira] [Updated] (BEAM-7951) Allow runner to configure customization WindowedValue coder such as ValueOnlyWindowedValueCoder

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-7951: --- Fix Version/s: (was: 2.16.0) 2.17.0 > Allow runner to configure customization

[jira] [Commented] (BEAM-5878) Support DoFns with Keyword-only arguments in Python 3.

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928050#comment-16928050 ] Mark Liu commented on BEAM-5878: release-2.16.0 branch is cut. Move it to 2.17 > Support DoFns with

[jira] [Updated] (BEAM-5878) Support DoFns with Keyword-only arguments in Python 3.

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-5878: --- Fix Version/s: (was: 2.16.0) 2.17.0 > Support DoFns with Keyword-only arguments in

[jira] [Commented] (BEAM-8111) SchemaCoder broken on DataflowRunner

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927895#comment-16927895 ] Mark Liu commented on BEAM-8111: ValidatesRunner tests added in https://github.com/apache/beam/pull/9454

[jira] [Updated] (BEAM-6928) Make Python SDK custom Sink the default Sink for BigQuery

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-6928: --- Fix Version/s: (was: 2.16.0) 2.17.0 > Make Python SDK custom Sink the default Sink for

[jira] [Commented] (BEAM-6928) Make Python SDK custom Sink the default Sink for BigQuery

2019-09-11 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927819#comment-16927819 ] Mark Liu commented on BEAM-6928: Since this jira is a improvement, not necessarily a release blocker, I'll

[jira] [Commented] (BEAM-7223) Add ValidatesRunner test suite for Flink on Python 3.

2019-09-10 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926822#comment-16926822 ] Mark Liu commented on BEAM-7223: Thanks. > Add ValidatesRunner test suite for Flink on Python 3. >

[jira] [Commented] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-09-10 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926796#comment-16926796 ] Mark Liu commented on BEAM-7013: sg. Thank you. > A new count distinct transform based on BigQuery

[jira] [Commented] (BEAM-8187) Gradlew_orig should not be published in release

2019-09-10 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926795#comment-16926795 ] Mark Liu commented on BEAM-8187: The fix is merged. I'll close this jira. > Gradlew_orig should not be

[jira] [Closed] (BEAM-8187) Gradlew_orig should not be published in release

2019-09-10 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-8187. -- Resolution: Fixed > Gradlew_orig should not be published in release >

[jira] [Updated] (BEAM-8187) Gradlew_orig should not be published in release

2019-09-10 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8187: --- Summary: Gradlew_orig should not be published in release (was: Gradlew_orig is published in release) >

[jira] [Commented] (BEAM-8155) Add PubsubIO.readMessagesWithCoderAndParseFn method

2019-09-10 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926790#comment-16926790 ] Mark Liu commented on BEAM-8155: It will goes into 2.16 after tomorrow branch cut :). Is there any other

[jira] [Closed] (BEAM-6114) SQL join selection should be done in planner, not in expansion to PTransform

2019-09-10 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-6114. -- Resolution: Fixed > SQL join selection should be done in planner, not in expansion to PTransform >

[jira] [Commented] (BEAM-6114) SQL join selection should be done in planner, not in expansion to PTransform

2019-09-10 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926784#comment-16926784 ] Mark Liu commented on BEAM-6114: I'll close this jira. If any further work needs to be done here, you can

[jira] [Commented] (BEAM-5878) Support DoFns with Keyword-only arguments in Python 3.

2019-09-10 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926781#comment-16926781 ] Mark Liu commented on BEAM-5878: Thank you [~tvalentyn] for clarification. > Support DoFns with

[jira] [Updated] (BEAM-8185) Release script overwrite local config files

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-8185: --- Parent: BEAM-7887 Issue Type: Sub-task (was: Bug) > Release script overwrite local config files >

[jira] [Created] (BEAM-8185) Release script overwrite local config files

2019-09-09 Thread Mark Liu (Jira)
Mark Liu created BEAM-8185: -- Summary: Release script overwrite local config files Key: BEAM-8185 URL: https://issues.apache.org/jira/browse/BEAM-8185 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-8105) Add container publishing instruction to release manual

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926048#comment-16926048 ] Mark Liu commented on BEAM-8105: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Commented] (BEAM-8155) Add PubsubIO.readMessagesWithCoderAndParseFn method

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926049#comment-16926049 ] Mark Liu commented on BEAM-8155: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Commented] (BEAM-8092) Switch to java Optional in DirectRunner

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926047#comment-16926047 ] Mark Liu commented on BEAM-8092: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Closed] (BEAM-7993) portable python precommit is flaky

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-7993. -- > portable python precommit is flaky > -- > > Key: BEAM-7993 >

[jira] [Commented] (BEAM-8032) JdbcIO.readRows() throws exception when the statementPreparator is not provided for simple Select statement

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926046#comment-16926046 ] Mark Liu commented on BEAM-8032: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Resolved] (BEAM-7993) portable python precommit is flaky

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-7993. Fix Version/s: (was: 2.16.0) Not applicable Resolution: Fixed > portable

[jira] [Commented] (BEAM-7993) portable python precommit is flaky

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926044#comment-16926044 ] Mark Liu commented on BEAM-7993: This Jenkins suite back to green consistently for a week. Job history

[jira] [Commented] (BEAM-7962) Drop support for Flink 1.5 and 1.6

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926040#comment-16926040 ] Mark Liu commented on BEAM-7962: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Commented] (BEAM-7972) Portable Python Reshuffle does not work with windowed pcollection

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926041#comment-16926041 ] Mark Liu commented on BEAM-7972: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Commented] (BEAM-7951) Allow runner to configure customization WindowedValue coder such as ValueOnlyWindowedValueCoder

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926038#comment-16926038 ] Mark Liu commented on BEAM-7951: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Commented] (BEAM-7947) Improves the interfaces of classes such as FnDataService, BundleProcessor, ActiveBundle, etc to change the parameter type from WindowedValue to T

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926037#comment-16926037 ] Mark Liu commented on BEAM-7947: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Commented] (BEAM-7945) Allow runner to configure "semi_persist_dir" which is used in the SDK harness

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926036#comment-16926036 ] Mark Liu commented on BEAM-7945: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Commented] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926035#comment-16926035 ] Mark Liu commented on BEAM-7944: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Resolved] (BEAM-7821) Wheels build on osx fails in Travis

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-7821. Assignee: yifan zou Resolution: Fixed > Wheels build on osx fails in Travis >

[jira] [Closed] (BEAM-7821) Wheels build on osx fails in Travis

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-7821. -- > Wheels build on osx fails in Travis > > > Key: BEAM-7821 >

[jira] [Commented] (BEAM-7907) Support customized container for python

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926032#comment-16926032 ] Mark Liu commented on BEAM-7907: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Commented] (BEAM-7906) Perf regression in SQL Query3 in Dataflow

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926029#comment-16926029 ] Mark Liu commented on BEAM-7906: Move it to 2.17.0 since the issue is gone now according to the dashboard.

[jira] [Updated] (BEAM-7906) Perf regression in SQL Query3 in Dataflow

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-7906: --- Fix Version/s: (was: 2.16.0) 2.17.0 > Perf regression in SQL Query3 in Dataflow >

[jira] [Commented] (BEAM-7821) Wheels build on osx fails in Travis

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926026#comment-16926026 ] Mark Liu commented on BEAM-7821: [~yifanzou] Is this issue resolved? If there is a related PR, can you add

[jira] [Commented] (BEAM-8157) [Flink Runner 1.9] State requests return wrong state in timers when encoded key is length-prefixed

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926024#comment-16926024 ] Mark Liu commented on BEAM-8157: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Commented] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926025#comment-16926025 ] Mark Liu commented on BEAM-7730: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

[jira] [Commented] (BEAM-7713) Migrate to "typing" module typing types in Beam typehints (on Py2 and Py3).

2019-09-09 Thread Mark Liu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926023#comment-16926023 ] Mark Liu commented on BEAM-7713: Is this issue on track for 2.16 release? (branch will be cut in 3 days)

  1   2   3   4   >