[jira] [Created] (BEAM-7120) Turn `WindowedValue` into `T` for all the interfaces of Data Plane

2019-04-19 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7120: - Summary: Turn `WindowedValue` into `T` for all the interfaces of Data Plane Key: BEAM-7120 URL: https://issues.apache.org/jira/browse/BEAM-7120 Project: Beam

[jira] [Created] (BEAM-7730) Make FlinkRunner compatible with Flink 1.9

2019-07-11 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7730: - Summary: Make FlinkRunner compatible with Flink 1.9 Key: BEAM-7730 URL: https://issues.apache.org/jira/browse/BEAM-7730 Project: Beam Issue Type: New Feature

[jira] [Updated] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-07-11 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7730: -- Description: Apache Flink 1.9 will coming and it's better to add Flink 1.9 build target and make Flink

[jira] [Updated] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-07-11 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7730: -- Summary: Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9 (was: Make

[jira] [Commented] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-07-11 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883483#comment-16883483 ] sunjincheng commented on BEAM-7730: --- Hi [~mxm] I have been seen that the patch of Flink 1.7, 1.8 are

[jira] [Commented] (BEAM-7440) Cannot setup flink 1.8 on dataproc (testing infrastructure).

2019-07-12 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883685#comment-16883685 ] sunjincheng commented on BEAM-7440: --- Hi [~ŁukaszG] Have you solved this problem? Just like [~mxm]

[jira] [Created] (BEAM-7950) Remove the Python 3 warning as it has already been supported

2019-08-12 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7950: - Summary: Remove the Python 3 warning as it has already been supported Key: BEAM-7950 URL: https://issues.apache.org/jira/browse/BEAM-7950 Project: Beam Issue

[jira] [Created] (BEAM-7947) Improves the interfaces of classes such as FnDataService, BundleProcessor, ActiveBundle, etc to change the parameter type from WindowedValue to T

2019-08-12 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7947: - Summary: Improves the interfaces of classes such as FnDataService, BundleProcessor, ActiveBundle, etc to change the parameter type from WindowedValue to T Key: BEAM-7947 URL:

[jira] [Updated] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-08-12 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7944: -- Fix Version/s: 2.15.0 > Improvements of portability framework to make it usable in other projects >

[jira] [Updated] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-08-12 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7944: -- Affects Version/s: (was: 2.14.0) > Improvements of portability framework to make it usable in other

[jira] [Updated] (BEAM-7948) Add time-based cache threshold support in the Java data service

2019-08-12 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7948: -- Fix Version/s: (was: 2.14.0) 2.15.0 > Add time-based cache threshold support in

[jira] [Created] (BEAM-7951) Allow runner to configure customization WindowedValue coder such as ValueOnlyWindowedValueCoder

2019-08-12 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7951: - Summary: Allow runner to configure customization WindowedValue coder such as ValueOnlyWindowedValueCoder Key: BEAM-7951 URL: https://issues.apache.org/jira/browse/BEAM-7951

[jira] [Created] (BEAM-7952) Make the input queue of the input buffer in Python SDK Harness size limited.

2019-08-12 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7952: - Summary: Make the input queue of the input buffer in Python SDK Harness size limited. Key: BEAM-7952 URL: https://issues.apache.org/jira/browse/BEAM-7952 Project: Beam

[jira] [Updated] (BEAM-7945) Allow runner to configure "semi_persist_dir" which is used in the SDK harness

2019-08-12 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7945: -- Fix Version/s: 2.15.0 > Allow runner to configure "semi_persist_dir" which is used in the SDK harness >

[jira] [Created] (BEAM-7949) Add time-based cache threshold support in the data service of the Python SDK harness

2019-08-12 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7949: - Summary: Add time-based cache threshold support in the data service of the Python SDK harness Key: BEAM-7949 URL: https://issues.apache.org/jira/browse/BEAM-7949 Project:

[jira] [Updated] (BEAM-7947) Improves the interfaces of classes such as FnDataService, BundleProcessor, ActiveBundle, etc to change the parameter type from WindowedValue to T

2019-08-12 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7947: -- Fix Version/s: 2.15.0 > Improves the interfaces of classes such as FnDataService, BundleProcessor, >

[jira] [Updated] (BEAM-7945) Allow runner to configure "semi_persist_dir" which is used in the SDK harness

2019-08-12 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7945: -- Affects Version/s: (was: 2.14.0) > Allow runner to configure "semi_persist_dir" which is used in

[jira] [Created] (BEAM-7945) Allow runner to configure "semi_persist_dir" which is used in the SDK harness

2019-08-12 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7945: - Summary: Allow runner to configure "semi_persist_dir" which is used in the SDK harness Key: BEAM-7945 URL: https://issues.apache.org/jira/browse/BEAM-7945 Project: Beam

[jira] [Updated] (BEAM-7947) Improves the interfaces of classes such as FnDataService, BundleProcessor, ActiveBundle, etc to change the parameter type from WindowedValue to T

2019-08-12 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7947: -- Affects Version/s: (was: 2.14.0) > Improves the interfaces of classes such as FnDataService,

[jira] [Created] (BEAM-7948) Add time-based cache threshold support in the Java data service

2019-08-12 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7948: - Summary: Add time-based cache threshold support in the Java data service Key: BEAM-7948 URL: https://issues.apache.org/jira/browse/BEAM-7948 Project: Beam Issue

[jira] [Created] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-08-12 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7944: - Summary: Improvements of portability framework to make it usable in other projects Key: BEAM-7944 URL: https://issues.apache.org/jira/browse/BEAM-7944 Project: Beam

[jira] [Updated] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-08-12 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7944: -- Description: The Flink community will use Beam's portability framework for its multi-language support,

[jira] [Commented] (BEAM-8034) Upgrade Flink Runner to 1.8.1 and fix Avro Schema serialization problems

2019-08-30 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919398#comment-16919398 ] sunjincheng commented on BEAM-8034: --- Thanks [~mxm] for your confirmation, I have already initiated the

[jira] [Commented] (BEAM-8034) Upgrade Flink Runner to 1.8.1 and fix Avro Schema serialization problems

2019-08-30 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919423#comment-16919423 ] sunjincheng commented on BEAM-8034: --- I would like to fix this issue after flink-1.8.2 released. >

[jira] [Assigned] (BEAM-8034) Upgrade Flink Runner to 1.8.1 and fix Avro Schema serialization problems

2019-08-30 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng reassigned BEAM-8034: - Assignee: sunjincheng > Upgrade Flink Runner to 1.8.1 and fix Avro Schema serialization problems

[jira] [Commented] (BEAM-8034) Upgrade Flink Runner to 1.8.1 and fix Avro Schema serialization problems

2019-08-29 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919079#comment-16919079 ] sunjincheng commented on BEAM-8034: --- Thanks report this issue and share your analysis and I agree with

[jira] [Updated] (BEAM-7949) Add time-based cache threshold support in the data service of the Python SDK harness

2019-08-29 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7949: -- Fix Version/s: (was: 2.16.0) 2.17.0 > Add time-based cache threshold support in

[jira] [Updated] (BEAM-7948) Add time-based cache threshold support in the Java data service

2019-08-29 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7948: -- Fix Version/s: (was: 2.16.0) 2.17.0 > Add time-based cache threshold support in

[jira] [Updated] (BEAM-7952) Make the input queue of the input buffer in Python SDK Harness size limited.

2019-08-29 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7952: -- Fix Version/s: (was: 2.16.0) 2.17.0 > Make the input queue of the input buffer

[jira] [Updated] (BEAM-7950) Remove the Python 3 warning as it has already been supported

2019-08-29 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7950: -- Fix Version/s: (was: 2.16.0) 2.17.0 > Remove the Python 3 warning as it has

[jira] [Commented] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-08-23 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914345#comment-16914345 ] sunjincheng commented on BEAM-7730: --- Thanks for the reassigned the JIRA. [~mxm] Great thanks for your

[jira] [Comment Edited] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-08-23 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914345#comment-16914345 ] sunjincheng edited comment on BEAM-7730 at 8/23/19 3:30 PM: Thanks for the

[jira] [Created] (BEAM-8164) Correct document for building the python SDK harness container

2019-09-06 Thread sunjincheng (Jira)
sunjincheng created BEAM-8164: - Summary: Correct document for building the python SDK harness container Key: BEAM-8164 URL: https://issues.apache.org/jira/browse/BEAM-8164 Project: Beam Issue

[jira] [Commented] (BEAM-8034) Upgrade Flink Runner to 1.8.1 and fix Avro Schema serialization problems

2019-09-13 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929227#comment-16929227 ] sunjincheng commented on BEAM-8034: --- 1.8.2 Already released. > Upgrade Flink Runner to 1.8.1 and fix

[jira] [Created] (BEAM-8206) Fix syntax errors in Java doc for PipelineRunner

2019-09-11 Thread sunjincheng (Jira)
sunjincheng created BEAM-8206: - Summary: Fix syntax errors in Java doc for PipelineRunner Key: BEAM-8206 URL: https://issues.apache.org/jira/browse/BEAM-8206 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-8164) Correct document for building the python SDK harness container

2019-09-06 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8164: -- Description: In the runner document, it is described that we can use the command: `./gradlew

[jira] [Updated] (BEAM-8164) Correct document for building the python SDK harness container

2019-09-06 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8164: -- Description: In the runner document, it is described that we can use the command: `./gradlew

[jira] [Commented] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-09-09 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926286#comment-16926286 ] sunjincheng commented on BEAM-7944: --- Thanks for the remind, this is umbrella JIRA, I have remark it as

[jira] [Updated] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-09-09 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7944: -- Fix Version/s: (was: 2.16.0) > Improvements of portability framework to make it usable in other

[jira] [Commented] (BEAM-8034) Upgrade Flink Runner to 1.8.1 and fix Avro Schema serialization problems

2019-09-09 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926290#comment-16926290 ] sunjincheng commented on BEAM-8034: --- Hi [~mxm] Beam 2.16 release branch will be cut in 3 days, So It's

[jira] [Created] (BEAM-8162) NPE error when add flink 1.9 runner

2019-09-06 Thread sunjincheng (Jira)
sunjincheng created BEAM-8162: - Summary: NPE error when add flink 1.9 runner Key: BEAM-8162 URL: https://issues.apache.org/jira/browse/BEAM-8162 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-09-16 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7944: -- Description: The Flink community will use Beam's portability framework for its multi-language support,

[jira] [Assigned] (BEAM-7948) Add time-based cache threshold support in the Java data service

2019-09-06 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng reassigned BEAM-7948: - Assignee: sunjincheng > Add time-based cache threshold support in the Java data service >

[jira] [Assigned] (BEAM-7951) Allow runner to configure customization WindowedValue coder such as ValueOnlyWindowedValueCoder

2019-09-06 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng reassigned BEAM-7951: - Assignee: sunjincheng > Allow runner to configure customization WindowedValue coder such as >

[jira] [Updated] (BEAM-8325) SdkWorker should be stopped in SdkHarness

2019-09-29 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8325: -- Fix Version/s: 2.17.0 > SdkWorker should be stopped in SdkHarness >

[jira] [Created] (BEAM-8325) SdkWorker should be stopped in SdkHarness

2019-09-29 Thread sunjincheng (Jira)
sunjincheng created BEAM-8325: - Summary: SdkWorker should be stopped in SdkHarness Key: BEAM-8325 URL: https://issues.apache.org/jira/browse/BEAM-8325 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-8557) Clean up useless null check.

2019-11-05 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8557: -- Description: I think we do not need null check here:

[jira] [Updated] (BEAM-8442) Unify bundle register in Python SDK harness

2019-11-05 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8442: -- Summary: Unify bundle register in Python SDK harness (was: Unfiy bundle register in Python SDK

[jira] [Updated] (BEAM-8557) Clean up useless null check.

2019-11-05 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8557: -- Description: I think we do not need null check here:

[jira] [Updated] (BEAM-8557) Clean up useless null check.

2019-11-05 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8557: -- Description: I think we do not need null check here:

[jira] [Updated] (BEAM-8557) Clean up useless null check.

2019-11-05 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8557: -- Description: I think we do not need null check here:

[jira] [Updated] (BEAM-8557) Clean up useless null check.

2019-11-05 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8557: -- Description: I think we do not need null check here:

[jira] [Created] (BEAM-8565) Update .test-infra/jenkins/README with missing entries and correct wrong entries

2019-11-06 Thread sunjincheng (Jira)
sunjincheng created BEAM-8565: - Summary: Update .test-infra/jenkins/README with missing entries and correct wrong entries Key: BEAM-8565 URL: https://issues.apache.org/jira/browse/BEAM-8565 Project: Beam

[jira] [Updated] (BEAM-8565) Update .test-infra/jenkins/README with missing entries and correct wrong entries

2019-11-06 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8565: -- Fix Version/s: 2.18.0 > Update .test-infra/jenkins/README with missing entries and correct wrong >

[jira] [Updated] (BEAM-8565) Update .test-infra/jenkins/README with missing entries and correct wrong entries

2019-11-06 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8565: -- Description: Currently the following tests are missing in the .test-infra/jenkins/README: {code:java}

[jira] [Created] (BEAM-8594) Remove unnecessary error check of the control service accessing in DataFlow Runner

2019-11-07 Thread sunjincheng (Jira)
sunjincheng created BEAM-8594: - Summary: Remove unnecessary error check of the control service accessing in DataFlow Runner Key: BEAM-8594 URL: https://issues.apache.org/jira/browse/BEAM-8594 Project:

[jira] [Created] (BEAM-8733) The "KeyError: u'-47'" error from line 305 of sdk_worker.py

2019-11-17 Thread sunjincheng (Jira)
sunjincheng created BEAM-8733: - Summary: The "KeyError: u'-47'" error from line 305 of sdk_worker.py Key: BEAM-8733 URL: https://issues.apache.org/jira/browse/BEAM-8733 Project: Beam Issue

[jira] [Commented] (BEAM-8733) The "KeyError: u'-47'" error from line 305 of sdk_worker.py

2019-11-17 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976225#comment-16976225 ] sunjincheng commented on BEAM-8733: --- Hi, Thanks for the log info, [~chamikara]. >From the exception

[jira] [Updated] (BEAM-8733) The "KeyError: u'-47'" error from line 305 of sdk_worker.py

2019-11-17 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8733: -- Description: The issue reported by [~chamikara], error message as follows:

[jira] [Created] (BEAM-8617) Tear down the DoFns upon the control service termination in Python SDK harness

2019-11-12 Thread sunjincheng (Jira)
sunjincheng created BEAM-8617: - Summary: Tear down the DoFns upon the control service termination in Python SDK harness Key: BEAM-8617 URL: https://issues.apache.org/jira/browse/BEAM-8617 Project: Beam

[jira] [Created] (BEAM-8619) Teardown the DoFns upon the control service termination in Java SDK harness

2019-11-12 Thread sunjincheng (Jira)
sunjincheng created BEAM-8619: - Summary: Teardown the DoFns upon the control service termination in Java SDK harness Key: BEAM-8619 URL: https://issues.apache.org/jira/browse/BEAM-8619 Project: Beam

[jira] [Created] (BEAM-8620) Tear down unused DoFns periodically in Java SDK harness

2019-11-12 Thread sunjincheng (Jira)
sunjincheng created BEAM-8620: - Summary: Tear down unused DoFns periodically in Java SDK harness Key: BEAM-8620 URL: https://issues.apache.org/jira/browse/BEAM-8620 Project: Beam Issue Type:

[jira] [Created] (BEAM-8618) Tear down unused DoFns periodically in Python SDK harness

2019-11-12 Thread sunjincheng (Jira)
sunjincheng created BEAM-8618: - Summary: Tear down unused DoFns periodically in Python SDK harness Key: BEAM-8618 URL: https://issues.apache.org/jira/browse/BEAM-8618 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8619) Tear down the DoFns upon the control service termination in Java SDK harness

2019-11-12 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8619: -- Summary: Tear down the DoFns upon the control service termination in Java SDK harness (was: Teardown

[jira] [Updated] (BEAM-8619) Tear down the DoFns upon the control service termination in Java SDK harness

2019-11-12 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8619: -- Issue Type: Task (was: Improvement) > Tear down the DoFns upon the control service termination in Java

[jira] [Updated] (BEAM-8620) Tear down unused DoFns periodically in Java SDK harness

2019-11-12 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8620: -- Issue Type: Task (was: Improvement) > Tear down unused DoFns periodically in Java SDK harness >

[jira] [Updated] (BEAM-8617) Tear down the DoFns upon the control service termination in Python SDK harness

2019-11-12 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8617: -- Issue Type: Task (was: Improvement) > Tear down the DoFns upon the control service termination in

[jira] [Updated] (BEAM-8618) Tear down unused DoFns periodically in Python SDK harness

2019-11-12 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8618: -- Issue Type: Task (was: Improvement) > Tear down unused DoFns periodically in Python SDK harness >

[jira] [Updated] (BEAM-8620) Tear down unused DoFns periodically in Java SDK harness

2019-11-12 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8620: -- Issue Type: Improvement (was: Task) > Tear down unused DoFns periodically in Java SDK harness >

[jira] [Updated] (BEAM-8618) Tear down unused DoFns periodically in Python SDK harness

2019-11-12 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8618: -- Issue Type: Improvement (was: Task) > Tear down unused DoFns periodically in Python SDK harness >

[jira] [Updated] (BEAM-8617) Tear down the DoFns upon the control service termination in Python SDK harness

2019-11-12 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8617: -- Issue Type: Improvement (was: Task) > Tear down the DoFns upon the control service termination in

[jira] [Updated] (BEAM-8619) Tear down the DoFns upon the control service termination in Java SDK harness

2019-11-12 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8619: -- Issue Type: Improvement (was: Task) > Tear down the DoFns upon the control service termination in Java

[jira] [Updated] (BEAM-8557) Clean up useless null check.

2019-11-05 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8557: -- Parent: BEAM-7944 Issue Type: Sub-task (was: Improvement) > Clean up useless null check. >

[jira] [Created] (BEAM-8557) Clean up useless null check.

2019-11-05 Thread sunjincheng (Jira)
sunjincheng created BEAM-8557: - Summary: Clean up useless null check. Key: BEAM-8557 URL: https://issues.apache.org/jira/browse/BEAM-8557 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-8733) The "KeyError: u'-47'" error from line 305 of sdk_worker.py

2019-11-22 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980674#comment-16980674 ] sunjincheng commented on BEAM-8733: --- Hi [~lcwik], thank you for explaining, then it makes sense to me

[jira] [Commented] (BEAM-8733) The "KeyError: u'-47'" error from line 305 of sdk_worker.py

2019-11-21 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979765#comment-16979765 ] sunjincheng commented on BEAM-8733: --- I want to confirm a few things with you before making changes as

[jira] [Assigned] (BEAM-8733) The "KeyError: u'-47'" error from line 305 of sdk_worker.py

2019-11-21 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng reassigned BEAM-8733: - Assignee: sunjincheng > The "KeyError: u'-47'" error from line 305 of sdk_worker.py >

[jira] [Assigned] (BEAM-7952) Make the input queue of the input buffer in Python SDK Harness size limited.

2019-11-21 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng reassigned BEAM-7952: - Assignee: sunjincheng > Make the input queue of the input buffer in Python SDK Harness size

[jira] [Created] (BEAM-8929) Remove unnecessary exception handling in FnApiControlClientPoolService

2019-12-09 Thread sunjincheng (Jira)
sunjincheng created BEAM-8929: - Summary: Remove unnecessary exception handling in FnApiControlClientPoolService Key: BEAM-8929 URL: https://issues.apache.org/jira/browse/BEAM-8929 Project: Beam

[jira] [Updated] (BEAM-8618) Tear down unused DoFns periodically in Python SDK harness

2019-12-05 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8618: -- Fix Version/s: (was: 2.18.0) 2.19.0 > Tear down unused DoFns periodically in

[jira] [Resolved] (BEAM-8733) The "KeyError: u'-47'" error from line 305 of sdk_worker.py

2019-12-05 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng resolved BEAM-8733. --- Resolution: Fixed > The "KeyError: u'-47'" error from line 305 of sdk_worker.py >

[jira] [Updated] (BEAM-8620) Tear down unused DoFns periodically in Java SDK harness

2019-12-05 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8620: -- Fix Version/s: (was: 2.18.0) 2.19.0 > Tear down unused DoFns periodically in

[jira] [Commented] (BEAM-8325) SdkWorker should be stopped in SdkHarness

2019-10-21 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955935#comment-16955935 ] sunjincheng commented on BEAM-8325: --- There are two approaches to solve this issue. We will describe them

[jira] [Created] (BEAM-8442) Unfiy bundle register in Python SDK harness

2019-10-21 Thread sunjincheng (Jira)
sunjincheng created BEAM-8442: - Summary: Unfiy bundle register in Python SDK harness Key: BEAM-8442 URL: https://issues.apache.org/jira/browse/BEAM-8442 Project: Beam Issue Type: Improvement

[jira] [Comment Edited] (BEAM-7951) Allow runner to configure customization WindowedValue coder such as ValueOnlyWindowedValueCoder

2019-10-25 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959462#comment-16959462 ] sunjincheng edited comment on BEAM-7951 at 10/25/19 6:19 AM: - This is not

[jira] [Commented] (BEAM-7951) Allow runner to configure customization WindowedValue coder such as ValueOnlyWindowedValueCoder

2019-10-25 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959462#comment-16959462 ] sunjincheng commented on BEAM-7951: --- This is not release blocker, thanks for reset the Fix Version. >

[jira] [Commented] (BEAM-7950) Remove the Python 3 warning as it has already been supported

2019-10-25 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959460#comment-16959460 ] sunjincheng commented on BEAM-7950: --- Thanks [~altay] and [~tvalentyn] :) > Remove the Python 3 warning

[jira] [Updated] (BEAM-8442) Unfiy bundle register in Python SDK harness

2019-10-22 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8442: -- Parent: BEAM-7944 Issue Type: Sub-task (was: Improvement) > Unfiy bundle register in Python

[jira] [Updated] (BEAM-7948) Add time-based cache threshold support in the Java data service

2019-11-24 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7948: -- Fix Version/s: 2.18.0 > Add time-based cache threshold support in the Java data service >

[jira] [Resolved] (BEAM-7948) Add time-based cache threshold support in the Java data service

2019-11-24 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng resolved BEAM-7948. --- Resolution: Fixed > Add time-based cache threshold support in the Java data service >

[jira] [Closed] (BEAM-8557) Clean up useless null check.

2019-11-24 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng closed BEAM-8557. - Resolution: Fixed > Clean up useless null check. > > > Key:

[jira] [Updated] (BEAM-8557) Clean up useless null check.

2019-11-24 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8557: -- Fix Version/s: 2.18.0 > Clean up useless null check. > > >

[jira] [Closed] (BEAM-8617) Tear down the DoFns upon the control service termination in Python SDK harness

2019-11-24 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng closed BEAM-8617. - Resolution: Duplicate > Tear down the DoFns upon the control service termination in Python SDK harness >

[jira] [Resolved] (BEAM-7952) Make the input queue of the input buffer in Python SDK Harness size limited.

2019-11-28 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng resolved BEAM-7952. --- Fix Version/s: 2.18.0 Resolution: Duplicate https://issues.apache.org/jira/browse/BEAM-8667 >

[jira] [Created] (BEAM-8846) Force synchronization of the stream observer in BeamFnControlClient

2019-11-28 Thread sunjincheng (Jira)
sunjincheng created BEAM-8846: - Summary: Force synchronization of the stream observer in BeamFnControlClient Key: BEAM-8846 URL: https://issues.apache.org/jira/browse/BEAM-8846 Project: Beam

[jira] [Created] (BEAM-8847) Handle the registration request synchronously in the Java SDK harness

2019-11-28 Thread sunjincheng (Jira)
sunjincheng created BEAM-8847: - Summary: Handle the registration request synchronously in the Java SDK harness Key: BEAM-8847 URL: https://issues.apache.org/jira/browse/BEAM-8847 Project: Beam

[jira] [Created] (BEAM-8377) Remove the flink-1.6 from the project-mappings

2019-10-10 Thread sunjincheng (Jira)
sunjincheng created BEAM-8377: - Summary: Remove the flink-1.6 from the project-mappings Key: BEAM-8377 URL: https://issues.apache.org/jira/browse/BEAM-8377 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-8375) Correct the command for Start a Flink job server in `environments.md`

2019-10-10 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-8375: -- Priority: Minor (was: Major) > Correct the command for Start a Flink job server in `environments.md` >

[jira] [Created] (BEAM-8375) Correct the command for Start a Flink job server in `environments.md`

2019-10-10 Thread sunjincheng (Jira)
sunjincheng created BEAM-8375: - Summary: Correct the command for Start a Flink job server in `environments.md` Key: BEAM-8375 URL: https://issues.apache.org/jira/browse/BEAM-8375 Project: Beam

[jira] [Updated] (BEAM-9006) Meta space memory leak caused by the shutdown hook of ProcessManager

2019-12-19 Thread sunjincheng (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-9006: -- Fix Version/s: (was: 2.18.0) 2.19.0 > Meta space memory leak caused by the

  1   2   >