[jira] [Commented] (FLINK-13482) How can I cleanly shutdown streaming jobs in local mode?
[ https://issues.apache.org/jira/browse/FLINK-13482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983147#comment-16983147 ] Donghui Xu commented on FLINK-13482: [~azagrebin] I can kill the Flink process manually . You can close this issue. Thanks. > How can I cleanly shutdown streaming jobs in local mode? > > > Key: FLINK-13482 > URL: https://issues.apache.org/jira/browse/FLINK-13482 > Project: Flink > Issue Type: Improvement > Components: API / DataStream >Affects Versions: 1.6.4 >Reporter: Donghui Xu >Priority: Minor > > Currently, streaming jobs can be stopped using "cancel" and "stop" command > only in cluster mode, not in local mode. > When users need to explicitly terminate jobs, it is necessary to provide a > termination mechanism for streaming jobs in local mode. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-13482) How can I cleanly shutdown streaming jobs in local mode?
[ https://issues.apache.org/jira/browse/FLINK-13482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982331#comment-16982331 ] Andrey Zagrebin commented on FLINK-13482: - [~davidxdh] Did it work for you if you just manually kill the local Flink process once it is not needed (Kafka topic is consumed)? Is the issue resolved? > How can I cleanly shutdown streaming jobs in local mode? > > > Key: FLINK-13482 > URL: https://issues.apache.org/jira/browse/FLINK-13482 > Project: Flink > Issue Type: Improvement > Components: API / DataStream >Affects Versions: 1.6.4 >Reporter: Donghui Xu >Priority: Minor > > Currently, streaming jobs can be stopped using "cancel" and "stop" command > only in cluster mode, not in local mode. > When users need to explicitly terminate jobs, it is necessary to provide a > termination mechanism for streaming jobs in local mode. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-13482) How can I cleanly shutdown streaming jobs in local mode?
[ https://issues.apache.org/jira/browse/FLINK-13482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971270#comment-16971270 ] Donghui Xu commented on FLINK-13482: Thank you for your advice. [~azagrebin] I want to kill the local process when the job has consumed all the topic data in kafka. > How can I cleanly shutdown streaming jobs in local mode? > > > Key: FLINK-13482 > URL: https://issues.apache.org/jira/browse/FLINK-13482 > Project: Flink > Issue Type: Improvement > Components: API / DataStream >Affects Versions: 1.6.4 >Reporter: Donghui Xu >Priority: Minor > > Currently, streaming jobs can be stopped using "cancel" and "stop" command > only in cluster mode, not in local mode. > When users need to explicitly terminate jobs, it is necessary to provide a > termination mechanism for streaming jobs in local mode. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-13482) How can I cleanly shutdown streaming jobs in local mode?
[ https://issues.apache.org/jira/browse/FLINK-13482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970086#comment-16970086 ] Andrey Zagrebin commented on FLINK-13482: - Donghui Xu In general, it is better firstly to discuss this kind of issues in [user ML|https://flink.apache.org/community.html#mailing-lists]. The local mode is intended more for debugging, could you not just kill the local process when the job is not needed? Alternatively, you could try [REST API|https://ci.apache.org/projects/flink/flink-docs-release-1.9/monitoring/rest_api.html#jobs-jobid-1]. There is also a [FLIP-73|https://cwiki.apache.org/confluence/display/FLINK/FLIP-73%3A+Introducing+Executors+for+job+submission] in progress for new executor, thereafter execution result handle might be revisited and cancel/stop might be added to manage job in code. Does it help? > How can I cleanly shutdown streaming jobs in local mode? > > > Key: FLINK-13482 > URL: https://issues.apache.org/jira/browse/FLINK-13482 > Project: Flink > Issue Type: Improvement > Components: API / DataStream >Reporter: Donghui Xu >Priority: Minor > > Currently, streaming jobs can be stopped using "cancel" and "stop" command > only in cluster mode, not in local mode. > When users need to explicitly terminate jobs, it is necessary to provide a > termination mechanism for streaming jobs in local mode. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-13482) How can I cleanly shutdown streaming jobs in local mode?
[ https://issues.apache.org/jira/browse/FLINK-13482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898496#comment-16898496 ] Donghui Xu commented on FLINK-13482: The data source I used was FlinkKafka Consumer010. After consuming kafka's data, I want to terminate stream job processing. Can this be implemented in code? > How can I cleanly shutdown streaming jobs in local mode? > > > Key: FLINK-13482 > URL: https://issues.apache.org/jira/browse/FLINK-13482 > Project: Flink > Issue Type: Improvement > Components: Runtime / Coordination >Reporter: Donghui Xu >Priority: Minor > > Currently, streaming jobs can be stopped using "cancel" and "stop" command > only in cluster mode, not in local mode. > When users need to explicitly terminate jobs, it is necessary to provide a > termination mechanism for streaming jobs in local mode. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (FLINK-13482) How can I cleanly shutdown streaming jobs in local mode?
[
https://issues.apache.org/jira/browse/FLINK-13482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897093#comment-16897093
]
Robert Metzger commented on FLINK-13482:
I'm not aware of a mechanism for that yet.
There are some plans for providing an API for controlling a running Flink job.
This API would probably work independent of the deployment mode.
If you are using a custom source, you could implement a mechanism that shuts
the sources down. Once the {{SourceFunction.run()}} method completes, Flink
will shut down the topology.
> How can I cleanly shutdown streaming jobs in local mode?
>
>
> Key: FLINK-13482
> URL: https://issues.apache.org/jira/browse/FLINK-13482
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Coordination
>Reporter: Donghui Xu
>Priority: Minor
>
> Currently, streaming jobs can be stopped using "cancel" and "stop" command
> only in cluster mode, not in local mode.
> When users need to explicitly terminate jobs, it is necessary to provide a
> termination mechanism for local mode flow jobs.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
