[jira] [Commented] (FLINK-4335) Add jar id, and job parameters information to job status rest call

[ https://issues.apache.org/jira/browse/FLINK-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415619#comment-15415619 ] Zhenzhong Xu commented on FLINK-4335: - [~rmetzger] Thanks for the comment, I will implement the

[jira] [Commented] (FLINK-4336) Expose ability to take a savepoint from job manager rest api

[ https://issues.apache.org/jira/browse/FLINK-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415639#comment-15415639 ] Zhenzhong Xu commented on FLINK-4336: - [~rmetzger] Sure, let me look into the implementation and send

[jira] [Commented] (FLINK-4308) Allow uploaded jar directory to be configurable

[ https://issues.apache.org/jira/browse/FLINK-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404889#comment-15404889 ] Zhenzhong Xu commented on FLINK-4308: - The proposal is to introduce a new optional config

[jira] [Comment Edited] (FLINK-4308) Allow uploaded jar directory to be configurable

[ https://issues.apache.org/jira/browse/FLINK-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404889#comment-15404889 ] Zhenzhong Xu edited comment on FLINK-4308 at 8/2/16 9:57 PM: - The proposal is

[jira] [Updated] (FLINK-4336) Expose ability to take a savepoint from job manager

[ https://issues.apache.org/jira/browse/FLINK-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4336: Summary: Expose ability to take a savepoint from job manager (was: Expose ability to take a

[jira] [Created] (FLINK-4372) Add ability to take savepoints from job manager web UI

Zhenzhong Xu created FLINK-4372: --- Summary: Add ability to take savepoints from job manager web UI Key: FLINK-4372 URL: https://issues.apache.org/jira/browse/FLINK-4372 Project: Flink Issue

[jira] [Created] (FLINK-4371) Add ability to take savepoints from job manager RESTful API

Zhenzhong Xu created FLINK-4371: --- Summary: Add ability to take savepoints from job manager RESTful API Key: FLINK-4371 URL: https://issues.apache.org/jira/browse/FLINK-4371 Project: Flink

[jira] [Assigned] (FLINK-4336) Expose ability to take a savepoint from job manager

[ https://issues.apache.org/jira/browse/FLINK-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu reassigned FLINK-4336: --- Assignee: Zhenzhong Xu > Expose ability to take a savepoint from job manager >

[jira] [Assigned] (FLINK-4335) Add jar id, and job parameters information to job status rest call

[ https://issues.apache.org/jira/browse/FLINK-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu reassigned FLINK-4335: --- Assignee: Zhenzhong Xu > Add jar id, and job parameters information to job status rest call

[jira] [Comment Edited] (FLINK-4308) Allow uploaded jar directory to be configurable

[ https://issues.apache.org/jira/browse/FLINK-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404889#comment-15404889 ] Zhenzhong Xu edited comment on FLINK-4308 at 8/4/16 10:23 PM: -- The proposal

[jira] [Created] (FLINK-4335) Add jar id, and job parameters information to job status rest call

Zhenzhong Xu created FLINK-4335: --- Summary: Add jar id, and job parameters information to job status rest call Key: FLINK-4335 URL: https://issues.apache.org/jira/browse/FLINK-4335 Project: Flink

[jira] [Created] (FLINK-4336) Expose ability to take a savepoint from job manager rest api

Zhenzhong Xu created FLINK-4336: --- Summary: Expose ability to take a savepoint from job manager rest api Key: FLINK-4336 URL: https://issues.apache.org/jira/browse/FLINK-4336 Project: Flink

[jira] [Updated] (FLINK-4335) Add jar id, and job parameters information to job status rest call

[ https://issues.apache.org/jira/browse/FLINK-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4335: Description: >From declarative, reconcilation based job management perspective, there is a >need

[jira] [Updated] (FLINK-4308) Allow uploaded jar directory to be configurable

[ https://issues.apache.org/jira/browse/FLINK-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4308: Description: I notice sometimes it's preferable to have uploaded jars to be put into a

[jira] [Updated] (FLINK-4308) Allow uploaded jar directory to be configurable

[ https://issues.apache.org/jira/browse/FLINK-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4308: Description: I notice sometimes it's preferable to have uploaded jars to be put into a

[jira] [Created] (FLINK-4308) Allow uploaded jar directory to be configurable

Zhenzhong Xu created FLINK-4308: --- Summary: Allow uploaded jar directory to be configurable Key: FLINK-4308 URL: https://issues.apache.org/jira/browse/FLINK-4308 Project: Flink Issue Type:

[jira] [Updated] (FLINK-4819) Checkpoint metadata+data inspection tool (view / update)

[ https://issues.apache.org/jira/browse/FLINK-4819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4819: Description: Checkpoint inspection tool for operationalization, troubleshooting, diagnostics, etc,

[jira] [Resolved] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu resolved FLINK-4660. - Resolution: Fixed > HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in

[jira] [Commented] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872727#comment-15872727 ] Zhenzhong Xu commented on FLINK-4660: - This is fixed,closing. > HadoopFileSystem (with S3A) may leak

[jira] [Closed] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu closed FLINK-4660. --- > HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in > a restarting loop >

[jira] [Assigned] (FLINK-4371) Add ability to take savepoints from job manager RESTful API

[ https://issues.apache.org/jira/browse/FLINK-4371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu reassigned FLINK-4371: --- Assignee: Zhenzhong Xu > Add ability to take savepoints from job manager RESTful API >

[jira] [Created] (FLINK-4545) Flink automatically manages TM network buffer

Zhenzhong Xu created FLINK-4545: --- Summary: Flink automatically manages TM network buffer Key: FLINK-4545 URL: https://issues.apache.org/jira/browse/FLINK-4545 Project: Flink Issue Type: Wish

[jira] [Commented] (FLINK-4760) Kafka 09 Consumer failed to initialize state because of corrupted operator state and not able to recover

[ https://issues.apache.org/jira/browse/FLINK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556026#comment-15556026 ] Zhenzhong Xu commented on FLINK-4760: - We are using v1.2 Commit: f3d7fa7. Can you confirm this commit

[jira] [Created] (FLINK-4760) Kafka 09 Consumer failed to initialize state causing job to restart

Zhenzhong Xu created FLINK-4760: --- Summary: Kafka 09 Consumer failed to initialize state causing job to restart Key: FLINK-4760 URL: https://issues.apache.org/jira/browse/FLINK-4760 Project: Flink

[jira] [Updated] (FLINK-4760) Kafka 09 Consumer failed to initialize state because of corrupted operator state and not able to recover

[ https://issues.apache.org/jira/browse/FLINK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4760: Summary: Kafka 09 Consumer failed to initialize state because of corrupted operator state and not

[jira] [Updated] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4660: Attachment: Screen Shot 2016-09-20 at 2.49.32 PM.png Screen Shot 2016-09-20 at

[jira] [Updated] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4660: Description: Flink job with checkpoints enabled and configured to use S3A file system backend,

[jira] [Updated] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4660: Description: Flink job with checkpoints enabled and configured to use S3A file system backend,

[jira] [Updated] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4660: Description: Flink job with checkpoints enabled and configured to use S3A file system backend,

[jira] [Updated] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4660: Description: Flink job with checkpoints enabled and configured to use S3A file system backend,

[jira] [Created] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

Zhenzhong Xu created FLINK-4660: --- Summary: HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop Key: FLINK-4660 URL: https://issues.apache.org/jira/browse/FLINK-4660

[jira] [Updated] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4660: Description: Flink job with checkpoints enabled and configured to use S3A file system backend,

[jira] [Updated] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4660: Description: Flink job with checkpoints enabled and configured to use S3A file system backend,

[jira] [Updated] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4660: Description: Flink job with checkpoints enabled and configured to use S3A file system backend,

[jira] [Updated] (FLINK-4660) HadoopFileSystem (with S3A) may leak connections, which cause job to stuck in a restarting loop

[ https://issues.apache.org/jira/browse/FLINK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4660: Description: Flink job with checkpoints enabled and configured to use S3A file system backend,

[jira] [Commented] (FLINK-4218) Sporadic "java.lang.RuntimeException: Error triggering a checkpoint..." causes task restarting

[ https://issues.apache.org/jira/browse/FLINK-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514093#comment-15514093 ] Zhenzhong Xu commented on FLINK-4218: - I think simply have retries potentially with configurable retry

[jira] [Created] (FLINK-4819) Checkpoint metadata+data inspection tool (view / update)

Zhenzhong Xu created FLINK-4819: --- Summary: Checkpoint metadata+data inspection tool (view / update) Key: FLINK-4819 URL: https://issues.apache.org/jira/browse/FLINK-4819 Project: Flink Issue

[jira] [Created] (FLINK-4820) Slf4j / log4j version upgrade to support dynamic change of log levels.

Zhenzhong Xu created FLINK-4820: --- Summary: Slf4j / log4j version upgrade to support dynamic change of log levels. Key: FLINK-4820 URL: https://issues.apache.org/jira/browse/FLINK-4820 Project: Flink

[jira] [Created] (FLINK-7278) Flink job can stuck while ZK leader reelected during ZK cluster migration

Zhenzhong Xu created FLINK-7278: --- Summary: Flink job can stuck while ZK leader reelected during ZK cluster migration Key: FLINK-7278 URL: https://issues.apache.org/jira/browse/FLINK-7278 Project:

[jira] [Resolved] (FLINK-6923) Kafka connector needs to expose information about in-flight record in AbstractFetcher base class

[ https://issues.apache.org/jira/browse/FLINK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu resolved FLINK-6923. - Resolution: Won't Fix Close this as Won't fix, as by leveraging KeyedDeserializerSchema works

[jira] [Commented] (FLINK-4371) Add ability to take savepoints from job manager RESTful API

[ https://issues.apache.org/jira/browse/FLINK-4371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075151#comment-16075151 ] Zhenzhong Xu commented on FLINK-4371: - [~uce] Sure, go for it! Thanks for driving! > Add ability to

[jira] [Commented] (FLINK-7278) Flink job can stuck while ZK leader reelected during ZK cluster migration

[ https://issues.apache.org/jira/browse/FLINK-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120845#comment-16120845 ] Zhenzhong Xu commented on FLINK-7278: - [~trohrm...@apache.org] unfortunately, we don't have logs for

[jira] [Commented] (FLINK-6923) Kafka connector needs to expose information about in-flight record in AbstractFetcher base class

[ https://issues.apache.org/jira/browse/FLINK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056437#comment-16056437 ] Zhenzhong Xu commented on FLINK-6923: - created PR https://github.com/apache/flink/pull/4149 > Kafka

[jira] [Created] (FLINK-6998) Kafka connector needs to expose metrics for failed/successful offset commits in the Kafka Consumer callback

Zhenzhong Xu created FLINK-6998: --- Summary: Kafka connector needs to expose metrics for failed/successful offset commits in the Kafka Consumer callback Key: FLINK-6998 URL:

[jira] [Assigned] (FLINK-6998) Kafka connector needs to expose metrics for failed/successful offset commits in the Kafka Consumer callback

[ https://issues.apache.org/jira/browse/FLINK-6998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu reassigned FLINK-6998: --- Assignee: Zhenzhong Xu > Kafka connector needs to expose metrics for failed/successful

[jira] [Updated] (FLINK-6998) Kafka connector needs to expose metrics for failed/successful offset commits in the Kafka Consumer callback

[ https://issues.apache.org/jira/browse/FLINK-6998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-6998: Description: Propose to add "successful-commits" and "failed-commits" metrics in

[jira] [Updated] (FLINK-6998) Kafka connector needs to expose metrics for failed/successful offset commits in the Kafka Consumer callback

[ https://issues.apache.org/jira/browse/FLINK-6998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-6998: Description: Propose to add "kafkaCommitsSucceeded" and "kafkaCommitsFailed" metrics in

[jira] [Updated] (FLINK-6998) Kafka connector needs to expose metrics for failed/successful offset commits in the Kafka Consumer callback

[ https://issues.apache.org/jira/browse/FLINK-6998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-6998: Description: Propose to add "kafka-commits-succeeded" and "kafka-commits-failed" metrics in

[jira] [Assigned] (FLINK-6923) Kafka connector needs to expose information about in-flight record in AbstractFetcher base class

[ https://issues.apache.org/jira/browse/FLINK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu reassigned FLINK-6923: --- Assignee: Zhenzhong Xu > Kafka connector needs to expose information about in-flight record

[jira] [Created] (FLINK-6923) Kafka connector needs to expose information about in-flight record in AbstractFetcher base class

Zhenzhong Xu created FLINK-6923: --- Summary: Kafka connector needs to expose information about in-flight record in AbstractFetcher base class Key: FLINK-6923 URL: https://issues.apache.org/jira/browse/FLINK-6923

[jira] [Updated] (FLINK-6923) Kafka connector needs to expose information about in-flight record in AbstractFetcher base class

[ https://issues.apache.org/jira/browse/FLINK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-6923: Description: We have a use case where we have our custom Fetcher implementation that extends

[jira] [Updated] (FLINK-7844) Fine Grained Recovery triggers checkpoint timeout failure

[ https://issues.apache.org/jira/browse/FLINK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-7844: Description: Context: We are using "individual" failover (fine-grained) recovery strategy for our

[jira] [Created] (FLINK-7844) Fine Grained Recovery triggers checkpoint timeout failure

Zhenzhong Xu created FLINK-7844: --- Summary: Fine Grained Recovery triggers checkpoint timeout failure Key: FLINK-7844 URL: https://issues.apache.org/jira/browse/FLINK-7844 Project: Flink Issue

[jira] [Updated] (FLINK-7844) Fine Grained Recovery triggers checkpoint timeout failure

[ https://issues.apache.org/jira/browse/FLINK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-7844: Attachment: screenshot-1.png > Fine Grained Recovery triggers checkpoint timeout failure >

[jira] [Updated] (FLINK-7844) Fine Grained Recovery triggers checkpoint timeout failure

[ https://issues.apache.org/jira/browse/FLINK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-7844: Description: Context: We are using "individual" failover (fine-grained) recovery strategy for our

[jira] [Comment Edited] (FLINK-7844) Fine Grained Recovery triggers checkpoint timeout failure

[ https://issues.apache.org/jira/browse/FLINK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206280#comment-16206280 ] Zhenzhong Xu edited comment on FLINK-7844 at 10/16/17 5:58 PM: ---

[jira] [Comment Edited] (FLINK-7844) Fine Grained Recovery triggers checkpoint timeout failure

[ https://issues.apache.org/jira/browse/FLINK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206280#comment-16206280 ] Zhenzhong Xu edited comment on FLINK-7844 at 10/16/17 5:46 PM: ---

[jira] [Assigned] (FLINK-7844) Fine Grained Recovery triggers checkpoint timeout failure

[ https://issues.apache.org/jira/browse/FLINK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu reassigned FLINK-7844: --- Assignee: Zhenzhong Xu > Fine Grained Recovery triggers checkpoint timeout failure >

[jira] [Commented] (FLINK-7844) Fine Grained Recovery triggers checkpoint timeout failure

[ https://issues.apache.org/jira/browse/FLINK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206280#comment-16206280 ] Zhenzhong Xu commented on FLINK-7844: - [~till.rohrmann] We have a use case where Task Managers will be

[jira] [Comment Edited] (FLINK-7844) Fine Grained Recovery triggers checkpoint timeout failure

[ https://issues.apache.org/jira/browse/FLINK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210134#comment-16210134 ] Zhenzhong Xu edited comment on FLINK-7844 at 10/18/17 10:14 PM:

[jira] [Commented] (FLINK-7844) Fine Grained Recovery triggers checkpoint timeout failure

[ https://issues.apache.org/jira/browse/FLINK-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210134#comment-16210134 ] Zhenzhong Xu commented on FLINK-7844: - [~till.rohrmann] Another question regarding checkpoint

[jira] [Created] (FLINK-7894) Improve metrics around fine-grained recovery and associated checkpointing behaviors

Zhenzhong Xu created FLINK-7894: --- Summary: Improve metrics around fine-grained recovery and associated checkpointing behaviors Key: FLINK-7894 URL: https://issues.apache.org/jira/browse/FLINK-7894

[jira] [Updated] (FLINK-33765) Flink SQL to support COLLECT_LIST

[ https://issues.apache.org/jira/browse/FLINK-33765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-33765: - Description: Flink SQL currently supports COLLECT, which returns a multiset, however, given

[jira] [Updated] (FLINK-33765) Flink SQL to support COLLECT_LIST

[ https://issues.apache.org/jira/browse/FLINK-33765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-33765: - Summary: Flink SQL to support COLLECT_LIST (was: Flink SQL to support COLLECTLIST) > Flink

[jira] [Created] (FLINK-33765) Flink SQL to support COLLECTLIST

Zhenzhong Xu created FLINK-33765: Summary: Flink SQL to support COLLECTLIST Key: FLINK-33765 URL: https://issues.apache.org/jira/browse/FLINK-33765 Project: Flink Issue Type: Improvement