[jira] [Comment Edited] (FLINK-19099) consume kafka message repeat
[ https://issues.apache.org/jira/browse/FLINK-19099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187653#comment-17187653 ] zouwenlong edited comment on FLINK-19099 at 8/31/20, 11:25 AM: --- [~danny0405] I used data stream,not SQL !image-2020-08-31-19-25-09-548.png! was (Author: moon_...@foxmail.com): [~danny0405] I used data stream,not SQL !image-2020-08-31-19-23-59-038.png! > consume kafka message repeat > > > Key: FLINK-19099 > URL: https://issues.apache.org/jira/browse/FLINK-19099 > Project: Flink > Issue Type: Bug > Components: API / DataStream, Connectors / Kafka >Affects Versions: 1.11.0 >Reporter: zouwenlong >Priority: Major > Attachments: image-2020-08-31-19-23-59-038.png, > image-2020-08-31-19-25-09-548.png > > > when taksmanager be killed ,my job consume some message , but the offset in > not commit, > then restart it ,my job consume kafka message repeat, I used checkpoint and > set 5 seconds , > I think this is a very common problem,how to solve this problem? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-19099) consume kafka message repeat
[ https://issues.apache.org/jira/browse/FLINK-19099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187653#comment-17187653 ] zouwenlong commented on FLINK-19099: [~danny0405] I used data stream,not SQL !image-2020-08-31-19-23-59-038.png! > consume kafka message repeat > > > Key: FLINK-19099 > URL: https://issues.apache.org/jira/browse/FLINK-19099 > Project: Flink > Issue Type: Bug > Components: API / DataStream, Connectors / Kafka >Affects Versions: 1.11.0 >Reporter: zouwenlong >Priority: Major > Attachments: image-2020-08-31-19-23-59-038.png > > > when taksmanager be killed ,my job consume some message , but the offset in > not commit, > then restart it ,my job consume kafka message repeat, I used checkpoint and > set 5 seconds , > I think this is a very common problem,how to solve this problem? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-19099) consume kafka message repeat
[ https://issues.apache.org/jira/browse/FLINK-19099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zouwenlong updated FLINK-19099: --- Attachment: image-2020-08-31-19-23-59-038.png > consume kafka message repeat > > > Key: FLINK-19099 > URL: https://issues.apache.org/jira/browse/FLINK-19099 > Project: Flink > Issue Type: Bug > Components: API / DataStream, Connectors / Kafka >Affects Versions: 1.11.0 >Reporter: zouwenlong >Priority: Major > Attachments: image-2020-08-31-19-23-59-038.png > > > when taksmanager be killed ,my job consume some message , but the offset in > not commit, > then restart it ,my job consume kafka message repeat, I used checkpoint and > set 5 seconds , > I think this is a very common problem,how to solve this problem? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-19099) consume kafka message repeat
[ https://issues.apache.org/jira/browse/FLINK-19099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zouwenlong updated FLINK-19099: --- Summary: consume kafka message repeat (was: consumer kafka message repeat) > consume kafka message repeat > > > Key: FLINK-19099 > URL: https://issues.apache.org/jira/browse/FLINK-19099 > Project: Flink > Issue Type: Bug > Components: API / DataStream, Connectors / Kafka >Affects Versions: 1.11.0 >Reporter: zouwenlong >Priority: Major > > when taksmanager be killed ,my job consume some message , but the offset in > not commit, > then restart it ,my job consume kafka message repeat, I used checkpoint and > set 5 seconds , > I think this is a very common problem,how to solve this problem? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19099) consumer kafka message repeat
zouwenlong created FLINK-19099: -- Summary: consumer kafka message repeat Key: FLINK-19099 URL: https://issues.apache.org/jira/browse/FLINK-19099 Project: Flink Issue Type: Bug Components: API / DataStream, Connectors / Kafka Affects Versions: 1.11.0 Reporter: zouwenlong when taksmanager be killed ,my job consume some message , but the offset in not commit, then restart it ,my job consume kafka message repeat, I used checkpoint and set 5 seconds , I think this is a very common problem,how to solve this problem? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18251) Cannot create index by time field?
zouwenlong created FLINK-18251: -- Summary: Cannot create index by time field? Key: FLINK-18251 URL: https://issues.apache.org/jira/browse/FLINK-18251 Project: Flink Issue Type: Improvement Components: Connectors / ElasticSearch Affects Versions: 1.10.1 Reporter: zouwenlong {{when i use "index-\{timestamp|-MM-dd}" to set index ,it not work. I write wrong or flink is not support it?}} {{eg: }} {{ }}{{return}} {{Requests.indexRequest()}} {{ }}{{.index("index-\{timestamp|-MM-dd}"}}{{)}} {{ }}{{.type("type"}}{{)}} {{ }}{{.source(o);}} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18249) Cannot create index by time field?
zouwenlong created FLINK-18249: -- Summary: Cannot create index by time field? Key: FLINK-18249 URL: https://issues.apache.org/jira/browse/FLINK-18249 Project: Flink Issue Type: Improvement Components: Connectors / ElasticSearch Affects Versions: 1.10.1 Reporter: zouwenlong Attachments: image-2020-06-11-16-22-36-912.png when i use "index-\{timestamp|-MM-dd}" to set index ,it not work. I write wrong or flink is not support it? !image-2020-06-11-16-22-36-912.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)