[jira] [Comment Edited] (FLINK-19099) consume kafka message repeat

2020-08-31 Thread zouwenlong (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-19099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187653#comment-17187653
 ] 

zouwenlong edited comment on FLINK-19099 at 8/31/20, 11:25 AM:
---

[~danny0405] I used data stream,not SQL 

!image-2020-08-31-19-25-09-548.png!


was (Author: moon_...@foxmail.com):
[~danny0405] I used data stream,not SQL 

!image-2020-08-31-19-23-59-038.png!

> consume kafka message repeat
> 
>
> Key: FLINK-19099
> URL: https://issues.apache.org/jira/browse/FLINK-19099
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream, Connectors / Kafka
>Affects Versions: 1.11.0
>Reporter: zouwenlong
>Priority: Major
> Attachments: image-2020-08-31-19-23-59-038.png, 
> image-2020-08-31-19-25-09-548.png
>
>
> when taksmanager be killed ,my job consume some message , but the offset in 
> not commit,
> then restart it ,my job consume kafka message repeat,  I used checkpoint  and 
> set 5 seconds ,
> I think this is a very common problem,how to solve this problem?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-19099) consume kafka message repeat

2020-08-31 Thread zouwenlong (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-19099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187653#comment-17187653
 ] 

zouwenlong commented on FLINK-19099:


[~danny0405] I used data stream,not SQL 

!image-2020-08-31-19-23-59-038.png!

> consume kafka message repeat
> 
>
> Key: FLINK-19099
> URL: https://issues.apache.org/jira/browse/FLINK-19099
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream, Connectors / Kafka
>Affects Versions: 1.11.0
>Reporter: zouwenlong
>Priority: Major
> Attachments: image-2020-08-31-19-23-59-038.png
>
>
> when taksmanager be killed ,my job consume some message , but the offset in 
> not commit,
> then restart it ,my job consume kafka message repeat,  I used checkpoint  and 
> set 5 seconds ,
> I think this is a very common problem,how to solve this problem?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-19099) consume kafka message repeat

2020-08-31 Thread zouwenlong (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-19099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zouwenlong updated FLINK-19099:
---
Attachment: image-2020-08-31-19-23-59-038.png

> consume kafka message repeat
> 
>
> Key: FLINK-19099
> URL: https://issues.apache.org/jira/browse/FLINK-19099
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream, Connectors / Kafka
>Affects Versions: 1.11.0
>Reporter: zouwenlong
>Priority: Major
> Attachments: image-2020-08-31-19-23-59-038.png
>
>
> when taksmanager be killed ,my job consume some message , but the offset in 
> not commit,
> then restart it ,my job consume kafka message repeat,  I used checkpoint  and 
> set 5 seconds ,
> I think this is a very common problem,how to solve this problem?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-19099) consume kafka message repeat

2020-08-31 Thread zouwenlong (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-19099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zouwenlong updated FLINK-19099:
---
Summary: consume kafka message repeat  (was: consumer kafka message repeat)

> consume kafka message repeat
> 
>
> Key: FLINK-19099
> URL: https://issues.apache.org/jira/browse/FLINK-19099
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream, Connectors / Kafka
>Affects Versions: 1.11.0
>Reporter: zouwenlong
>Priority: Major
>
> when taksmanager be killed ,my job consume some message , but the offset in 
> not commit,
> then restart it ,my job consume kafka message repeat,  I used checkpoint  and 
> set 5 seconds ,
> I think this is a very common problem,how to solve this problem?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-19099) consumer kafka message repeat

2020-08-31 Thread zouwenlong (Jira)
zouwenlong created FLINK-19099:
--

 Summary: consumer kafka message repeat
 Key: FLINK-19099
 URL: https://issues.apache.org/jira/browse/FLINK-19099
 Project: Flink
  Issue Type: Bug
  Components: API / DataStream, Connectors / Kafka
Affects Versions: 1.11.0
Reporter: zouwenlong


when taksmanager be killed ,my job consume some message , but the offset in not 
commit,

then restart it ,my job consume kafka message repeat,  I used checkpoint  and 
set 5 seconds ,

I think this is a very common problem,how to solve this problem?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-18251) Cannot create index by time field?

2020-06-11 Thread zouwenlong (Jira)
zouwenlong created FLINK-18251:
--

 Summary: Cannot create index by time field?
 Key: FLINK-18251
 URL: https://issues.apache.org/jira/browse/FLINK-18251
 Project: Flink
  Issue Type: Improvement
  Components: Connectors / ElasticSearch
Affects Versions: 1.10.1
Reporter: zouwenlong


{{when i use "index-\{timestamp|-MM-dd}" to set index ,it not work.  I 
write wrong or flink is not support it?}}
{{eg:   }}
{{  }}{{return}} {{Requests.indexRequest()}}
{{ }}{{.index("index-\{timestamp|-MM-dd}"}}{{)}}
{{ }}{{.type("type"}}{{)}}
{{ }}{{.source(o);}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-18249) Cannot create index by time field?

2020-06-11 Thread zouwenlong (Jira)
zouwenlong created FLINK-18249:
--

 Summary: Cannot create index by time field?
 Key: FLINK-18249
 URL: https://issues.apache.org/jira/browse/FLINK-18249
 Project: Flink
  Issue Type: Improvement
  Components: Connectors / ElasticSearch
Affects Versions: 1.10.1
Reporter: zouwenlong
 Attachments: image-2020-06-11-16-22-36-912.png

when i use "index-\{timestamp|-MM-dd}" to set index ,it not work.  I write 
wrong or flink is not support it?

!image-2020-06-11-16-22-36-912.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)