Re: flink解析kafka json数据

2020-07-25 Thread 吴 祥平
改用csv用一个很不常用的分隔符去获取是可以的,比如/u0005 Get Outlook for Android

Re: Is there a way to use stream API with this program?

2020-07-25 Thread David Anderson
In this use case, couldn't the custom trigger register an event time timer for MAX_WATERMARK, which would be triggered when the bounded input reaches its end? David On Mon, Jul 20, 2020 at 5:47 PM Piotr Nowojski wrote: > Hi, > > I'm afraid that there is not out of the box way of doing this.

Re: Count of records coming into the Flink App from KDS and at each step through Execution Graph

2020-07-25 Thread David Anderson
Setting up a Flink metrics dashboard in Grafana requires setting up and configuring one of Flink's metrics reporters [1] that is supported by Grafana as a data source. That means your options for a metrics reporter are Graphite, InfluxDB, Prometheus, or the Prometheus push reporter. If you want

Re: Flink 1.11 job stop with save point timeout error

2020-07-25 Thread Congxian Qiu
Hi Ivan From the JM log, the savepoint complete with 1 second, and the timeout exception said that the stop-with-savepoint can not be completed in 60s(this was calculated by 20 -- RestOptions#RETRAY_MAX_ATTEMPTS * 3s -- RestOptions#RETRY_DELAY. you can check the logic here[1]). I'm not sure

Re: metrics influxdb reporter 不支持https及jar放置路径问题

2020-07-25 Thread Congxian Qiu
Hi 感谢你的反馈,你可以创建两个 issue 来分别跟进反馈的这两个问题。如果你有兴趣的话,也可以尝试对这两个问题进行共享的 Best, Congxian zz zhang 于2020年7月23日周四 下午5:02写道: > hello,目前Flink1.11.1 > > 发布的org.apache.flink.metrics.influxdb.InfluxdbReporter默认是上报是http协议,并不支持https协议,源码参考[2] > > 另外,文档[1]标注的需要将 >

Re: 自定义metrics reporter 如何不通过flink conf来注册并生效

2020-07-25 Thread Congxian Qiu
Hi Fisher 尝试理解一下你的需求,你自己实现了一个 report,也希望在 source 和 sink 中计算一些 metric,希望把 source 和 sink 的这些 metric 通过自定义的 report 上报到你指定的地方。然后不希望在 env 里面配置 report 的信息,是这样吗? 能否解释下为什么不希望在 flink-conf 中进行配置,而是希望在 env 中进行配置吗 Best, Congxian Fisher Xiang 于2020年7月23日周四 下午10:16写道: > Hi all, > > 请问实现了

????: flink1.11??????????????????mysql????????

2020-07-25 Thread chengyanan1...@foxmail.com
Hello?? flink1.11.0??kafka?? mysqlsink.buffer-flush.max-rows1000