Re: A little doubt about the blog A Deep To Flink's NetworkStack

2019-06-16 Thread aitozi
Hi Zhijiang, Thanks for your explanation, I have understood it. My former thoughts was wrong, the real TCP channel was established when createPartitionRequestClient. Thanks, Aitozi -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

回复: flink 自定义UDTF函数

2019-06-16 Thread liu_mingzhang
@Jark Wu @Zili Chen 感谢两位大佬帮忙解答哈~ 在2019年6月17日 11:57,Zili Chen 写道: @imj...@gmail.com 这个问题已经在另一个 thread 【Types源码】下解答了 Best, tison. Jark Wu 于2019年6月17日周一 上午11:26写道: Hi Liu, 好像还是没有收到你的函数源码? 你可以尝试将源码粘贴过来,不要粘贴图片。 On Mon, 17 Jun 2019 at 10:09, liu_mingzhang wrote: 自定义的函数如下:

Re: flink 自定义UDTF函数

2019-06-16 Thread Zili Chen
@imj...@gmail.com 这个问题已经在另一个 thread 【Types源码】下解答了 Best, tison. Jark Wu 于2019年6月17日周一 上午11:26写道: > Hi Liu, > > 好像还是没有收到你的函数源码? 你可以尝试将源码粘贴过来,不要粘贴图片。 > > On Mon, 17 Jun 2019 at 10:09, liu_mingzhang wrote: > > > 自定义的函数如下: > > > > > > 源码中注释里的示例也是这样写的,但是编译报错... > > > > 在2019年6月15日 15:52,Hequn

Re: flink 自定义UDTF函数

2019-06-16 Thread Jark Wu
Hi Liu, 好像还是没有收到你的函数源码? 你可以尝试将源码粘贴过来,不要粘贴图片。 On Mon, 17 Jun 2019 at 10:09, liu_mingzhang wrote: > 自定义的函数如下: > > > 源码中注释里的示例也是这样写的,但是编译报错... > > 在2019年6月15日 15:52,Hequn Cheng > 写道: > > 自定义的函数忘贴了么 :) > > On Fri, Jun 14, 2019 at 6:58 PM liu_mingzhang > wrote: > > > 我希望自定义一个这样功能的UDTF, > >

回复: Types源码

2019-06-16 Thread liu_mingzhang
非常感谢您的回复! 现在编译已经不报错了. 我试试运行一下, 非常感谢! 在2019年6月17日 10:57,Xingcan Cui 写道: 你好,看故障猜测是Scala类型推断机制问题,用.asInstanceOf[Array[TypeInformation[_]强转一下即可。 On Jun 16, 2019, at 10:33 PM, liu_mingzhang wrote: 感谢您的回复, 我试过运行了, 编译报错, 无法build project 另外您贴的issue我这里打不开... 在2019年6月17日 10:27,Zili Chen 写道:

Re: Types源码

2019-06-16 Thread Xingcan Cui
你好,看故障猜测是Scala类型推断机制问题,用.asInstanceOf[Array[TypeInformation[_]强转一下即可。 > On Jun 16, 2019, at 10:33 PM, liu_mingzhang wrote: > > 感谢您的回复, 我试过运行了, 编译报错, 无法build project > 另外您贴的issue我这里打不开... > > > 在2019年6月17日 10:27,Zili Chen 写道: > 你试过直接运行吗?IDEA 有时候对 Scala 的类型推断有问题,可以编译运行的代码会误报类型不匹配。如果可以运行应该是 IDEA

回复: Types源码

2019-06-16 Thread liu_mingzhang
感谢您的回复, 我试过运行了, 编译报错, 无法build project 另外您贴的issue我这里打不开... 在2019年6月17日 10:27,Zili Chen 写道: 你试过直接运行吗?IDEA 有时候对 Scala 的类型推断有问题,可以编译运行的代码会误报类型不匹配。如果可以运行应该是 IDEA 的问题,可以到相应的 issue tracker[1] 报告。 Best, tison. [1] https://youtrack.jetbrains.com/oauth?state=%2Fissues%2FIDEA liu_mingzhang

Re: Types源码

2019-06-16 Thread Zili Chen
你试过直接运行吗?IDEA 有时候对 Scala 的类型推断有问题,可以编译运行的代码会误报类型不匹配。如果可以运行应该是 IDEA 的问题,可以到相应的 issue tracker[1] 报告。 Best, tison. [1] https://youtrack.jetbrains.com/oauth?state=%2Fissues%2FIDEA liu_mingzhang 于2019年6月17日周一 上午10:22写道: > > 我希望自定义一个这样功能的UDTF, > > 将表中原始数据: > idfiled1field2 > 1

Types源码

2019-06-16 Thread liu_mingzhang
我希望自定义一个这样功能的UDTF, 将表中原始数据: idfiled1field2 1 A,B,C D,E,F 转换成: idnumfiled1field2 1 1AD 1 2BE 1 3CF 下面是我自己写的函数,但是报错

Re: A little doubt about the blog A Deep To Flink's NetworkStack

2019-06-16 Thread zhijiang
Hi Aitozi, The current connection sharing is only suitbale for the same jobVertex between TaskMangaers via ConnectionIndex. I ever tried to remove this limit by ticket [1] but have not reached an agreement on this. You could watch this jira if interested. [1]

回复: flink 自定义UDTF函数

2019-06-16 Thread liu_mingzhang
自定义的函数如下: 源码中注释里的示例也是这样写的,但是编译报错... 在2019年6月15日 15:52,Hequn Cheng 写道: 自定义的函数忘贴了么 :) On Fri, Jun 14, 2019 at 6:58 PM liu_mingzhang wrote: 我希望自定义一个这样功能的UDTF, 将表中原始数据: idfiled1field2 1 A,B,C D,E,F 转换成: idnumfiled1field2 1 1A

Re: How to join/group 2 streams by key?

2019-06-16 Thread Congxian Qiu
Hi John I've seen other people have the same problem to solve, the following is their solution: union the two Datastreams, then use ProcsssFunction[1] to solve this, will also register timers to do GC things. [1]

回复: flink 自定义UDTF函数

2019-06-16 Thread liu_mingzhang
自定义的函数如下: 源码中注释里的示例也是这样写的,但是编译报错... 在2019年6月15日 15:52,Hequn Cheng 写道: 自定义的函数忘贴了么 :) On Fri, Jun 14, 2019 at 6:58 PM liu_mingzhang wrote: 我希望自定义一个这样功能的UDTF, 将表中原始数据: idfiled1field2 1 A,B,C D,E,F 转换成: idnumfiled1field2 1 1A

Re: Building flink from source---error of resolving dependencies

2019-06-16 Thread syed
DeAR Fabian; THANKS FOR YOUR ANSWER! I tried to build the flink again, but after several tries I am still facing the same error. Is there any other alternative to resolve the dependencies to successfully build the flink? Kind Regards; Syed -- Sent from:

Re: [ANNOUNCE] Weekly Community Update 2019/24

2019-06-16 Thread Zili Chen
Hi Konstantin and all, Thank Konstantin very much for reviving this tradition! It reminds me of the joyful time I can easily catch up interesting ongoing threads. Thanks for Till's work, too. Besides exciting updates and news above, I'd like to pick up some other threads you guys may be

[ANNOUNCE] Weekly Community Update 2019/24

2019-06-16 Thread Konstantin Knauf
Dear community, last year Till did a great job on summarizing recent developments in the Flink community in a "Weekly community update" thread. I found this very helpful and would like to revive this tradition with a focus on topics & threads which are particularly relevant to the wider community

A little doubt about the blog A Deep To Flink's NetworkStack

2019-06-16 Thread aitozi
Hi, community I read this blog A Deep To Flink's NetworkStack In the chapter *Physical Transport*, it says that the /if different subtasks of the same task are scheduled onto the same TaskManager, their network connections towards

Asynchronous I/O

2019-06-16 Thread Halfon, Roey
Hi All, I have a flow which contains few external REST calls, in few different operators. As I read in documentation, using AsyncFunction is the recommended way to execute these calls. Few questions regarding that: 1. Can someone explain better the 'capacity' parameter? How it affects