Re: [DISCUSS] What parts of the Python API should we focus on next ?

2019-12-22 文章 jincheng sun
gt; On Wed, Dec 18, 2019 at 19:05 jincheng sun > wrote: > >> Also CC user-zh. >> >> Best, >> Jincheng >> >> >> jincheng sun 于2019年12月19日周四 上午10:20写道: >> >>> Hi folks, >>> >>> As release-1.10 is under feature-fre

Re: [DISCUSS] What parts of the Python API should we focus on next ?

2019-12-18 文章 jincheng sun
Also CC user-zh. Best, Jincheng jincheng sun 于2019年12月19日周四 上午10:20写道: > Hi folks, > > As release-1.10 is under feature-freeze(The stateless Python UDF is > already supported), it is time for us to plan the features of PyFlink for > the next release. > > To make sure t

Re: [VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

2020-02-10 文章 jincheng sun
l > and no exception. > - Try a word count example in IDE with Python 2.7.15 and Python 3.7.5, run > well and no exception. > > Best, > Wei > > > 在 2020年2月10日,19:12,jincheng sun 写道: > > Hi everyone, > > Please review and vote on the release candidate #1 f

[DISCUSS] Upload the Flink Python API 1.9.x to PyPI for user convenience.

2020-02-03 文章 jincheng sun
Hi folks, I am very happy to receive some user inquiries about the use of Flink Python API (PyFlink) recently. One of the more common questions is whether it is possible to install PyFlink without using source code build. The most convenient and natural way for users is to use `pip install

[VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

2020-02-10 文章 jincheng sun
Hi everyone, Please review and vote on the release candidate #1 for the PyFlink version 1.9.2, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * the official

[ANNOUNCE] Apache Flink Python API(PyFlink) 1.9.2 released

2020-02-12 文章 jincheng sun
Hi everyone, The Apache Flink community is very happy to announce the release of Apache Flink Python API(PyFlink) 1.9.2, which is the first release to PyPI for the Apache Flink Python API 1.9 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing,

Re: [VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

2020-02-12 文章 jincheng sun
t;> > >>> > On Tue, Feb 11, 2020 at 12:17 PM Dian Fu >>> wrote: >>> > >>> > > +1 (non-binding) >>> > > >>> > > - Verified the signature and checksum >>> > > - Pip installed the package successfully: pip install >

[ANNOUNCE] Dian Fu becomes a Flink committer

2020-01-16 文章 jincheng sun
Hi everyone, I'm very happy to announce that Dian accepted the offer of the Flink PMC to become a committer of the Flink project. Dian Fu has been contributing to Flink for many years. Dian Fu played an essential role in PyFlink/CEP/SQL/Table API modules. Dian Fu has contributed several major

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

2020-01-16 文章 jincheng sun
Congrats Dian Fu and welcome on board! Best, Jincheng Shuo Cheng 于2020年1月16日周四 下午6:22写道: > Congratulations! Dian Fu > > > Xingbo Wei Zhong 于2020年1月16日周四 下午6:13写道: jincheng sun > 于2020年1月16日周四 下午5:58写道: >

Re: [udf questions]

2020-03-26 文章 jincheng sun
比较明显的一个问题是UDF定义有些问题是你的sink表定义了一个STRING类型的字段,但是你SQL里面是SELECT了udf的结果,所以我想你的UDF应该也返回一个STRING,也就是result_type=DataTypes.STRING(),同时确保你udf真的返回的是一个字符串,不是json的Object。 Best, Jincheng WuPangang 于2020年3月26日周四 下午5:24写道: > Data as below: > >

Re: flink1.10 & pyflink相关问题咨询

2020-03-26 文章 jincheng sun
stall apache-flink > 5.venv/bin/pip install pydemo.tar.gz > 6.zip -r venv.zip venv > 7.bin/flink run -pyarch venv.zip -pyexec venv.zip/venv/bin/python -py > ./word_count_socket.py -j pydemo.jar > > 不知道前辈是否有遇到过类似情况呢? > > 完整异常栈信息 & 作业见附件 > > jincheng sun 于2020年3月19日周四 下

Re: Re: Re: Re: 向您请教pyflink在windows上运行的问题,我第一次接触flink。

2020-03-26 文章 jincheng sun
第一行错误信息是没有安装 bash ? xu1990xaut 于2020年3月26日周四 下午12:12写道: > 孙老师,我按照您视频里的方法把flink包安装好了。 但是运行您提供得demo时出现下面这个错误。 我在网上找了好久还是没解决。 > 望老师再指点指点。 > > > > > > 在 2020-03-25 15:47:49,"jincheng sun" 写道: > > 哦,PyFlink目前不支持windows。 > > Best, > Jinche

Re: 向您请教pyflink在windows上运行的问题,我第一次接触flink。

2020-03-24 文章 jincheng sun
很高兴收到您的邮件,我不太确定您具体看的是哪一个视频,所以很难确定您遇到的问题原因。您可以参考官方文档[1], 同时我个人博客里有一些3分钟的视频和文档入门教程[2],您可以先查阅一下。如又问题,可以保持邮件沟通,可以在我的博客留言! [1] https://ci.apache.org/projects/flink/flink-docs-release-1.10/tutorials/python_table_api.html [2] https://enjoyment.cool/ Best, Jincheng xu1990xaut 于2020年3月24日周二

Re: 【PyFlink】对于数据以Csv()格式写入kafka报错,以及使用python udf时无法启动udf

2020-03-24 文章 jincheng sun
e-flink的时候发现有很多依赖,而且在安装时候要求安装beam的2.15.0的版本,我就安上了2.15.0。flink版本是1.10,没有从源码编译。因此我们也很困扰现在,希望能够求得帮助。 >> >> 还有个小问题,就是我看到似乎你没有把日志一起转到邮件列表中,我想附带上去,那么我在订阅后,直接回复可以把日志贴上去吗? >> >> 顺祝,周末愉快:)非常感谢回复! >> >> 彭哲夫 >> >> On Fri, Mar 20, 2020 at 22:34 jincheng sun >&

Re: Re: 向您请教pyflink在windows上运行的问题,我第一次接触flink。

2020-03-25 文章 jincheng sun
- xu1990xaut 于2020年3月25日周三 下午2:23写道: > 孙老师您好,我之前在网上看的是这个视频《【Apache Flink 进阶教程】14课. Apache Flink Python API > 的现状及未来规划》。 今天我也在虚拟机下试了,还是无法运行。 > 我用的是flink1.10,python3.6。 麻烦老师指点指点。 > > > > > > > 在 2020-03-25 11:32:29,"jincheng sun" 写道: > > 很高兴收到您的

Re: [ANNOUNCE] Apache Flink 1.9.3 released

2020-04-25 文章 jincheng sun
Thanks for your great job, Dian! Best, Jincheng Hequn Cheng 于2020年4月25日周六 下午8:30写道: > @Dian, thanks a lot for the release and for being the release manager. > Also thanks to everyone who made this release possible! > > Best, > Hequn > > On Sat, Apr 25, 2020 at 7:57 PM Dian Fu wrote: > >> Hi

Re: Python UDF from Java

2020-04-30 文章 jincheng sun
Thanks Flavio and Thanks Marta, That's a good question as many user want to know that! CC to user-zh mailing list :) Best, Jincheng - Twitter: https://twitter.com/sunjincheng121 - Flavio Pompermaier 于2020年5月1日周五 上午7:04写道: > Yes, that's awesome! I think this would

Re: 【PyFlink】对于数据以Csv()格式写入kafka报错,以及使用python udf时无法启动udf

2020-03-20 文章 jincheng sun
.apache.flink.streaming.runtime.tasks.StreamTask.lambda$beforeInvoke$0(StreamTask.java:454) >> at >> org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$SynchronizedStreamTaskActionExecutor.runThrowing(StreamTaskActionExecutor.java:94) >> >> >> 我猜测原因正如你提到的worker的环境不符标准,我会在明天上

[ANNOUNCE] New PMC member: Dian Fu

2020-08-27 文章 jincheng sun
Hi all, On behalf of the Flink PMC, I'm happy to announce that Dian Fu is now part of the Apache Flink Project Management Committee (PMC). Dian Fu has been very active on PyFlink component, working on various important features, such as the Python UDF and Pandas integration, and keeps checking

Re: pyflink 问题请教

2020-05-25 文章 jincheng sun
你好,感谢你邮件中的问题! > 1. pyflink 是还没有对应到 java datastream api 和 dataset api 的底层api 吗? 有什么加入计划? 是的,PyDataStream的支持已经初步计划在1.12版本进行支持,近期我会发出PyFlink在1.12的初步规划! > 2. pyfilink的api 和Java api的命名是基本对应的吗? Python API 和 Java API要求语法语义高度一致,所以命名应该是对应的。 同时PyFlink会根据Python语言的特点在局部使用过程中进行一定的使用优化, 比如

Re: [DISCUSS] FLIP-133: Rework PyFlink Documentation

2020-08-04 文章 jincheng sun
tation is currently > organized is that it's relatively straightforward to compare the Python API > with the Java and Scala versions. I'm concerned that if the PyFlink docs > are more independent, it will be challenging to respond to questions about > which features from the other APIs are available from

Re: [DISCUSS] FLIP-133: Rework PyFlink Documentation

2020-08-03 文章 jincheng sun
;>> >> Thanks a lot for bringing up this discussion and the proposal. +1 to >>> >> improve the Python API doc. >>> >> >>> >> I have received many feedbacks from PyFlink beginners about >>> >> the PyFlink doc, e.g. the material

Re: [DISCUSS] FLIP-133: Rework PyFlink Documentation

2020-08-10 文章 jincheng sun
Thank you for your positive feedback Seth ! Would you please vote in the voting mail thread. Thank you! Best, Jincheng Seth Wiesman 于2020年8月10日周一 下午10:34写道: > I think this sounds good. +1 > > On Wed, Aug 5, 2020 at 8:37 PM jincheng sun > wrote: > >> Hi David,

Re: [DISCUSS] FLIP-133: Rework PyFlink Documentation

2020-08-05 文章 jincheng sun
ght of -- as in this case, where one can use a JDBC sink from >> Python if one thinks to use DDL. >> >> So I think it would be helpful to be explicit about both what is, and >> what is not, supported in PyFlink. And to have some very clear organizing >> principles in t

Re: pyflink数据查询

2020-06-15 文章 jincheng sun
你好 Jack, > pyflink 从source通过sql对数据进行查询聚合等操作 不输出到sink中,而是可以直接作为结果, 我这边可以通过开发web接口直接查询这个结果,不必去sink中进行查询 我理解你上面说的 【直接作为结果】+ 【web接口查询】已经包含了“sink”的动作。只是这个“sink” 是这样的实现而已。对于您的场景: 1. 如果您想直接将结果不落地(不存储)执行推送的 web页面,可以自定义一个Web Socket的Sink。 2. 如果您不是想直接推送到web页面,而是通过查询拉取结果,那么您上面说的

Re: pyflink的table api 能否根据 filed的值进行判断插入到不同的sink表中

2020-06-22 文章 jincheng sun
您好,jack: Table API 不用 if/else 直接用类似逻辑即可: val t1 = table.filter('x > 2).groupBy(..) val t2 = table.filter('x <= 2).groupBy(..) t1.insert_into("sink1) t2.insert_into("sink2") Best, Jincheng jack 于2020年6月19日周五 上午10:35写道: > > 测试使用如下结构: > table= t_env.from_path("source") > > if

[ANNOUNCE] Yu Li is now part of the Flink PMC

2020-06-16 文章 jincheng sun
Hi all, On behalf of the Flink PMC, I'm happy to announce that Yu Li is now part of the Apache Flink Project Management Committee (PMC). Yu Li has been very active on Flink's Statebackend component, working on various improvements, for example the RocksDB memory management for 1.10. and keeps

[DISCUSS] FLIP-133: Rework PyFlink Documentation

2020-07-30 文章 jincheng sun
Hi folks, Since the release of Flink 1.11, users of PyFlink have continued to grow. As far as I know there are many companies have used PyFlink for data analysis, operation and maintenance monitoring business has been put into production(Such as 聚美优品[1](Jumei), 浙江墨芷[2] (Mozhi) etc.). According