[jira] [Created] (FLINK-20989) Functions in ExplodeFunctionUtil should handle null data to avoid NPE

2021-01-14 Thread godfrey he (Jira)
godfrey he created FLINK-20989: -- Summary: Functions in ExplodeFunctionUtil should handle null data to avoid NPE Key: FLINK-20989 URL: https://issues.apache.org/jira/browse/FLINK-20989 Project: Flink

Re: [Discussion] More Deep Learning usages on Apache Flink

2021-01-14 Thread Becket Qin
Hi Qing, Thanks for raising the discussion. It is great to know the project DJL. If I understand correctly, the discussion is mostly about inference. DJL essentially provides a uniform Java API for people to use different deep learning engines. It is useful for people to combine Flink and DJL so

[jira] [Created] (FLINK-20988) Various resource allocation improvements for active resource managers

2021-01-14 Thread Xintong Song (Jira)
Xintong Song created FLINK-20988: Summary: Various resource allocation improvements for active resource managers Key: FLINK-20988 URL: https://issues.apache.org/jira/browse/FLINK-20988 Project: Flink

[DISCUSS] FLIP-158: Generalized incremental checkpoints

2021-01-14 Thread Khachatryan Roman
Hi devs, I'd like to start a discussion of FLIP-158: Generalized incremental checkpoints [1] FLIP motivation: Low end-to-end latency is a much-demanded property in many Flink setups. With exactly-once, this latency depends on checkpoint interval/duration which in turn is defined by the slowest

[jira] [Created] (FLINK-20987) Upgrade Stateful Functions to use Flink 1.12

2021-01-14 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-20987: --- Summary: Upgrade Stateful Functions to use Flink 1.12 Key: FLINK-20987 URL: https://issues.apache.org/jira/browse/FLINK-20987 Project: Flink

Re: Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-01-14 Thread Yun Gao
Hi all, We have some offline discussion together with @Arvid, @Roman and @Aljoscha and I'd like to post some points we discussed: 1) For the problem that the "new" root task coincidently finished before getting triggered successfully, we have listed two options in the FLIP-147[1], for the

[jira] [Created] (FLINK-20985) end the stream-job in docker container will remain some zombie processes in 1.11, these useless processes not be maked as zombie but still exist in 1.12

2021-01-14 Thread he jie (Jira)
he jie created FLINK-20985: -- Summary: end the stream-job in docker container will remain some zombie processes in 1.11, these useless processes not be maked as zombie but still exist in 1.12 Key: FLINK-20985 URL:

[jira] [Created] (FLINK-20986) GenericTypeInfo equality issue

2021-01-14 Thread Tianshi Zhu (Jira)
Tianshi Zhu created FLINK-20986: --- Summary: GenericTypeInfo equality issue Key: FLINK-20986 URL: https://issues.apache.org/jira/browse/FLINK-20986 Project: Flink Issue Type: Bug Affects

[jira] [Created] (FLINK-20983) FlinkKafkaProducerITCase.testMigrateFromAtExactlyOnceToAtLeastOnce failed with Timeout expired after 60000milliseconds while awaiting InitProducerId

2021-01-14 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-20983: -- Summary: FlinkKafkaProducerITCase.testMigrateFromAtExactlyOnceToAtLeastOnce failed with Timeout expired after 6milliseconds while awaiting InitProducerId Key: FLINK-20983 URL:

[jira] [Created] (FLINK-20984) can not convert an array into Table

2021-01-14 Thread Spongebob (Jira)
Spongebob created FLINK-20984: - Summary: can not convert an array into Table Key: FLINK-20984 URL: https://issues.apache.org/jira/browse/FLINK-20984 Project: Flink Issue Type: Improvement

[Discussion] More Deep Learning usages on Apache Flink

2021-01-14 Thread Qing Lan
Hi all, On behalf of the AWS DJL team, I would like to discuss about the Apache Flink's ML integration development. We would like to contribute some more Deep Learning (DL) based applications to Flink that including but not limited to TensorFlow, PyTorch, Apache MXNet, Apache TVM and more

Re: [DISCUSS] Planning Flink 1.13

2021-01-14 Thread Yangze Guo
Thanks for being the release managers, Guowei and Dawid. +1 for the proposed feature freeze date Best, Yangze Guo On Fri, Jan 15, 2021 at 2:01 AM Zhu Zhu wrote: > > +1 for Dawid and Guowei being the release managers and +1 for the proposed > feature freeze date > > Thanks, > Zhu > > Leonard Xu

[RESULT] [VOTE] Release 1.12.1, release candidate #2

2021-01-14 Thread Xintong Song
Hi everyone, I'm happy to announce that we have unanimously approved this release. There are 8 approving votes, 3 of which are binding: * Chesnay Schepler (binding) * Xintong Song (non-binding) * Yang Wang (non-binding) * Jark Wu (binding) * Xingbo Huang (non-binding) * Wei Zhong (non-binding) *

Re: [VOTE] Release 1.12.1, release candidate #2

2021-01-14 Thread Xintong Song
Thanks everyone for the verifications and votes. We have collected 3 binding votes and no vetoes. I'm closing this vote in another thread. Thank you~ Xintong Song On Fri, Jan 15, 2021 at 1:58 AM Zhu Zhu wrote: > +1 (binding) > > - verified checksums and signatures > - built from sources >

Re: InfluxDB Source Sink Connector

2021-01-14 Thread Leon Papke
The current connector is based on the Flink's old connector API and InfluxDB v1.X. InfluxDB's architecture change was quite an impact, hence, changes were made on both sides. Though, we are aware of the current implementation and investigate what we can reuse. Best Leon -- Sent from:

[jira] [Created] (FLINK-20982) Flink TaskManager throws RegistrationTimeoutException when using Kubernetes HA

2021-01-14 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created FLINK-20982: - Summary: Flink TaskManager throws RegistrationTimeoutException when using Kubernetes HA Key: FLINK-20982 URL: https://issues.apache.org/jira/browse/FLINK-20982

Re: [DISCUSS][FLINK-20726] Introduce Pulsar connector

2021-01-14 Thread 赵 建云
Hi Arvid, Thank you very much for being a mentor to the Flink community, I will finish submitting all the content as soon as possible. The PR submission will be supported by me and weijie Guo(wei...@streamnative.io). I have submitted PRs for

Re: [DISCUSS] Planning Flink 1.13

2021-01-14 Thread Zhu Zhu
+1 for Dawid and Guowei being the release managers and +1 for the proposed feature freeze date Thanks, Zhu Leonard Xu 于2021年1月15日周五 上午12:02写道: > Thanks Dawid & Guowei for starting the release cycle and volunteering as > the release managers. > > +1 for the rought feature freeze date. > > Best,

Re: [VOTE] Release 1.12.1, release candidate #2

2021-01-14 Thread Zhu Zhu
+1 (binding) - verified checksums and signatures - built from sources - ran batch and streaming testing jobs on a yarn cluster, verified results and logs Thanks, Zhu Leonard Xu 于2021年1月14日周四 下午11:56写道: > +1 (non-binding) > > - checked/verified signatures and hashes > - built from source code

Re: [VOTE] Release 1.12.1, release candidate #2

2021-01-14 Thread Leonard Xu
+1 (non-binding) - checked/verified signatures and hashes - built from source code with scala 2.11 success - checked that there are no missing artifacts - started a cluster, ran a wordcount job, no suspicious log output - tested using SQL Client to submit a simple SQL job and the query result is

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-14 Thread Seth Wiesman
Happy to see there is enthusiasm for this change, let me try and answers each of these questions. @Jark Wu Hugo has proper support for i18n which means we can move content into external files that can be easily translated[1]. For reference, Kubernetes has successfully used Hugo's built-in

[jira] [Created] (FLINK-20981) ArchivedExecutionGraph#createFromInitializingJob should support SUSPENDED as final state

2021-01-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-20981: Summary: ArchivedExecutionGraph#createFromInitializingJob should support SUSPENDED as final state Key: FLINK-20981 URL: https://issues.apache.org/jira/browse/FLINK-20981

[jira] [Created] (FLINK-20980) ResourceCounter#withResources accepts negative count

2021-01-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-20980: Summary: ResourceCounter#withResources accepts negative count Key: FLINK-20980 URL: https://issues.apache.org/jira/browse/FLINK-20980 Project: Flink

Re: [DISCUSS] Planning Flink 1.13

2021-01-14 Thread Aljoscha Krettek
On 2021/01/14 10:28, Till Rohrmann wrote: I've created a 1.13 wiki page [1] where we can collect the features we want to complete for the 1.13 release. [1] https://cwiki.apache.org/confluence/display/FLINK/1.13+Release Thanks! I've starting adding things to this.

Re: [DISCUSS] Planning Flink 1.13

2021-01-14 Thread Aljoscha Krettek
+1 to the rough feature freeze date and the proposed release managers Thanks for taking care of this! Best, Aljoscha On 2021/01/13 15:47, Dawid Wysakowicz wrote: Hi all, With the 1.12 being released some time ago already I thought it would be a good time to kickstart the 1.13 release cycle.

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-14 Thread David Anderson
I've spent a few hours digging into this with Seth, and can report that this makes working on the docs much less of a chore. +1 (with enthusiasm) Best, David On Thu, Jan 14, 2021 at 1:34 PM Kostas Kloudas wrote: > +1 for moving to Hugo. > > Cheers, > Kostas > > On Thu, Jan 14, 2021 at 1:27 PM

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-14 Thread Kostas Kloudas
+1 for moving to Hugo. Cheers, Kostas On Thu, Jan 14, 2021 at 1:27 PM Wei Zhong wrote: > > +1 for migrating to Hugo. > > Currently we have developed many plugins based on Jekyll because the native > features of Jekyll cannot meet our needs. It seems all of them can be > supported via Hugo

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-14 Thread Wei Zhong
+1 for migrating to Hugo. Currently we have developed many plugins based on Jekyll because the native features of Jekyll cannot meet our needs. It seems all of them can be supported via Hugo shortcodes and will become more concise. Best, Wei > 在 2021年1月14日,18:21,Aljoscha Krettek 写道: > > +1

[jira] [Created] (FLINK-20979) Wrong description of 'sink.bulk-flush.max-actions'

2021-01-14 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-20979: Summary: Wrong description of 'sink.bulk-flush.max-actions' Key: FLINK-20979 URL: https://issues.apache.org/jira/browse/FLINK-20979 Project: Flink

Re: [VOTE] Release 1.12.1, release candidate #2

2021-01-14 Thread Wei Zhong
+1 (non-binding) - verified checksums and signatures - build Flink from source code - pip install PyFlink source distribution and run a python udf job on MacOS/Win10 - start a standalone cluster on MacOS and submit a python udf job - the documentation pages built from source look good Best, Wei

Re: [DISCUSS] Planning Flink 1.13

2021-01-14 Thread Xingbo Huang
Thanks for being our release managers for the 1.13 release Dawid & Guowei! The end of March as the feature freeze date sounds good to me. Best, Xingbo Jark Wu 于2021年1月14日周四 下午6:21写道: > Thanks for starting the 1.13 release cycle and volunteering as the release > managers! > > The feature

Re: [VOTE] Release 1.12.1, release candidate #2

2021-01-14 Thread Xingbo Huang
+1 (non-binding) - verified checksums and signatures - build Flink from source code - pip install PyFlink in MacOS under py35,py36,py37,py38 - start a standalone cluster and submit a python udf job. Best, Xingbo Jark Wu 于2021年1月14日周四 下午6:14写道: > +1 > > - checked/verified signatures and hashes

Re: [DISCUSS] Releasing Apache Flink 1.10.3

2021-01-14 Thread Matthias Pohl
You right, Yu. Thanks for pointing that out. And thanks for volunteering, Xintong. On Thu, Jan 14, 2021 at 3:31 AM Xintong Song wrote: > Maybe I can help drive this release, if there's no one else volunteering. > I've been managing the 1.11.3 and 1.12.1 releases. The bugfix release > process is

[jira] [Created] (FLINK-20978) Implement HeapSavepointRestoreOperation

2021-01-14 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-20978: Summary: Implement HeapSavepointRestoreOperation Key: FLINK-20978 URL: https://issues.apache.org/jira/browse/FLINK-20978 Project: Flink Issue Type:

[jira] [Created] (FLINK-20977) can not use `use` command to switch database

2021-01-14 Thread Jun Zhang (Jira)
Jun Zhang created FLINK-20977: - Summary: can not use `use` command to switch database Key: FLINK-20977 URL: https://issues.apache.org/jira/browse/FLINK-20977 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-20976) Unify Binary format for Keyed State savepoints

2021-01-14 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-20976: Summary: Unify Binary format for Keyed State savepoints Key: FLINK-20976 URL: https://issues.apache.org/jira/browse/FLINK-20976 Project: Flink Issue

[jira] [Created] (FLINK-20975) HiveTableSourceITCase.testPartitionFilter fails on AZP

2021-01-14 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-20975: - Summary: HiveTableSourceITCase.testPartitionFilter fails on AZP Key: FLINK-20975 URL: https://issues.apache.org/jira/browse/FLINK-20975 Project: Flink

[jira] [Created] (FLINK-20974) docker容器pyflink中stream任务取消之后会留下几个僵尸进程

2021-01-14 Thread he jie (Jira)
he jie created FLINK-20974: -- Summary: docker容器pyflink中stream任务取消之后会留下几个僵尸进程 Key: FLINK-20974 URL: https://issues.apache.org/jira/browse/FLINK-20974 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-20973) failed to submit flink-on-yarn job on Windows due to error of classPath

2021-01-14 Thread kunnni (Jira)
kunnni created FLINK-20973: -- Summary: failed to submit flink-on-yarn job on Windows due to error of classPath Key: FLINK-20973 URL: https://issues.apache.org/jira/browse/FLINK-20973 Project: Flink

Re: [DISCUSS] Planning Flink 1.13

2021-01-14 Thread Jark Wu
Thanks for starting the 1.13 release cycle and volunteering as the release managers! The feature freeze date sounds good to me. Best, Jark On Thu, 14 Jan 2021 at 18:19, Khachatryan Roman wrote: > Thanks for doing this! > > Some teams are currently doing (or already finalizing) the "usability

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-14 Thread Aljoscha Krettek
+1 The build times on Jekyll have just become to annoying for me. I realize that that is also a function of how we structure our documentation, and especially how we construct the nav sidebar, but I think overall moving to Hugo is still a benefit. Aljoscha On 2021/01/13 10:14, Seth Wiesman

Re: [DISCUSS] Planning Flink 1.13

2021-01-14 Thread Khachatryan Roman
Thanks for doing this! Some teams are currently doing (or already finalizing) the "usability sprint". I was wondering whether it makes sense to release the implemented features without waiting for the major changes. If it works well we could decide to shorten the next release as well. Regards,

[jira] [Created] (FLINK-20972) TwoPhaseCommitSinkFunction Output a large amount of EventData

2021-01-14 Thread huajiewang (Jira)
huajiewang created FLINK-20972: -- Summary: TwoPhaseCommitSinkFunction Output a large amount of EventData Key: FLINK-20972 URL: https://issues.apache.org/jira/browse/FLINK-20972 Project: Flink

Re: [VOTE] Release 1.12.1, release candidate #2

2021-01-14 Thread Jark Wu
+1 - checked/verified signatures and hashes - reviewed the release pull request - started cluster for Scala 2.11, ran examples, verified web ui and log output, nothing unexpected - started cluster and SQL CLI, run some SQL queries for kafka, upsert-kafka, elasticsearch, and mysql connectors,

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-14 Thread Chesnay Schepler
Did you already try to set this up on buildbot? I assume that we'd have to ask infra to set this up for us? On 1/13/2021 5:14 PM, Seth Wiesman wrote: Hi All, I would like to start a discussion for FLIP-157: Migrating the Flink docs from Jekyll to Hugo. This will allow us: - Proper

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-14 Thread Till Rohrmann
The benefits of Hugo look convincing to me. Faster build times, working search and proper internationalization are important. Hence, I am +1 for FLIP-157. Are there any downsides over using Jekyll you have discovered so far? Cheers, Till On Thu, Jan 14, 2021 at 10:18 AM Dawid Wysakowicz wrote:

[jira] [Created] (FLINK-20971) Allow SQL expressions in Table API

2021-01-14 Thread Timo Walther (Jira)
Timo Walther created FLINK-20971: Summary: Allow SQL expressions in Table API Key: FLINK-20971 URL: https://issues.apache.org/jira/browse/FLINK-20971 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Planning Flink 1.13

2021-01-14 Thread Till Rohrmann
Thanks for volunteering as the release managers for the 1.13 release Guowei and Dawid. I'd also be in favour of targeting the end of March as the feature freeze date. I've created a 1.13 wiki page [1] where we can collect the features we want to complete for the 1.13 release. [1]

转发:flink-sql字段类型问题

2021-01-14 Thread 郝文强
| | 郝文强 | | 18846086...@163.com | 签名由网易邮箱大师定制 - 转发邮件信息 - 发件人: 郝文强 <18846086...@163.com> 发送日期: 2021年01月14日 17:22 发送至: dev-h...@flink.apache.org 主题: flink-sql字段类型问题 sql-client 创建表 报错java.math.BigInteger cannot be cast to java.lang.Long 麻烦各位帮看一下 源数据表是

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-14 Thread Dawid Wysakowicz
Great idea! The current infrastructure is really painful with its long build times... Best, Dawid On 13/01/2021 17:14, Seth Wiesman wrote: > Hi All, > > I would like to start a discussion for FLIP-157: Migrating the Flink docs > from Jekyll to Hugo. > > This will allow us: > >- Proper

[jira] [Created] (FLINK-20970) DECIMAL(10, 0) can not be GROUP BY key.

2021-01-14 Thread Wong Mulan (Jira)
Wong Mulan created FLINK-20970: -- Summary: DECIMAL(10, 0) can not be GROUP BY key. Key: FLINK-20970 URL: https://issues.apache.org/jira/browse/FLINK-20970 Project: Flink Issue Type: Bug

Re: InfluxDB Source Sink Connector

2021-01-14 Thread Yun Tang
I wonder what's relationship between current influxdb connector in bahir-flink [1]? [1] https://github.com/apache/bahir-flink/tree/master/flink-connector-influxdb Best Yun Tang From: Leon Papke Sent: Wednesday, January 13, 2021 19:16 To: dev@flink.apache.org

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-14 Thread Yun Tang
+1 for this proposal. I really like this idea for much less build time and no more docker or ruby dependencies. Developers in China often suffer with the international network connect. Best Yun Tang From: Jark Wu Sent: Thursday, January 14, 2021 10:49 To: dev

[jira] [Created] (FLINK-20969) Update Scala 2.12 version to 2.12.13

2021-01-14 Thread Erwan Loisant (Jira)
Erwan Loisant created FLINK-20969: - Summary: Update Scala 2.12 version to 2.12.13 Key: FLINK-20969 URL: https://issues.apache.org/jira/browse/FLINK-20969 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-20968) Remove legacy exec nodes

2021-01-14 Thread godfrey he (Jira)
godfrey he created FLINK-20968: -- Summary: Remove legacy exec nodes Key: FLINK-20968 URL: https://issues.apache.org/jira/browse/FLINK-20968 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-20967) Add Documentation for hbase connector new Function

2021-01-14 Thread WeiNan Zhao (Jira)
WeiNan Zhao created FLINK-20967: --- Summary: Add Documentation for hbase connector new Function Key: FLINK-20967 URL: https://issues.apache.org/jira/browse/FLINK-20967 Project: Flink Issue Type: