[jira] [Created] (FLINK-15309) Execute sql appear "NumberFormatException: Zero length BigInteger"

xiaojin.wy created FLINK-15309: -- Summary: Execute sql appear "NumberFormatException: Zero length BigInteger" Key: FLINK-15309 URL: https://issues.apache.org/jira/browse/FLINK-15309 Project: Flink

Re: [DISCUSS] Releasing Flink 1.9.2

Thanks for bring up the discussion Hequn. I would like to give you a hand at the last stage when the RC is finished.(If you need) :) Best, Jincheng Best, Jincheng @sunjincheng121 Hequn Cheng 于2019年12月18日周三 下午3:44写道： > Hi everyone, > > It has already been

[DISCUSS] Releasing Flink 1.9.2

Hi everyone, It has already been two months since we released the Flink 1.9.1. We already have many important bug fixes from which our users can benefit in the release-1.9 branch (85 resolved issues). Therefore, I propose to create the next bug fix release for Flink 1.9. Most notable fixes are:

[jira] [Created] (FLINK-15308) Job failed when enable pipelined-shuffle.compression and numberOfTaskSlots > 1

Feng Jiajie created FLINK-15308: --- Summary: Job failed when enable pipelined-shuffle.compression and numberOfTaskSlots > 1 Key: FLINK-15308 URL: https://issues.apache.org/jira/browse/FLINK-15308

Re: Potential side-effect of connector code to JM/TM

Hi Till & Biao, Thanks for the reply. I agree that supplying some stress or stability tests can really help, except for the jvm resource leak mentioned above, there may be other type of resource leak like slot or network buffer leak. In addition, other tests like triggering failover in various

[jira] [Created] (FLINK-15307) Subclasses of FailoverStrategy are easily confused with implementation classes of RestartStrategy

andrew.D.lin created FLINK-15307: Summary: Subclasses of FailoverStrategy are easily confused with implementation classes of RestartStrategy Key: FLINK-15307 URL: https://issues.apache.org/jira/browse/FLINK-15307

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

Congrats, Zhu Zhu! Best Regards, Yu On Wed, 18 Dec 2019 at 08:40, zhenya Sun wrote: > Congrats zhuzhu! > > > > > | | > zhenya Sun > 邮箱：toke...@126.com > | > > Signature is customized by Netease Mail Master > > On 12/17/2019 17:32, Gary Yao wrote: > Congratulations, well deserved. > > On Tue,

Re: Processing events based on weights

Resending email again... Hello, I would like to understand the options available to design an ingestion pipeline to support the following requirements. 1) Events are coming from various sources and depending on the type of the events it will be stored in specific Kafka topics (say we have 4

[jira] [Created] (FLINK-15306) Adjust the default netty transport option from nio to auto

zhijiang created FLINK-15306: Summary: Adjust the default netty transport option from nio to auto Key: FLINK-15306 URL: https://issues.apache.org/jira/browse/FLINK-15306 Project: Flink Issue

[jira] [Created] (FLINK-15305) MemoryMappedBoundedDataTest fails with IOException on ppc64le

Siddhesh Ghadi created FLINK-15305: -- Summary: MemoryMappedBoundedDataTest fails with IOException on ppc64le Key: FLINK-15305 URL: https://issues.apache.org/jira/browse/FLINK-15305 Project: Flink

Re: [DISCUSS] FLIP-27: Refactor Source Interface

Hi Becket, That's great we have reached a consensus on Source#getBoundedness(). Regarding to option#3, my concern is that if we don't support streaming mode for bounded source, how could we create a testing source for streaming mode? Currently, all the testing source for streaming are bounded,

[jira] [Created] (FLINK-15304) Remove unexpected Hadoop dependency from Flink's Mesos integration

Yangze Guo created FLINK-15304: -- Summary: Remove unexpected Hadoop dependency from Flink's Mesos integration Key: FLINK-15304 URL: https://issues.apache.org/jira/browse/FLINK-15304 Project: Flink

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

Congrats zhuzhu! | | zhenya Sun 邮箱：toke...@126.com | Signature is customized by Netease Mail Master On 12/17/2019 17:32, Gary Yao wrote: Congratulations, well deserved. On Tue, Dec 17, 2019 at 10:09 AM lining jing wrote: > Congratulations Zhu Zhu~ > > Andrey Zagrebin 于2019年12月16日周一

Re: [DISCUSS] Flink docs vendor table

Happy to see there seems to be a consensus. Robert, can you elaborate on what you mean by "deployment model"? Seth On Tue, Dec 17, 2019 at 12:19 PM Robert Metzger wrote: > +1 to the general idea > > Maybe we could add "Deployment Model" in addition to "Supported > Environments" as properties

[jira] [Created] (FLINK-15303) support predicate pushdown for sources in hive connector

Bowen Li created FLINK-15303: Summary: support predicate pushdown for sources in hive connector Key: FLINK-15303 URL: https://issues.apache.org/jira/browse/FLINK-15303 Project: Flink Issue

[jira] [Created] (FLINK-15302) properties in create table DDL need to be backward compatible

Bowen Li created FLINK-15302: Summary: properties in create table DDL need to be backward compatible Key: FLINK-15302 URL: https://issues.apache.org/jira/browse/FLINK-15302 Project: Flink

Re: [DISCUSS] Flink docs vendor table

+1 to the general idea Maybe we could add "Deployment Model" in addition to "Supported Environments" as properties for the vendors. I'd say Cloudera, Eventador and Huawei [1] are missing from this page [1]https://www.huaweicloud.com/en-us/product/cs.html On Tue, Dec 17, 2019 at 5:05 PM Stephan

Re: [DISCUSS] have separate Flink distributions with built-in Hive dependencies

I'm not sure providing an uber jar would be possible. Different from kafka and elasticsearch connector who have dependencies for a specific kafka/elastic version, or the kafka universal connector that provides good compatibilities, hive connector needs to deal with hive jars in all 1.x, 2.x, 3.x

[jira] [Created] (FLINK-15301) Flink Kinesis AsyncRecordEmitter needs to handle unchecked exception gracefully

Ying Xu created FLINK-15301: --- Summary: Flink Kinesis AsyncRecordEmitter needs to handle unchecked exception gracefully Key: FLINK-15301 URL: https://issues.apache.org/jira/browse/FLINK-15301 Project: Flink

Re: [DISCUSS] Flink docs vendor table

+1 for your proposed solution, Seth! On Tue, Dec 17, 2019 at 3:05 PM Till Rohrmann wrote: > Thanks for continuing this discussion Seth. I like the mockup and I think > this is a good improvement. Modulo the completeness check, +1 for offering > links to 3rd party integrations. > > Cheers, >

[jira] [Created] (FLINK-15300) Shuffle memory fraction sanity check does not account for its min/max limit

Andrey Zagrebin created FLINK-15300: --- Summary: Shuffle memory fraction sanity check does not account for its min/max limit Key: FLINK-15300 URL: https://issues.apache.org/jira/browse/FLINK-15300

Re: [DISCUSS] Flink docs vendor table

Thanks for continuing this discussion Seth. I like the mockup and I think this is a good improvement. Modulo the completeness check, +1 for offering links to 3rd party integrations. Cheers, Till On Mon, Dec 16, 2019 at 6:04 PM Seth Wiesman wrote: > This discussion is a follow up to the

Re: [DISCUSS] FLIP-27: Refactor Source Interface

Hi folks, Thanks for the comments. I am convinced that the Source API should not take boundedness as a parameter after it is constructed. What Timo and Dawid suggested sounds a reasonable solution to me. So the Source API would become: Source { Boundedness getBoundedness(); } Assuming the

[jira] [Created] (FLINK-15299) Move ClientUtils#submitJob & ClientUtils#submitJobAndWaitForResult to flink-test-utils

Zili Chen created FLINK-15299: - Summary: Move ClientUtils#submitJob & ClientUtils#submitJobAndWaitForResult to flink-test-utils Key: FLINK-15299 URL: https://issues.apache.org/jira/browse/FLINK-15299

[jira] [Created] (FLINK-15298) Wrong dependences in the DataStream API tutorial (the wiki-edits example)

Jun Qin created FLINK-15298: --- Summary: Wrong dependences in the DataStream API tutorial (the wiki-edits example) Key: FLINK-15298 URL: https://issues.apache.org/jira/browse/FLINK-15298 Project: Flink

Re: Potential side-effect of connector code to JM/TM

Hi Yingjie, Thanks for figuring out the impressive bug and bringing this discussion. I'm afraid there is no such a silver bullet for isolation from third-party library. However I agree that resource checking utils might help. It seems that you and Till have already raised some feasible ideas.

[jira] [Created] (FLINK-15297) Do not throw exception if YARN Application switched to FINISHED immediately after deployed in YarnClusterDescriptor#startAppMaster

Zili Chen created FLINK-15297: - Summary: Do not throw exception if YARN Application switched to FINISHED immediately after deployed in YarnClusterDescriptor#startAppMaster Key: FLINK-15297 URL:

Re: Potential side-effect of connector code to JM/TM

Hi Yingjie, thanks for reporting this issue and starting this discussion. If we are dealing with third party libraries I believe there is always the risk that one overlooks closing resources. Ideally we make it as hard from Flink's perspective as possible but realistically it is hard to

Re: [ANNOUNCE] Weekly Community Update 2019/50

Cool. I will do it in the next three weeks. Thanks a lot for your continued great work! Best, Hequn On Tue, Dec 17, 2019 at 6:16 PM Konstantin Knauf wrote: > Hi Hequn, > > thanks, and thanks for the offer. Of course, you can cover the holiday > break, i.e. the next three weeks. Looking forward

Re: [ANNOUNCE] Weekly Community Update 2019/50

Hi Hequn, thanks, and thanks for the offer. Of course, you can cover the holiday break, i.e. the next three weeks. Looking forward to your updates! Cheers, Konstantin On Mon, Dec 16, 2019 at 5:53 AM Hequn Cheng wrote: > Hi Konstantin, > > Happy holidays and thanks a lot for your great job on

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

Congratulations, well deserved. On Tue, Dec 17, 2019 at 10:09 AM lining jing wrote: > Congratulations Zhu Zhu~ > > Andrey Zagrebin 于2019年12月16日周一 下午5:01写道： > > > Congrats Zhu Zhu! > > > > On Mon, Dec 16, 2019 at 8:10 AM Xintong Song > > wrote: > > > > > Congratulations Zhu Zhu~ > > > > > >

Re: [DISCUSS] Improve documentation / tooling around security of Flink

Hey, changes to the network configuration often cause unforeseen trouble, in particular with things like Kubernetes, Docker etc., and the "onboarding experience" might suffer due to this. Updated list: a) Add a check-security.sh script, or a check into the frontend if the JobManager can be

[jira] [Created] (FLINK-15296) Support print executor-specific help information from CLI

Zili Chen created FLINK-15296: - Summary: Support print executor-specific help information from CLI Key: FLINK-15296 URL: https://issues.apache.org/jira/browse/FLINK-15296 Project: Flink Issue

[jira] [Created] (FLINK-15295) Mark CustomCommandLine and its subclass as deprecated

Zili Chen created FLINK-15295: - Summary: Mark CustomCommandLine and its subclass as deprecated Key: FLINK-15295 URL: https://issues.apache.org/jira/browse/FLINK-15295 Project: Flink Issue Type:

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

Congratulations Zhu Zhu~ Andrey Zagrebin 于2019年12月16日周一 下午5:01写道： > Congrats Zhu Zhu! > > On Mon, Dec 16, 2019 at 8:10 AM Xintong Song > wrote: > > > Congratulations Zhu Zhu~ > > > > Thank you~ > > > > Xintong Song > > > > > > > > On Mon, Dec 16, 2019 at 12:34 PM Danny Chan > wrote: > > > > >

[jira] [Created] (FLINK-15294) Deprecate CustomCommandLine

Zili Chen created FLINK-15294: - Summary: Deprecate CustomCommandLine Key: FLINK-15294 URL: https://issues.apache.org/jira/browse/FLINK-15294 Project: Flink Issue Type: Task Components:

[jira] [Created] (FLINK-15293) Document new RocksDB memory configuration

Stephan Ewen created FLINK-15293: Summary: Document new RocksDB memory configuration Key: FLINK-15293 URL: https://issues.apache.org/jira/browse/FLINK-15293 Project: Flink Issue Type:

[jira] [Created] (FLINK-15292) Rename Executor interface to PipelineExecutor

Kostas Kloudas created FLINK-15292: -- Summary: Rename Executor interface to PipelineExecutor Key: FLINK-15292 URL: https://issues.apache.org/jira/browse/FLINK-15292 Project: Flink Issue

[jira] [Created] (FLINK-15291) Rename WatermarkSepc#getWatermarkExpressionString to getWatermarkExpr

Jark Wu created FLINK-15291: --- Summary: Rename WatermarkSepc#getWatermarkExpressionString to getWatermarkExpr Key: FLINK-15291 URL: https://issues.apache.org/jira/browse/FLINK-15291 Project: Flink

[jira] [Created] (FLINK-15290) Need a way to turn off vectorized orc reader for SQL CLI

Rui Li created FLINK-15290: -- Summary: Need a way to turn off vectorized orc reader for SQL CLI Key: FLINK-15290 URL: https://issues.apache.org/jira/browse/FLINK-15290 Project: Flink Issue Type: Bug