[jira] [Created] (FLINK-17995) Add a new overview page for the new SQL connectors

2020-05-28 Thread Jark Wu (Jira)
Jark Wu created FLINK-17995: --- Summary: Add a new overview page for the new SQL connectors Key: FLINK-17995 URL: https://issues.apache.org/jira/browse/FLINK-17995 Project: Flink Issue Type:

[jira] [Created] (FLINK-17996) NEP in CatalogTableStatisticsConverter.convertToColumnStats method

2020-05-28 Thread godfrey he (Jira)
godfrey he created FLINK-17996: -- Summary: NEP in CatalogTableStatisticsConverter.convertToColumnStats method Key: FLINK-17996 URL: https://issues.apache.org/jira/browse/FLINK-17996 Project: Flink

Re: [DISCUSS] Introduce a new module 'flink-hadoop-utils'

2020-05-28 Thread Robert Metzger
Hi Sivaprasanna, thanks a lot for your proposal. Now that I ran into a HadoopUtils-related issue myself [1] I see the benefit in this proposal. I'm happy to be the Flink committer that mentors this change. If we do this, I would like to have a small scope for the initial change: - create a

Re: [DISCUSS] Introduce a new module 'flink-hadoop-utils'

2020-05-28 Thread Sivaprasanna
Awesome. : ) Thanks, Robert for signing up to be the reviewer. I will create Jira and share the link here. Stay safe. - Sivaprasanna On Thu, May 28, 2020 at 12:13 PM Robert Metzger wrote: > Hi Sivaprasanna, > > thanks a lot for your proposal. Now that I ran into a HadoopUtils-related > issue

Fwd: Season of Docs - Ex-participant Intro

2020-05-28 Thread Marta Paes Moreira
Hi again, Kartik! Our project idea is pretty open-ended — there really is a lot of work to do in the Table API / SQL documentation, so we're not being picky about what people choose to work on. Regarding timelines on our side, I think FLIP-60 and other documentation improvement proposals will be

[jira] [Created] (FLINK-17997) Revert manual merging of AWS KPL's THIRD_PARTY_NOTICE files content in Stateful Functions distribution artifact

2020-05-28 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-17997: --- Summary: Revert manual merging of AWS KPL's THIRD_PARTY_NOTICE files content in Stateful Functions distribution artifact Key: FLINK-17997 URL:

[jira] [Created] (FLINK-17998) Support limiting job history size

2020-05-28 Thread Daniel Laszlo Magyar (Jira)
Daniel Laszlo Magyar created FLINK-17998: Summary: Support limiting job history size Key: FLINK-17998 URL: https://issues.apache.org/jira/browse/FLINK-17998 Project: Flink Issue

[ANNOUNCE] Stateful Functions 2.1.0 feature freeze

2020-05-28 Thread Tzu-Li (Gordon) Tai
Hi all, Following the consensus to do the next feature release for Flink Stateful Functions, we've finished all the planned features and have cut the feature branch: https://github.com/apache/flink-statefun/tree/release-2.1 This time, we've added quite a bit more coverage for typical functional

[jira] [Created] (FLINK-18001) Add a new test base for evaluating expressions

2020-05-28 Thread Timo Walther (Jira)
Timo Walther created FLINK-18001: Summary: Add a new test base for evaluating expressions Key: FLINK-18001 URL: https://issues.apache.org/jira/browse/FLINK-18001 Project: Flink Issue Type:

[jira] [Created] (FLINK-18004) Update checkpoint UI related pictures in documentation

2020-05-28 Thread Yun Tang (Jira)
Yun Tang created FLINK-18004: Summary: Update checkpoint UI related pictures in documentation Key: FLINK-18004 URL: https://issues.apache.org/jira/browse/FLINK-18004 Project: Flink Issue Type:

[jira] [Created] (FLINK-18000) Flink-job-manger Get a X509 error, when I try to delpoy flink on kubelet 1.18.2

2020-05-28 Thread Max (Jira)
Max created FLINK-18000: --- Summary: Flink-job-manger Get a X509 error, when I try to delpoy flink on kubelet 1.18.2 Key: FLINK-18000 URL: https://issues.apache.org/jira/browse/FLINK-18000 Project: Flink

[jira] [Created] (FLINK-18003) Table hints support multi Options

2020-05-28 Thread hailong wang (Jira)
hailong wang created FLINK-18003: Summary: Table hints support multi Options Key: FLINK-18003 URL: https://issues.apache.org/jira/browse/FLINK-18003 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-17999) Translate "Query Configuration" page of "Streaming Concepts" into Chinese

2020-05-28 Thread Yubin Li (Jira)
Yubin Li created FLINK-17999: Summary: Translate "Query Configuration" page of "Streaming Concepts" into Chinese Key: FLINK-17999 URL: https://issues.apache.org/jira/browse/FLINK-17999 Project: Flink

Re: [VOTE] Release flink-shaded 11.0, release candidate #1

2020-05-28 Thread Congxian Qiu
+1 (non-binding) checked - mvn clean verify, ok - gpg & sha512, ok - all pom files point to the same version, ok - checked license, ok Best, Congxian Robert Metzger 于2020年5月27日周三 下午6:05写道: > +1 (binding) > > Checks: > - diff to flink-shaded 1.10: > >

[jira] [Created] (FLINK-18002) Support forcing varchar type in Json format

2020-05-28 Thread Benchao Li (Jira)
Benchao Li created FLINK-18002: -- Summary: Support forcing varchar type in Json format Key: FLINK-18002 URL: https://issues.apache.org/jira/browse/FLINK-18002 Project: Flink Issue Type:

[jira] [Created] (FLINK-18005) Implement type inference for CAST

2020-05-28 Thread Timo Walther (Jira)
Timo Walther created FLINK-18005: Summary: Implement type inference for CAST Key: FLINK-18005 URL: https://issues.apache.org/jira/browse/FLINK-18005 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-18006) It will throw Invalid lambda deserialization Exception when writing to elastic search with new format

2020-05-28 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-18006: - Summary: It will throw Invalid lambda deserialization Exception when writing to elastic search with new format Key: FLINK-18006 URL:

[jira] [Created] (FLINK-18007) Translate "Joins in Continuous Queries" page of "Streaming Concepts" into Chinese

2020-05-28 Thread Yubin Li (Jira)
Yubin Li created FLINK-18007: Summary: Translate "Joins in Continuous Queries" page of "Streaming Concepts" into Chinese Key: FLINK-18007 URL: https://issues.apache.org/jira/browse/FLINK-18007 Project:

[jira] [Created] (FLINK-18008) HistoryServer does not log environment information on startup

2020-05-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-18008: Summary: HistoryServer does not log environment information on startup Key: FLINK-18008 URL: https://issues.apache.org/jira/browse/FLINK-18008 Project: Flink

[jira] [Created] (FLINK-18009) Select an invalid column crashes the SQL CLI

2020-05-28 Thread Rui Li (Jira)
Rui Li created FLINK-18009: -- Summary: Select an invalid column crashes the SQL CLI Key: FLINK-18009 URL: https://issues.apache.org/jira/browse/FLINK-18009 Project: Flink Issue Type: Bug

Re: [DISCUSS] Introduce a new module 'flink-hadoop-utils'

2020-05-28 Thread Sivaprasanna
FYI. I created a Jira to track this improvement. https://issues.apache.org/jira/browse/FLINK-18013 - Sivaprasanna On Thu, May 28, 2020 at 12:22 PM Sivaprasanna wrote: > Awesome. : ) > Thanks, Robert for signing up to be the reviewer. I will create Jira and > share the link here. > > Stay

Re: [VOTE] Release flink-shaded 11.0, release candidate #1

2020-05-28 Thread Till Rohrmann
+1 (binding) - verified checksums and signature - mvn clean verify passes on source release - verified licenses - checked pom.xml changes Cheers, Till On Thu, May 28, 2020 at 1:05 PM Congxian Qiu wrote: > +1 (non-binding) > > checked > - mvn clean verify, ok > - gpg & sha512, ok > - all pom

Re: [DISCUSS] FLINK-17989 - java.lang.NoClassDefFoundError org.apache.flink.fs.azure.common.hadoop.HadoopRecoverableWriter

2020-05-28 Thread Till Rohrmann
Hi Israel, thanks for reaching out to the Flink community. As Guowei said, the StreamingFileSink can currently only recover from faults if it writes to HDFS or S3. Other file systems are currently not supported if you need fault tolerance. Maybe Klou can tell you more about the background and

Re: [VOTE] Release flink-shaded 11.0, release candidate #1

2020-05-28 Thread Yu Li
+1 (non-binding) Checked issues listed in release notes: ok (*) - Add shaded-11.0 as fixed version for FLINK-17513 - Minor: FLINK-16454 is listed in the release note but found no changes in commit history Checked sums and signatures: ok Checked the maven central artifices: ok Built from source:

[jira] [Created] (FLINK-18012) Deactivate slot timeout if TaskSlotTable.tryMarkSlotActive is called

2020-05-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-18012: - Summary: Deactivate slot timeout if TaskSlotTable.tryMarkSlotActive is called Key: FLINK-18012 URL: https://issues.apache.org/jira/browse/FLINK-18012 Project:

Re: [DISCUSS] FLINK-17989 - java.lang.NoClassDefFoundError org.apache.flink.fs.azure.common.hadoop.HadoopRecoverableWriter

2020-05-28 Thread Israel Ekpo
Guowei, What do we need to do to add support for it? How do I get started on that? On Wed, May 27, 2020 at 8:53 PM Guowei Ma wrote: > Hi, > I think the StreamingFileSink could not support Azure currently. > You could find more detailed info from here[1]. > > [1]

Re: [DISCUSS] Backpoint FLIP-126 (watermarks) integration with FLIP-27

2020-05-28 Thread Aljoscha Krettek
+1 I'm in favour of backporting this because we otherwise would immediately break the API between 1.11 and 1.12. Best, Aljoscha On 26.05.20 17:05, Zhijiang wrote: In the beginning, I have somehow similar concerns as Piotr mentioned below. After some offline discussions, also as explained by

[jira] [Created] (FLINK-18010) Add more logging to HistoryServer

2020-05-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-18010: Summary: Add more logging to HistoryServer Key: FLINK-18010 URL: https://issues.apache.org/jira/browse/FLINK-18010 Project: Flink Issue Type:

Re: [DISCUSS] FLINK-17989 - java.lang.NoClassDefFoundError org.apache.flink.fs.azure.common.hadoop.HadoopRecoverableWriter

2020-05-28 Thread Israel Ekpo
Hi Till, Thanks for your feedback and guidance. It seems similar work was done for S3 filesystem where relocations were removed for those file system plugins. https://issues.apache.org/jira/browse/FLINK-11956 It appears the same needs to be done for Azure File systems. I will attempt to

Re: [DISCUSS] FLINK-17989 - java.lang.NoClassDefFoundError org.apache.flink.fs.azure.common.hadoop.HadoopRecoverableWriter

2020-05-28 Thread Till Rohrmann
I think what needs to be done is to implement a org.apache.flink.core.fs.RecoverableWriter for the respective file system. Similar to HadoopRecoverableWriter and S3RecoverableWriter. Cheers, Till On Thu, May 28, 2020 at 6:00 PM Israel Ekpo wrote: > Hi Till, > > Thanks for your feedback and

[jira] [Created] (FLINK-18011) Make WatermarkStrategy/WatermarkStrategies more ergonomic

2020-05-28 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-18011: Summary: Make WatermarkStrategy/WatermarkStrategies more ergonomic Key: FLINK-18011 URL: https://issues.apache.org/jira/browse/FLINK-18011 Project: Flink

[jira] [Created] (FLINK-18013) Refactor Hadoop Utility classes/functions into a common Maven module

2020-05-28 Thread Sivaprasanna Sethuraman (Jira)
Sivaprasanna Sethuraman created FLINK-18013: --- Summary: Refactor Hadoop Utility classes/functions into a common Maven module Key: FLINK-18013 URL: https://issues.apache.org/jira/browse/FLINK-18013

Re: [DISCUSS] FLINK-17989 - java.lang.NoClassDefFoundError org.apache.flink.fs.azure.common.hadoop.HadoopRecoverableWriter

2020-05-28 Thread Israel Ekpo
Thanks Till. I will take a look at that tomorrow and let you know if I hit any roadblocks. On Thu, May 28, 2020 at 12:11 PM Till Rohrmann wrote: > I think what needs to be done is to implement > a org.apache.flink.core.fs.RecoverableWriter for the respective file > system. Similar to

[jira] [Created] (FLINK-18015) Document State TTL

2020-05-28 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-18015: Summary: Document State TTL Key: FLINK-18015 URL: https://issues.apache.org/jira/browse/FLINK-18015 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] Stateful Functions 2.1.0 feature freeze

2020-05-28 Thread Seth Wiesman
Thank you for driving this release Gordon! We are still missing documentation for state ttl and unix sockets. This doesn't need to block release testing, but it would be nice to get this done before 2.1 is released. Seth https://issues.apache.org/jira/browse/FLINK-18015

[jira] [Created] (FLINK-18014) JSONDeserializationSchema: removed in Flink 1.8, but still in the docs

2020-05-28 Thread David Anderson (Jira)
David Anderson created FLINK-18014: -- Summary: JSONDeserializationSchema: removed in Flink 1.8, but still in the docs Key: FLINK-18014 URL: https://issues.apache.org/jira/browse/FLINK-18014 Project:

[jira] [Created] (FLINK-18016) Document Unix Socket Remote Functions

2020-05-28 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-18016: Summary: Document Unix Socket Remote Functions Key: FLINK-18016 URL: https://issues.apache.org/jira/browse/FLINK-18016 Project: Flink Issue Type:

[jira] [Created] (FLINK-18017) improve Kafka connector to handle record deserialization exception and report related metrics

2020-05-28 Thread Yu Yang (Jira)
Yu Yang created FLINK-18017: --- Summary: improve Kafka connector to handle record deserialization exception and report related metrics Key: FLINK-18017 URL: https://issues.apache.org/jira/browse/FLINK-18017

[jira] [Created] (FLINK-18018) Bundle GPU plugin in "plugins/" directory

2020-05-28 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-18018: -- Summary: Bundle GPU plugin in "plugins/" directory Key: FLINK-18018 URL: https://issues.apache.org/jira/browse/FLINK-18018 Project: Flink Issue Type:

[jira] [Created] (FLINK-18019) The configuration specified in TableConfig may not take effect

2020-05-28 Thread Dian Fu (Jira)
Dian Fu created FLINK-18019: --- Summary: The configuration specified in TableConfig may not take effect Key: FLINK-18019 URL: https://issues.apache.org/jira/browse/FLINK-18019 Project: Flink Issue