[jira] [Created] (FLINK-18057) SingleInputGateTest.testConcurrentReadStateAndProcessAndClose: expected:<3> but was:<2>

2020-06-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18057: -- Summary: SingleInputGateTest.testConcurrentReadStateAndProcessAndClose: expected:<3> but was:<2> Key: FLINK-18057 URL: https://issues.apache.org/jira/browse/FLINK-18057

[jira] [Created] (FLINK-18058) MesosResourceManagerTest.testWorkerStarted:656 » NullPointer

2020-06-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18058: -- Summary: MesosResourceManagerTest.testWorkerStarted:656 » NullPointer Key: FLINK-18058 URL: https://issues.apache.org/jira/browse/FLINK-18058 Project: Flink

Re: Questions around MemoryStateBackend size limits

2020-06-02 Thread Yun Tang
Hi + user mail list The limit max state size is because we would send the checkpointed data as a byte array and send it back to jobmanager. If the checkpointed byte stream is too large, the job manager would meet the risk of out-of-memory-error. If you want to use heap-based state-backend,

[jira] [Created] (FLINK-18059) Can not execute create/drop catalog statement in sql client

2020-06-02 Thread godfrey he (Jira)
godfrey he created FLINK-18059: -- Summary: Can not execute create/drop catalog statement in sql client Key: FLINK-18059 URL: https://issues.apache.org/jira/browse/FLINK-18059 Project: Flink

[Discussion] flink elasticsearch connector supports

2020-06-02 Thread Jacky Lau
Hi all! We have started some preliminary work on the flink elasticsearch integration (es connector for es version7) at hikvision research institute. It seems that the integration should think throughly. And we want to contribute our code for the conmunity. So I think I should open a discussion

Re: MODERATE for dev@flink.apache.org

2020-06-02 Thread Henry Saputra
Hi, Looks like you have not subscribe to Apache Flink dev@ mailing list. Please subscribe by following instruction here to continue with the discussions and receive followups: https://flink.apache.org/community.html#mailing-lists Thanks, Henry Saputra On behalf of Apache Flink PMC > > >

[jira] [Created] (FLINK-18060) Add notice for heap-based state backend of state access reference problem

2020-06-02 Thread Yun Tang (Jira)
Yun Tang created FLINK-18060: Summary: Add notice for heap-based state backend of state access reference problem Key: FLINK-18060 URL: https://issues.apache.org/jira/browse/FLINK-18060 Project: Flink

[jira] [Created] (FLINK-18061) TableResult#collect should return closeable iterator to avoid resource leak

2020-06-02 Thread godfrey he (Jira)
godfrey he created FLINK-18061: -- Summary: TableResult#collect should return closeable iterator to avoid resource leak Key: FLINK-18061 URL: https://issues.apache.org/jira/browse/FLINK-18061 Project:

[jira] [Created] (FLINK-18062) prometheus metrics reporter support custom labels

2020-06-02 Thread Luke Sun (Jira)
Luke Sun created FLINK-18062: Summary: prometheus metrics reporter support custom labels Key: FLINK-18062 URL: https://issues.apache.org/jira/browse/FLINK-18062 Project: Flink Issue Type:

[jira] [Created] (FLINK-18063) Fix the race condition for aborting current checkpoint in CheckpointBarrierUnaligner#processEndOfPartition

2020-06-02 Thread Zhijiang (Jira)
Zhijiang created FLINK-18063: Summary: Fix the race condition for aborting current checkpoint in CheckpointBarrierUnaligner#processEndOfPartition Key: FLINK-18063 URL:

[jira] [Created] (FLINK-18064) Update documentation taking unaligned checkpoints into the account

2020-06-02 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-18064: -- Summary: Update documentation taking unaligned checkpoints into the account Key: FLINK-18064 URL: https://issues.apache.org/jira/browse/FLINK-18064 Project:

Re: [ANNOUNCE] Apache Flink-shaded 11.0 released

2020-06-02 Thread Yu Li
Thanks Chesnay! Best Regards, Yu On Tue, 2 Jun 2020 at 18:21, Till Rohrmann wrote: > Thanks for creating the latest flink-shaded release Chesnay! > > Cheers, > Till > > On Sun, May 31, 2020 at 1:25 PM Chesnay Schepler > wrote: > > > The Apache Flink community is very happy to announce the

[jira] [Created] (FLINK-18071) CoordinatorEventsExactlyOnceITCase.checkListContainsSequence fails on CI

2020-06-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18071: -- Summary: CoordinatorEventsExactlyOnceITCase.checkListContainsSequence fails on CI Key: FLINK-18071 URL: https://issues.apache.org/jira/browse/FLINK-18071

[jira] [Created] (FLINK-18072) HBaseLookupFunction can not work with new internal data structure RowData

2020-06-02 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-18072: -- Summary: HBaseLookupFunction can not work with new internal data structure RowData Key: FLINK-18072 URL: https://issues.apache.org/jira/browse/FLINK-18072 Project: Flink

[jira] [Created] (FLINK-18065) Add documentation for new scalar/table functions

2020-06-02 Thread Timo Walther (Jira)
Timo Walther created FLINK-18065: Summary: Add documentation for new scalar/table functions Key: FLINK-18065 URL: https://issues.apache.org/jira/browse/FLINK-18065 Project: Flink Issue Type:

Questions around MemoryStateBackend size limits

2020-06-02 Thread vishalovercome
The documentation says: *The size of each individual state is by default limited to 5 MB. This value can be increased in the constructor of the MemoryStateBackend.* 1. I want to know what would happen if a job ended up adding elements to a state variable causing its size to exceed 5MB. There

[jira] [Created] (FLINK-18066) Add documentation for how to develop a new table source/sink

2020-06-02 Thread Timo Walther (Jira)
Timo Walther created FLINK-18066: Summary: Add documentation for how to develop a new table source/sink Key: FLINK-18066 URL: https://issues.apache.org/jira/browse/FLINK-18066 Project: Flink

[jira] [Created] (FLINK-18067) Invalid default value for yarnMinAllocationMB in YarnClusterDescriptor

2020-06-02 Thread Jiayi Liao (Jira)
Jiayi Liao created FLINK-18067: -- Summary: Invalid default value for yarnMinAllocationMB in YarnClusterDescriptor Key: FLINK-18067 URL: https://issues.apache.org/jira/browse/FLINK-18067 Project: Flink

Re: [DISCUSS] Stability guarantees for @PublicEvolving classes

2020-06-02 Thread Till Rohrmann
FYI: The API and binary compatibility check has been activated [1]. [1] https://issues.apache.org/jira/browse/FLINK-17844 Cheers, Till On Mon, May 18, 2020 at 1:11 PM Chesnay Schepler wrote: > yes > > On 18/05/2020 13:05, Piotr Nowojski wrote: > > How would we enforce this change? That we

Re: [Discussion] flink elasticsearch connector supports

2020-06-02 Thread Robert Metzger
Hi Jacky, thanks a lot for starting the discussion. I have no objections to adding support for reading data from ElasticSearch as well, as long as we clearly state the performance and correctness implications / guarantees in the Flink documentation. On Tue, Jun 2, 2020 at 9:52 AM Jacky Lau

Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-06-02 Thread Yun Tang
Since Flink lacks of such kind of experiments to ensure the backwards compatibility of savepoints before, especially those built-in operators with their own operator state. I am afraid we need huge energy to cover all cases to give the most correct result. I prefer to just point out this in

[jira] [Created] (FLINK-18068) Job stuck after IllegalStateException in scheduling

2020-06-02 Thread Jiayi Liao (Jira)
Jiayi Liao created FLINK-18068: -- Summary: Job stuck after IllegalStateException in scheduling Key: FLINK-18068 URL: https://issues.apache.org/jira/browse/FLINK-18068 Project: Flink Issue Type:

Re: [NOTICE] Release guide updated for updating japicmp configuration

2020-06-02 Thread Till Rohrmann
Thanks for activating the checks and providing the tooling Chesnay. Cheers, Till On Fri, May 29, 2020 at 6:51 PM Yu Li wrote: > Thanks Chesnay for the efforts! > > Best Regards, > Yu > > > On Fri, 29 May 2020 at 18:03, Piotr Nowojski wrote: > > > Thanks Chesney for adding those scripts and

Re: [ANNOUNCE] Apache Flink-shaded 11.0 released

2020-06-02 Thread Till Rohrmann
Thanks for creating the latest flink-shaded release Chesnay! Cheers, Till On Sun, May 31, 2020 at 1:25 PM Chesnay Schepler wrote: > The Apache Flink community is very happy to announce the release of > Apache Flink-shaded 11.0. > > The flink-shaded project contains a number of shaded

[jira] [Created] (FLINK-18069) Scaladocs not building since inner Java interfaces cannot be recognized

2020-06-02 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-18069: --- Summary: Scaladocs not building since inner Java interfaces cannot be recognized Key: FLINK-18069 URL: https://issues.apache.org/jira/browse/FLINK-18069

[jira] [Created] (FLINK-18070) Time attribute been materialized after sub graph optimize

2020-06-02 Thread YufeiLiu (Jira)
YufeiLiu created FLINK-18070: Summary: Time attribute been materialized after sub graph optimize Key: FLINK-18070 URL: https://issues.apache.org/jira/browse/FLINK-18070 Project: Flink Issue

[jira] [Created] (FLINK-18074) Confirm checkpoint completed on task side would not fail the task if exception thrown out

2020-06-02 Thread Yun Tang (Jira)
Yun Tang created FLINK-18074: Summary: Confirm checkpoint completed on task side would not fail the task if exception thrown out Key: FLINK-18074 URL: https://issues.apache.org/jira/browse/FLINK-18074

[jira] [Created] (FLINK-18073) AvroRowDataSerializationSchema is not always serializable

2020-06-02 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-18073: Summary: AvroRowDataSerializationSchema is not always serializable Key: FLINK-18073 URL: https://issues.apache.org/jira/browse/FLINK-18073 Project: Flink

[jira] [Created] (FLINK-18076) Sql client uses wrong class loader when parsing queries

2020-06-02 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-18076: Summary: Sql client uses wrong class loader when parsing queries Key: FLINK-18076 URL: https://issues.apache.org/jira/browse/FLINK-18076 Project: Flink

Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-06-02 Thread Steven Wu
Current Flink documentation is actually pretty clear about no guarantees for backward compatibility. https://ci.apache.org/projects/flink/flink-docs-stable/ops/upgrading.html#compatibility-table On Tue, Jun 2, 2020 at 3:20 AM Yun Tang wrote: > Since Flink lacks of such kind of experiments to

[jira] [Created] (FLINK-18075) Kafka connector does not call open method of (de)serialization schema

2020-06-02 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-18075: Summary: Kafka connector does not call open method of (de)serialization schema Key: FLINK-18075 URL: https://issues.apache.org/jira/browse/FLINK-18075 Project: Flink

[jira] [Created] (FLINK-18080) Translate the "Kerberos Authentication Setup and Configuration" page into Chinese

2020-06-02 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-18080: -- Summary: Translate the "Kerberos Authentication Setup and Configuration" page into Chinese Key: FLINK-18080 URL: https://issues.apache.org/jira/browse/FLINK-18080

[jira] [Created] (FLINK-18081) Fix broken links in "Kerberos Authentication Setup and Configuration" doc

2020-06-02 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-18081: -- Summary: Fix broken links in "Kerberos Authentication Setup and Configuration" doc Key: FLINK-18081 URL: https://issues.apache.org/jira/browse/FLINK-18081 Project: Flink

[jira] [Created] (FLINK-18082) UnsignedTypeConversionITCase stalls in ch.vorburger.mariadb4j.DB.stop

2020-06-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18082: -- Summary: UnsignedTypeConversionITCase stalls in ch.vorburger.mariadb4j.DB.stop Key: FLINK-18082 URL: https://issues.apache.org/jira/browse/FLINK-18082 Project:

Re: [Discussion] flink elasticsearch connector supports

2020-06-02 Thread Jacky Lau
Hi Robert Metzger: Thanks for your response. could you please read this docs. https://www.yuque.com/jackylau-sc7w6/bve18l/14a2ad5b7f86998433de83dd0f8ec067 . Any Is it any problem here? we are worried about we do not think throughly. thanks. -- Sent from:

[jira] [Created] (FLINK-18078) E2E tests manually for Hive streaming dim join

2020-06-02 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-18078: Summary: E2E tests manually for Hive streaming dim join Key: FLINK-18078 URL: https://issues.apache.org/jira/browse/FLINK-18078 Project: Flink Issue Type:

[jira] [Created] (FLINK-18077) E2E tests manually for Hive streaming source

2020-06-02 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-18077: Summary: E2E tests manually for Hive streaming source Key: FLINK-18077 URL: https://issues.apache.org/jira/browse/FLINK-18077 Project: Flink Issue Type:

[jira] [Created] (FLINK-18079) KafkaShuffle Manual Tests

2020-06-02 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-18079: Summary: KafkaShuffle Manual Tests Key: FLINK-18079 URL: https://issues.apache.org/jira/browse/FLINK-18079 Project: Flink Issue Type: Improvement