[jira] [Created] (FLINK-23868) JobExecutionResult printed event if suppressSysout is on

2021-08-18 Thread Paul Lin (Jira)
Paul Lin created FLINK-23868: Summary: JobExecutionResult printed event if suppressSysout is on Key: FLINK-23868 URL: https://issues.apache.org/jira/browse/FLINK-23868 Project: Flink Issue Type:

Re: Configuring flink-python in IntelliJ

2021-08-18 Thread Ingo Bürk
Hi Dian, thank you for the explanation. I guess this is, at least as far as we know, as good as it gets for an IntelliJ setup for all of Flink. I'll put up a pull request to update the IDE setup guide, but also point out that for specific work on PyFlink, a separate setup with PyCharm is

Re: [DISCUSS] Merge FLINK-23757 after feature freeze

2021-08-18 Thread Xintong Song
Sounds good to me. Thank you both! Thank you~ Xintong Song On Thu, Aug 19, 2021 at 12:34 PM Ingo Bürk wrote: > Thanks everyone, and especially Dian, > > the PR was a draft because originally the task was for all JSON methods. > I've now split it to only refer to those which are merged for

[jira] [Created] (FLINK-23867) FlinkKafkaInternalProducerITCase.testCommitTransactionAfterClosed fails with IllegalStateException

2021-08-18 Thread Xintong Song (Jira)
Xintong Song created FLINK-23867: Summary: FlinkKafkaInternalProducerITCase.testCommitTransactionAfterClosed fails with IllegalStateException Key: FLINK-23867 URL:

Re: [DISCUSS] Merge FLINK-23757 after feature freeze

2021-08-18 Thread Ingo Bürk
Thanks everyone, and especially Dian, the PR was a draft because originally the task was for all JSON methods. I've now split it to only refer to those which are merged for 1.14 already, and converted the PR to a normal one. Dian kindly offered to review and merge it. Best Ingo On Thu, Aug 19,

[jira] [Created] (FLINK-23866) KafkaTransactionLogITCase.testGetTransactionsToAbort fails with IllegalStateException

2021-08-18 Thread Xintong Song (Jira)
Xintong Song created FLINK-23866: Summary: KafkaTransactionLogITCase.testGetTransactionsToAbort fails with IllegalStateException Key: FLINK-23866 URL: https://issues.apache.org/jira/browse/FLINK-23866

[jira] [Created] (FLINK-23865) Class cast error caused by nested Pojo in legacy outputConversion

2021-08-18 Thread zoucao (Jira)
zoucao created FLINK-23865: -- Summary: Class cast error caused by nested Pojo in legacy outputConversion Key: FLINK-23865 URL: https://issues.apache.org/jira/browse/FLINK-23865 Project: Flink Issue

Re: [DISCUSS] Merge FLINK-23757 after feature freeze

2021-08-18 Thread Dian Fu
Hi Xintong, I can help review the PR. Regards, Dian > 2021年8月19日 上午9:48,Xintong Song 写道: > > Thanks all for the discussion. > > Quick question for @Ingo: > When do you think the PR will be ready (given that it's still a draft now), > and who would review it? > > Thank you~ > > Xintong Song

Re: [DISCUSS] Merge Kafka-related PRs after feature freeze

2021-08-18 Thread Xintong Song
Thanks for starting this discussion, Arvid. I'd be fine with merging them, as long as there's no other objections and the PRs are ready for merging on Friday. If this takes more time than that, I'd rather consider it as a distraction for the release stabilization and should be moved to the next

Re: [DISCUSS] Merge FLINK-23757 after feature freeze

2021-08-18 Thread Xintong Song
Thanks all for the discussion. Quick question for @Ingo: When do you think the PR will be ready (given that it's still a draft now), and who would review it? Thank you~ Xintong Song On Wed, Aug 18, 2021 at 10:27 PM Dian Fu wrote: > The risk should be very limited and it should not affect

[jira] [Created] (FLINK-23864) The document for Pulsar Source

2021-08-18 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-23864: --- Summary: The document for Pulsar Source Key: FLINK-23864 URL: https://issues.apache.org/jira/browse/FLINK-23864 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Merge FLINK-23757 after feature freeze

2021-08-18 Thread Dian Fu
The risk should be very limited and it should not affect other parts of the functionality. So I'm also in favour of merging it. Regards, Dian On Wed, Aug 18, 2021 at 8:07 PM Till Rohrmann wrote: > @Dian Fu could you assess how involved this > change is? If the change is not very involved and

Re: Common type required when creating TableSchema

2021-08-18 Thread Ingo Bürk
Hi Dominik, can you maybe share how you are trying to create the Schema and what you are doing with it afterwards? Best Ingo On Wed, Aug 18, 2021 at 4:08 PM Dominik Wosiński wrote: > Hey, > I've stumbled across a weird behavior and was wondering whether this is > intentional for some reason

Re: Configuring flink-python in IntelliJ

2021-08-18 Thread Dian Fu
Hi Ingo, There are both Java/Python source codes in PyFlink and I use two IDEs at the same time: IntelliJ IDEA & PyCharm. Regarding ONLY using IntelliJ IDEA for both Python & Java development, I have tried it and it works just as you said. I have done the following: - Install Python Plugin -

Common type required when creating TableSchema

2021-08-18 Thread Dominik Wosiński
Hey, I've stumbled across a weird behavior and was wondering whether this is intentional for some reason or the result of a weird bug. So, basically currently if we want to create *org.apache.flink.table.api.Schema *taht has one of the types defined as *RAW (*AVRO enum in my case) it's probably

Re: Incompatible RAW types in Table API

2021-08-18 Thread Dominik Wosiński
FYI. I've managed to fix that by switching to using `toDataStream`. It seems to be working fine now. I have created the issue about the UDF though, since it seems to be different issue. Not sure if an issue should be created for `toAppendStream` if this is meant to be deprecated. pon., 9 sie 2021

[jira] [Created] (FLINK-23863) AVRO Raw types do not match for UDFs

2021-08-18 Thread Jira
Dominik Wosiński created FLINK-23863: Summary: AVRO Raw types do not match for UDFs Key: FLINK-23863 URL: https://issues.apache.org/jira/browse/FLINK-23863 Project: Flink Issue Type:

[jira] [Created] (FLINK-23862) Race condition while cancelling task during initialization

2021-08-18 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-23862: - Summary: Race condition while cancelling task during initialization Key: FLINK-23862 URL: https://issues.apache.org/jira/browse/FLINK-23862 Project: Flink

[DISCUSS] Merge Kafka-related PRs after feature freeze

2021-08-18 Thread Arvid Heise
Dear devs, we would like to merge these PRs after features freeze: FLINK-23838: Add FLIP-33 metrics to new KafkaSink [1] FLINK-23801: Add FLIP-33 metrics to KafkaSource [2] FLINK-23640: Create a KafkaRecordSerializationSchemas builder [3] All of the 3 PRs are smaller quality of life improvements

[jira] [Created] (FLINK-23861) flink sql client support dynamic params

2021-08-18 Thread zhangbinzaifendou (Jira)
zhangbinzaifendou created FLINK-23861: - Summary: flink sql client support dynamic params Key: FLINK-23861 URL: https://issues.apache.org/jira/browse/FLINK-23861 Project: Flink Issue

[jira] [Created] (FLINK-23860) Conversion to relational algebra failed to preserve datatypes

2021-08-18 Thread lixu (Jira)
lixu created FLINK-23860: Summary: Conversion to relational algebra failed to preserve datatypes Key: FLINK-23860 URL: https://issues.apache.org/jira/browse/FLINK-23860 Project: Flink Issue Type:

[jira] [Created] (FLINK-23859) [typo][flink-core][flink-connectors]fix typo for code

2021-08-18 Thread wuguihu (Jira)
wuguihu created FLINK-23859: --- Summary: [typo][flink-core][flink-connectors]fix typo for code Key: FLINK-23859 URL: https://issues.apache.org/jira/browse/FLINK-23859 Project: Flink Issue Type:

[jira] [Created] (FLINK-23858) Clarify StreamRecord#timestamp.

2021-08-18 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-23858: --- Summary: Clarify StreamRecord#timestamp. Key: FLINK-23858 URL: https://issues.apache.org/jira/browse/FLINK-23858 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-23857) insert overwirite table select * from t where 1 != 1, Unable to clear table data

2021-08-18 Thread lixu (Jira)
lixu created FLINK-23857: Summary: insert overwirite table select * from t where 1 != 1, Unable to clear table data Key: FLINK-23857 URL: https://issues.apache.org/jira/browse/FLINK-23857 Project: Flink

Re: [DISCUSS] Merge FLINK-23757 after feature freeze

2021-08-18 Thread Till Rohrmann
@Dian Fu could you assess how involved this change is? If the change is not very involved and the risk is limited, then I'd be in favour of merging it because feature parity of APIs is quite important for our users. Cheers, Till On Wed, Aug 18, 2021 at 1:46 PM Ingo Bürk wrote: > Hello dev, >

[DISCUSS] Merge FLINK-23757 after feature freeze

2021-08-18 Thread Ingo Bürk
Hello dev, I was wondering whether we could also consider merging FLINK-23757[1][2] after the freeze. This is about exposing two built-in functions which we added to Table API & SQL prior to the freeze also for PyFlink. Meaning that the feature itself isn't new, we only expose it on the Python

[jira] [Created] (FLINK-23856) Support all JSON methods in PyFlink

2021-08-18 Thread Jira
Ingo Bürk created FLINK-23856: - Summary: Support all JSON methods in PyFlink Key: FLINK-23856 URL: https://issues.apache.org/jira/browse/FLINK-23856 Project: Flink Issue Type: Sub-task

Re: Configuring flink-python in IntelliJ

2021-08-18 Thread Ingo Bürk
Hi Dian, thanks for responding! No, I haven't tried, but I'm aware of it. I don't work exclusively on PyFlink, but rather just occasionally. So instead of having a whole separate IDE and project for one module I'm trying to get the whole Flink project to work as one in IntelliJ. Do PyFlink

Re: Configuring flink-python in IntelliJ

2021-08-18 Thread Dian Fu
Hi Ingo, Thanks a lot for starting up this discussion. I have not tried IntelliJ and I’m using PyCharm for PyFlink development. Have you tried this guideline? [1] It’s written in 1.9 and I think it should still work. Regards, Dian [1]

[jira] [Created] (FLINK-23855) Table API & SQL Configuration Not displayed on flink dashboard

2021-08-18 Thread simenliuxing (Jira)
simenliuxing created FLINK-23855: Summary: Table API & SQL Configuration Not displayed on flink dashboard Key: FLINK-23855 URL: https://issues.apache.org/jira/browse/FLINK-23855 Project: Flink

Re: Configuring flink-python in IntelliJ

2021-08-18 Thread Till Rohrmann
Thanks for starting this discussion Ingo. I guess that Dian can probably answer this question. I am big +1 for updating our documentation for how to set up the IDE since this problem will probably be encountered a couple of times. Cheers, Till On Wed, Aug 18, 2021 at 11:03 AM Ingo Bürk wrote:

回复:[DISCUSS] FLIP-173: Support DAG of algorithms (Flink ML)

2021-08-18 Thread 洪帆(既起)
Hi, Mingliang, Thank you for providing a real-world case of heterogeneous topology in the training and inference phase, and Becket has given two options to you to choose. Personally, I think Becket's two options are over-simplified in description, and may be somehow misleading. Here, I would

[jira] [Created] (FLINK-23854) KafkaSink error when restart from the checkpoint with a lower parallelism

2021-08-18 Thread Hang Ruan (Jira)
Hang Ruan created FLINK-23854: - Summary: KafkaSink error when restart from the checkpoint with a lower parallelism Key: FLINK-23854 URL: https://issues.apache.org/jira/browse/FLINK-23854 Project: Flink

Configuring flink-python in IntelliJ

2021-08-18 Thread Ingo Bürk
Hello @dev, like probably most of you, I am using IntelliJ to work on Flink. Lately I needed to also work with flink-python, and thus was wondering about how to properly set it up to work in IntelliJ. So far, I have done the following: 1. Install the Python plugin 2. Set up a custom Python SDK

Flink 1.14 Bi-weekly 2021-08-17 Feature Freeze done, now stabilise!

2021-08-18 Thread Johannes Moser
Dear Flink Community, Thanks for putting all that effort into the 1.14 release. We are now post feature freeze and it looks like most of the features made it. This will be a decent release. Here's a summary of today's bi-weekly, which has been a bit longer. *Exception for feature freeze*

[jira] [Created] (FLINK-23853) Update StateFun's Flink dependency to 1.13.2

2021-08-18 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-23853: --- Summary: Update StateFun's Flink dependency to 1.13.2 Key: FLINK-23853 URL: https://issues.apache.org/jira/browse/FLINK-23853 Project: Flink

[jira] [Created] (FLINK-23852) In sql-client mode ,could not change the properties.

2021-08-18 Thread Shuaishuai Guo (Jira)
Shuaishuai Guo created FLINK-23852: -- Summary: In sql-client mode ,could not change the properties. Key: FLINK-23852 URL: https://issues.apache.org/jira/browse/FLINK-23852 Project: Flink