回复：flinksql问题请教

已解决 where 条件始终为假。 -- 发件人：silence 发送时间：2021年7月7日(星期三) 12:05 收件人：user-zh 主　题：flinksql问题请教 请教一下下面的sql为什么会被翻译成有限数据集？源表是个kafka source，用了row_number进行开窗和两次Table Function join flink版本：1.12.2 Stage 1 : Data Source content : Source:

Re: flinksql 流维join 问题

语句看起来是没有问题的，可以检查下数据是否能关联上 Best, Terry Wang > 2021年7月6日 下午3:24，赵旭晨 写道： > > 流表： > CREATE TABLE flink_doris_source ( > reporttime STRING, > tenantcode STRING, > visitid STRING, > orderid STRING, > orderdetailid STRING, > paymentdetailid STRING, > etltype

flinksql问题请教

请教一下下面的sql为什么会被翻译成有限数据集？源表是个kafka source，用了row_number进行开窗和两次Table Function join flink版本：1.12.2 Stage 1 : Data Source content : Source: Values(tuples=[[]]) Stage 2 : Operator content : Correlate(invocation=[LateralArray($cor3.gift_list)], correlate=[table(LateralArray($cor3.gift_list))],

Re:Reply:flinksql 流维join 问题

单独查kafka，mysql都有数据， 关联temporal join 维表字段就带不出来 看了下流表的proctime比当前时间早8小时，会不会这个原因？ 在 2021-07-06 15:33:08，"guoyb" <861277...@qq.com.INVALID> 写道： >select的问题，排查一下，单独查表是否有数据，关联条件。 > > > >---Original--- >From: "赵旭晨"Sent at: 2021年7月6日(Tue) PM3:25 >To: "user-zh"Subject: flinksql 流维join 问题 > >

Re: Apache Flink - How to use/invoke LookupTableSource/Function

Hi Mans, `LookupTableSource` used to look up rows from external storage system by given keys, it's very suitable for Key/Value storage system (e.g Redis, HBase), or storage system with key concept (e.g, Mysql, Hive). ` ScanTableSource` is used to scan all rows from an external storage system. Some

Re: Using Flink's Kubernetes API inside Java

Hi Alexis, I used to create a ticket[1] to make the ApplicationDeployer interface public. However, the community is very careful to add new public interfaces. Because it will make the maintenance more difficult. AFAIK, the ApplicationDeployer is stable and it is a very basic requirement for

Re: Flink CEP checkpoint size

Hi, Jameson Thanks very much for replying , I am really struggling on this. I am using flowId as my keys, which means they will be matched and never use again. This seems like the scenario 2. I didn't know it is not fixed yet. thank you again and do you have any solutions ？ On 2021/07/07

Re: Flink CEP checkpoint size

Hi Li, How big is your keyspace? Had a similar problem which turns out to be scenario 2 in this issue https://issues.apache.org/jira/browse/FLINK-19970. Looks like the bug in scenario 1 got fixed by scenario 2 did not. There's more detail in this thread,

Apache Flink - How to use/invoke LookupTableSource/Function

Hey Folks: I am trying to understand how LookupTableSource works and have a few questions:  1. Are there other examples/documentation on how create a query that uses it vs ScanTableSource ?2. Are there any best practices for using this interface ?3. How does the planner decide to use

Re: Understanding recovering from savepoint / checkpoint with additional operators when chaining

Hello Roman, Sorry I did some more testing and the original failure was caused by a different part of the pipeline. We I added a new stateless operator, it was able to restart from the previous savepoint with no issue. Another question I have is, since you explicitly asked whether it's a

Re: Using Flink's Kubernetes API inside Java

Hi Alexis, KubernetesSessionCli provides a similar functionality IIUC but it's also marked as @Internal (so it likely will change in the future; the REST APIs it uses aren't likely to change, but I guess it doesn't help as you'd like some helper classes.). I think it's a good idea to ask this

Re: WELCOME to user@flink.apache.org

Hi Wanghui, unfortunately, this is not supported to my knowledge. See also this similar question on Stackoverflow: https://stackoverflow.com/questions/60950594/flink-encryption-parameters-in-flink-conf-yaml Best regards, Nico On Mon, Jul 5, 2021 at 3:45 PM Wanghui (HiCampus) wrote: > Hello, I

Re: How Do I Specify the Encryption Algorithm Suite of the Flink REST Service?

Hi Wanghui, if I understand correctly, you are looking for the config option security.ssl.algorithms [1]? Best regards, Nico [1] https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/security/security-ssl/#cipher-suites On Tue, Jul 6, 2021 at 3:46 AM Wanghui (HiCampus)

Bug in MATCH_RECOGNIZE ?

Hi, I have a very strange bug when using MATCH_RECOGNIZE. I'm using some joins and unions to create an event stream. Sample event stream (for one user) looks like this: uuid cif event_type v balance ts 621456e9-389b-409b-aaca-bca99eeb43b3 0004091386 trx 4294.38

[no subject]

Hi, I have a very strange bug when using MATCH_RECOGNIZE. I'm using some joins and unions to create event stream. Sample event stream (for one user) looks like this: uuidcif event_type v balance ts 621456e9-389b-409b-aaca-bca99eeb43b30004091386 trx

Re: Job Recovery Time on TM Lost

Yes, I have noticed the PR and commented there with some consideration about the new option. We can discuss further there. On Tue, Jul 6, 2021 at 6:04 PM Till Rohrmann wrote: > This is actually a very good point Gen. There might not be a lot to gain > for us by implementing a fancy algorithm

Re: Job Recovery Time on TM Lost

This is actually a very good point Gen. There might not be a lot to gain for us by implementing a fancy algorithm for figuring out whether a TM is dead or not based on failed heartbeat RPCs from the JM if the TM <> TM communication does not tolerate failures and directly fails the affected tasks.

Re: kerberos token expire

As Yangze stated ticket cache will be expired after its lifespan. Please be aware that when keytab is used then Flink obtains delegation tokens which will be never ever used. The fact that delegation token handling is not functioning is a known issue and working on it to fix it. w/o delegation

PyFlink performance and deployment issues

Dear community, I have been struggling a lot with the deployment of my PyFlink job. Moreover, the performance seems to be very disappointing especially the low-throughput latency. I have been playing around with configuration values, but it has not been improving. In short, I have a Datastream

Re: 退订

如果需要取消订阅 u...@flink.apache.org 邮件组，请发送任意内容的邮件到 user-zh-unsubscr...@flink.apache.org 。 张保淇 于2021年7月6日周二 下午4:13写道： > 退订

退订

退订

Re: Flink 1.10 内存问题

Hi, 有可能的，如果下游发生了死锁，无法消费任何数据的话，整个作业就假死了。要定位root cause还是需要查一下下游的task究竟怎么了 祝好 唐云 From: Ada Luna Sent: Tuesday, July 6, 2021 12:04 To: user-zh@flink.apache.org Subject: Re: Flink 1.10 内存问题 反压会导致整个Flink任务假死吗？一条Kafka数据都不消费了。持续几天，不重启不恢复的 Yun Tang 于2021年7月6日周二

Flink CEP checkpoint size

I am using Flink CEP to do some performance tests. Flink version 1.13.1. below is the sql: INSERT INTO to_kafka SELECT bizName, wdName, wdValue , zbValue , flowId FROM kafka_source MATCH_RECOGNIZE ( PARTITION BY flow_id ORDER BY proctime MEASURES A.biz_name as bizName, A.wd_name as

Reply:flinksql 流维join 问题

select的问题，排查一下，单独查表是否有数据，关联条件。 ---Original--- From: "赵旭晨"

flinksql 流维join 问题

流表： CREATE TABLE flink_doris_source ( reporttime STRING, tenantcode STRING, visitid STRING, orderid STRING, orderdetailid STRING, paymentdetailid STRING, etltype STRING, ptime as proctime() ) WITH ( 'connector' = 'kafka', 'topic' = 'demo', 'properties.bootstrap.servers' =

Re: Flink cep checkpoint size

Hi, Mohit, Have you figured out any solusions on this problem ? I am now facing the exactly same problem , I was using Flink of version 1.12.0 and I also upgrated it to 1.13.1 but the checkpoint size is still growing. On 2021/06/02 15:45:59, "Singh, Mohit" wrote: > Hi, > > I am facing an