[jira] [Created] (FLINK-35313) Add upsert changelog mode to avoid UPDATE_BEFORE records push down
ude created FLINK-35313:
---
Summary: Add upsert changelog mode to avoid UPDATE_BEFORE records
push down
Key: FLINK-35313
URL: https://issues.apache.org/jira/browse/FLINK-35313
Project: Flink
Issue Type: New Feature
Components: Flink CDC
Reporter: ude
I try to use flink sql to write mysql cdc-data into redis as a dimension table
for other business use. When executing {{UPDATE}} DML, the cdc-data will be
converted into {{-D (UPDATE_BEFORE)}} and {{+I (UPDATE_AFTER)}} two records to
sink redis. However, delete first will cause other data streams to be
lost(NULL) when join data, which is unacceptable.
I think we can add support for [upser changelog
mode|https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/concepts/dynamic_tables/#table-to-stream-conversion]
by adding changelogMode option with mandatory primary key
configuration.Basically, with {{changelogMode=upsert}} we will avoid
{{UPDATE_BEFORE}} rows and we will require a primary key for the table.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (FLINK-35111) Modify the spelling mistakes in the taskmanager html
ude created FLINK-35111: --- Summary: Modify the spelling mistakes in the taskmanager html Key: FLINK-35111 URL: https://issues.apache.org/jira/browse/FLINK-35111 Project: Flink Issue Type: Improvement Components: Runtime / Web Frontend Affects Versions: 1.19.0 Reporter: ude Fix For: 1.19.0 Fix the spelling error from "profiler" to "profiling" -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35110) Modify the spelling mistakes in the taskmanager html
ude created FLINK-35110: --- Summary: Modify the spelling mistakes in the taskmanager html Key: FLINK-35110 URL: https://issues.apache.org/jira/browse/FLINK-35110 Project: Flink Issue Type: Improvement Components: Runtime / Web Frontend Affects Versions: 1.19.0 Reporter: ude Fix For: 1.19.0 Fix the spelling error from "profiler" to "profiling" -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35039) Create Profiling JobManager/TaskManager Instance failed
ude created FLINK-35039: --- Summary: Create Profiling JobManager/TaskManager Instance failed Key: FLINK-35039 URL: https://issues.apache.org/jira/browse/FLINK-35039 Project: Flink Issue Type: Bug Components: Runtime / Web Frontend Affects Versions: 1.19.0 Environment: Hadoop 3.2.2 Flink 1.19 Reporter: ude Attachments: image-2024-04-08-10-21-31-066.png, image-2024-04-08-10-21-48-417.png, image-2024-04-08-10-30-16-683.png I'm test the "async-profiler" feature in version 1.19, but when I submit a task in yarn per-job mode, I get an error when I click Create Profiling Instance on the flink Web UI page. !image-2024-04-08-10-21-31-066.png! !image-2024-04-08-10-21-48-417.png! The error message obviously means that the yarn proxy server does not support *POST* calls. I checked the code of _*WebAppProxyServlet.java*_ and found that the *POST* method is indeed not supported, so I changed it to *PUT* method and the call was successful. !image-2024-04-08-10-30-16-683.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
