Ramin Gharib created FLINK-39913:
------------------------------------

             Summary: Improve the error message when a foreground query emits 
an upsert changelog
                 Key: FLINK-39913
                 URL: https://issues.apache.org/jira/browse/FLINK-39913
             Project: Flink
          Issue Type: Improvement
          Components: Table SQL / API, Table SQL / Planner
            Reporter: Ramin Gharib
            Assignee: Ramin Gharib


A foreground query (a bare SELECT, collected with no primary key) over a 
relation that emits an upsert changelog fails with an unhelpful error. The 
message is just "Can't generate a valid execution plan" followed by the 
optimized plan. A user has no way  to tell what went wrong or how to fix it.    
                                                                                
   
                                                                                
                                                  
The plan can emit an upsert changelog, for example via FROM_CHANGELOG with 
PARTITION BY and an op_mapping that has no UPDATE_BEFORE. The foreground sink 
has no primary key, so the planner requires a retract changelog (UPDATE_BEFORE 
+ UPDATE_AFTER). Upsert cannot satisfy that, and the planner gives up.

Reproduce:
{code:java}
SELECT *
FROM FROM_CHANGELOG(
  input => TABLE events PARTITION BY id,
  op    => DESCRIPTOR(operation),
  op_mapping => MAP[
    'c', 'INSERT',
    'u', 'UPDATE_AFTER',
    'd', 'DELETE'
  ]
); {code}

Part of the error message the users sees is:
{code:java}
Can't generate a valid execution plan for the given query:
    Sink(table=[*anonymous_foreground-sink$112*], fields=[id, name, email, 
status, event_time], changelogMode=[NONE])
...{code}
 

 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to