[ 
https://issues.apache.org/jira/browse/HUDI-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

xy updated HUDI-7208:
---------------------
    Description: 
when user execute merge into or insert into to a table,if source table data is 
not right(such as source schema is not consistent to target table),should 
shutdown and throw error details to user,this can reduce cost of job and 
indicate more message for user to dig questions,

job is not error evenwhen data insert occur error,this would misstake user and 
cost more compute time which is not necessary,stage status show success,but had 
been failed due to writing failed,like the pictures:

  was:
when user execute merge into or insert into to a table,if source table data is 
not right(such as source schema is not consistent to target table),should 
shutdown and throw error details to user,this can reduce cost of job and 
indicate more message for user to dig questions,like the pictures:

job is not error evenwhen data insert occur error,this would misstake user and 
cost more compute time which is not necessary


> Do writing stage should shutdown with error when insert failed to reduce user 
> execute time and show error details
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-7208
>                 URL: https://issues.apache.org/jira/browse/HUDI-7208
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: spark-sql
>            Reporter: xy
>            Priority: Major
>         Attachments: CAPTURE_2023-12-11_144823.jpg, 
> CAPTURE_2023-12-11_144839.jpg, CAPTURE_2023-12-11_144849.jpg, 
> CAPTURE_2023-12-11_144901.jpg
>
>
> when user execute merge into or insert into to a table,if source table data 
> is not right(such as source schema is not consistent to target table),should 
> shutdown and throw error details to user,this can reduce cost of job and 
> indicate more message for user to dig questions,
> job is not error evenwhen data insert occur error,this would misstake user 
> and cost more compute time which is not necessary,stage status show 
> success,but had been failed due to writing failed,like the pictures:



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to