[
https://issues.apache.org/jira/browse/HUDI-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-4761:
------------------------------
Description: For major write operations and table services, we should guard
the DAG by making use of spark listeners. Some basic things can be validated
such as no. of stages, tasks, executor runtime, records written. (was: For
major write operations and table services, we should guard the DAG by making
use of spark listeners. Some basic things can be validated such as no. of
stages, tasks, executor runtime records written.)
> Test using spark listeners that guards any changes to DAG
> ---------------------------------------------------------
>
> Key: HUDI-4761
> URL: https://issues.apache.org/jira/browse/HUDI-4761
> Project: Apache Hudi
> Issue Type: Task
> Reporter: Sagar Sumit
> Priority: Major
>
> For major write operations and table services, we should guard the DAG by
> making use of spark listeners. Some basic things can be validated such as no.
> of stages, tasks, executor runtime, records written.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
