vinishjail97 opened a new pull request, #12813:
URL: https://github.com/apache/hudi/pull/12813
### Change Logs
Enable writing of error and data table in parallel. This behavior is
disabled by default and can enabled by setting error table config property:
`hoodie.errortable.write.union.enable` to true.
### Impact
The DAG's for data table + error table are sequential today, this change
executes them in a union to better utilize the executor resources in the spark
driver.
### Risk level (write none, low medium or high below)
Low.
### Documentation Update
```
public static final ConfigProperty<Boolean>
ENABLE_ERROR_TABLE_WRITE_UNIFICATION = ConfigProperty
.key("hoodie.errortable.write.union.enable")
.defaultValue(false)
.withDocumentation("Enable error table union with data table when
writing for improved commit performance. "
+ "By default it is disabled meaning data table and error table
writes are sequential");
### Contributor's checklist
```
- [x] Read through [contributor's
guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Change Logs and Impact were stated clearly
- [x] Adequate tests were added if applicable
- [x] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
