sivabalan narayanan created HUDI-5337:
-----------------------------------------
Summary: Support Prepped operations w/ spark-sql
Key: HUDI-5337
URL: https://issues.apache.org/jira/browse/HUDI-5337
Project: Apache Hudi
Issue Type: Improvement
Components: spark-sql, writer-core
Reporter: sivabalan narayanan
If incoming data was consumed from a hudi table, it already has the fileName
from which we can glean the fileId info. And adding a prepped flow, we can
avoid the index lookup altogether.
We can add this support DELETEs in spark-sql. But may be worth considering for
UPDATE and MERGE INTO as well.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)