sivabalan narayanan created HUDI-5337:
-----------------------------------------

             Summary: Support Prepped operations w/ spark-sql
                 Key: HUDI-5337
                 URL: https://issues.apache.org/jira/browse/HUDI-5337
             Project: Apache Hudi
          Issue Type: Improvement
          Components: spark-sql, writer-core
            Reporter: sivabalan narayanan


If incoming data was consumed from a hudi table, it already has the fileName 
from which we can glean the fileId info. And adding a prepped flow, we can 
avoid the index lookup altogether. 

 

We can add this support DELETEs in spark-sql. But may be worth considering for 
UPDATE and MERGE INTO as well. 

 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to