Jonathan Vexler created HUDI-5829:
-------------------------------------

             Summary: Optimize conversion from json to row format when 
sanitizing field names
                 Key: HUDI-5829
                 URL: https://issues.apache.org/jira/browse/HUDI-5829
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: Jonathan Vexler


With HUDI-4442, we have sanitization for row and json. However in 
SourceFormatAdapter.fetchNewDataInRowFormat to sanitize the json we leverage 
the sanitization that takes place when json is converted to avro, and then we 
convert the subsequent avro to row format. An optimization is to sanitize when 
converting directly from json to row format



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to