ad1happy2go commented on issue #11213: URL: https://github.com/apache/hudi/issues/11213#issuecomment-2112549033
@bibhu107 It should not be straight forward to implement that. According to me thinking of a design to have a list with 100,000 items itself not correct. It is not scalable at all. The job is going to fail only. If you are concerned about data redundancy, why not create two tables. one containing contract details and other table containing item details(with contract id). In the second table, both contract id and item id can make the record key. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
