steveloughran commented on issue #17214: URL: https://github.com/apache/iceberg/issues/17214#issuecomment-4980839634
For the curious, scanning was claude's homework with the given prompt. ----- You are security auditing iceberg file reading for resilience to malicious content. The threat model is covered in @SECURITY-THREAT-MODEL.md The requirement is that * malformed data is rejected without disrupting other work on a multithreaded, multitenant system, such as through excessive memory consumption * files where statistics are inconsistent with data simply produce incorrect results; this is to be expected * files where the content is correct but inefficient: empty deletion vectors, equality deletes with no matches, dictionaries where all entries map to the same value MUST be accepted. * variant hardening is underway elsewhere. 1. Look at Puffin files in org.apache.iceberg.puffin and their uses 2. look for: integer wraparounds before use, memory allocation attacks and other classic attacks. Race conditions. 3. Triage into: minor issues, serious disruptions, violations of the security model. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
