sivabalan narayanan created HUDI-6183:
-----------------------------------------
Summary: Fail the reads from log record reader for any corruptness
Key: HUDI-6183
URL: https://issues.apache.org/jira/browse/HUDI-6183
Project: Apache Hudi
Issue Type: Improvement
Components: reader-core
Reporter: sivabalan narayanan
In GCS and S3 like systems, where partial writes failures are not possible, we
are planning to fail (fail fast) the reads from log files if hudi deduces any
corrupt data rather than silently skip and move on. Since writes are atomic and
only effective if the entire data is fully written, this should be fine with
GCS and S3 schemes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
