Steve Loughran created HADOOP-18854: ---------------------------------------
Summary: add options to disable range merging of vectored io Key: HADOOP-18854 URL: https://issues.apache.org/jira/browse/HADOOP-18854 Project: Hadoop Common Issue Type: Improvement Components: fs, fs/s3 Affects Versions: 3.3.6, 3.3.5 Reporter: Steve Loughran I'm seeing test failures in my PARQUET-2171 pr because assertions about the #of bytes read isn't holding -small files are being read and the vector range merging is pulling in the whole file. ``` [ERROR] TestInputOutputFormat.testReadWriteWithCounter:338 bytestotal != bytesread expected:<5510> but was:<11020> ``` I think for parquet i will add an option to disable vector io, but really the filesystems which support it should allow for merging to be disabled -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org