Steve Loughran created HADOOP-19557:
---------------------------------------
Summary: S3A: S3ABlockOutputStream to never log/reject hflush():
calls
Key: HADOOP-19557
URL: https://issues.apache.org/jira/browse/HADOOP-19557
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Steve Loughran
Parquet's GH-3204 patch uses hflush() just before close()
this is needless and hurts write performance on hdfs.
For s3A it will trigger a warning long (Syncable is not supported) or an actual
failure if
fs.s3a.downgrade.syncable.exceptions is false
proposed: hflush to log at debug -only log/reject on hsync, which is the real
place where semantics cannot be met
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
