Kevin English created HIVE-8595: ----------------------------------- Summary: Slow IO when stdout directed to NAS with large blocksize Key: HIVE-8595 URL: https://issues.apache.org/jira/browse/HIVE-8595 Project: Hive Issue Type: Bug Components: Clients Affects Versions: 0.13.1 Environment: nfs4 rsize=1048576,wsize=1048576 Reporter: Kevin English Priority: Minor
Very slow IO when executing a SQL command file using the following command line when the target file system is an nfs4 mounted NAS with a large blocksize: hive -f sqlscript.sql 2>results.log >results.tab Work around (thousands of times faster): hive -f sqlscript.sql 2>results.log | cat >results.tab For instance I had a command finish 10 hours ago and I forgot to use cat and it is still writing out the output which after 10 hours is in the 180 GB range. -- This message was sent by Atlassian JIRA (v6.3.4#6332)