Joe Crobak created HIVE-3482:
--------------------------------

             Summary: Add support for S3 FileSystemCounters to MapRedStats
                 Key: HIVE-3482
                 URL: https://issues.apache.org/jira/browse/HIVE-3482
             Project: Hive
          Issue Type: Improvement
          Components: CLI
    Affects Versions: 0.9.0
            Reporter: Joe Crobak
            Priority: Minor


When I run a Hive query on data in S3, it'd be nice if the output included 
filesystem counters for S3, too. e.g., I'm envisioning a few more columns:

{noformat}
Job 0: Map: 14  Reduce: 1   Cumulative CPU: 491.7 sec   HDFS Read: 3714 S3N 
Read: 1051000000 HDFS Write: 29 SUCCESS
{noformat}

rather than
{noformat}
Job 0: Map: 14  Reduce: 1   Cumulative CPU: 491.7 sec   HDFS Read: 3714 HDFS 
Write: 29 SUCCESS
{noformat}

This shouldn't require a new setting -- but rather a would only output the 
counters for which there was a non-null value. And it wouldn't report on 
FILES_BYTES_READ/WRITTEN.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to