[jira] [Commented] (HIVE-10223) Consolidate several redundant FileSystem API calls.
[
https://issues.apache.org/jira/browse/HIVE-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519944#comment-14519944
]
Sushanth Sowmyan commented on HIVE-10223:
-
Hi,
FYI, looks like this patch broke -Phadoop-1 compilation compatibility. I've
opened HIVE-10536 for this.
Consolidate several redundant FileSystem API calls.
---
Key: HIVE-10223
URL: https://issues.apache.org/jira/browse/HIVE-10223
Project: Hive
Issue Type: Improvement
Reporter: Chris Nauroth
Assignee: Chris Nauroth
Fix For: 1.2.0
Attachments: HIVE-10223.1.patch
This issue proposes to consolidate several Hive calls to the Hadoop Common
{{FileSystem}} API into a fewer number of calls that still accomplish the
equivalent work. {{FileSystem}} API calls typically translate into RPCs to
other services like the HDFS NameNode or alternative file system
implementations. Consolidating RPCs will lower latency a bit for Hive code
and reduce some load on these external services.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-10223) Consolidate several redundant FileSystem API calls.
[
https://issues.apache.org/jira/browse/HIVE-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483649#comment-14483649
]
Chris Nauroth commented on HIVE-10223:
--
[~hagleitn], thanks for confirming the tests and doing the commit!
Consolidate several redundant FileSystem API calls.
---
Key: HIVE-10223
URL: https://issues.apache.org/jira/browse/HIVE-10223
Project: Hive
Issue Type: Improvement
Reporter: Chris Nauroth
Assignee: Chris Nauroth
Fix For: 1.2.0
Attachments: HIVE-10223.1.patch
This issue proposes to consolidate several Hive calls to the Hadoop Common
{{FileSystem}} API into a fewer number of calls that still accomplish the
equivalent work. {{FileSystem}} API calls typically translate into RPCs to
other services like the HDFS NameNode or alternative file system
implementations. Consolidating RPCs will lower latency a bit for Hive code
and reduce some load on these external services.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
