[
https://issues.apache.org/jira/browse/HIVE-11376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681285#comment-14681285
]
Lefty Leverenz commented on HIVE-11376:
---------------------------------------
Doc note: This removes *hive.hadoop.supports.splittable.combineinputformat*
from HiveConf.java, so the wikidoc needs a bullet "Removed In: 2.0.0 with
HIVE-11376" for the parameter.
* [Configuration Properties --
hive.hadoop.supports.splittable.combineinputformat |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.hadoop.supports.splittable.combineinputformat]
> CombineHiveInputFormat is falling back to HiveInputFormat in case codecs are
> found for one of the input files
> -------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-11376
> URL: https://issues.apache.org/jira/browse/HIVE-11376
> Project: Hive
> Issue Type: Bug
> Reporter: Rajat Khandelwal
> Assignee: Rajat Khandelwal
> Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: HIVE-11376.02.patch
>
>
> https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java#L379
> This is the exact code snippet:
> {noformat}
> / Since there is no easy way of knowing whether MAPREDUCE-1597 is present in
> the tree or not,
> // we use a configuration variable for the same
> if (this.mrwork != null && !this.mrwork.getHadoopSupportsSplittable()) {
> // The following code should be removed, once
> // https://issues.apache.org/jira/browse/MAPREDUCE-1597 is fixed.
> // Hadoop does not handle non-splittable files correctly for
> CombineFileInputFormat,
> // so don't use CombineFileInputFormat for non-splittable files
> //ie, dont't combine if inputformat is a TextInputFormat and has
> compression turned on
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
