[ 
https://issues.apache.org/jira/browse/TEZ-529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254902#comment-14254902
 ] 

Hitesh Shah commented on TEZ-529:
---------------------------------

[~sseth] [~hagleitn] Is this still a valid issue? 

> Hive communicates state from RecordReader to Processor via JobConf
> ------------------------------------------------------------------
>
>                 Key: TEZ-529
>                 URL: https://issues.apache.org/jira/browse/TEZ-529
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.2.0
>            Reporter: Gunther Hagleitner
>            Assignee: Siddharth Seth
>
> Hive currently switches between operator pipelines + partition descriptors 
> via a map.input.file
> In the CombineFileInputFormat case Hive relies on the fact that 
> CombineFileRecordReader sets this field every time a new file is processed. 
> This file will then be read in the processor to setup the correct processing 
> pipeline.
> After the Tez refactor RecordReader and TezProcessor use different job conf 
> instances. Because of that Hive will fail since map.input.file isn't set and 
> updated in the processor's conf.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to