Kanwaljit Singh created HIVE-4906: ------------------------------------- Summary: IO Exception for empty file not found if IP address used in core site instead of hostname Key: HIVE-4906 URL: https://issues.apache.org/jira/browse/HIVE-4906 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.10.0 Reporter: Kanwaljit Singh
The hive server has core-site.xml with IP address for DFS namenode instead of the hostname. But it also has host ip mapping. We are getting this error. I think the host reverse mapping is not taking place while trying to access the folder on the HDFS. hive> select httpurl, ptime from edr where ptime='2013-07-07 10:35:00' limit 10; Total MapReduce jobs = 1 Launching Job 1 out of 1 Number of reduce tasks is set to 0 since there's no reduce operator java.io.IOException: cannot find dir = hdfs://Namenode-VIP:9000/tmp/hive-admin/hive_2013-07-19_07-56-06_498_6777975312240173780/-mr-10002/1/emptyFile in pathToPartitionInfo: [hdfs://192.168.172.87:9000/tmp/hive-admin/hive_2013-07-19_07-56-06_498_6777975312240173780/-mr-10002/1] at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getPartitionDescFromPathRecursively(HiveFileFormatUtils.java:298) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getPartitionDescFromPathRecursively(HiveFileFormatUtils.java:260) at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat$CombineHiveInputSplit.<init>(CombineHiveInputFormat.java:104) at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:407) at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:929) at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:921) at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:838) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:791) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Unknown Source) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:791) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:765) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:447) at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira