[jira] [Commented] (HIVE-8484) HCatalog throws an exception if Pig job is of type 'fetch'
[ https://issues.apache.org/jira/browse/HIVE-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14203332#comment-14203332 ] Lorand Bendig commented on HIVE-8484: - Thank you, Daniel! > HCatalog throws an exception if Pig job is of type 'fetch' > -- > > Key: HIVE-8484 > URL: https://issues.apache.org/jira/browse/HIVE-8484 > Project: Hive > Issue Type: Bug > Components: HCatalog >Affects Versions: 0.14.0 >Reporter: Lorand Bendig > Fix For: 0.14.0 > > Attachments: HIVE-8484.patch > > > When Pig tries to retrieve result in fetch mode through HCatalog then > HCatLoader#setLocation(String location, Job job) can't set the outputschema > because HCatUtil#checkJobContextIfRunningFromBackend(job) always returns > false : > {code} > public static boolean checkJobContextIfRunningFromBackend(JobContext j) { > if (j.getConfiguration().get("mapred.task.id", "").equals("") && > !("true".equals(j.getConfiguration().get("pig.illustrating" { > return false; > } > return true; > } > {code} > This is because in fetch mode we don't have a mapred.task.id. A null > outputschema will raise an exception when HCatBaseLoader#getNext() is called: > (ERROR 6018: Error converting read value to tuple). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8484) HCatalog throws an exception if Pig job is of type 'fetch'
[ https://issues.apache.org/jira/browse/HIVE-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14198641#comment-14198641 ] Lorand Bendig commented on HIVE-8484: - I suspect that these failing tests are not related to this change. Would anyone verify this patch? Would be great to have it in 0.14. > HCatalog throws an exception if Pig job is of type 'fetch' > -- > > Key: HIVE-8484 > URL: https://issues.apache.org/jira/browse/HIVE-8484 > Project: Hive > Issue Type: Bug > Components: HCatalog >Affects Versions: 0.14.0 >Reporter: Lorand Bendig > Fix For: 0.14.0 > > Attachments: HIVE-8484.patch > > > When Pig tries to retrieve result in fetch mode through HCatalog then > HCatLoader#setLocation(String location, Job job) can't set the outputschema > because HCatUtil#checkJobContextIfRunningFromBackend(job) always returns > false : > {code} > public static boolean checkJobContextIfRunningFromBackend(JobContext j) { > if (j.getConfiguration().get("mapred.task.id", "").equals("") && > !("true".equals(j.getConfiguration().get("pig.illustrating" { > return false; > } > return true; > } > {code} > This is because in fetch mode we don't have a mapred.task.id. A null > outputschema will raise an exception when HCatBaseLoader#getNext() is called: > (ERROR 6018: Error converting read value to tuple). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8484) HCatalog throws an exception if Pig job is of type 'fetch'
[ https://issues.apache.org/jira/browse/HIVE-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174004#comment-14174004 ] Hive QA commented on HIVE-8484: --- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12675260/HIVE-8484.patch {color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 6559 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_custom_key org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_custom_key2 org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_custom_key3 org.apache.hive.beeline.TestSchemaTool.testSchemaInit org.apache.hive.beeline.TestSchemaTool.testSchemaUpgrade {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1300/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1300/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1300/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 5 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12675260 - PreCommit-HIVE-TRUNK-Build > HCatalog throws an exception if Pig job is of type 'fetch' > -- > > Key: HIVE-8484 > URL: https://issues.apache.org/jira/browse/HIVE-8484 > Project: Hive > Issue Type: Bug > Components: HCatalog >Affects Versions: 0.14.0 >Reporter: Lorand Bendig > Fix For: 0.14.0 > > Attachments: HIVE-8484.patch > > > When Pig tries to retrieve result in fetch mode through HCatalog then > HCatLoader#setLocation(String location, Job job) can't set the outputschema > because HCatUtil#checkJobContextIfRunningFromBackend(job) always returns > false : > {code} > public static boolean checkJobContextIfRunningFromBackend(JobContext j) { > if (j.getConfiguration().get("mapred.task.id", "").equals("") && > !("true".equals(j.getConfiguration().get("pig.illustrating" { > return false; > } > return true; > } > {code} > This is because in fetch mode we don't have a mapred.task.id. A null > outputschema will raise an exception when HCatBaseLoader#getNext() is called: > (ERROR 6018: Error converting read value to tuple). -- This message was sent by Atlassian JIRA (v6.3.4#6332)