[jira] [Commented] (HIVE-6374) Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly
[ https://issues.apache.org/jira/browse/HIVE-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995914#comment-13995914 ] Ashutosh Chauhan commented on HIVE-6374: +1 Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly --- Key: HIVE-6374 URL: https://issues.apache.org/jira/browse/HIVE-6374 Project: Hive Issue Type: Bug Components: CLI Affects Versions: 0.11.0, 0.12.0, 0.13.0 Environment: Any Reporter: Benjamin Zhitomirsky Assignee: Benjamin Zhitomirsky Attachments: Design of the fix HIVE-6374.docx, hive-6374.1.patch, hive-6374.3.patch, hive-6374.patch Original Estimate: 168h Remaining Estimate: 168h Create table/index/database and add partition DDL doesn't work properly if all following conditions are true: - Metastore service is used - fs.default.name is specified and it differs from the default one - Location is not specified or specified as a not fully qualified URI The root cause of this behavior is that Hive client doesn't pass configuration context to the metastore services which tries to resolve the paths. The fix is it too resolve the path in the Hive client if fs.default.name is specified and it differs from the default one (it is must easier then start passing the context, which would be a major change). The CR will submitted shortly after tests are done -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6374) Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly
[
https://issues.apache.org/jira/browse/HIVE-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989185#comment-13989185
]
Hive QA commented on HIVE-6374:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12642627/hive-6374.3.patch
{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 5496 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_partscan_1_23
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_insert1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_load_dyn_part1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_dml
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_union
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/122/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/122/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12642627
Hive job submitted with non-default name node (fs.default.name) doesn't
process locations properly
---
Key: HIVE-6374
URL: https://issues.apache.org/jira/browse/HIVE-6374
Project: Hive
Issue Type: Bug
Components: CLI
Affects Versions: 0.11.0, 0.12.0, 0.13.0
Environment: Any
Reporter: Benjamin Zhitomirsky
Assignee: Benjamin Zhitomirsky
Attachments: Design of the fix HIVE-6374.docx, hive-6374.1.patch,
hive-6374.3.patch, hive-6374.patch
Original Estimate: 168h
Remaining Estimate: 168h
Create table/index/database and add partition DDL doesn't work properly if
all following conditions are true:
- Metastore service is used
- fs.default.name is specified and it differs from the default one
- Location is not specified or specified as a not fully qualified URI
The root cause of this behavior is that Hive client doesn't pass
configuration context to the metastore services which tries to resolve the
paths. The fix is it too resolve the path in the Hive client if
fs.default.name is specified and it differs from the default one (it is must
easier then start passing the context, which would be a major change).
The CR will submitted shortly after tests are done
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-6374) Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly
[
https://issues.apache.org/jira/browse/HIVE-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13961005#comment-13961005
]
Hive QA commented on HIVE-6374:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12638250/hive-6374.1.patch
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 5549 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_parallel_orderby
{noformat}
Test results:
http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2120/testReport
Console output:
http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2120/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12638250
Hive job submitted with non-default name node (fs.default.name) doesn't
process locations properly
---
Key: HIVE-6374
URL: https://issues.apache.org/jira/browse/HIVE-6374
Project: Hive
Issue Type: Bug
Components: CLI
Affects Versions: 0.11.0, 0.12.0, 0.13.0
Environment: Any
Reporter: Benjamin Zhitomirsky
Assignee: Benjamin Zhitomirsky
Attachments: Design of the fix HIVE-6374.docx, hive-6374.1.patch,
hive-6374.patch
Original Estimate: 168h
Remaining Estimate: 168h
Create table/index/database and add partition DDL doesn't work properly if
all following conditions are true:
- Metastore service is used
- fs.default.name is specified and it differs from the default one
- Location is not specified or specified as a not fully qualified URI
The root cause of this behavior is that Hive client doesn't pass
configuration context to the metastore services which tries to resolve the
paths. The fix is it too resolve the path in the Hive client if
fs.default.name is specified and it differs from the default one (it is must
easier then start passing the context, which would be a major change).
The CR will submitted shortly after tests are done
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-6374) Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly
[ https://issues.apache.org/jira/browse/HIVE-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13957781#comment-13957781 ] Benjamin Zhitomirsky commented on HIVE-6374: CR is available here: https://reviews.apache.org/r/19923/ Thanks to Ashutosh for reminding! Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly --- Key: HIVE-6374 URL: https://issues.apache.org/jira/browse/HIVE-6374 Project: Hive Issue Type: Bug Components: CLI Affects Versions: 0.11.0, 0.12.0, 0.13.0 Environment: Any Reporter: Benjamin Zhitomirsky Assignee: Benjamin Zhitomirsky Attachments: Design of the fix HIVE-6374.docx, hive-6374.1.patch, hive-6374.patch Original Estimate: 168h Remaining Estimate: 168h Create table/index/database and add partition DDL doesn't work properly if all following conditions are true: - Metastore service is used - fs.default.name is specified and it differs from the default one - Location is not specified or specified as a not fully qualified URI The root cause of this behavior is that Hive client doesn't pass configuration context to the metastore services which tries to resolve the paths. The fix is it too resolve the path in the Hive client if fs.default.name is specified and it differs from the default one (it is must easier then start passing the context, which would be a major change). The CR will submitted shortly after tests are done -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6374) Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly
[ https://issues.apache.org/jira/browse/HIVE-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13955752#comment-13955752 ] Ashutosh Chauhan commented on HIVE-6374: [~benjzh] Can you create review board entry for this on : https://reviews.apache.org/r/new/ Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly --- Key: HIVE-6374 URL: https://issues.apache.org/jira/browse/HIVE-6374 Project: Hive Issue Type: Bug Components: CLI Affects Versions: 0.11.0, 0.12.0, 0.13.0 Environment: Any Reporter: Benjamin Zhitomirsky Assignee: Benjamin Zhitomirsky Attachments: Design of the fix HIVE-6374.docx, hive-6374.patch Original Estimate: 168h Remaining Estimate: 168h Create table/index/database and add partition DDL doesn't work properly if all following conditions are true: - Metastore service is used - fs.default.name is specified and it differs from the default one - Location is not specified or specified as a not fully qualified URI The root cause of this behavior is that Hive client doesn't pass configuration context to the metastore services which tries to resolve the paths. The fix is it too resolve the path in the Hive client if fs.default.name is specified and it differs from the default one (it is must easier then start passing the context, which would be a major change). The CR will submitted shortly after tests are done -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6374) Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly
[
https://issues.apache.org/jira/browse/HIVE-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13954697#comment-13954697
]
Hive QA commented on HIVE-6374:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12637707/hive-6374.patch
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 5504 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_parallel_orderby
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority2
org.apache.hive.service.cli.thrift.TestThriftHttpCLIService.testExecuteStatementAsync
{noformat}
Test results:
http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2045/testReport
Console output:
http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2045/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12637707
Hive job submitted with non-default name node (fs.default.name) doesn't
process locations properly
---
Key: HIVE-6374
URL: https://issues.apache.org/jira/browse/HIVE-6374
Project: Hive
Issue Type: Bug
Components: CLI
Affects Versions: 0.11.0, 0.12.0, 0.13.0
Environment: Any
Reporter: Benjamin Zhitomirsky
Attachments: Design of the fix HIVE-6374.docx, hive-6374.patch
Original Estimate: 168h
Remaining Estimate: 168h
Create table/index/database and add partition DDL doesn't work properly if
all following conditions are true:
- Metastore service is used
- fs.default.name is specified and it differs from the default one
- Location is not specified or specified as a not fully qualified URI
The root cause of this behavior is that Hive client doesn't pass
configuration context to the metastore services which tries to resolve the
paths. The fix is it too resolve the path in the Hive client if
fs.default.name is specified and it differs from the default one (it is must
easier then start passing the context, which would be a major change).
The CR will submitted shortly after tests are done
--
This message was sent by Atlassian JIRA
(v6.2#6252)
