[jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
[ https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13810671#comment-13810671 ] Thejas M Nair commented on HIVE-5547: - +1 webhcat pig job submission should ship hive tar if -usehcatalog is specified Key: HIVE-5547 URL: https://issues.apache.org/jira/browse/HIVE-5547 Project: Hive Issue Type: Bug Components: WebHCat Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Attachments: HIVE-5547.2.patch, HIVE-5547.3.patch, HIVE-5547.patch Currently when when a Pig job is submitted through WebHCat and the Pig script uses HCatalog, that means that Hive should be installed on the node in the cluster which ends up executing the job. For large clusters is this a manageability issue so we should use DistributedCache to ship the Hive tar file to the target node as part of job submission TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has the test case for this -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
[
https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13810743#comment-13810743
]
Hive QA commented on HIVE-5547:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12611223/HIVE-5547.3.patch
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 4545 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_2
{noformat}
Test results:
http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/85/testReport
Console output:
http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/85/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
webhcat pig job submission should ship hive tar if -usehcatalog is specified
Key: HIVE-5547
URL: https://issues.apache.org/jira/browse/HIVE-5547
Project: Hive
Issue Type: Bug
Components: WebHCat
Affects Versions: 0.12.0
Reporter: Eugene Koifman
Assignee: Eugene Koifman
Attachments: HIVE-5547.2.patch, HIVE-5547.3.patch, HIVE-5547.patch
Currently when when a Pig job is submitted through WebHCat and the Pig script
uses HCatalog, that means that Hive should be installed on the node in the
cluster which ends up executing the job. For large clusters is this a
manageability issue so we should use DistributedCache to ship the Hive tar
file to the target node as part of job submission
TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has
the test case for this
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
[ https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13809830#comment-13809830 ] Eugene Koifman commented on HIVE-5547: -- HIVE-5627 covers documentation for this and HIVE-5133 webhcat pig job submission should ship hive tar if -usehcatalog is specified Key: HIVE-5547 URL: https://issues.apache.org/jira/browse/HIVE-5547 Project: Hive Issue Type: Bug Components: WebHCat Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Attachments: HIVE-5547.2.patch, HIVE-5547.3.patch, HIVE-5547.patch Currently when when a Pig job is submitted through WebHCat and the Pig script uses HCatalog, that means that Hive should be installed on the node in the cluster which ends up executing the job. For large clusters is this a manageability issue so we should use DistributedCache to ship the Hive tar file to the target node as part of job submission TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has the test case for this -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
[ https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13808434#comment-13808434 ] Thejas M Nair commented on HIVE-5547: - Eugene, can you please include a reviewboard link ? webhcat pig job submission should ship hive tar if -usehcatalog is specified Key: HIVE-5547 URL: https://issues.apache.org/jira/browse/HIVE-5547 Project: Hive Issue Type: Bug Components: WebHCat Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Attachments: HIVE-5547.2.patch, HIVE-5547.patch Currently when when a Pig job is submitted through WebHCat and the Pig script uses HCatalog, that means that Hive should be installed on the node in the cluster which ends up executing the job. For large clusters is this a manageability issue so we should use DistributedCache to ship the Hive tar file to the target node as part of job submission TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has the test case for this -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
[ https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13808488#comment-13808488 ] Eugene Koifman commented on HIVE-5547: -- https://reviews.facebook.net/D13779 webhcat pig job submission should ship hive tar if -usehcatalog is specified Key: HIVE-5547 URL: https://issues.apache.org/jira/browse/HIVE-5547 Project: Hive Issue Type: Bug Components: WebHCat Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Attachments: HIVE-5547.2.patch, HIVE-5547.patch Currently when when a Pig job is submitted through WebHCat and the Pig script uses HCatalog, that means that Hive should be installed on the node in the cluster which ends up executing the job. For large clusters is this a manageability issue so we should use DistributedCache to ship the Hive tar file to the target node as part of job submission TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has the test case for this -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
[ https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13808523#comment-13808523 ] Thejas M Nair commented on HIVE-5547: - Added comments on reviewboard. webhcat pig job submission should ship hive tar if -usehcatalog is specified Key: HIVE-5547 URL: https://issues.apache.org/jira/browse/HIVE-5547 Project: Hive Issue Type: Bug Components: WebHCat Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Attachments: HIVE-5547.2.patch, HIVE-5547.patch Currently when when a Pig job is submitted through WebHCat and the Pig script uses HCatalog, that means that Hive should be installed on the node in the cluster which ends up executing the job. For large clusters is this a manageability issue so we should use DistributedCache to ship the Hive tar file to the target node as part of job submission TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has the test case for this -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
[
https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802763#comment-13802763
]
Hive QA commented on HIVE-5547:
---
{color:green}Overall{color}: +1 all checks pass
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12609763/HIVE-5547.2.patch
{color:green}SUCCESS:{color} +1 4430 tests passed
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1204/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1204/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
webhcat pig job submission should ship hive tar if -usehcatalog is specified
Key: HIVE-5547
URL: https://issues.apache.org/jira/browse/HIVE-5547
Project: Hive
Issue Type: Bug
Components: WebHCat
Affects Versions: 0.12.0
Reporter: Eugene Koifman
Assignee: Eugene Koifman
Attachments: HIVE-5547.2.patch, HIVE-5547.patch
Currently when when a Pig job is submitted through WebHCat and the Pig script
uses HCatalog, that means that Hive should be installed on the node in the
cluster which ends up executing the job. For large clusters is this a
manageability issue so we should use DistributedCache to ship the Hive tar
file to the target node as part of job submission
TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has
the test case for this
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
[ https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803248#comment-13803248 ] Eugene Koifman commented on HIVE-5547: -- HIVE-5627 covers the doc for this bug webhcat pig job submission should ship hive tar if -usehcatalog is specified Key: HIVE-5547 URL: https://issues.apache.org/jira/browse/HIVE-5547 Project: Hive Issue Type: Bug Components: WebHCat Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Attachments: HIVE-5547.2.patch, HIVE-5547.patch Currently when when a Pig job is submitted through WebHCat and the Pig script uses HCatalog, that means that Hive should be installed on the node in the cluster which ends up executing the job. For large clusters is this a manageability issue so we should use DistributedCache to ship the Hive tar file to the target node as part of job submission TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has the test case for this -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
[ https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803454#comment-13803454 ] Eugene Koifman commented on HIVE-5547: -- This works with Pig 12. Pig 11 is looking for jdo2 library which is not part of Hive tar file (Hive 13) webhcat pig job submission should ship hive tar if -usehcatalog is specified Key: HIVE-5547 URL: https://issues.apache.org/jira/browse/HIVE-5547 Project: Hive Issue Type: Bug Components: WebHCat Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Attachments: HIVE-5547.2.patch, HIVE-5547.patch Currently when when a Pig job is submitted through WebHCat and the Pig script uses HCatalog, that means that Hive should be installed on the node in the cluster which ends up executing the job. For large clusters is this a manageability issue so we should use DistributedCache to ship the Hive tar file to the target node as part of job submission TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has the test case for this -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
[ https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802463#comment-13802463 ] Eugene Koifman commented on HIVE-5547: -- patch in HIVE-5511 must be applied before this webhcat pig job submission should ship hive tar if -usehcatalog is specified Key: HIVE-5547 URL: https://issues.apache.org/jira/browse/HIVE-5547 Project: Hive Issue Type: Bug Components: WebHCat Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Currently when when a Pig job is submitted through WebHCat and the Pig script uses HCatalog, that means that Hive should be installed on the node in the cluster which ends up executing the job. For large clusters is this a manageability issue so we should use DistributedCache to ship the Hive tar file to the target node as part of job submission TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has the test case for this -- This message was sent by Atlassian JIRA (v6.1#6144)
