[jira] Updated: (HIVE-1696) Add delegation token support to metastore
[ https://issues.apache.org/jira/browse/HIVE-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HIVE-1696: -- Attachment: hive-1696-3.patch Attached patch has a testcase that tests the Hive MetaStore client to MetaStore server communication with SASL on delegation tokens. The test is run as part of the test target at the top level. Add delegation token support to metastore - Key: HIVE-1696 URL: https://issues.apache.org/jira/browse/HIVE-1696 Project: Hive Issue Type: Sub-task Components: Metastore, Security, Server Infrastructure Reporter: Todd Lipcon Fix For: 0.7.0 Attachments: hive-1696-1-with-gen-code.patch, hive-1696-1.patch, hive-1696-3.patch, hive_1696.patch, hive_1696.patch, hive_1696_no-thrift.patch As discussed in HIVE-842, kerberos authentication is only sufficient for authentication of a hive user client to the metastore. There are other cases where thrift calls need to be authenticated when the caller is running in an environment without kerberos credentials. For example, an MR task running as part of a hive job may want to report statistics to the metastore, or a job may be running within the context of Oozie or Hive Server. This JIRA is to implement support of delegation tokens for the metastore. The concept of a delegation token is borrowed from the Hadoop security design - the quick summary is that a kerberos-authenticated client may retrieve a binary token from the server. This token can then be passed to other clients which can use it to achieve authentication as the original user in lieu of a kerberos ticket. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1696) Add delegation token support to metastore
[ https://issues.apache.org/jira/browse/HIVE-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HIVE-1696: -- Attachment: hive-1696-3-with-gen-code.patch Patch with the generated code.. Add delegation token support to metastore - Key: HIVE-1696 URL: https://issues.apache.org/jira/browse/HIVE-1696 Project: Hive Issue Type: Sub-task Components: Metastore, Security, Server Infrastructure Reporter: Todd Lipcon Fix For: 0.7.0 Attachments: hive-1696-1-with-gen-code.patch, hive-1696-1.patch, hive-1696-3-with-gen-code.patch, hive-1696-3.patch, hive_1696.patch, hive_1696.patch, hive_1696_no-thrift.patch As discussed in HIVE-842, kerberos authentication is only sufficient for authentication of a hive user client to the metastore. There are other cases where thrift calls need to be authenticated when the caller is running in an environment without kerberos credentials. For example, an MR task running as part of a hive job may want to report statistics to the metastore, or a job may be running within the context of Oozie or Hive Server. This JIRA is to implement support of delegation tokens for the metastore. The concept of a delegation token is borrowed from the Hadoop security design - the quick summary is that a kerberos-authenticated client may retrieve a binary token from the server. This token can then be passed to other clients which can use it to achieve authentication as the original user in lieu of a kerberos ticket. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
HIVE SERVER in background
Hi All, How to run Hive Server in background ? Currently when i run hive --service hiveserver , it starts hive server on the terminal. Also, how to capture logs written on terminal of hive server ? Any pointers will be appreciated. Vaibhav Negi
Re: HIVE SERVER in background
issue this command in your cli: nohup bin/hive --service hwi /dev/null 2 /dev/null then you can run Hive Server in backgroud. If you want get logs, you can redirect the output of Hive to a logfile, just as the command above. 2010-12-30 wjh_hadoop 发件人： vaibhav negi 发送时间： 2010-12-30 21:18:25 收件人： hive-u...@hadoop.apache.org; hive-...@hadoop.apache.org 抄送： 主题： HIVE SERVER in background Hi All, How to run Hive Server in background ? Currently when i run hive --service hiveserver , it starts hive server on the terminal. Also, how to capture logs written on terminal of hive server ? Any pointers will be appreciated. Vaibhav Negi
[jira] Created: (HIVE-1872) Hive process is exiting on executing ALTER query
Hive process is exiting on executing ALTER query
Key: HIVE-1872
URL: https://issues.apache.org/jira/browse/HIVE-1872
Project: Hive
Issue Type: Bug
Components: CLI, Server Infrastructure
Affects Versions: 0.6.0
Environment: SUSE Linux Enterprise Server 10 SP2 (i586) - Kernel
2.6.16.60-0.21-smp (3)
Hadoop 0.20.1
Hive 0.6.0
Reporter: Bharath R
Fix For: 0.6.0
Hive process is exiting on executing the below queries in the same order as
mentioned
1) CREATE TABLE SAMPLETABLE(IP STRING , showtime BIGINT ) partitioned by (ds
string,ipz int) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\040'
2) ALTER TABLE SAMPLETABLE add Partition(ds='sf') location
'/user/hive/warehouse' Partition(ipz=100) location '/user/hive/warehouse'
After the second query execution , the hive throws the below exception and
exiting the process
10:09:03 ERROR exec.DDLTask: FAILED: Error in metadata: table is partitioned
but partition spec is not specified or tab: {ipz=100}
org.apache.hadoop.hive.ql.metadata.HiveException: table is partitioned but
partition spec is not specified or tab: {ipz=100}
at org.apache.hadoop.hive.ql.metadata.Table.isValidSpec(Table.java:341)
at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:902)
at org.apache.hadoop.hive.ql.exec.DDLTask.addPartition(DDLTask.java:282)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:191)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:633)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:506)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:384)
at
org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:114)
at
org.apache.hadoop.hive.service.ThriftHive$Processor$execute.process(ThriftHive.java:378)
at
org.apache.hadoop.hive.service.ThriftHive$Processor.process(ThriftHive.java:366)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:252)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
As the alter query is incorrect the exception was thrown, ideally it should
be ALTER TABLE SAMPLETABLE add Partition(ds='sf',ipz=100) location
'/user/hive/warehouse'.
It is not good to exit the HIVE process when the query is incorrect.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: HIVE SERVER in background
nohup hive --service hiveserver u can get logs written to terminal in nohup.out -- Best Regards, Pavan Sent from my Nokia N900 - Original message - Hi All, How to run Hive Server in background ? Currently when i run hive --service hiveserver , it starts hive server on the terminal. Also, how to capture logs written on terminal of hive server ? Any pointers will be appreciated. Vaibhav Negi
[jira] Updated: (HIVE-1873) Fix 'tar' build target broken in HIVE-1526
[ https://issues.apache.org/jira/browse/HIVE-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1873: - Status: Patch Available (was: Open) Fix 'tar' build target broken in HIVE-1526 -- Key: HIVE-1873 URL: https://issues.apache.org/jira/browse/HIVE-1873 Project: Hive Issue Type: Bug Components: Build Infrastructure Reporter: Carl Steinbach Assignee: Carl Steinbach Attachments: HIVE-1873.1.patch.txt My patch for HIVE-1526 broke the 'tar' build target. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1873) Fix 'tar' build target broken in HIVE-1526
[ https://issues.apache.org/jira/browse/HIVE-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1873: - Attachment: HIVE-1873.1.patch.txt Fix 'tar' build target broken in HIVE-1526 -- Key: HIVE-1873 URL: https://issues.apache.org/jira/browse/HIVE-1873 Project: Hive Issue Type: Bug Components: Build Infrastructure Reporter: Carl Steinbach Assignee: Carl Steinbach Attachments: HIVE-1873.1.patch.txt My patch for HIVE-1526 broke the 'tar' build target. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1871) bug introduced by HIVE-1806
[ https://issues.apache.org/jira/browse/HIVE-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1871: --- Status: Patch Available (was: Open) bug introduced by HIVE-1806 --- Key: HIVE-1871 URL: https://issues.apache.org/jira/browse/HIVE-1871 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Namit Jain Assignee: He Yongqiang Attachments: HIVE-1871.1.patch LoadMultiFilesDesc lmfd = new LoadMultiFilesDesc(toMove, targetDir, lfd.getIsDfsDir(), lfd.getColumns(), lfd.getColumnTypes()); The toMove includes full paths for each partition. But the targetDir is a root path that does not contain any partition part. So it is move, for example, from hdfs://dfs2.data.facebook.com:9000/tmp/hive-heyongqiang/hive_2010-12-29_13-31-58_051_54619753122187226/-ext-10002/ds=2010-12-28/hr=17/offset=16-435944367480 to hdfs://dfs2.data.facebook.com:9000/tmp/hive-heyongqiang/hive_2010-12-29_13-31-58_051_54619753122187226/-ext-1 And the final path after the move is hdfs://dfs2.data.facebook.com:9000/tmp/hive-heyongqiang/hive_2010-12-29_13-31-58_051_54619753122187226/-ext-1/ offset=16-435944367480 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1871) bug introduced by HIVE-1806
[ https://issues.apache.org/jira/browse/HIVE-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1871: --- Attachment: HIVE-1871.1.patch bug introduced by HIVE-1806 --- Key: HIVE-1871 URL: https://issues.apache.org/jira/browse/HIVE-1871 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Namit Jain Assignee: He Yongqiang Attachments: HIVE-1871.1.patch LoadMultiFilesDesc lmfd = new LoadMultiFilesDesc(toMove, targetDir, lfd.getIsDfsDir(), lfd.getColumns(), lfd.getColumnTypes()); The toMove includes full paths for each partition. But the targetDir is a root path that does not contain any partition part. So it is move, for example, from hdfs://dfs2.data.facebook.com:9000/tmp/hive-heyongqiang/hive_2010-12-29_13-31-58_051_54619753122187226/-ext-10002/ds=2010-12-28/hr=17/offset=16-435944367480 to hdfs://dfs2.data.facebook.com:9000/tmp/hive-heyongqiang/hive_2010-12-29_13-31-58_051_54619753122187226/-ext-1 And the final path after the move is hdfs://dfs2.data.facebook.com:9000/tmp/hive-heyongqiang/hive_2010-12-29_13-31-58_051_54619753122187226/-ext-1/ offset=16-435944367480 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
