[jira] [Created] (HIVE-7699) HIVE fails to LOAD DATA INTO TABLE from external storage
Xiaobing Zhou created HIVE-7699: --- Summary: HIVE fails to LOAD DATA INTO TABLE from external storage Key: HIVE-7699 URL: https://issues.apache.org/jira/browse/HIVE-7699 Project: Hive Issue Type: Bug Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Hive is supposed to support loading data to table from external storage like Azure storage. Here's an exampLe: property namefs.azure.account.key.XXX.blob.core.windows.net/name valueCREDENTIAL-KEY/value /property is configured into hadoop core-site.xml. bin/hadoop fs works, however if run the query like: LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt' OVERWRITE INTO TABLE hivetable; HIVE CLI will complain as FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''wasb://t...@account-name.blob.core.windows.net/data.t xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to: hdfs://HDFS-HOST:8020/hivetable is not vali d. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. The stacktrace is at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363) at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460) at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7699) HIVE fails to LOAD DATA INTO TABLE from external storage
[ https://issues.apache.org/jira/browse/HIVE-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7699: Description: Hive is supposed to support loading data to table from external storage like Azure blob storage. Here's an exampLe: property namefs.azure.account.key.XXX.blob.core.windows.net/name valueCREDENTIAL-KEY/value /property is configured into hadoop core-site.xml. bin/hadoop fs works, however if run the query like: LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt' OVERWRITE INTO TABLE hivetable; HIVE CLI will complain as FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''wasb://t...@account-name.blob.core.windows.net/data.t xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to: hdfs://HDFS-HOST:8020/hivetable is not vali d. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. The stacktrace is at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363) at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460) at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) was: Hive is supposed to support loading data to table from external storage like Azure storage. Here's an exampLe: property namefs.azure.account.key.XXX.blob.core.windows.net/name valueCREDENTIAL-KEY/value /property is configured into hadoop core-site.xml. bin/hadoop fs works, however if run the query like: LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt' OVERWRITE INTO TABLE hivetable; HIVE CLI will complain as FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''wasb://t...@account-name.blob.core.windows.net/data.t xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to: hdfs://HDFS-HOST:8020/hivetable is not vali d. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. The stacktrace is at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363) at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460) at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489) at
[jira] [Commented] (HIVE-7699) HIVE fails to LOAD DATA INTO TABLE from external storage
[ https://issues.apache.org/jira/browse/HIVE-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094791#comment-14094791 ] Xiaobing Zhou commented on HIVE-7699: - I tracked and debugged into .LoadSemanticAnalyzer.applyConstraints where execption's thrown. Here's the comment, // only in 'local' mode do we copy stuff from one place to another. // reject different scheme/authority in other cases. I am wondering this is part of design or sth else? Anyone could comment on this? Thanks! HIVE fails to LOAD DATA INTO TABLE from external storage - Key: HIVE-7699 URL: https://issues.apache.org/jira/browse/HIVE-7699 Project: Hive Issue Type: Bug Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Hive is supposed to support loading data to table from external storage like Azure blob storage. Here's an exampLe: property namefs.azure.account.key.XXX.blob.core.windows.net/name valueCREDENTIAL-KEY/value /property is configured into hadoop core-site.xml. bin/hadoop fs works, however if run the query like: LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt' OVERWRITE INTO TABLE hivetable; HIVE CLI will complain as FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''wasb://t...@account-name.blob.core.windows.net/data.t xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to: hdfs://HDFS-HOST:8020/hivetable is not vali d. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. The stacktrace is at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363) at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460) at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HIVE-7875) Hive cannot load data into partitioned table with Unicode key
Xiaobing Zhou created HIVE-7875: --- Summary: Hive cannot load data into partitioned table with Unicode key Key: HIVE-7875 URL: https://issues.apache.org/jira/browse/HIVE-7875 Project: Hive Issue Type: Bug Environment: Windows Server 2008 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Steps to reproduce: 1) Copy the file partitioned.txt to the root folder HDFS. Copy the two hql files to your local directory. 2) Open Hive CLI. 3) Run: hive source path to CreatePartitionedTable.hql; 4) Run hive source path to LoadIntoPartitionedTable.hql; The following error will be shown: hive source C:\Scripts\partition\LoadIntoPartitionedTable.hql; Loading data to table default.mypartitioned partition (tag=䶵) Failed with exception null FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7875) Hive cannot load data into partitioned table with Unicode key
[ https://issues.apache.org/jira/browse/HIVE-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7875: Fix Version/s: 0.14.0 Hive cannot load data into partitioned table with Unicode key - Key: HIVE-7875 URL: https://issues.apache.org/jira/browse/HIVE-7875 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Environment: Windows Server 2008 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: CreatePartitionedTable.hql, LoadIntoPartitionedTable.hql, partitioned.txt Steps to reproduce: 1) Copy the file partitioned.txt to the root folder HDFS. Copy the two hql files to your local directory. 2) Open Hive CLI. 3) Run: hive source path to CreatePartitionedTable.hql; 4) Run hive source path to LoadIntoPartitionedTable.hql; The following error will be shown: hive source C:\Scripts\partition\LoadIntoPartitionedTable.hql; Loading data to table default.mypartitioned partition (tag=䶵) Failed with exception null FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7875) Hive cannot load data into partitioned table with Unicode key
[ https://issues.apache.org/jira/browse/HIVE-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7875: Affects Version/s: 0.13.0 Hive cannot load data into partitioned table with Unicode key - Key: HIVE-7875 URL: https://issues.apache.org/jira/browse/HIVE-7875 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Environment: Windows Server 2008 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: CreatePartitionedTable.hql, LoadIntoPartitionedTable.hql, partitioned.txt Steps to reproduce: 1) Copy the file partitioned.txt to the root folder HDFS. Copy the two hql files to your local directory. 2) Open Hive CLI. 3) Run: hive source path to CreatePartitionedTable.hql; 4) Run hive source path to LoadIntoPartitionedTable.hql; The following error will be shown: hive source C:\Scripts\partition\LoadIntoPartitionedTable.hql; Loading data to table default.mypartitioned partition (tag=䶵) Failed with exception null FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7875) Hive cannot load data into partitioned table with Unicode key
[ https://issues.apache.org/jira/browse/HIVE-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7875: Attachment: partitioned.txt LoadIntoPartitionedTable.hql CreatePartitionedTable.hql Hive cannot load data into partitioned table with Unicode key - Key: HIVE-7875 URL: https://issues.apache.org/jira/browse/HIVE-7875 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Environment: Windows Server 2008 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: CreatePartitionedTable.hql, LoadIntoPartitionedTable.hql, partitioned.txt Steps to reproduce: 1) Copy the file partitioned.txt to the root folder HDFS. Copy the two hql files to your local directory. 2) Open Hive CLI. 3) Run: hive source path to CreatePartitionedTable.hql; 4) Run hive source path to LoadIntoPartitionedTable.hql; The following error will be shown: hive source C:\Scripts\partition\LoadIntoPartitionedTable.hql; Loading data to table default.mypartitioned partition (tag=䶵) Failed with exception null FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-5764) Stopping Metastore and HiveServer2 from command line
[ https://issues.apache.org/jira/browse/HIVE-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-5764: Attachment: HIVE-5764.patch This patch is to support stop service by command line. So far only hiveserver2 and metastore are supported, but maintains back compatibility. bin/hive --service hiveserver2 --stop bin/hive --service metastore --stop Only one instance of hiveserver2 or metastore is allowed to be launched in individual node, but many instances allowed before applying this patch. Stopping Metastore and HiveServer2 from command line Key: HIVE-5764 URL: https://issues.apache.org/jira/browse/HIVE-5764 Project: Hive Issue Type: Bug Components: HiveServer2, Metastore Reporter: Vaibhav Gumashta Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: HIVE-5764.patch Currently a user needs to kill the process. Ideally there should be something like: hive --service metastore stop hive --service hiveserver2 stop -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-5764) Stopping Metastore and HiveServer2 from command line
[ https://issues.apache.org/jira/browse/HIVE-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-5764: Tags: HIVE-5764.patch Labels: patch (was: ) Release Note: bin/hive --service hiveserver2 --stop bin/hive --service metastore --stop Status: Patch Available (was: Open) This patch is to support stop service by command line. So far only hiveserver2 and metastore are supported, but maintains back compatibility. bin/hive --service hiveserver2 --stop bin/hive --service metastore --stop Only one instance of hiveserver2 or metastore is allowed to be launched in individual node, but many instances allowed before applying this patch. Stopping Metastore and HiveServer2 from command line Key: HIVE-5764 URL: https://issues.apache.org/jira/browse/HIVE-5764 Project: Hive Issue Type: Bug Components: HiveServer2, Metastore Reporter: Vaibhav Gumashta Assignee: Xiaobing Zhou Labels: patch Fix For: 0.14.0 Attachments: HIVE-5764.patch Currently a user needs to kill the process. Ideally there should be something like: hive --service metastore stop hive --service hiveserver2 stop -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HIVE-7167) Hive Metastore fails to start with SQLServerException
Xiaobing Zhou created HIVE-7167: --- Summary: Hive Metastore fails to start with SQLServerException Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Fix For: 0.13.0 metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.net.ConnectException: Connection refused: connect at java.net.TwoStacksPlainSocketImpl.socketConnect(Native Method) at
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7167: Description: When hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.net.ConnectException: Connection refused: connect at java.net.TwoStacksPlainSocketImpl.socketConnect(Native Method) at
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7167: Description: In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.net.ConnectException: Connection refused: connect at java.net.TwoStacksPlainSocketImpl.socketConnect(Native Method) at
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7167: Attachment: HIVE-7167.1.patch The patch is available now. I setup a review for submission, see the link: https://reviews.apache.org/r/22191/ Hive Metastore fails to start with SQLServerException - Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Labels: test Fix For: 0.13.0 Attachments: HIVE-7167.1.patch In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7167: Labels: patch (was: test) Status: Patch Available (was: Open) Hive Metastore fails to start with SQLServerException - Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Labels: patch Fix For: 0.13.0 Attachments: HIVE-7167.1.patch In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) at
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7167: Labels: patch, test (was: patch) Hive Metastore fails to start with SQLServerException - Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Labels: patch,, test Fix For: 0.13.0 Attachments: HIVE-7167.1.patch In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7167: Attachment: HIVE-7167.2.patch Hive Metastore fails to start with SQLServerException - Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Labels: patch,, test Attachments: HIVE-7167.1.patch, HIVE-7167.2.patch In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at
[jira] [Commented] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039334#comment-14039334 ] Xiaobing Zhou commented on HIVE-7167: - Thanks [~sershe], 1) Here's the exception. 2) it's because these three methods are potential places that causes contention when two metastores both try to initialize DB in the same time. 3) I don't think so. If one tried and failed in the first time, JDOException is caught for one more time try, if failed again, simply ignored, means another metastore succeeds. 2014-05-15 21:06:01,659 WARN server.HiveServer2 (HiveServer2.java:startHiveServer2(112)) - Error starting HiveServer2 on attempt 1, will retry in 60 seconds java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:347) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:292) at org.apache.hive.service.cli.session.SessionManager.applyAuthorizationConfigPolicy(SessionManager.java:88) at org.apache.hive.service.cli.session.SessionManager.init(SessionManager.java:63) at org.apache.hive.service.CompositeService.init(CompositeService.java:59) at org.apache.hive.service.cli.CLIService.init(CLIService.java:110) at org.apache.hive.service.CompositeService.init(CompositeService.java:59) at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:68) at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:100) at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:149) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(RetryingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2453) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2465) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:341) ... 9 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1411) ... 14 more Caused by: javax.jdo.JDODataStoreException: Exception thrown flushing changes to datastore NestedThrowables: java.sql.BatchUpdateException: Violation of UNIQUE KEY constraint 'GLOBALPRIVILEGEINDEX'. Cannot insert duplicate key in object 'dbo.GLOBAL_PRIVS'. The duplicate key value is (admin, ROLE, All, admin, ROLE). at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:451) at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:165) at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:406) at org.apache.hadoop.hive.metastore.ObjectStore.grantPrivileges(ObjectStore.java:3877) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:108) at $Proxy10.grantPrivileges(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultRoles(HiveMetaStore.java:567) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:398) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:356) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.init(RetryingHMSHandler.java:54) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:59) at org.apache.hadoop.hive.metastore.HiveMetaStore.newHMSHandler(HiveMetaStore.java:4944) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaStoreClient.java:171) ... 19 more Caused by: java.sql.BatchUpdateException: Violation of
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7167: Resolution: Fixed Fix Version/s: 0.14.0 Release Note: Marked it as resolved due to HIVE-7167.2.patch Status: Resolved (was: Patch Available) Hive Metastore fails to start with SQLServerException - Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Labels: patch,, test Fix For: 0.14.0 Attachments: HIVE-7167.1.patch, HIVE-7167.2.patch In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7167: Fix Version/s: (was: 0.14.0) Hive Metastore fails to start with SQLServerException - Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Labels: patch,, test Attachments: HIVE-7167.1.patch, HIVE-7167.2.patch In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7167: Affects Version/s: (was: 0.13.0) 0.14.0 Hive Metastore fails to start with SQLServerException - Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Labels: patch,, test Attachments: HIVE-7167.1.patch, HIVE-7167.2.patch In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) at
[jira] [Reopened] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reopened HIVE-7167: - closed by mistake, reopen it. Hive Metastore fails to start with SQLServerException - Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Labels: patch,, test Attachments: HIVE-7167.1.patch, HIVE-7167.2.patch In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at
[jira] [Updated] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7167: Release Note: (was: Marked it as resolved due to HIVE-7167.2.patch) Status: Patch Available (was: Reopened) HIVE-7167.2.patch is available. Hive Metastore fails to start with SQLServerException - Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Labels: patch,, test Attachments: HIVE-7167.1.patch, HIVE-7167.2.patch In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at
[jira] [Created] (HIVE-7276) BaseSemanticAnalyzer.unescapeSQLString fails to parse Windows like path
Xiaobing Zhou created HIVE-7276: --- Summary: BaseSemanticAnalyzer.unescapeSQLString fails to parse Windows like path Key: HIVE-7276 URL: https://issues.apache.org/jira/browse/HIVE-7276 Project: Hive Issue Type: Bug Components: Query Processor, Windows Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Critical BaseSemanticAnalyzer.unescapeSQLString fails to parse windows-like path, e.g. C:\Users\xzhou\hworks. This will cause a large quantity of queries on windows to fail. For example, 'C:\Users\xzhou\hworks\workspace\hwx-hive-ws\hive\hcatalog\core\target\tmp\hive-junit-960740885870900' will be parsed as 'C:Usersxzhouhworksworkspacehwx-hive-wshivehcatalogcore arget mphive-junit-960740885870900', since \ is interpreted as start char in unicode string, e.g. \002 for delimiter, and thus swallowed. \0, \b, \n, \r, \t, \Z, and so on within normal Windows like path will also be swallowed. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HIVE-7295) FileStatus.getOwner on Windows returns name of group the user belongs to, instead of user name expected, fails many authorization related unit tests
Xiaobing Zhou created HIVE-7295: --- Summary: FileStatus.getOwner on Windows returns name of group the user belongs to, instead of user name expected, fails many authorization related unit tests Key: HIVE-7295 URL: https://issues.apache.org/jira/browse/HIVE-7295 Project: Hive Issue Type: Bug Components: Authorization, HCatalog, Security, Windows Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Priority: Critical Unit test in TestHdfsAuthorizationProvider, e.g. org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps. fails to run. Running org.apache.hcatalog.security.TestHdfsAuthorizationProvider Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.799 sec FAILURE! - in org.apache.hcatalog.security.TestHdfsAuthorizationProvider testTableOps(org.apache.hcatalog.security.TestHdfsAuthorizationProvider) Time elapsed: 15.546 sec FAILURE! junit.framework.AssertionFailedError: FAILED: AuthorizationException org.apache.hadoop.security.AccessControlException: action WRITE not permitted on path pfile:/Users/xz hou/hworks/workspace/hwx-hive-ws/hive/hcatalog/core/target/warehouse for user xzhou expected:0 but was:4 at junit.framework.Assert.fail(Assert.java:50) at junit.framework.Assert.failNotEquals(Assert.java:287) at junit.framework.Assert.assertEquals(Assert.java:67) at junit.framework.Assert.assertEquals(Assert.java:199) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.exec(TestHdfsAuthorizationProvider.java:172) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps(TestHdfsAuthorizationProvider.java:307) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7295) FileStatus.getOwner on Windows returns name of group the user belongs to, instead of user name expected, fails many authorization related unit tests
[ https://issues.apache.org/jira/browse/HIVE-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14044328#comment-14044328 ] Xiaobing Zhou commented on HIVE-7295: - After digging, AuthorizationException is thrown inside HdfsAuthorizationProvider.checkPermissions(final FileSystem fs...) because permissions to operate on DB path are not met. FileStatus.getOwner gives out name of group, not user name expected for permission check going through. e.g. Administrators, not xzhou. FileStatus.getGroup also returns group like machine-name\None, which does not match group the user running program belongs to, operation on the path not permitted. FileStatus.getOwner on Windows returns name of group the user belongs to, instead of user name expected, fails many authorization related unit tests Key: HIVE-7295 URL: https://issues.apache.org/jira/browse/HIVE-7295 Project: Hive Issue Type: Bug Components: Authorization, HCatalog, Security, Windows Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Priority: Critical Unit test in TestHdfsAuthorizationProvider, e.g. org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps. fails to run. Running org.apache.hcatalog.security.TestHdfsAuthorizationProvider Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.799 sec FAILURE! - in org.apache.hcatalog.security.TestHdfsAuthorizationProvider testTableOps(org.apache.hcatalog.security.TestHdfsAuthorizationProvider) Time elapsed: 15.546 sec FAILURE! junit.framework.AssertionFailedError: FAILED: AuthorizationException org.apache.hadoop.security.AccessControlException: action WRITE not permitted on path pfile:/Users/xz hou/hworks/workspace/hwx-hive-ws/hive/hcatalog/core/target/warehouse for user xzhou expected:0 but was:4 at junit.framework.Assert.fail(Assert.java:50) at junit.framework.Assert.failNotEquals(Assert.java:287) at junit.framework.Assert.assertEquals(Assert.java:67) at junit.framework.Assert.assertEquals(Assert.java:199) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.exec(TestHdfsAuthorizationProvider.java:172) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps(TestHdfsAuthorizationProvider.java:307) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7295) FileStatus.getOwner on Windows returns name of group the user belongs to, instead of user name expected, fails many authorization related unit tests
[ https://issues.apache.org/jira/browse/HIVE-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14044330#comment-14044330 ] Xiaobing Zhou commented on HIVE-7295: - This is a bug from HDFS, I guess. It was reported that permissions check would go through if a dedicated user detached from administrators group is used to login windows and run the unit tests. I will try that and get back. FileStatus.getOwner on Windows returns name of group the user belongs to, instead of user name expected, fails many authorization related unit tests Key: HIVE-7295 URL: https://issues.apache.org/jira/browse/HIVE-7295 Project: Hive Issue Type: Bug Components: Authorization, HCatalog, Security, Windows Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Priority: Critical Unit test in TestHdfsAuthorizationProvider, e.g. org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps. fails to run. Running org.apache.hcatalog.security.TestHdfsAuthorizationProvider Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.799 sec FAILURE! - in org.apache.hcatalog.security.TestHdfsAuthorizationProvider testTableOps(org.apache.hcatalog.security.TestHdfsAuthorizationProvider) Time elapsed: 15.546 sec FAILURE! junit.framework.AssertionFailedError: FAILED: AuthorizationException org.apache.hadoop.security.AccessControlException: action WRITE not permitted on path pfile:/Users/xz hou/hworks/workspace/hwx-hive-ws/hive/hcatalog/core/target/warehouse for user xzhou expected:0 but was:4 at junit.framework.Assert.fail(Assert.java:50) at junit.framework.Assert.failNotEquals(Assert.java:287) at junit.framework.Assert.assertEquals(Assert.java:67) at junit.framework.Assert.assertEquals(Assert.java:199) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.exec(TestHdfsAuthorizationProvider.java:172) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps(TestHdfsAuthorizationProvider.java:307) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HIVE-7297) org.apache.hadoop.hive.ql.WindowsPathUtil is not easy to be reused across different hive projects
Xiaobing Zhou created HIVE-7297: --- Summary: org.apache.hadoop.hive.ql.WindowsPathUtil is not easy to be reused across different hive projects Key: HIVE-7297 URL: https://issues.apache.org/jira/browse/HIVE-7297 Project: Hive Issue Type: Improvement Components: Testing Infrastructure, Tests Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Minor WindowsPathUtil converts Windows path notation(c:\Uses\xzhou) to HDFS compatible Unix notation(/Users/xzhou). It was used in several places, will be reused by other fixes like patches for HIVE-7276 and HIVE-7295. There's need to change those influenced projects pom.xml to include dependency. Or could pushed WindowsPathUtil down to hive-exec library code. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7295) FileStatus.getOwner on Windows returns name of group the user belongs to, instead of user name expected, fails many authorization related unit tests
[
https://issues.apache.org/jira/browse/HIVE-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14044947#comment-14044947
]
Xiaobing Zhou commented on HIVE-7295:
-
Thanks [~cnauroth].
Since this is Windows specific, we can use this code snippet for work-around.
if (user.equals(stat.getOwner())) {
if (dirPerms.getUserAction().implies(action)) {
continue;
}
}
if (ArrayUtils.contains(groups, stat.getGroup())) {
if (dirPerms.getGroupAction().implies(action)) {
continue;
}
}
if (dirPerms.getOtherAction().implies(action)) {
continue;
}
//windows specific add-on
if (Shell.WINDOWS) {
if (ArrayUtils.contains(groups, stat.getOwner())) { //stat.getOwner
returns administrators
if (dirPerms.getUserAction().implies(action)) {
continue;
}
}
}
This passes all failed test cases affected, even if login user is a member of
admin group.
FileStatus.getOwner on Windows returns name of group the user belongs to,
instead of user name expected, fails many authorization related unit tests
Key: HIVE-7295
URL: https://issues.apache.org/jira/browse/HIVE-7295
Project: Hive
Issue Type: Bug
Components: Authorization, HCatalog, Security, Windows
Affects Versions: 0.13.0
Environment: Windows Server 2008 R2
Reporter: Xiaobing Zhou
Priority: Critical
Unit test in TestHdfsAuthorizationProvider, e.g.
org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps.
fails to run.
Running org.apache.hcatalog.security.TestHdfsAuthorizationProvider
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.799 sec
FAILURE! - in org.apache.hcatalog.security.TestHdfsAuthorizationProvider
testTableOps(org.apache.hcatalog.security.TestHdfsAuthorizationProvider)
Time elapsed: 15.546 sec FAILURE!
junit.framework.AssertionFailedError: FAILED: AuthorizationException
org.apache.hadoop.security.AccessControlException: action WRITE not permitted
on path pfile:/Users/xz
hou/hworks/workspace/hwx-hive-ws/hive/hcatalog/core/target/warehouse for user
xzhou expected:0 but was:4
at junit.framework.Assert.fail(Assert.java:50)
at junit.framework.Assert.failNotEquals(Assert.java:287)
at junit.framework.Assert.assertEquals(Assert.java:67)
at junit.framework.Assert.assertEquals(Assert.java:199)
at
org.apache.hcatalog.security.TestHdfsAuthorizationProvider.exec(TestHdfsAuthorizationProvider.java:172)
at
org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps(TestHdfsAuthorizationProvider.java:307)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7295) FileStatus.getOwner on Windows returns name of group the user belongs to, instead of user name expected, fails many authorization related unit tests
[ https://issues.apache.org/jira/browse/HIVE-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046119#comment-14046119 ] Xiaobing Zhou commented on HIVE-7295: - Thanks [~cnauroth] for pointing-out. Not setting ownership of new files to Administrators is preferable, this is loose constraint as compared. FileStatus.getOwner on Windows returns name of group the user belongs to, instead of user name expected, fails many authorization related unit tests Key: HIVE-7295 URL: https://issues.apache.org/jira/browse/HIVE-7295 Project: Hive Issue Type: Bug Components: Authorization, HCatalog, Security, Windows Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Priority: Critical Unit test in TestHdfsAuthorizationProvider, e.g. org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps. fails to run. Running org.apache.hcatalog.security.TestHdfsAuthorizationProvider Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.799 sec FAILURE! - in org.apache.hcatalog.security.TestHdfsAuthorizationProvider testTableOps(org.apache.hcatalog.security.TestHdfsAuthorizationProvider) Time elapsed: 15.546 sec FAILURE! junit.framework.AssertionFailedError: FAILED: AuthorizationException org.apache.hadoop.security.AccessControlException: action WRITE not permitted on path pfile:/Users/xz hou/hworks/workspace/hwx-hive-ws/hive/hcatalog/core/target/warehouse for user xzhou expected:0 but was:4 at junit.framework.Assert.fail(Assert.java:50) at junit.framework.Assert.failNotEquals(Assert.java:287) at junit.framework.Assert.assertEquals(Assert.java:67) at junit.framework.Assert.assertEquals(Assert.java:199) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.exec(TestHdfsAuthorizationProvider.java:172) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps(TestHdfsAuthorizationProvider.java:307) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7167) Hive Metastore fails to start with SQLServerException
[ https://issues.apache.org/jira/browse/HIVE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068719#comment-14068719 ] Xiaobing Zhou commented on HIVE-7167: - Thanks [~sershe], I will do that to make next patch. Hive Metastore fails to start with SQLServerException - Key: HIVE-7167 URL: https://issues.apache.org/jira/browse/HIVE-7167 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Labels: patch,, test Attachments: HIVE-7167.1.patch, HIVE-7167.2.patch In the case that hiveserver2 uses embedded metastore and hiveserver uses remote metastore, this exception comes up when hiveserver2 and hiveserver are started simultaneously. metastore service status is running but when I launch hive cli, I get following metastore connection error: C:\apps\dist\hive-0.13.0.2.1.2.0-1660\binhive.cmd 14/05/09 17:40:03 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no l onger has any effect. Use hive.hmshandler.retry.* instead Logging initialized using configuration in file:/C:/apps/dist/hive-0.13.0.2.1.2. 0-1660/conf/hive-log4j.properties Exception in thread main java.lang.RuntimeException: java.lang.RuntimeExceptio n: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:347) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.h ive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1413) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) ... 7 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) ... 12 more Caused by: MetaException(message:Could not connect to meta store using any of th e URIs provided. Most recent failure: org.apache.thrift.transport.TTransportExce ption: java.net.ConnectException: Connection refused: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaSto reClient.java:336) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaS toreClient.java:214) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStore Utils.java:1411) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(Retry ingMetaStoreClient.java:62) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(Ret ryingMetaStoreClient.java:72) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.ja va:2444) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2456) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.jav a:341) at
[jira] [Updated] (HIVE-7295) automatically set ownership of new files/dirs to administrators instead of individual user
[ https://issues.apache.org/jira/browse/HIVE-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7295: Summary: automatically set ownership of new files/dirs to administrators instead of individual user (was: FileStatus.getOwner on Windows returns name of group the user belongs to, instead of user name expected, fails many authorization related unit tests) automatically set ownership of new files/dirs to administrators instead of individual user -- Key: HIVE-7295 URL: https://issues.apache.org/jira/browse/HIVE-7295 Project: Hive Issue Type: Bug Components: Authorization, HCatalog, Security, Windows Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Priority: Critical Unit test in TestHdfsAuthorizationProvider, e.g. org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps. fails to run. Running org.apache.hcatalog.security.TestHdfsAuthorizationProvider Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.799 sec FAILURE! - in org.apache.hcatalog.security.TestHdfsAuthorizationProvider testTableOps(org.apache.hcatalog.security.TestHdfsAuthorizationProvider) Time elapsed: 15.546 sec FAILURE! junit.framework.AssertionFailedError: FAILED: AuthorizationException org.apache.hadoop.security.AccessControlException: action WRITE not permitted on path pfile:/Users/xz hou/hworks/workspace/hwx-hive-ws/hive/hcatalog/core/target/warehouse for user xzhou expected:0 but was:4 at junit.framework.Assert.fail(Assert.java:50) at junit.framework.Assert.failNotEquals(Assert.java:287) at junit.framework.Assert.assertEquals(Assert.java:67) at junit.framework.Assert.assertEquals(Assert.java:199) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.exec(TestHdfsAuthorizationProvider.java:172) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps(TestHdfsAuthorizationProvider.java:307) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7295) automatically set ownership of new files/dirs to Administrators group instead of individual user
[ https://issues.apache.org/jira/browse/HIVE-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7295: Summary: automatically set ownership of new files/dirs to Administrators group instead of individual user (was: automatically set ownership of new files/dirs to administrators instead of individual user) automatically set ownership of new files/dirs to Administrators group instead of individual user Key: HIVE-7295 URL: https://issues.apache.org/jira/browse/HIVE-7295 Project: Hive Issue Type: Bug Components: Authorization, HCatalog, Security, Windows Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Priority: Critical Unit test in TestHdfsAuthorizationProvider, e.g. org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps. fails to run. Running org.apache.hcatalog.security.TestHdfsAuthorizationProvider Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.799 sec FAILURE! - in org.apache.hcatalog.security.TestHdfsAuthorizationProvider testTableOps(org.apache.hcatalog.security.TestHdfsAuthorizationProvider) Time elapsed: 15.546 sec FAILURE! junit.framework.AssertionFailedError: FAILED: AuthorizationException org.apache.hadoop.security.AccessControlException: action WRITE not permitted on path pfile:/Users/xz hou/hworks/workspace/hwx-hive-ws/hive/hcatalog/core/target/warehouse for user xzhou expected:0 but was:4 at junit.framework.Assert.fail(Assert.java:50) at junit.framework.Assert.failNotEquals(Assert.java:287) at junit.framework.Assert.assertEquals(Assert.java:67) at junit.framework.Assert.assertEquals(Assert.java:199) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.exec(TestHdfsAuthorizationProvider.java:172) at org.apache.hcatalog.security.TestHdfsAuthorizationProvider.testTableOps(TestHdfsAuthorizationProvider.java:307) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HIVE-7511) Hive: output is incorrect if there are UTF-8 characters in where clause of a hive select query.
Xiaobing Zhou created HIVE-7511: --- Summary: Hive: output is incorrect if there are UTF-8 characters in where clause of a hive select query. Key: HIVE-7511 URL: https://issues.apache.org/jira/browse/HIVE-7511 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Critical Fix For: 0.14.0 When we put UTF-8 characters in where clause of a hive query the results are empty for where content like '%丄%' and results contain all rows for where content not like '%丄%'; even when few rows contain this character. Steps to reproduce: 1. Save a file called data.txt in the root container. The contents of the files are as follows. 190 丄f齄啊c狛䶴h䶴c狝 899 d狜狜㐁geg阿狚ea䶴eead狜e 137 齄鼾h狝ge㐀狛g狚阿 21 﨩﨩e㐀c狛鼾d䶴﨨 767 﨩c﨩g狜㐁狜狛齄阿﨩狚齄﨨䶵狝﨨 281 﨨㐀啊aga啊c狝e鼾鼾 573 㐁䶴hc﨨b狝㐁﨩䶴狜丄hc齄 966 䶴丄狜﨨e狝eb狜㐁c㐀鼾﨩丄ga狚丄 565 䶵㐀﨩㐀bb狛ehd丄ea丄㐀 778 﨩㐁阿﨨狚bbea丄䶵丄狚鼾狚a䶵 363 gd齄a鼾a䶴b㐁㐁fg鼾 822 a阿狜䶵h䶵e狛h﨩gac狜阿㐀啊b 338 b齄㐁ff阿e狜e㐀ba齄 2. Execute the following queries to setup the table. a. CREATE TABLE hivetable(row INT, content STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY ' t' LOCATION '/hivetable'; b. LOAD DATA INPATH 'wasb:///data.txt' OVERWRITE INTO TABLE hivetable; 3. create a query file query.hql with following contents INSERT OVERWRITE DIRECTORY 'wasb:///hiveoutput' select * from hivetable where content like '%丄%'; 4. even though few rows contains this character the output is empty. 5. change the contents of query.hql to INSERT OVERWRITE DIRECTORY 'wasb:///hiveoutput' select * from hivetable where content not like '%丄%'; 6. The output contains all rows including those containing the given character. 7. Similar results are observed when using where content = '丄f齄啊c狛䶴h䶴c狝'; 8. We get expected results when using where content like '%a%'; -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7511) Hive: output is incorrect if there are UTF-8 characters in where clause of a hive select query.
[ https://issues.apache.org/jira/browse/HIVE-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7511: Attachment: HIVE-7511.1.patch Hive: output is incorrect if there are UTF-8 characters in where clause of a hive select query. --- Key: HIVE-7511 URL: https://issues.apache.org/jira/browse/HIVE-7511 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Critical Fix For: 0.14.0 Attachments: HIVE-7511.1.patch When we put UTF-8 characters in where clause of a hive query the results are empty for where content like '%丄%' and results contain all rows for where content not like '%丄%'; even when few rows contain this character. Steps to reproduce: 1. Save a file called data.txt in the root container. The contents of the files are as follows. 190 丄f齄啊c狛䶴h䶴c狝 899 d狜狜㐁geg阿狚ea䶴eead狜e 137 齄鼾h狝ge㐀狛g狚阿 21﨩﨩e㐀c狛鼾d䶴﨨 767 﨩c﨩g狜㐁狜狛齄阿﨩狚齄﨨䶵狝﨨 281 﨨㐀啊aga啊c狝e鼾鼾 573 㐁䶴hc﨨b狝㐁﨩䶴狜丄hc齄 966 䶴丄狜﨨e狝eb狜㐁c㐀鼾﨩丄ga狚丄 565 䶵㐀﨩㐀bb狛ehd丄ea丄㐀 778 﨩㐁阿﨨狚bbea丄䶵丄狚鼾狚a䶵 363 gd齄a鼾a䶴b㐁㐁fg鼾 822 a阿狜䶵h䶵e狛h﨩gac狜阿㐀啊b 338 b齄㐁ff阿e狜e㐀ba齄 2. Execute the following queries to setup the table. a. CREATE TABLE hivetable(row INT, content STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY ' t' LOCATION '/hivetable'; b. LOAD DATA INPATH 'wasb:///data.txt' OVERWRITE INTO TABLE hivetable; 3. create a query file query.hql with following contents INSERT OVERWRITE DIRECTORY 'wasb:///hiveoutput' select * from hivetable where content like '%丄%'; 4. even though few rows contains this character the output is empty. 5. change the contents of query.hql to INSERT OVERWRITE DIRECTORY 'wasb:///hiveoutput' select * from hivetable where content not like '%丄%'; 6. The output contains all rows including those containing the given character. 7. Similar results are observed when using where content = '丄f齄啊c狛䶴h䶴c狝'; 8. We get expected results when using where content like '%a%'; -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HIVE-7511) Hive: output is incorrect if there are UTF-8 characters in where clause of a hive select query.
[ https://issues.apache.org/jira/browse/HIVE-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou resolved HIVE-7511. - Resolution: Fixed Mark it as resolved, patch's available. Can anyone help to review this jira? Thanks! Hive: output is incorrect if there are UTF-8 characters in where clause of a hive select query. --- Key: HIVE-7511 URL: https://issues.apache.org/jira/browse/HIVE-7511 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Critical Fix For: 0.14.0 Attachments: HIVE-7511.1.patch When we put UTF-8 characters in where clause of a hive query the results are empty for where content like '%丄%' and results contain all rows for where content not like '%丄%'; even when few rows contain this character. Steps to reproduce: 1. Save a file called data.txt in the root container. The contents of the files are as follows. 190 丄f齄啊c狛䶴h䶴c狝 899 d狜狜㐁geg阿狚ea䶴eead狜e 137 齄鼾h狝ge㐀狛g狚阿 21﨩﨩e㐀c狛鼾d䶴﨨 767 﨩c﨩g狜㐁狜狛齄阿﨩狚齄﨨䶵狝﨨 281 﨨㐀啊aga啊c狝e鼾鼾 573 㐁䶴hc﨨b狝㐁﨩䶴狜丄hc齄 966 䶴丄狜﨨e狝eb狜㐁c㐀鼾﨩丄ga狚丄 565 䶵㐀﨩㐀bb狛ehd丄ea丄㐀 778 﨩㐁阿﨨狚bbea丄䶵丄狚鼾狚a䶵 363 gd齄a鼾a䶴b㐁㐁fg鼾 822 a阿狜䶵h䶵e狛h﨩gac狜阿㐀啊b 338 b齄㐁ff阿e狜e㐀ba齄 2. Execute the following queries to setup the table. a. CREATE TABLE hivetable(row INT, content STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY ' t' LOCATION '/hivetable'; b. LOAD DATA INPATH 'wasb:///data.txt' OVERWRITE INTO TABLE hivetable; 3. create a query file query.hql with following contents INSERT OVERWRITE DIRECTORY 'wasb:///hiveoutput' select * from hivetable where content like '%丄%'; 4. even though few rows contains this character the output is empty. 5. change the contents of query.hql to INSERT OVERWRITE DIRECTORY 'wasb:///hiveoutput' select * from hivetable where content not like '%丄%'; 6. The output contains all rows including those containing the given character. 7. Similar results are observed when using where content = '丄f齄啊c狛䶴h䶴c狝'; 8. We get expected results when using where content like '%a%'; -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HIVE-7297) org.apache.hadoop.hive.ql.WindowsPathUtil is not easy to be reused across different hive projects
[ https://issues.apache.org/jira/browse/HIVE-7297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7297: Assignee: Hari Sankar Sivarama Subramaniyan (was: Xiaobing Zhou) org.apache.hadoop.hive.ql.WindowsPathUtil is not easy to be reused across different hive projects - Key: HIVE-7297 URL: https://issues.apache.org/jira/browse/HIVE-7297 Project: Hive Issue Type: Improvement Components: Testing Infrastructure, Tests Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Hari Sankar Sivarama Subramaniyan Priority: Minor WindowsPathUtil converts Windows path notation(c:\Uses\xzhou) to HDFS compatible Unix notation(/Users/xzhou). It was used in several places, will be reused by other fixes like patches for HIVE-7276 and HIVE-7295. There's need to change those influenced projects pom.xml to include dependency. Or could pushed WindowsPathUtil down to hive-exec library code. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-8115) Hive select query hang when fields contain map
Xiaobing Zhou created HIVE-8115: --- Summary: Hive select query hang when fields contain map Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Attachment: createTable.hql Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Description: Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. was:Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14134809#comment-14134809 ] Xiaobing Zhou commented on HIVE-8115: - Just verified, [STX]my-key[ETX] is fine for empty value with specific key, however, [STX][EXT]my-value doesn't really work. So the conclusion is empty key will hang the query. Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14134811#comment-14134811 ] Xiaobing Zhou commented on HIVE-8115: - LazyMap was commented as LazyMap does not deal with the case of a NULL map. That is handled by the parent LazyObject., so it'd better to output some warning message regarding empty key or pair in line 173 of LazyMap.parse(). Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Attachment: HIVE-8115.1.patch made a patch to warn empty key or empty pair. Can anyone do a quick review? Thanks! Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: HIVE-8115.1.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Status: Patch Available (was: Open) Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: HIVE-8115.1.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-5764) Stopping Metastore and HiveServer2 from command line
[ https://issues.apache.org/jira/browse/HIVE-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136012#comment-14136012 ] Xiaobing Zhou commented on HIVE-5764: - Can anyone do a review to make it go to trunk? Thanks! Stopping Metastore and HiveServer2 from command line Key: HIVE-5764 URL: https://issues.apache.org/jira/browse/HIVE-5764 Project: Hive Issue Type: Bug Components: HiveServer2, Metastore Reporter: Vaibhav Gumashta Assignee: Xiaobing Zhou Labels: patch Fix For: 0.14.0 Attachments: HIVE-5764.patch Currently a user needs to kill the process. Ideally there should be something like: hive --service metastore stop hive --service hiveserver2 stop -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-5764) Stopping Metastore and HiveServer2 from command line
[ https://issues.apache.org/jira/browse/HIVE-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-5764: Attachment: HIVE-5764.1.patch Stopping Metastore and HiveServer2 from command line Key: HIVE-5764 URL: https://issues.apache.org/jira/browse/HIVE-5764 Project: Hive Issue Type: Bug Components: HiveServer2, Metastore Reporter: Vaibhav Gumashta Assignee: Xiaobing Zhou Labels: patch Fix For: 0.14.0 Attachments: HIVE-5764.1.patch, HIVE-5764.patch Currently a user needs to kill the process. Ideally there should be something like: hive --service metastore stop hive --service hiveserver2 stop -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-5764) Stopping Metastore and HiveServer2 from command line
[ https://issues.apache.org/jira/browse/HIVE-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-5764: Attachment: (was: HIVE-5764.patch) Stopping Metastore and HiveServer2 from command line Key: HIVE-5764 URL: https://issues.apache.org/jira/browse/HIVE-5764 Project: Hive Issue Type: Bug Components: HiveServer2, Metastore Reporter: Vaibhav Gumashta Assignee: Xiaobing Zhou Labels: patch Fix For: 0.14.0 Attachments: HIVE-5764.1.patch Currently a user needs to kill the process. Ideally there should be something like: hive --service metastore stop hive --service hiveserver2 stop -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
Xiaobing Zhou created HIVE-8147: --- Summary: Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION Key: HIVE-8147 URL: https://issues.apache.org/jira/browse/HIVE-8147 Project: Hive Issue Type: Bug Reporter: Xiaobing Zhou -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[ https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HIVE-8147: --- Assignee: Xiaobing Zhou Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION Key: HIVE-8147 URL: https://issues.apache.org/jira/browse/HIVE-8147 Project: Hive Issue Type: Bug Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[ https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8147: Description: Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. drop table if exists hcat_altertable_16; 2. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 3. hadoop fs -put bug-22915 /data/table.dat Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION Key: HIVE-8147 URL: https://issues.apache.org/jira/browse/HIVE-8147 Project: Hive Issue Type: Bug Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. drop table if exists hcat_altertable_16; 2. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 3. hadoop fs -put bug-22915 /data/table.dat -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[ https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8147: Attachment: table.dat Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION Key: HIVE-8147 URL: https://issues.apache.org/jira/browse/HIVE-8147 Project: Hive Issue Type: Bug Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: table.dat Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. drop table if exists hcat_altertable_16; 2. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 3. hadoop fs -put bug-22915 /data/table.dat -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[ https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8147: Description: Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. hadoop fs -put table.dat /data/table.dat 2. drop table if exists hcat_altertable_16; 3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; 5. hadoop fs -put table.dat /data/table.dat 6. hadoop fs -mkdir /tmp/table_has_moved 7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/'; 8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; Step 8 will complain: FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/table.data'': Move from: hdfs://hh uang-clst21:8020/data/table.data to: hdfs:/tmp/table_has_moved is not valid. Please check that values for param s default.fs.name and hive.metastore.warehouse.dir do not conflict. 2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) - FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:169) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:235) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:217) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:407) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:303) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1058) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1128) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:995) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:985) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:246) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:198) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) was: Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. drop table if exists hcat_altertable_16; 2. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 3. hadoop fs -put bug-22915 /data/table.dat Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION Key: HIVE-8147 URL: https://issues.apache.org/jira/browse/HIVE-8147 Project: Hive Issue Type: Bug Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: table.dat Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. hadoop fs -put table.dat /data/table.dat 2. drop table if exists hcat_altertable_16; 3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; 5. hadoop fs -put table.dat /data/table.dat 6. hadoop fs -mkdir /tmp/table_has_moved 7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/'; 8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; Step 8 will complain: FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/table.data'': Move from: hdfs://hh uang-clst21:8020/data/table.data to: hdfs:/tmp/table_has_moved is not valid. Please
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[ https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8147: Description: Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. hadoop fs -put table.dat /data/table.dat 2. drop table if exists hcat_altertable_16; 3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; 5. hadoop fs -put table.dat /data/table.dat 6. hadoop fs -mkdir /tmp/table_has_moved 7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/'; 8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; Step 8 will complain: FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to: hdfs:/tmp/table_has_moved is not valid. Please check that values for param s default.fs.name and hive.metastore.warehouse.dir do not conflict. 2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) - FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:169) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:235) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:217) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:407) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:303) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1058) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1128) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:995) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:985) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:246) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:198) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) was: Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. hadoop fs -put table.dat /data/table.dat 2. drop table if exists hcat_altertable_16; 3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; 5. hadoop fs -put table.dat /data/table.dat 6. hadoop fs -mkdir /tmp/table_has_moved 7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/'; 8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; Step 8 will complain: FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/table.data'': Move from: hdfs://hh uang-clst21:8020/data/table.data to: hdfs:/tmp/table_has_moved is not valid. Please check that values for param s default.fs.name and hive.metastore.warehouse.dir do not conflict. 2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) - FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[ https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8147: Description: Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. hadoop fs -put table.dat /data/table.dat 2. drop table if exists hcat_altertable_16; 3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; 5. hadoop fs -put table.dat /data/table.dat 6. hadoop fs -mkdir /tmp/table_has_moved 7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/'; 8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; Step 8 will complain: FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. Stack trace: 2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) - FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:169) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:235) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:217) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:407) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:303) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1058) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1128) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:995) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:985) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:246) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:198) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) was: Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. hadoop fs -put table.dat /data/table.dat 2. drop table if exists hcat_altertable_16; 3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; 5. hadoop fs -put table.dat /data/table.dat 6. hadoop fs -mkdir /tmp/table_has_moved 7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/'; 8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; Step 8 will complain: FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to: hdfs:/tmp/table_has_moved is not valid. Please check that values for param s default.fs.name and hive.metastore.warehouse.dir do not conflict. 2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) - FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[ https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8147: Description: Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. hadoop fs -put table.dat /data/table.dat 2. drop table if exists hcat_altertable_16; 3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; 5. hadoop fs -put table.dat /data/table.dat 6. hadoop fs -mkdir /tmp/table_has_moved 7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/'; 8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; Step 8 will complain: FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. Stack trace: 2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) - FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:169) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:235) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:217) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:407) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:303) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1058) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1128) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:995) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:985) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:246) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:198) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) was: Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. hadoop fs -put table.dat /data/table.dat 2. drop table if exists hcat_altertable_16; 3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; 5. hadoop fs -put table.dat /data/table.dat 6. hadoop fs -mkdir /tmp/table_has_moved 7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/'; 8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; Step 8 will complain: FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. Stack trace: 2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) - FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid.
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[ https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8147: Fix Version/s: 0.14.0 Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION Key: HIVE-8147 URL: https://issues.apache.org/jira/browse/HIVE-8147 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: table.dat Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. hadoop fs -put table.dat /data/table.dat 2. drop table if exists hcat_altertable_16; 3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; 5. hadoop fs -put table.dat /data/table.dat 6. hadoop fs -mkdir /tmp/table_has_moved 7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/'; 8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; Step 8 will complain: FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. Stack trace: 2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) - FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:169) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:235) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:217) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:407) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:303) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1058) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1128) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:995) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:985) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:246) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:198) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[ https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8147: Affects Version/s: 0.13.0 Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION Key: HIVE-8147 URL: https://issues.apache.org/jira/browse/HIVE-8147 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 0.14.0 Attachments: table.dat Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION. Repro steps: 1. hadoop fs -put table.dat /data/table.dat 2. drop table if exists hcat_altertable_16; 3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' stored as textfile; 4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; 5. hadoop fs -put table.dat /data/table.dat 6. hadoop fs -mkdir /tmp/table_has_moved 7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/'; 8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16; Step 8 will complain: FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. Stack trace: 2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) - FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal ''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not valid. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:169) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:235) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:217) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:407) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:303) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1058) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1128) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:995) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:985) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:246) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:198) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[
https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou updated HIVE-8147:
Description:
Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION.
Repro steps:
{noformat}
1. hadoop fs -put table.dat /data/table.dat
2. drop table if exists hcat_altertable_16;
3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS
TERMINATED BY '\t' stored as textfile;
4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16;
5. hadoop fs -put table.dat /data/table.dat
6. hadoop fs -mkdir /tmp/table_has_moved
7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/';
8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16;
{noformat}
Step 8 will complain:
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
{noformat}
Stack trace:
{noformat}
2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) -
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal
''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:169)
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:235)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:217)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:407)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:303)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1058)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1128)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:995)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:985)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:246)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:198)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
{noformat}
was:
Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION.
Repro steps:
1. hadoop fs -put table.dat /data/table.dat
2. drop table if exists hcat_altertable_16;
3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS
TERMINATED BY '\t' stored as textfile;
4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16;
5. hadoop fs -put table.dat /data/table.dat
6. hadoop fs -mkdir /tmp/table_has_moved
7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/';
8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16;
Step 8 will complain:
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
Stack trace:
2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) -
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal
''/data/bug-22915'': Move from:
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[
https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou updated HIVE-8147:
Description:
Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION.
Repro steps:
{noformat}
1. hadoop fs -put table.dat /data/table.dat
2. drop table if exists hcat_altertable_16;
3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS
TERMINATED BY '\t' stored as textfile;
4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16;
5. hadoop fs -put table.dat /data/table.dat
6. hadoop fs -mkdir /tmp/table_has_moved
7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/';
8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16;
{noformat}
Step 8 will complain:
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
{noformat}
Stack trace:
{noformat}
2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) -
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal
''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:169)
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:235)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:217)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:407)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:303)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1058)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1128)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:995)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:985)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:246)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:198)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
{noformat}
was:
Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION.
Repro steps:
{noformat}
1. hadoop fs -put table.dat /data/table.dat
2. drop table if exists hcat_altertable_16;
3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED FIELDS
TERMINATED BY '\t' stored as textfile;
4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16;
5. hadoop fs -put table.dat /data/table.dat
6. hadoop fs -mkdir /tmp/table_has_moved
7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/';
8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16;
{noformat}
Step 8 will complain:
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
{noformat}
Stack trace:
{noformat}
2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) -
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not legal
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Fix Version/s: (was: 0.14.0) Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[
https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou updated HIVE-8147:
Fix Version/s: (was: 0.14.0)
Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
Key: HIVE-8147
URL: https://issues.apache.org/jira/browse/HIVE-8147
Project: Hive
Issue Type: Bug
Affects Versions: 0.13.0
Reporter: Xiaobing Zhou
Assignee: Xiaobing Zhou
Attachments: table.dat
Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION.
Repro steps:
{noformat}
1. hadoop fs -put table.dat /data/table.dat
2. drop table if exists hcat_altertable_16;
3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t' stored as textfile;
4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16;
5. hadoop fs -put table.dat /data/table.dat
6. hadoop fs -mkdir /tmp/table_has_moved
7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/';
8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE
hcat_altertable_16;
{noformat}
Step 8 will complain:
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
{noformat}
Stack trace:
{noformat}
2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) -
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not
legal ''/data/bug-22915'': Move from:
hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not
valid. Please check that values for params default.fs.name and
hive.metastore.warehouse.dir do not conflict.
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:169)
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:235)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:217)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:407)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:303)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1058)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1128)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:995)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:985)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:246)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:198)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-8147) Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
[
https://issues.apache.org/jira/browse/HIVE-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou updated HIVE-8147:
Affects Version/s: (was: 0.13.0)
0.14.0
Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION
Key: HIVE-8147
URL: https://issues.apache.org/jira/browse/HIVE-8147
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Xiaobing Zhou
Assignee: Xiaobing Zhou
Attachments: table.dat
Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION.
Repro steps:
{noformat}
1. hadoop fs -put table.dat /data/table.dat
2. drop table if exists hcat_altertable_16;
3. create table hcat_altertable_16(a int, b string) ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t' stored as textfile;
4. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE hcat_altertable_16;
5. hadoop fs -put table.dat /data/table.dat
6. hadoop fs -mkdir /tmp/table_has_moved
7. alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/';
8. LOAD DATA INPATH '/data/table.dat' OVERWRITE INTO TABLE
hcat_altertable_16;
{noformat}
Step 8 will complain:
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/table.dat'': Move from: hdfs://hhuang-clst21:8020/data/table.dat to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
{noformat}
Stack trace:
{noformat}
2014-09-16 21:37:45,020 ERROR ql.Driver (SessionState.java:printError(824)) -
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''/data/bug-22915'': Move from: hdfs://hhuang-clst21:8020/data/bug-22915 to:
hdfs:/tmp/table_has_moved is not valid. Please check that values for params
default.fs.name and hive.metastore.warehouse.dir do not conflict.
org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:17 Path is not
legal ''/data/bug-22915'': Move from:
hdfs://hhuang-clst21:8020/data/bug-22915 to: hdfs:/tmp/table_has_moved is not
valid. Please check that values for params default.fs.name and
hive.metastore.warehouse.dir do not conflict.
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:169)
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:235)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:217)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:407)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:303)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1058)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1128)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:995)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:985)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:246)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:198)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-5764) Stopping Metastore and HiveServer2 from command line
[ https://issues.apache.org/jira/browse/HIVE-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-5764: Fix Version/s: (was: 0.14.0) Stopping Metastore and HiveServer2 from command line Key: HIVE-5764 URL: https://issues.apache.org/jira/browse/HIVE-5764 Project: Hive Issue Type: Bug Components: HiveServer2, Metastore Reporter: Vaibhav Gumashta Assignee: Xiaobing Zhou Labels: patch Attachments: HIVE-5764.1.patch Currently a user needs to kill the process. Ideally there should be something like: hive --service metastore stop hive --service hiveserver2 stop -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-7875) Hive cannot load data into partitioned table with Unicode key
[ https://issues.apache.org/jira/browse/HIVE-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7875: Fix Version/s: (was: 0.14.0) Hive cannot load data into partitioned table with Unicode key - Key: HIVE-7875 URL: https://issues.apache.org/jira/browse/HIVE-7875 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Environment: Windows Server 2008 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: CreatePartitionedTable.hql, LoadIntoPartitionedTable.hql, partitioned.txt Steps to reproduce: 1) Copy the file partitioned.txt to the root folder HDFS. Copy the two hql files to your local directory. 2) Open Hive CLI. 3) Run: hive source path to CreatePartitionedTable.hql; 4) Run hive source path to LoadIntoPartitionedTable.hql; The following error will be shown: hive source C:\Scripts\partition\LoadIntoPartitionedTable.hql; Loading data to table default.mypartitioned partition (tag=䶵) Failed with exception null FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-7511) Hive: output is incorrect if there are UTF-8 characters in where clause of a hive select query.
[ https://issues.apache.org/jira/browse/HIVE-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7511: Fix Version/s: (was: 0.14.0) Hive: output is incorrect if there are UTF-8 characters in where clause of a hive select query. --- Key: HIVE-7511 URL: https://issues.apache.org/jira/browse/HIVE-7511 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Critical Attachments: HIVE-7511.1.patch When we put UTF-8 characters in where clause of a hive query the results are empty for where content like '%丄%' and results contain all rows for where content not like '%丄%'; even when few rows contain this character. Steps to reproduce: 1. Save a file called data.txt in the root container. The contents of the files are as follows. 190 丄f齄啊c狛䶴h䶴c狝 899 d狜狜㐁geg阿狚ea䶴eead狜e 137 齄鼾h狝ge㐀狛g狚阿 21﨩﨩e㐀c狛鼾d䶴﨨 767 﨩c﨩g狜㐁狜狛齄阿﨩狚齄﨨䶵狝﨨 281 﨨㐀啊aga啊c狝e鼾鼾 573 㐁䶴hc﨨b狝㐁﨩䶴狜丄hc齄 966 䶴丄狜﨨e狝eb狜㐁c㐀鼾﨩丄ga狚丄 565 䶵㐀﨩㐀bb狛ehd丄ea丄㐀 778 﨩㐁阿﨨狚bbea丄䶵丄狚鼾狚a䶵 363 gd齄a鼾a䶴b㐁㐁fg鼾 822 a阿狜䶵h䶵e狛h﨩gac狜阿㐀啊b 338 b齄㐁ff阿e狜e㐀ba齄 2. Execute the following queries to setup the table. a. CREATE TABLE hivetable(row INT, content STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY ' t' LOCATION '/hivetable'; b. LOAD DATA INPATH 'wasb:///data.txt' OVERWRITE INTO TABLE hivetable; 3. create a query file query.hql with following contents INSERT OVERWRITE DIRECTORY 'wasb:///hiveoutput' select * from hivetable where content like '%丄%'; 4. even though few rows contains this character the output is empty. 5. change the contents of query.hql to INSERT OVERWRITE DIRECTORY 'wasb:///hiveoutput' select * from hivetable where content not like '%丄%'; 6. The output contains all rows including those containing the given character. 7. Similar results are observed when using where content = '丄f齄啊c狛䶴h䶴c狝'; 8. We get expected results when using where content like '%a%'; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-7699) HIVE fails to LOAD DATA INTO TABLE from external storage
[ https://issues.apache.org/jira/browse/HIVE-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-7699: Affects Version/s: 0.13.0 HIVE fails to LOAD DATA INTO TABLE from external storage - Key: HIVE-7699 URL: https://issues.apache.org/jira/browse/HIVE-7699 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Hive is supposed to support loading data to table from external storage like Azure blob storage. Here's an exampLe: property namefs.azure.account.key.XXX.blob.core.windows.net/name valueCREDENTIAL-KEY/value /property is configured into hadoop core-site.xml. bin/hadoop fs works, however if run the query like: LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt' OVERWRITE INTO TABLE hivetable; HIVE CLI will complain as FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''wasb://t...@account-name.blob.core.windows.net/data.t xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to: hdfs://HDFS-HOST:8020/hivetable is not vali d. Please check that values for params default.fs.name and hive.metastore.warehouse.dir do not conflict. The stacktrace is at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170) at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363) at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460) at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8169) Windows: alter table ..set location from hcatalog failed with NullPointerException
[
https://issues.apache.org/jira/browse/HIVE-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138166#comment-14138166
]
Xiaobing Zhou commented on HIVE-8169:
-
Steps to reproduce the issue:
{noformat}
drop table if exists hcat_altertable_16;
create table hcat_altertable_16(a int, b string) stored as textfile;
show table extended like hcat_altertable_16;
alter table hcat_altertable_16 set location 'hdfs:///tmp/table_has_moved/';
show table extended like hcat_altertable_16;
{noformat}
Stack trace:
{noformat}
org.apache.hadoop.hive.ql.parse.SemanticException:
org.apache.hadoop.hive.ql.parse.SemanticException:
java.lang.NullPointerException
at
org.apache.hive.hcatalog.cli.SemanticAnalysis.HCatSemanticAnalyzer.postAnalyze(HCatSemanticAnalyzer.java:264)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:406)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:299)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:993)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1063)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:930)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:920)
at org.apache.hive.hcatalog.cli.HCatDriver.run(HCatDriver.java:43)
at org.apache.hive.hcatalog.cli.HCatCli.processCmd(HCatCli.java:291)
at org.apache.hive.hcatalog.cli.HCatCli.processLine(HCatCli.java:245)
at org.apache.hive.hcatalog.cli.HCatCli.processFile(HCatCli.java:264)
at org.apache.hive.hcatalog.cli.HCatCli.main(HCatCli.java:188)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: org.apache.hadoop.hive.ql.parse.SemanticException:
java.lang.NullPointerException
at
org.apache.hive.hcatalog.cli.SemanticAnalysis.HCatSemanticAnalyzerBase.authorizeDDL(HCatSemanticAnalyzerBase.java:114)
at
org.apache.hive.hcatalog.cli.SemanticAnalysis.HCatSemanticAnalyzer.postAnalyze(HCatSemanticAnalyzer.java:259)
... 17 more
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178)
at
org.apache.hive.hcatalog.cli.SemanticAnalysis.HCatSemanticAnalyzerBase.authorize(HCatSemanticAnalyzerBase.java:161)
at
org.apache.hive.hcatalog.cli.SemanticAnalysis.HCatSemanticAnalyzer.authorizeDDLWork(HCatSemanticAnalyzer.java:381)
at
org.apache.hive.hcatalog.cli.SemanticAnalysis.HCatSemanticAnalyzerBase.authorizeDDL(HCatSemanticAnalyzerBase.java:105)
... 18 more
{noformat}
Windows: alter table ..set location from hcatalog failed with
NullPointerException
--
Key: HIVE-8169
URL: https://issues.apache.org/jira/browse/HIVE-8169
Project: Hive
Issue Type: Bug
Components: HCatalog
Affects Versions: 0.14.0
Reporter: Xiaobing Zhou
Assignee: Xiaobing Zhou
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HIVE-8169) Windows: alter table ..set location from hcatalog failed with NullPointerException
Xiaobing Zhou created HIVE-8169: --- Summary: Windows: alter table ..set location from hcatalog failed with NullPointerException Key: HIVE-8169 URL: https://issues.apache.org/jira/browse/HIVE-8169 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8169) Windows: alter table ..set location from hcatalog failed with NullPointerException
[ https://issues.apache.org/jira/browse/HIVE-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8169: Environment: Windows Server 2008 R2 Windows: alter table ..set location from hcatalog failed with NullPointerException -- Key: HIVE-8169 URL: https://issues.apache.org/jira/browse/HIVE-8169 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.14.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8169) Windows: alter table ..set location from hcatalog failed with NullPointerException
[
https://issues.apache.org/jira/browse/HIVE-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138175#comment-14138175
]
Xiaobing Zhou commented on HIVE-8169:
-
Save the above query as HIVE-8169.hql, run it by python
$HIVE_HOME/hcatalog/bin/hcat.py -f HIVE-8169.hql, it pops up exception like:
{noformat}
FAILED: SemanticException org.apache.hadoop.hive.ql.parse.SemanticException:
java.lang.NullPointerException
{noformat}
Windows: alter table ..set location from hcatalog failed with
NullPointerException
--
Key: HIVE-8169
URL: https://issues.apache.org/jira/browse/HIVE-8169
Project: Hive
Issue Type: Bug
Components: HCatalog
Affects Versions: 0.14.0
Environment: Windows Server 2008 R2
Reporter: Xiaobing Zhou
Assignee: Xiaobing Zhou
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8169) Windows: alter table ..set location from hcatalog failed with NullPointerException
[ https://issues.apache.org/jira/browse/HIVE-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138182#comment-14138182 ] Xiaobing Zhou commented on HIVE-8169: - Investigated and found issue comes from line 362 of org.apache.hive.hcatalog.cli.SemanticAnalysis.HCatSemanticAnalyzer. In function authorizeDDLWork, hive.getTable tries to use default and default.hcat_altertable_16 are used as dbname and tablename to query table metadata, eventually, default.default.hcat_altertable_16 is the full table name used for query, causing failure like NoSuchObjectException which is cast to NullPointerException in upstream path. Windows: alter table ..set location from hcatalog failed with NullPointerException -- Key: HIVE-8169 URL: https://issues.apache.org/jira/browse/HIVE-8169 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.14.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8169) Windows: alter table ..set location from hcatalog failed with NullPointerException
[ https://issues.apache.org/jira/browse/HIVE-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8169: Attachment: HIVE-8169.1.patch Made a patch for review. Windows: alter table ..set location from hcatalog failed with NullPointerException -- Key: HIVE-8169 URL: https://issues.apache.org/jira/browse/HIVE-8169 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.14.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8169.1.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8169) Windows: alter table ..set location from hcatalog failed with NullPointerException
[ https://issues.apache.org/jira/browse/HIVE-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8169: Status: Patch Available (was: Open) Windows: alter table ..set location from hcatalog failed with NullPointerException -- Key: HIVE-8169 URL: https://issues.apache.org/jira/browse/HIVE-8169 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.14.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8169.1.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8169) Windows: alter table ..set location from hcatalog failed with NullPointerException
[ https://issues.apache.org/jira/browse/HIVE-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139236#comment-14139236 ] Xiaobing Zhou commented on HIVE-8169: - Thanks [~alangates]. There already exist unit test and system test, somehow, just failed in this case. Windows: alter table ..set location from hcatalog failed with NullPointerException -- Key: HIVE-8169 URL: https://issues.apache.org/jira/browse/HIVE-8169 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.14.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8169.1.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-7699) HIVE fails to LOAD DATA INTO TABLE from external storage
[
https://issues.apache.org/jira/browse/HIVE-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou updated HIVE-7699:
Description:
Hive is supposed to support loading data to table from external storage like
Azure blob storage. Here's an exampLe:
{noformat}
property
namefs.azure.account.key.XXX.blob.core.windows.net/name
valueCREDENTIAL-KEY/value
/property
{noformat}
is configured into hadoop core-site.xml. bin/hadoop fs works, however if run
the query like:
LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt'
OVERWRITE INTO TABLE hivetable;
HIVE CLI will complain as
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''wasb://t...@account-name.blob.core.windows.net/data.t
xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to:
hdfs://HDFS-HOST:8020/hivetable is not vali
d. Please check that values for params default.fs.name and
hive.metastore.warehouse.dir do not conflict.
{noformat}
Stack trace:
{noformat}
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
at
org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460)
at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
{noformat}
was:
Hive is supposed to support loading data to table from external storage like
Azure blob storage. Here's an exampLe:
property
namefs.azure.account.key.XXX.blob.core.windows.net/name
valueCREDENTIAL-KEY/value
/property is configured into hadoop core-site.xml. bin/hadoop fs works,
however if run the query like:
LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt'
OVERWRITE INTO TABLE hivetable;
HIVE CLI will complain as
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''wasb://t...@account-name.blob.core.windows.net/data.t
xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to:
hdfs://HDFS-HOST:8020/hivetable is not vali
d. Please check that values for params default.fs.name and
hive.metastore.warehouse.dir do not conflict.
The stacktrace is
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
at
org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460)
at
[jira] [Updated] (HIVE-7699) HIVE fails to LOAD DATA INTO TABLE from external storage
[
https://issues.apache.org/jira/browse/HIVE-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou updated HIVE-7699:
Description:
Hive is supposed to support loading data to table from external storage like
Azure blob storage. Here's an exampLe:
{noformat}
property
namefs.azure.account.key.XXX.blob.core.windows.net/name
valueCREDENTIAL-KEY/value
/property
{noformat}
is configured into hadoop core-site.xml. bin/hadoop fs -ls / works fine,
however if run the query like:
LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt'
OVERWRITE INTO TABLE hivetable;
HIVE CLI will complain as
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''wasb://t...@account-name.blob.core.windows.net/data.t
xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to:
hdfs://HDFS-HOST:8020/hivetable is not vali
d. Please check that values for params default.fs.name and
hive.metastore.warehouse.dir do not conflict.
{noformat}
Stack trace:
{noformat}
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
at
org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460)
at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
{noformat}
was:
Hive is supposed to support loading data to table from external storage like
Azure blob storage. Here's an exampLe:
{noformat}
property
namefs.azure.account.key.XXX.blob.core.windows.net/name
valueCREDENTIAL-KEY/value
/property
{noformat}
is configured into hadoop core-site.xml. bin/hadoop fs works, however if run
the query like:
LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt'
OVERWRITE INTO TABLE hivetable;
HIVE CLI will complain as
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''wasb://t...@account-name.blob.core.windows.net/data.t
xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to:
hdfs://HDFS-HOST:8020/hivetable is not vali
d. Please check that values for params default.fs.name and
hive.metastore.warehouse.dir do not conflict.
{noformat}
Stack trace:
{noformat}
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
at
org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460)
[jira] [Updated] (HIVE-7699) HIVE fails to LOAD DATA INTO TABLE from external storage
[
https://issues.apache.org/jira/browse/HIVE-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou updated HIVE-7699:
Description:
Hive is supposed to support loading data to table from external storage like
Azure blob storage. Here's an exampLe:
{noformat}
property
namefs.azure.account.key.XXX.blob.core.windows.net/name
valueCREDENTIAL-KEY/value
/property
{noformat}
is configured into hadoop core-site.xml. bin/hadoop fs -ls / works fine,
however if run the query like:
{noformat}
LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt'
OVERWRITE INTO TABLE hivetable;
{noformat}, where wasb is schema of Azure blob store.
HIVE CLI will complain as
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''wasb://t...@account-name.blob.core.windows.net/data.t
xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to:
hdfs://HDFS-HOST:8020/hivetable is not vali
d. Please check that values for params default.fs.name and
hive.metastore.warehouse.dir do not conflict.
{noformat}
Stack trace:
{noformat}
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
at
org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460)
at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
{noformat}
was:
Hive is supposed to support loading data to table from external storage like
Azure blob storage. Here's an exampLe:
{noformat}
property
namefs.azure.account.key.XXX.blob.core.windows.net/name
valueCREDENTIAL-KEY/value
/property
{noformat}
is configured into hadoop core-site.xml. bin/hadoop fs -ls / works fine,
however if run the query like:
LOAD DATA INPATH 'wasb://t...@account-name.blob.core.windows.net/data.txt'
OVERWRITE INTO TABLE hivetable;
HIVE CLI will complain as
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal
''wasb://t...@account-name.blob.core.windows.net/data.t
xt'': Move from: wasb://t...@account-name.blob.core.windows.net/data.txt to:
hdfs://HDFS-HOST:8020/hivetable is not vali
d. Please check that values for params default.fs.name and
hive.metastore.warehouse.dir do not conflict.
{noformat}
Stack trace:
{noformat}
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
at
org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
at
[jira] [Commented] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139362#comment-14139362 ] Xiaobing Zhou commented on HIVE-8115: - [~hsubramaniyan] This is intentional because LazyMap does not deal with the case of a NULL map. That is handled by the parent LazyObject. , This patch lets users know what happened behind. Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Attachment: HIVE-8115.2.patch Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139719#comment-14139719 ] Xiaobing Zhou commented on HIVE-8115: - Made another patch to throw RuntimeException in addition to output warning messages. Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Attachment: (was: HIVE-8115.2.patch) Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Attachment: HIVE-8115.2.patch Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Description: Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; was: Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs ls -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Attachment: HIVE-8115.3.patch Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, HIVE-8115.3.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143906#comment-14143906 ] Xiaobing Zhou commented on HIVE-8115: - There is an infinite loop due to parsing pointer not advanced in LazyMap.parse that hangs query in the case of bad map with empty entry. The 3rd patch logged warning message and skipped those bad entries, and made queries going on by returning good entries in map. Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, HIVE-8115.3.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143914#comment-14143914 ] Xiaobing Zhou commented on HIVE-8115: - [~alangates] [~prasanth_j] [~jdere] [~ekoifman] [~hsubramaniyan] could you review this patch please? Thanks! Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, HIVE-8115.3.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Attachment: (was: HIVE-8115.3.patch) Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Attachment: HIVE-8115.3.patch Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, HIVE-8115.3.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Attachment: HIVE-8115.4.patch The 4th patch, made a change to remove redundant code according to [~jdere] 'review. Will add test cases in the following patch. Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, HIVE-8115.3.patch, HIVE-8115.4.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8115: Attachment: HIVE-8115.5.patch Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, HIVE-8115.3.patch, HIVE-8115.4.patch, HIVE-8115.5.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8115) Hive select query hang when fields contain map
[ https://issues.apache.org/jira/browse/HIVE-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145427#comment-14145427 ] Xiaobing Zhou commented on HIVE-8115: - Made the 5th patch, and added unit test cases. Hive select query hang when fields contain map -- Key: HIVE-8115 URL: https://issues.apache.org/jira/browse/HIVE-8115 Project: Hive Issue Type: Bug Affects Versions: 0.13.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8115.1.patch, HIVE-8115.2.patch, HIVE-8115.3.patch, HIVE-8115.4.patch, HIVE-8115.5.patch, createTable.hql, data Attached the repro of the issue. When creating an table loading the data attached, all hive query with hangs even just select * from the table. repro steps: 1. run createTable.hql 2. hadoop fs -put data /data 3. LOAD DATA INPATH '/data' OVERWRITE INTO TABLE testtable; 4. SELECT * FROM testtable; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8169) Windows: alter table ..set location from hcatalog failed with NullPointerException
[ https://issues.apache.org/jira/browse/HIVE-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8169: Attachment: HIVE-8169.2.patch Made the 2nd patch by adding unit tests. [~alangates] can you please review it? Thanks! Windows: alter table ..set location from hcatalog failed with NullPointerException -- Key: HIVE-8169 URL: https://issues.apache.org/jira/browse/HIVE-8169 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.14.0 Environment: Windows Server 2008 R2 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8169.1.patch, HIVE-8169.2.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-8340) HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start.
Xiaobing Zhou created HIVE-8340: --- Summary: HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start. Key: HIVE-8340 URL: https://issues.apache.org/jira/browse/HIVE-8340 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.14.0 Environment: Windows Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou On stopping the HS2 service from the services tab, it only kills the root process and does not kill the child java process. As a result resources are not freed and this throws an error on restarting from command line. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8340) HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start.
[ https://issues.apache.org/jira/browse/HIVE-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158281#comment-14158281 ] Xiaobing Zhou commented on HIVE-8340: - Here are comments years ago to explain why the grand-children process is not killed(http://bugs.java.com/bugdatabase/view_bug.do?bug_id=4770092), but I guess there should be some fixes, I will dig more. The following excellent SDN comment explains what's going on: - The fundamental problem here is that, unlike Unix, Windows does that maintain parent-child relationships between processes. A process can kill its own immediate children, but unless you make other arrangements to obtain the information, can't kill any 'grand-children' because it has no way of finding them. Ctrl-C types at a command prompt is just a character that the command processor interprets and not a signal sent from outside. When you 'destroy' a child command script, that process does not get the opportunity to terminate any child processes it may know about. Recent versions of WIndows (2000 or later) do provide a Job concept which acts as a container for processes. Killing a Job does terminate all processes associated with that job. However Jobs do not contain other jobs, so fully emulating the Unix behaviour is probably impossible. - Note that Unix emulation environments on Windows, like Cygwin, suffer from the same problem. Any fix would be difficult. Even if we could figure out how to fix this, we might choose not to do so for the usual reason – compatibility. 2005-09-27 HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start. - Key: HIVE-8340 URL: https://issues.apache.org/jira/browse/HIVE-8340 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.14.0 Environment: Windows Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou On stopping the HS2 service from the services tab, it only kills the root process and does not kill the child java process. As a result resources are not freed and this throws an error on restarting from command line. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8340) HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start.
[ https://issues.apache.org/jira/browse/HIVE-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158286#comment-14158286 ] Xiaobing Zhou commented on HIVE-8340: - Removed cmd.exe process as a wrapper of JVM process. This fixed the issue. HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start. - Key: HIVE-8340 URL: https://issues.apache.org/jira/browse/HIVE-8340 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.14.0 Environment: Windows Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou On stopping the HS2 service from the services tab, it only kills the root process and does not kill the child java process. As a result resources are not freed and this throws an error on restarting from command line. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8340) HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start.
[ https://issues.apache.org/jira/browse/HIVE-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8340: Attachment: HIVE-8340.1.patch Made a patch. Can anyone in the watcher list review it? Thanks! HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start. - Key: HIVE-8340 URL: https://issues.apache.org/jira/browse/HIVE-8340 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.14.0 Environment: Windows Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-8340.1.patch On stopping the HS2 service from the services tab, it only kills the root process and does not kill the child java process. As a result resources are not freed and this throws an error on restarting from command line. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8340) HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start.
[ https://issues.apache.org/jira/browse/HIVE-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158440#comment-14158440 ] Xiaobing Zhou commented on HIVE-8340: - [~hsubramaniyan] I think you had more knowledge to clear [~vgumashta]'s doubts in review board. Can you comment on this? Thanks! HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start. - Key: HIVE-8340 URL: https://issues.apache.org/jira/browse/HIVE-8340 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.14.0 Environment: Windows Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8340.1.patch On stopping the HS2 service from the services tab, it only kills the root process and does not kill the child java process. As a result resources are not freed and this throws an error on restarting from command line. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8340) HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start.
[ https://issues.apache.org/jira/browse/HIVE-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8340: Attachment: HIVE-8340.2.patch Posted 2nd patch to be reviewed. Thanks! HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start. - Key: HIVE-8340 URL: https://issues.apache.org/jira/browse/HIVE-8340 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.14.0 Environment: Windows Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8340.1.patch, HIVE-8340.2.patch On stopping the HS2 service from the services tab, it only kills the root process and does not kill the child java process. As a result resources are not freed and this throws an error on restarting from command line. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8340) HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start.
[ https://issues.apache.org/jira/browse/HIVE-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8340: Attachment: HIVE-8340.3.patch HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start. - Key: HIVE-8340 URL: https://issues.apache.org/jira/browse/HIVE-8340 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.14.0 Environment: Windows Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8340.1.patch, HIVE-8340.2.patch, HIVE-8340.3.patch On stopping the HS2 service from the services tab, it only kills the root process and does not kill the child java process. As a result resources are not freed and this throws an error on restarting from command line. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8340) HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start.
[ https://issues.apache.org/jira/browse/HIVE-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158929#comment-14158929 ] Xiaobing Zhou commented on HIVE-8340: - Thanks [~vgumashta]. Made that change and the 3rd patch to be reviewed. HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start. - Key: HIVE-8340 URL: https://issues.apache.org/jira/browse/HIVE-8340 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.14.0 Environment: Windows Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8340.1.patch, HIVE-8340.2.patch, HIVE-8340.3.patch On stopping the HS2 service from the services tab, it only kills the root process and does not kill the child java process. As a result resources are not freed and this throws an error on restarting from command line. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8340) HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start.
[ https://issues.apache.org/jira/browse/HIVE-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8340: Attachment: HIVE-8340.4.patch Thanks [~leftylev]. Made the 4th patch to be reviewed. HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start. - Key: HIVE-8340 URL: https://issues.apache.org/jira/browse/HIVE-8340 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.14.0 Environment: Windows Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8340.1.patch, HIVE-8340.2.patch, HIVE-8340.3.patch, HIVE-8340.4.patch On stopping the HS2 service from the services tab, it only kills the root process and does not kill the child java process. As a result resources are not freed and this throws an error on restarting from command line. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
