[
https://issues.apache.org/jira/browse/HIVE-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860153#comment-15860153
]
Sahil Takiar edited comment on HIVE-15856 at 2/9/17 8:36 PM:
-------------------------------------------------------------
[~zyork] it seems that HIVE-13463 fixes issues when trying to import across
filesystems, but in order for an export / import command to run against a
filesystem, the scheme of the filesystem uri must be in the list
{{hive.exim.uri.scheme.whitelist}} - currently there are no S3 schemes in that
list.
At least, the following query fails:
{code}
export table src to '${hiveconf:test.blobstore.path.unique}/exim/src';
{code}
with the following exception:
{code}
org.apache.hadoop.hive.ql.parse.SemanticException: Invalid path only the
following file systems accepted for export/import : hdfs,pfile,file
at
org.apache.hadoop.hive.ql.parse.EximUtil.getValidatedURI(EximUtil.java:187)
at
org.apache.hadoop.hive.ql.parse.ExportSemanticAnalyzer.analyzeInternal(ExportSemanticAnalyzer.java:73)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:514)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1319)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1459)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1239)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1229)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:336)
...
{code}
was (Author: stakiar):
[~zyork] it seems that HIVE-13463 fixes issues when trying to import across
filesystems, but in order for an export / import command to run against a
filesystem, the scheme of the filesystem uri must be in the list
{{hive.exim.uri.scheme.whitelist}} - currently there are no S3 schemes in that
list.
At least, the following query fails:
{quote}
export table src to '${hiveconf:test.blobstore.path.unique}/exim/src';
{quote}
with the following exception:
{quote}
org.apache.hadoop.hive.ql.parse.SemanticException: Invalid path only the
following file systems accepted for export/import : hdfs,pfile,file
at
org.apache.hadoop.hive.ql.parse.EximUtil.getValidatedURI(EximUtil.java:187)
at
org.apache.hadoop.hive.ql.parse.ExportSemanticAnalyzer.analyzeInternal(ExportSemanticAnalyzer.java:73)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:514)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1319)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1459)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1239)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1229)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:336)
...
{quote}
> Hive export/import (hive.exim.uri.scheme.whitelist) to support s3a
> ------------------------------------------------------------------
>
> Key: HIVE-15856
> URL: https://issues.apache.org/jira/browse/HIVE-15856
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
>
> Add support for export / import operations on S3.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
