[
https://issues.apache.org/jira/browse/SPARK-47912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhen Wang updated SPARK-47912:
------------------------------
Description:
File format of insert overwrite dir does not take effect.
Reproduce:
{code:java}
set hive.default.fileformat=parquet;
-- Not as expected, I want an orc file but written in parquet format
INSERT OVERWRITE DIRECTORY '$tablePath'
STORED AS
INPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat'
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
select 1;
-- Failed
select * from `orc`.`$tablePath`; {code}
was:
File format of insert overwrite dir does not take effect.
Reproduce:
{code:java}
set hive.default.fileformat=parquet;-- Not as expected, I want an orc file but
written in parquet format
INSERT OVERWRITE DIRECTORY '$tablePath'
STORED AS
INPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat'
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
select 1;-- Failed
select * from `orc`.`$tablePath`; {code}
> File format of insert overwrite dir does not take effect
> --------------------------------------------------------
>
> Key: SPARK-47912
> URL: https://issues.apache.org/jira/browse/SPARK-47912
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 4.0.0
> Reporter: Zhen Wang
> Priority: Major
>
> File format of insert overwrite dir does not take effect.
>
> Reproduce:
> {code:java}
> set hive.default.fileformat=parquet;
> -- Not as expected, I want an orc file but written in parquet format
> INSERT OVERWRITE DIRECTORY '$tablePath'
> STORED AS
> INPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat'
> OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
> select 1;
> -- Failed
> select * from `orc`.`$tablePath`; {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
