[
https://issues.apache.org/jira/browse/SPARK-30249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-30249:
-----------------------------------
Description:
Column names such as `a:b` , `??`, `,,`, `^^` , `++`etc are allowed when we
are creating parquet tables.
While when we are creating tables with `orc` all such column names are marked
as invalid and analysis exception is thrown.
These column names should also be not allowed for parquet tables as well.
Also this induces inconsistency between column names for Parquet and ORC
was:
Column names such as `a:b` , `??`, `,,`, `^^` , `++`etc are allowed when we
are creating parquet tables.
While when we are creating tables with `orc` all such column names are marked
as invalid and analysis exception is thrown.
These column names should also be not allowed for parquet tables as well.
> Invalid Column Names in parquet tables should not be allowed
> ------------------------------------------------------------
>
> Key: SPARK-30249
> URL: https://issues.apache.org/jira/browse/SPARK-30249
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Rakesh Raushan
> Priority: Minor
>
> Column names such as `a:b` , `??`, `,,`, `^^` , `++`etc are allowed when we
> are creating parquet tables.
> While when we are creating tables with `orc` all such column names are marked
> as invalid and analysis exception is thrown.
> These column names should also be not allowed for parquet tables as well.
> Also this induces inconsistency between column names for Parquet and ORC
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
