[
https://issues.apache.org/jira/browse/HUDI-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rahil Chertara updated HUDI-5601:
---------------------------------
Description:
Currently it seems that when a user tries to add a partition to their table
using `spark.sql("alter table hudi_table add partition(year='2021')")` and then
run a `show partition`, nothing is returned. When running the command
`spark.sql("msck repair table hudi_table").show(20)` nothing is returned as
well.
I believe in hudi we have not integrated this with the external catalog (hive
metastore), and thus we should look into this integration.
scala> spark.sql("SHOW PARTITIONS hudi_table ").show(20)
+---------+ |partition|
+--------{-}{-}+ +--------+
was:
Currently it seems that when a user tries to add a partition to their table
using `spark.sql("alter table hudi_table add partition(year='2021')")` and then
run a `show partition`, nothing is returned. I believe in hudi we have not
integrated this with the external catalog (hive metastore), and thus we should
look into this integration.
scala> spark.sql("SHOW PARTITIONS hudi_table ").show(20)
+---------+ |partition|
+---------+ +---------+
> Support for commands ALTER TABLE ADD PARTITION, and MSCK REPAIR
> ---------------------------------------------------------------
>
> Key: HUDI-5601
> URL: https://issues.apache.org/jira/browse/HUDI-5601
> Project: Apache Hudi
> Issue Type: Task
> Reporter: Rahil Chertara
> Priority: Major
>
>
> Currently it seems that when a user tries to add a partition to their table
> using `spark.sql("alter table hudi_table add partition(year='2021')")` and
> then run a `show partition`, nothing is returned. When running the command
> `spark.sql("msck repair table hudi_table").show(20)` nothing is returned as
> well.
> I believe in hudi we have not integrated this with the external catalog (hive
> metastore), and thus we should look into this integration.
> scala> spark.sql("SHOW PARTITIONS hudi_table ").show(20)
> +---------+ |partition|
> +--------{-}{-}+ +--------+
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
