rangareddy commented on issue #12808:
URL: https://github.com/apache/hudi/issues/12808#issuecomment-2642904684
Hi @pravin1406
As Aditya mentioned in an earlier comment, we cannot execute procedures for
two different table formats in a single Spark session. We can only execute one
SQL procedure per Spark session.
If we attempt to use multiple procedures, we will encounter a similar type
of exception.
```sql
spark-sql (default)> CALL
iceberg_catalog.system.rewrite_data_files('default.iceberg_tbl');
procedure: rewrite_data_files is not exists
```
**Example code:**
```sh
spark-sql \
--conf
'spark.kryo.registrator=org.apache.spark.HoodieSparkKryoRegistrar' \
--conf
spark.sql.extensions=org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions,org.apache.spark.sql.hudi.HoodieSparkSessionExtension
\
--conf
spark.sql.catalog.spark_catalog=org.apache.spark.sql.hudi.catalog.HoodieCatalog
\
--conf
spark.sql.catalog.iceberg_catalog=org.apache.iceberg.spark.SparkCatalog \
--conf spark.sql.catalog.iceberg_catalog.type=hive
```
```sql
CREATE TABLE iceberg_catalog.default.iceberg_tbl (id bigint, data string)
USING iceberg;
INSERT INTO iceberg_catalog.default.iceberg_tbl VALUES (1, 'a'), (2, 'b'),
(3, 'c');
SELECT * FROM iceberg_catalog.default.iceberg_tbl;
CALL iceberg_catalog.system.rewrite_data_files('default.iceberg_tbl');
CREATE TABLE hudi_tbl (
ts BIGINT,
uuid STRING,
rider STRING,
driver STRING,
fare DOUBLE,
city STRING
) USING HUDI
PARTITIONED BY (city);
INSERT INTO hudi_tbl
VALUES
(1695159649087,'334e26e9-8355-45cc-97c6-c31daf0df330','rider-A','driver-K',19.10,'san_francisco'),
(1695091554788,'e96c4396-3fad-413a-a942-4cb36106d721','rider-C','driver-M',27.70
,'san_francisco'),
(1695046462179,'9909a8b1-2d15-4d3d-8ec9-efc48c536a00','rider-D','driver-L',33.90
,'san_francisco'),
(1695332066204,'1dced545-862b-4ceb-8b43-d2a568f6616b','rider-E','driver-O',93.50,'san_francisco'),
(1695516137016,'e3cf430c-889d-4015-bc98-59bdce1e530c','rider-F','driver-P',34.15,'sao_paulo'
),
(1695376420876,'7a84095f-737f-40bc-b62f-6b69664712d2','rider-G','driver-Q',43.40
,'sao_paulo' ),
(1695173887231,'3eeb61f7-c2b0-4636-99bd-5d7a5a1d2c04','rider-I','driver-S',41.06
,'chennai' ),
(1695115999911,'c8abbe79-8d89-47ea-b4ce-4d224bae5bfa','rider-J','driver-T',17.85,'chennai');
SELECT * FROM hudi_tbl;
call show_commits(table => 'hudi_tbl', limit => 10);
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
