markhoerth opened a new issue, #10697:
URL: https://github.com/apache/gravitino/issues/10697
When using the Gravitino Spark connector with an HMS (Hive Metastore)
catalog, SHOW TABLES correctly returns tables, but executing a query against
those tables fails with TABLE_OR_VIEW_NOT_FOUND.
Steps to reproduce:
spark-sql (public)> use hive_nyc.nyc_taxi;
Time taken: 0.189 seconds
spark-sql (nyc_taxi)> show tables;
yellow_trips
Time taken: 0.05 seconds, Fetched 1 row(s)
spark-sql (nyc_taxi)> SELECT * FROM hive_nyc.nyc_taxi.yellow_trips LIMIT 10;
26/04/07 04:57:16 WARN ObjectStore: Failed to get database nyc_taxi,
returning NoSuchObjectException
[TABLE_OR_VIEW_NOT_FOUND] The table or view
`hive_nyc`.`nyc_taxi`.`yellow_trips` cannot be found. Verify the spelling and
correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema()
output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF
EXISTS.; line 1 pos 14;
'GlobalLimit 10
+- 'LocalLimit 10
+- 'Project [*]
+- 'UnresolvedRelation [hive_nyc, nyc_taxi, yellow_trips], [], false
Observed: Table resolves in SHOW TABLES but not in query execution. The
error suggests Spark is falling back to its local Hive metastore rather than
routing through the Gravitino connector.
Note: JDBC/PostgreSQL catalogs work correctly with the same connector
configuration. Only HMS catalogs are affected.
Environment: Gravitino 1.2.0, Spark 3.5.5,
gravitino-spark-connector-runtime-3.5_2.12-1.2.0.jar
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
