aswathinj-pai opened a new issue, #30208:
URL: https://github.com/apache/superset/issues/30208
### Bug description
Hi ,
I deployed apache superset 4.0.1 in aws kubernetes cluster. A connection to
the Spark Thrift Server was successfully established through Spark SQL via the
Superset UI. The connection was confirmed to be working as expected. While
executing the SHOW TABLES query in SQL Lab, it successfully retrieved results.
However, when attempting to access the table schema section, an error occurred.
{
"message": "(pyhive.exc.OperationalError)
TExecuteStatementResp(status=TStatus(statusCode=3,
infoMessages=[\"*org.apache.hive.service.cli.HiveSQLException:Error running
query: org.apache.spark.sql.AnalysisException: Table or view not found:
srdm_edm_sit.srdm_edm_sit; line 1 pos 9;\\n'DescribeRelation false,
[col_name#4361, data_type#4362, comment#4363]\\n+- 'UnresolvedTableOrView
[srdm_edm_sit, srdm_edm_sit], DESCRIBE TABLE, true\\n:37:36\",
'org.apache.spark.sql.hive.thriftserver.HiveThriftServerErrors$:runningQueryError:HiveThriftServerErrors.scala:43',
'org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation:org$apache$spark$sql$hive$thriftserver$SparkExecuteStatementOperation$$execute:SparkExecuteStatementOperation.scala:325',
'org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation:runInternal:SparkExecuteStatementOperation.scala:216',
'org.apache.hive.service.cli.operation.Operation:run:Operation.java:277',
'org.apache.spark.sql.hive.thriftser
ver.SparkExecuteStatementOperation:org$apache$spark$sql$hive$thriftserver$SparkOperation$$super$run:SparkExecuteStatementOperation.scala:43',
'org.apache.spark.sql.hive.thriftserver.SparkOperation:$anonfun$run$1:SparkOperation.scala:45',
'scala.runtime.java8.JFunction0$mcV$sp:apply:JFunction0$mcV$sp.java:23',
'org.apache.spark.sql.hive.thriftserver.SparkOperation:withLocalProperties:SparkOperation.scala:79',
'org.apache.spark.sql.hive.thriftserver.SparkOperation:withLocalProperties$:SparkOperation.scala:63',
'org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation:withLocalProperties:SparkExecuteStatementOperation.scala:43',
'org.apache.spark.sql.hive.thriftserver.SparkOperation:run:SparkOperation.scala:45',
'org.apache.spark.sql.hive.thriftserver.SparkOperation:run$:SparkOperation.scala:43',
'org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation:run:SparkExecuteStatementOperation.scala:43',
'org.apache.hive.service.cli.session.HiveSessionImpl:executeSt
atementInternal:HiveSessionImpl.java:484',
'org.apache.hive.service.cli.session.HiveSessionImpl:executeStatement:HiveSessionImpl.java:460',
'sun.reflect.GeneratedMethodAccessor142:invoke::-1',
'sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43',
'java.lang.reflect.Method:invoke:Method.java:498',
'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:77',
'org.apache.hive.service.cli.session.HiveSessionProxy:access$000:HiveSessionProxy.java:35',
'org.apache.hive.service.cli.session.HiveSessionProxy$1:run:HiveSessionProxy.java:62',
'java.security.AccessController:doPrivileged:AccessController.java:-2',
'javax.security.auth.Subject:doAs:Subject.java:422',
'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1878',
'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:58',
'com.sun.proxy.$Proxy37:executeStatement::-1',
'org.apache.hive.service.cli.CLIService:executeStat
ement:CLIService.java:280',
'org.apache.hive.service.cli.thrift.ThriftCLIService:ExecuteStatement:ThriftCLIService.java:456',
'org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1557',
'org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1542',
'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:38',
'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39',
'org.apache.hive.service.auth.TSetIpAddressProcessor:process:TSetIpAddressProcessor.java:52',
'org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:310',
'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1149',
'java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:624',
'java.lang.Thread:run:Thread.java:750',
\"*org.apache.spark.sql.AnalysisException:Table or view not found:
srdm_edm_sit.srdm_edm_sit; line 1 pos 9;\\n'DescribeRelation
false, [col_name#4361, data_type#4362, comment#4363]\\n+-
'UnresolvedTableOrView [srdm_edm_sit, srdm_edm_sit], DESCRIBE TABLE,
true\\n:70:34\",
'org.apache.spark.sql.catalyst.analysis.package$AnalysisErrorAt:failAnalysis:package.scala:42',
'org.apache.spark.sql.catalyst.analysis.CheckAnalysis:$anonfun$checkAnalysis$1:CheckAnalysis.scala:123',
'org.apache.spark.sql.catalyst.analysis.CheckAnalysis:$anonfun$checkAnalysis$1$adapted:CheckAnalysis.scala:97',
'org.apache.spark.sql.catalyst.trees.TreeNode:foreachUp:TreeNode.scala:263',
'org.apache.spark.sql.catalyst.trees.TreeNode:$anonfun$foreachUp$1:TreeNode.scala:262',
'org.apache.spark.sql.catalyst.trees.TreeNode:$anonfun$foreachUp$1$adapted:TreeNode.scala:262',
'scala.collection.Iterator:foreach:Iterator.scala:943',
'scala.collection.Iterator:foreach$:Iterator.scala:943',
'scala.collection.AbstractIterator:foreach:Iterator.scala:1431',
'scala.collection.IterableLike:foreach:IterableLike.scala:74',
'scala.collection.IterableLike:foreach
$:IterableLike.scala:73',
'scala.collection.AbstractIterable:foreach:Iterable.scala:56',
'org.apache.spark.sql.catalyst.trees.TreeNode:foreachUp:TreeNode.scala:262',
'org.apache.spark.sql.catalyst.analysis.CheckAnalysis:checkAnalysis:CheckAnalysis.scala:97',
'org.apache.spark.sql.catalyst.analysis.CheckAnalysis:checkAnalysis$:CheckAnalysis.scala:92',
'org.apache.spark.sql.catalyst.analysis.Analyzer:checkAnalysis:Analyzer.scala:182',
'org.apache.spark.sql.catalyst.analysis.Analyzer:$anonfun$executeAndCheck$1:Analyzer.scala:205',
'org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$:markInAnalyzer:AnalysisHelper.scala:330',
'org.apache.spark.sql.catalyst.analysis.Analyzer:executeAndCheck:Analyzer.scala:202',
'org.apache.spark.sql.execution.QueryExecution:$anonfun$analyzed$1:QueryExecution.scala:75',
'org.apache.spark.sql.catalyst.QueryPlanningTracker:measurePhase:QueryPlanningTracker.scala:111',
'org.apache.spark.sql.execution.QueryExecution:$anonfun$executePhase$1:QueryExecuti
on.scala:183',
'org.apache.spark.sql.SparkSession:withActive:SparkSession.scala:775',
'org.apache.spark.sql.execution.QueryExecution:executePhase:QueryExecution.scala:183',
'org.apache.spark.sql.execution.QueryExecution:analyzed$lzycompute:QueryExecution.scala:75',
'org.apache.spark.sql.execution.QueryExecution:analyzed:QueryExecution.scala:73',
'org.apache.spark.sql.execution.QueryExecution:assertAnalyzed:QueryExecution.scala:65',
'org.apache.spark.sql.Dataset$:$anonfun$ofRows$2:Dataset.scala:98',
'org.apache.spark.sql.SparkSession:withActive:SparkSession.scala:775',
'org.apache.spark.sql.Dataset$:ofRows:Dataset.scala:96',
'org.apache.spark.sql.SparkSession:$anonfun$sql$1:SparkSession.scala:618',
'org.apache.spark.sql.SparkSession:withActive:SparkSession.scala:775',
'org.apache.spark.sql.SparkSession:sql:SparkSession.scala:613',
'org.apache.spark.sql.SQLContext:sql:SQLContext.scala:651',
'org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation:org$apache$spark$sql$hiv
e$thriftserver$SparkExecuteStatementOperation$$execute:SparkExecuteStatementOperation.scala:291'],
sqlState=None, errorCode=0, errorMessage=\"Error running query:
org.apache.spark.sql.AnalysisException: Table or view not found:
srdm_edm_sit.srdm_edm_sit; line 1 pos 9;\\n'DescribeRelation false,
[col_name#4361, data_type#4362, comment#4363]\\n+- 'UnresolvedTableOrView
[srdm_edm_sit, srdm_edm_sit], DESCRIBE TABLE, true\\n\"),
operationHandle=None)\n[SQL: DESCRIBE srdm_edm_sit.srdm_edm_sit]\n(Background
on this error at: https://sqlalche.me/e/14/e3q8)"
}
### How to reproduce the bug
1.Added a database connection to Spark Thrift. During the connection test,
it indicated that "the connection looks good."
2.In SQL Lab, executed the query SHOW TABLES in the srdm_edm_sit schema, and
the results were successfully retrieved.
3.However, when trying to select the schema and view the table schema(tables
are not listed in table schema section) from the left tab, an error was
displayed as mentioned above.
### Screenshots/recordings
_No response_
### Superset version
master / latest-dev
### Python version
3.9
### Node version
Not applicable
### Browser
Firefox
### Additional context
_No response_
### Checklist
- [X] I have searched Superset docs and Slack and didn't find a solution to
my problem.
- [ ] I have searched the GitHub issue tracker and didn't find a similar bug
report.
- [ ] I have checked Superset's logs for errors and if I found a relevant
Python stacktrace, I included it here as text in the "additional context"
section.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
