Hi, I'm trying to use spark SQL to define a temp table which can be destroyed automatically with the session. But when I using the SQL as below, I can't query any valid row, meanwhile, it works when I delete the word 'temp'. Is there anyone can tell me how to write the right SQL?
It doesn't work like this one. spark.sql("create temp view people (name string, age int) using csv options(sep=',',inferSchema='true',ignoreLeadingWhiteSpace='true') location 'src/main/resources/people.txt'") It works like this one, but it's not a temp table. spark.sql("create view people (name string, age int) using csv options(sep=',',inferSchema='true',ignoreLeadingWhiteSpace='true') location 'src/main/resources/people.txt'") As a repetition, I would like to use SQL to get the same result as 'dataset.createOrReplaceTempView(table name)'. Thank you. Best Regards