If it contains only SQL then you can use a function as below -
import subprocess
def run_sql(sql_file_path, your_db_name ,location):
subprocess.call(["spark-sql","-S","--hivevar","",,"--hivevar","LOCATION",location,"-f",sql_file_path])
In you have other pieces like spark code and not only sql
Hi All,
I have a python file which I am executing directly with spark-submit
command.
Inside the python file, I have sql written using hive context.I created a
generic variable for the database name inside sql
The problem is : How can I pass the value for this variable dynamically
just as we
