hi guys, tried spark_sql_hook to run a multi-statement query (two queries separated by semi-column ) and it hangs forever. If i comment out the second query, it runs fine.
Anyone had the same issue? i do not see anything in the code preventing
more one statement.
sql = """
select * from .... ;
select * from .... ;
"""
spark = SparkSqlHook(sql, conn_id='spark_default', master='yarn',
num_executors=4)
spark.run_query()
Boris
