Re: UnspecifiedDistribution Error using AQE

2021-08-03 Thread Mich Talebzadeh
Hi, There have been reports of errors coming out when the following is set. spark.conf.set("spark.sql.adaptive.enabled", "true") Some reported in this forum. Please search the email list for => spark.sql.adaptive.enabled as you have not specified the nature of your query causing error with this

UnspecifiedDistribution Error using AQE

2021-08-03 Thread Jesse Lord
Hello spark users, I have an error that I would like to report as a spark 3.1.1 bug but I do not know how to create a reproducible example. I can provide a full stack trace if desired but the most useful information seems to be E py4j.protocol.Py4JJavaError: An error occurred