Hi Soumyadeep,
Both the configs are more or less the same. However, sql.adaptive.auto*
config is applicable (starting from version 3.2.0)
only in adaptive framework
As per the doc, default value for "
spark.sql.adaptive.autoBroadcastJoinThreshold" is same with "
spark.sql.autoBroadcastJoinThresh
Not sure if I understood the question correctly, but did you try using
`case when` ?
Thanks,
Bala
On Fri, Mar 25, 2022, 12:44 PM Sid wrote:
> Hi Team,
>
> I need help with the below problem:
>
>
> https://stackoverflow.com/questions/71613292/how-to-use-columns-in-if-else-condition-in-pyspark
>
