try explain codegen on your DF and then pardee the string
On Fri, 7 Apr, 2023, 3:53 pm Chenghao Lyu, wrote:
> Hi,
>
> The detailed stage page shows the involved WholeStageCodegen Ids in its
> DAG visualization from the Spark UI when running a SparkSQL. (e.g., under
> the link
>
Hi,
The detailed stage page shows the involved WholeStageCodegen Ids in its DAG
visualization from the Spark UI when running a SparkSQL. (e.g., under the link
node:18088/history/application_1663600377480_62091/stages/stage/?id=1=0).
However, I have trouble extracting the WholeStageCodegen ids