LuciferYang opened a new issue, #13330: URL: https://github.com/apache/gluten/issues/13330
With `spark.gluten.sql.columnar.backend.velox.driverSideBroadcastHashTableBuild=true`, the driver-side hash table build fails when a join key reaches the build side under a generated alias, for example the json_tuple LATERAL VIEW query added in #12407. The native build reports `Field not found: key#329. Available fields are: p_partkey#197, _post_11#329`. `VeloxSparkPlanExecApi` catches the error, logs "Failed to build hash table on driver ... falling back to executor-side build", and each executor builds the table instead. Results are correct, but the driver-side build never takes effect for such joins. #12407 fixed this for the executor-side `buildHashTable` in `ColumnarBuildSideRelation` and `UnsafeColumnarBuildSideRelation` by mapping each join key to the build output attribute with the same exprId. `buildHashTableWithRuntime`, which does the driver-side build, still passes the unmapped name. This issue was written with the assistance of AI (Claude Opus). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
