Github user maropu commented on the issue:
https://github.com/apache/spark/pull/20345
When trying to add the end-to-end test, I got stuck in a trouble; IIUC we
cannot enable `StarSchemaDetection.reorderStarJoins` now? That's because we
[need to turn off CBO to enable
it](https://github.com/apache/spark/pull/20345/files#diff-17d31b198ff391188311550fcabd1198R107)
but `StarSchemaDetection` internally references `LogicalPlan.stats.rowCount`
stat. [`LogicalPlan` does not compute the `rowCount` stat if CBO
disabled](https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala#L44).
If my understanding is correct, we might need to use a different config to
enable plan stats like:
https://github.com/apache/spark/pull/20345/commits/246edcd194ef3d2a3d40737a39e2a411af5c6c02#diff-fa1d044f9cfe587e27866393fe18fd46R325
Anyone can check this? @gatorsmile @maryannxue
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
