GitHub user jinchengchenghh added a comment to the discussion: [Performance]
Velox Bloom Filter Inefficiency vs. Photon at 1TB Scale
These configs should respect Spark config except `maxNumBits` since memory
issue. CC @zhouyuan
spark.gluten.sql.columnar.backend.velox.bloomFilter.maxNumBits
```
val RUNTIME_BLOOM_FILTER_MAX_NUM_BITS =
buildConf("spark.sql.optimizer.runtime.bloomFilter.maxNumBits")
.doc("The max number of bits to use for the runtime bloom filter")
.version("3.3.0")
.longConf
.createWithDefault(67108864L)
```
GitHub link:
https://github.com/apache/incubator-gluten/discussions/11554#discussioncomment-15690327
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
