Github user ChengXiangLi commented on the pull request:
https://github.com/apache/flink/pull/888#issuecomment-118786914
I did a simple test on single node, here is the related information:
1 task manager, 1 slot, 1G RAM assigned, probe table 5G, build table 1G,
half of build table partitions get spilled to disk.
FOF: how many percent records been filtered out during probe phase?
FOF | without bloom filter(s) | with bloom filter(s)
------------- | ------------- | -------------------
90% | 210 | 147
50% | 214 | 187
0 | 236 | 252
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---