Hi Everyone, I was wondering if we could make any enhancements to the FP-Growth algorithm in spark/pyspark.
Many times I am looking for a rule for a particular consequent, so I don't need the rules for all the other consequents. I know I can filter the rules to get the desired output, but if I could input this in the algorithm itself, the execution time would reduce drastically. Also, sometimes I want the rules to be small, maybe of length 5-6. Again, I can filter on length but I was wondering if we could take this as input into the algo. Given the Depth first nature of FP-Growth, I am not sure that is feasible. I am willing to work on these suggestions, if someone thinks they are feasible. Thanks to the dev team for all the hard work! Regards, Aditya Addepalli