GitHub user hhbyyh opened a pull request:
https://github.com/apache/spark/pull/17280
[SPARK-19939] [ML] Add support for association rules in ML
## What changes were proposed in this pull request?
jira: https://issues.apache.org/jira/browse/SPARK-19939
Adding another essential characteristic for the Association Rule in Spark
ml.fpm.
Support is an indication of how frequently the itemset of an association
rule appears in the database and suggests if the rules are generally applicable
to the dateset. refer to
[https://en.wikipedia.org/wiki/Association_rule_learning] for more details.
Before adding support:
rules | confidence
---------|----------------
beer -> soda | 0.5
pecan -> milk | 0.6
After adding support:
rules | confidence | support
-------------------|----------------|-----------
beer -> soda | 0.5 | 0.3
pecan -> milk | 0.6 | 0.01
Thus to allow a better understanding for the generated association rules.
This is a new feature and was not included in the original function parity PR.
## How was this patch tested?
existing and new unit test
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/hhbyyh/spark arSupport
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/17280.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #17280
----
commit f86c5122eadd9b0a595b776d77d6cdf23ad6731a
Author: Yuhao Yang <[email protected]>
Date: 2017-03-11T01:18:21Z
half
commit bb8ed118619ae93badca06dc346304adce3fa4b7
Author: Yuhao Yang <[email protected]>
Date: 2017-03-11T01:45:33Z
Merge remote-tracking branch 'upstream/master' into arSupport
commit a0ad6628766a5bc556777629fddfc3c61d02d57a
Author: Yuhao Yang <[email protected]>
Date: 2017-03-11T19:01:15Z
Merge remote-tracking branch 'upstream/master' into arSupport
commit 9580aa910523144aba8e4f5a3d9693fe4387f16f
Author: Yuhao Yang <[email protected]>
Date: 2017-03-12T17:50:30Z
add support to association rules
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
