[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-16 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334100#comment-15334100 ] yuhao yang commented on SPARK-15930: [~GayathriMurali] Adding the information value would be an

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-15 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332588#comment-15332588 ] Gayathri Murali commented on SPARK-15930: - [~yuhaoyan] If you havent already started working on

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332559#comment-15332559 ] Joseph K. Bradley commented on SPARK-15930: --- This seems like a reasonable field to add to

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread John Aherne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329564#comment-15329564 ] John Aherne commented on SPARK-15930: - Oh.. Sorry, you are correct, I had my statistical terms mixed

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329558#comment-15329558 ] Sean Owen commented on SPARK-15930: --- Confidence just needs the support of two item sets, not the size

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread John Aherne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329559#comment-15329559 ] John Aherne commented on SPARK-15930: - I don't necessarily know the site of the dataset being

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread John Aherne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329548#comment-15329548 ] John Aherne commented on SPARK-15930: - Exactly. The number of rows in the training dataset is used to

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329087#comment-15329087 ] Sean Owen commented on SPARK-15930: --- Yes, you already have that information, but I can see wanting that

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329074#comment-15329074 ] Jeff Zhang commented on SPARK-15930: I see, I guess you are trying to get the total number of

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329072#comment-15329072 ] yuhao yang commented on SPARK-15930: We need the size of input dataset to calculate relative

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329063#comment-15329063 ] Sean Owen commented on SPARK-15930: --- The sum of all frequencies from freqItemSets is not the total size

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329059#comment-15329059 ] Jeff Zhang commented on SPARK-15930: Don't we can get the count from freqItemsets in FPGrowthModel ?

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329025#comment-15329025 ] Sean Owen commented on SPARK-15930: --- What's the use case for this? the FP growth output is logically

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-13 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328802#comment-15328802 ] yuhao yang commented on SPARK-15930: That looks reasonable. +1. [~John Aherne] I would wait for one

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-13 Thread John Aherne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328786#comment-15328786 ] John Aherne commented on SPARK-15930: - In your example, the row count would be 4. > Add Row count

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-13 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328759#comment-15328759 ] yuhao yang commented on SPARK-15930: || items|| freq|| |[27]|5| |