[jira] [Commented] (SPARK-3614) Filter on minimum occurrences of a term in IDF

2014-09-22 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143898#comment-14143898 ] RJ Nowling commented on SPARK-3614: --- It could lead to over-fitting and thus mis-predicti

[jira] [Commented] (SPARK-3614) Filter on minimum occurrences of a term in IDF

2014-09-22 Thread Liquan Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143887#comment-14143887 ] Liquan Pei commented on SPARK-3614: --- To me, the less number of documents a term appears,

[jira] [Commented] (SPARK-3614) Filter on minimum occurrences of a term in IDF

2014-09-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143820#comment-14143820 ] Apache Spark commented on SPARK-3614: - User 'rnowling' has created a pull request for

[jira] [Commented] (SPARK-3614) Filter on minimum occurrences of a term in IDF

2014-09-21 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142860#comment-14142860 ] RJ Nowling commented on SPARK-3614: --- Thanks, Andrew! I'll do that. -- em rnowl...@g

[jira] [Commented] (SPARK-3614) Filter on minimum occurrences of a term in IDF

2014-09-21 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142827#comment-14142827 ] Andrew Ash commented on SPARK-3614: --- Great! I assigned this ticket to you RJ. Please tr

[jira] [Commented] (SPARK-3614) Filter on minimum occurrences of a term in IDF

2014-09-21 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142631#comment-14142631 ] RJ Nowling commented on SPARK-3614: --- I would like to work on this. > Filter on minimum