[
https://issues.apache.org/jira/browse/MAHOUT-962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13672562#comment-13672562
]
Hudson commented on MAHOUT-962:
-------------------------------
Integrated in Mahout-Quality #2030 (See
[https://builds.apache.org/job/Mahout-Quality/2030/])
MAHOUT-962 minDF and maxDFPercent filtering doesnt get applied when output
weight is tf in SpareVecorsFromSequenceFile (Dave Byrne) (Revision 1488725)
Result = SUCCESS
robinanil :
Files :
*
/mahout/trunk/core/src/main/java/org/apache/mahout/vectorizer/HighDFWordsPruner.java
*
/mahout/trunk/core/src/main/java/org/apache/mahout/vectorizer/SparseVectorsFromSequenceFiles.java
*
/mahout/trunk/core/src/main/java/org/apache/mahout/vectorizer/pruner/WordsPrunerReducer.java
> minDF and maxDFPercent filtering doesnt get applied when output weight is tf
> in SpareVecorsFromSequenceFile
> -----------------------------------------------------------------------------------------------------------
>
> Key: MAHOUT-962
> URL: https://issues.apache.org/jira/browse/MAHOUT-962
> Project: Mahout
> Issue Type: Bug
> Components: Clustering
> Affects Versions: 0.6, 0.7, 0.8
> Reporter: John Conwell
> Assignee: Robin Anil
> Priority: Minor
> Labels: patch
> Fix For: 0.8
>
> Attachments: mahout_962.patch
>
>
> This is similar to the same reasoning behind the fix for MAHOUT-957. The
> desired output is term frequency vectors, but I want terms filtered by their
> min and max DF values. This might be valid in LDA, where tf vectors is
> desired for input, but filtering out the maxDFPercent is also useful.
> Currently minDF and maxDFPercent are only used when calculating tfidf, and
> the original tv vectors are not updated to represent the term filtering.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira