[ 
https://issues.apache.org/jira/browse/MAHOUT-962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13672562#comment-13672562
 ] 

Hudson commented on MAHOUT-962:
-------------------------------

Integrated in Mahout-Quality #2030 (See 
[https://builds.apache.org/job/Mahout-Quality/2030/])
    MAHOUT-962 minDF and maxDFPercent filtering doesnt get applied when output 
weight is tf in SpareVecorsFromSequenceFile (Dave Byrne) (Revision 1488725)

     Result = SUCCESS
robinanil : 
Files : 
* 
/mahout/trunk/core/src/main/java/org/apache/mahout/vectorizer/HighDFWordsPruner.java
* 
/mahout/trunk/core/src/main/java/org/apache/mahout/vectorizer/SparseVectorsFromSequenceFiles.java
* 
/mahout/trunk/core/src/main/java/org/apache/mahout/vectorizer/pruner/WordsPrunerReducer.java

                
> minDF and maxDFPercent filtering doesnt get applied when output weight is tf 
> in SpareVecorsFromSequenceFile
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: MAHOUT-962
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-962
>             Project: Mahout
>          Issue Type: Bug
>          Components: Clustering
>    Affects Versions: 0.6, 0.7, 0.8
>            Reporter: John Conwell
>            Assignee: Robin Anil
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.8
>
>         Attachments: mahout_962.patch
>
>
> This is similar to the same reasoning behind the fix for MAHOUT-957.  The 
> desired output is term frequency vectors, but I want terms filtered by their 
> min and max DF values. This might be valid in LDA, where tf vectors is 
> desired for input, but filtering out the maxDFPercent is also useful.
> Currently minDF and maxDFPercent are only used when calculating tfidf, and 
> the original tv vectors are not updated to represent the term filtering.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to