[ 
https://issues.apache.org/jira/browse/LUCENE-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12859817#action_12859817
 ] 

Michael McCandless commented on LUCENE-2393:
--------------------------------------------

Thanks for the updated patch Tom... feedback:

  * Maybe do away with the "hack to allow tokens with whitespace"?
    One should use quotes with their shell for this?  (And eg the hack
    doens't work with tokens that have 2 spaces).

  * Can you rename things like total_tf --> totalTF (consistent w/
    Lucene's standard code style)

  * Maybe rename TermInfoWithTotalTF -> TermStats?  (It also has
    .docFreq)

  * Maybe rename TermInfoWithTotalTF.termFreq -> .totalTermFreq?

  * Maybe rename .getTermFreqOrdered -> .sortByTotalTermFreq?

  * You don't really need a priority queue to for the
    getTermFreqOrdered case?  Ie, instead, just fill in the
    .totalTermFreq and then do a normal sort (make a
    Comparator<TermStats> that sorts by the .totalTermFreq)


> Utility to output total term frequency and df from a lucene index
> -----------------------------------------------------------------
>
>                 Key: LUCENE-2393
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2393
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: contrib/*
>            Reporter: Tom Burton-West
>            Priority: Trivial
>         Attachments: LUCENE-2393.patch, LUCENE-2393.patch, LUCENE-2393.patch, 
> LUCENE-2393.patch
>
>
> This is a command line utility that takes a field name, term, and index 
> directory and outputs the document frequency for the term and the total 
> number of occurrences of the term in the index (i.e. the sum of the tf of the 
> term for each document).  It is useful for estimating the size of the term's 
> entry in the *prx files and consequent Disk I/O demands

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to