[ https://issues.apache.org/jira/browse/LUCENE-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500324#comment-14500324 ]
Nicholas Knize edited comment on LUCENE-6422 at 4/17/15 6:42 PM: ----------------------------------------------------------------- Updated to remove StreamingPrefixTreeStrategy. PackedQuadTree is now self contained to one file and uses the RecursivePrefixTreeStrategy but ignores leafyBranchPruning. Still only integrated and tested on branch_5x, per discussion above. was (Author: nknize): Updated to remove StreamingPrefixTreeStrategy. PackedQuadTree is now self contained to one file and uses the RecursivePrefixTreeStrategy but ignores leafyBranchPruning. Still only integrated and tested on branch_5x, per discussion below. > Add StreamingQuadPrefixTree > --------------------------- > > Key: LUCENE-6422 > URL: https://issues.apache.org/jira/browse/LUCENE-6422 > Project: Lucene - Core > Issue Type: Improvement > Components: modules/spatial > Affects Versions: 5.x > Reporter: Nicholas Knize > Attachments: LUCENE-6422.patch, LUCENE-6422.patch, > LUCENE-6422_with_SPT_factory_and_benchmark.patch > > > To conform to Lucene's inverted index, SpatialStrategies use strings to > represent QuadCells and GeoHash cells. Yielding 1 byte per QuadCell and 5 > bits per GeoHash cell, respectively. To create the terms representing a > Shape, the BytesRefIteratorTokenStream first builds all of the terms into an > ArrayList of Cells in memory, then passes the ArrayList.Iterator back to > invert() which creates a second lexicographically sorted array of Terms. This > doubles the memory consumption when indexing a shape. > This task introduces a PackedQuadPrefixTree that uses a StreamingStrategy to > accomplish the following: > 1. Create a packed 8byte representation for a QuadCell > 2. Build the Packed cells 'on demand' when incrementToken is called > Improvements over this approach include the generation of the packed cells > using an AutoPrefixAutomaton -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org