[ 
https://issues.apache.org/jira/browse/LUCENE-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717174#comment-14717174
 ] 

Michael McCandless commented on LUCENE-6759:
--------------------------------------------

bq. I can't handle it until I know what the rounding is doing.

That logic needs to "reverse" the quantizing done by Geo3DDVFormat.encodeValue, 
when passed a bounding box in quantized space, to translate it into a 
containing bbox in unquantized space.

The min/max (quantized) values are inclusive values, and a single value in 
quantized space (a pixel) is really a volume in unquantized space, so we have 
to move the boundaries of the bbox to the outer volume of the edges of the 
quantized bbox ...

I thought I did it correctly in what's committed but probably not :)

> Integrate lat/long BKD and spatial 3d, part 2
> ---------------------------------------------
>
>                 Key: LUCENE-6759
>                 URL: https://issues.apache.org/jira/browse/LUCENE-6759
>             Project: Lucene - Core
>          Issue Type: New Feature
>            Reporter: Michael McCandless
>         Attachments: LUCENE-6699.patch, LUCENE-6699.patch, LUCENE-6699.patch, 
> LUCENE-6699.patch, LUCENE-6699.patch, LUCENE-6699.patch, LUCENE-6699.patch
>
>
> This is just a continuation of LUCENE-6699, which became too big.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to