[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789187#comment-16789187 ] Dale Richardson commented on SOLR-6741: --- Yes, still working on it. Put in a PR for https://issues.apache.org/jira/browse/SOLR-13260 first because of the amount of supporting framework in it. > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey >Priority: Major > Labels: gsoc2019, mentor > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788318#comment-16788318 ] David Smiley commented on SOLR-6741: Any progress on this Dale? If you've given up but made partial progress, you can share your progress. I was thinking this would be a nice GSOC project (along with some related issues), so I labelled it as such. > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey >Priority: Major > Labels: gsoc2019, mentor > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760491#comment-16760491 ] David Smiley commented on SOLR-6741: Thanks for volunteering Dale! Don't worry about the ability to assign yourself; it's only possible for committers and certain "contributors". It's enough to just declare you're going to work on it. > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey >Priority: Major > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759743#comment-16759743 ] Dale Richardson commented on SOLR-6741: --- Could somebody please assign this to me - I do not appear to have the relevant access to do so. > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey >Priority: Major > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364362#comment-16364362 ] Erick Erickson commented on SOLR-6741: -- OK, I'm not going to get to this, so un-assigning. > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey >Assignee: Erick Erickson >Priority: Major > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[
https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15308500#comment-15308500
]
Erick Erickson commented on SOLR-6741:
--
Again assigned it to myself but if someone else wants to pick this up, please
feel free.
I have no idea how this plays with LUCENE-7043 at all, but it _really_ looks
like it should use the InetAddressPoint. I have no idea when I'll be able to
even take a look. This JIRA though has a bunch of tests that we should respect
and possibly expand to IPV6 as well.
I've had an offline conversation that claims that the current patch should have
this change:
protected static boolean isCidrPrefixInteger(String str) {
return str.matches("^(3[0-2]|[1-2][0-9]|[1-9])$");
}
Not putting it in the patch pending review of the patch itself to see how it
would all fit.
> IPv6 Field Type
> ---
>
> Key: SOLR-6741
> URL: https://issues.apache.org/jira/browse/SOLR-6741
> Project: Solr
> Issue Type: Improvement
>Reporter: Lloyd Ramey
>Assignee: Erick Erickson
> Attachments: SOLR-6741.patch
>
>
> It would be nice if Solr had a field type which could be used to index IPv6
> data and supported efficient range queries.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186465#comment-15186465 ] David Smiley commented on SOLR-6741: Not on the Solr end, but IMO it's just as well since only weeks ago did LUCENE-7043 InetAddressPoint ged added to Lucene. > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186461#comment-15186461 ] Erick Erickson commented on SOLR-6741: -- Bah: Then I just looked and LUCENE-5879 is already committed so I don't think committing an IPV4-only type is a good idea. So I'll un-assign it to myself as I won't have time to enhance this patch to work on both any time soon. It would still be a good thing for IPV4 to be more efficient space-wise than IPV6, possibly based on a hint in the schema. That said, I have no clue whether LUCENE-5879 already "does the right thing" here. The unit tests in this patch are pretty cool IIRC, so if anything is done with this it'd be a good idea to use them as a base for IPV6-specific tests. > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey >Assignee: Erick Erickson > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186454#comment-15186454 ] Erick Erickson commented on SOLR-6741: -- I've assigned this to myself, but I'm not entirely sure when I'll be able to work on it so if anyone's interested it won't hurt my feelings if they take it over. Going to dust this off and commit it if it works, as I remember it's got some pretty good unit tests & etc. I don't think waiting for IPV6 (and biginteger) support is necessary, we can fold this into IPV6 support whenever IPV6 gets under way. > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey >Assignee: Erick Erickson > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186415#comment-15186415 ] Steve Davids commented on SOLR-6741: Any updates on this ticket regarding rolling with IPv4 support with IPv6 being added later? > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955994#comment-14955994 ] Erick Erickson commented on SOLR-6741: -- Happens that I have a flight tomorrow, I may be able to give it a preliminary look-see. > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955952#comment-14955952 ] Erick Erickson commented on SOLR-6741: -- I'm want to float the notion that we'll need to specialized IPv4 support until there are _no_ IPv4-only IP addresses people want to index. In very large volume situations (think log files), requiring that a field support IPv6 when you _know_ that IPv4 is all you're interested in seems wasteful to require IPv6 capabilities space-wise as well as making queries more complex and consuming unnecessary memory. Even if there's a 128 bit native type. We could, in future if/when IPv6 support is added allow a hint in the schema file to use this code in future, something like: where ipv4only defaults to "false". If that is desirable, I'd argue that this patch is not wasted effort and is in fact a building block for IPv6 support. Straw-man proposal: 1> break this out into a separate JIRA, having an IPv4 patch under an IPv6 header is...odd 2> Change the class names and field type to reference IPv4 3> Fix it up for trunk and commit. What do people think? > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955964#comment-14955964 ] Yonik Seeley commented on SOLR-6741: +1, if we can get ipv4 working today, no reason not to do so. > IPv6 Field Type > --- > > Key: SOLR-6741 > URL: https://issues.apache.org/jira/browse/SOLR-6741 > Project: Solr > Issue Type: Improvement >Reporter: Lloyd Ramey > Attachments: SOLR-6741.patch > > > It would be nice if Solr had a field type which could be used to index IPv6 > data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513017#comment-14513017 ] David Smiley commented on SOLR-6741: This should definitely use Lucene's new experimental auto prefix terms; Hoss mentioned that. This is *not* blocked by LUCENE-5596. We'd need a new Solr field type with the sugar like in the IPv4 patch here but that which does a range between 2 terms. That will functionally work even without auto prefix terms. Then configure the codec appropriately and then the search will be much faster (and indexing a bit slower too of course). FWIW Lucene spatial's NumberRangePrefixTreeStrategy could work, but it needs a subclass of NumberRangePrefixTree and presently the only one that exists is DateRangePrefixTree. _If_ you need to index IPv6 ranges, then this _should_ be faster than intersecting 2 range queries on a start and end field. IPv6 Field Type --- Key: SOLR-6741 URL: https://issues.apache.org/jira/browse/SOLR-6741 Project: Solr Issue Type: Improvement Reporter: Lloyd Ramey Attachments: SOLR-6741.patch It would be nice if Solr had a field type which could be used to index IPv6 data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[ https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500868#comment-14500868 ] Shawn Heisey commented on SOLR-6741: Something related, but not exactly the same, that would be really awesome - support for general 128 bit numbers. That type could be used as a building-block for an IPv6 type. This would allow more efficient encoding of UUIDs for indexes with billions of documents, among other things. IPv6 Field Type --- Key: SOLR-6741 URL: https://issues.apache.org/jira/browse/SOLR-6741 Project: Solr Issue Type: Improvement Reporter: Lloyd Ramey Attachments: SOLR-6741.patch It would be nice if Solr had a field type which could be used to index IPv6 data and supported efficient range queries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-6741) IPv6 Field Type
[
https://issues.apache.org/jira/browse/SOLR-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14230695#comment-14230695
]
Hoss Man commented on SOLR-6741:
bq. It would be nice if Solr had a field type which could be used to index IPv6
data and supported efficient range queries.
better still would be a field type that understood how to parse index both
IPv4 and IPv6 and could likewise handle range prefix (ie:
{{ip:169.229.136.*}}) queries of both.
but i think doing the IPv6 part (correctly) is kind of blocked by LUCENE-5596
and/or LUCENE-5879.
We could do something IPv4 specific in the meantime by wrapping TrieLongField
-- but personally i'd rather have one single well done IPField class that
deals with bytes under the hood and handles IPv4 string parsing as a slightly
special case - storing them internally as IPv6 mapped addrs...
https://en.wikipedia.org/wiki/IPv6#IPv4-mapped_IPv6_addresses
IPv6 Field Type
---
Key: SOLR-6741
URL: https://issues.apache.org/jira/browse/SOLR-6741
Project: Solr
Issue Type: Improvement
Reporter: Lloyd Ramey
It would be nice if Solr had a field type which could be used to index IPv6
data and supported efficient range queries.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
