Re: Encryption at lucene index

2017-08-11 Thread Kumaran Ramasubramanian
I got it Erick.. Thank you.. - ​Kumaran R ​ On Fri, Aug 11, 2017 at 10:35 PM, Erick Erickson wrote: > Encrypting the _tokens_ inevitably leads to reduced capabilities BTW. > Trivial example: > I have these tokens in my index > run > runner > running > runs > > Any non-trivial encryption algorit

Re: Encryption at lucene index

2017-08-11 Thread Erick Erickson
Encrypting the _tokens_ inevitably leads to reduced capabilities BTW. Trivial example: I have these tokens in my index run runner running runs Any non-trivial encryption algorithm will not encrypt the first three letters "run" identically in all three so searching for run* simply won't work. As y

Re: Encryption at lucene index

2017-08-10 Thread Kumaran Ramasubramanian
Hi Ishan, thank you :-) - ​- Kumaran R ​ On Mon, Aug 7, 2017 at 10:53 PM, Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > Harry Ochiai (Hitachi) has some index encryption solution, > https://www.slideshare.net/maggon/securing-solr-search-data-in-the-cloud > I think it is proprietary,

Re: Encryption at lucene index

2017-08-07 Thread Ishan Chattopadhyaya
Harry Ochiai (Hitachi) has some index encryption solution, https://www.slideshare.net/maggon/securing-solr-search-data-in-the-cloud I think it is proprietary, but I'm not sure. Maybe more googling might help find the exact page where his solution is described. On Mon, Aug 7, 2017 at 9:59 PM, Kumar

Re: Encryption at lucene index

2017-08-07 Thread Kumaran Ramasubramanian
Hi Erick, i want to encrypt some fields of an document which has personal identifiable information ( both indexed and stored data)... for eg: email, mobilenumber etc.. i am able to find LUCENE-6966 alone while googling it.. any related pointers in solr or latest lucene version? - ​- Kumaran R​ O

Re: Encryption at lucene index

2017-08-07 Thread Erick Erickson
No, since you haven't defined what you want to encrypt, what your requirements are, what you hope to get out of "encryption" etc. Put the index on an encrypting filesystem and forget about it if you possibly can, because anything else is a significant amount of work. To encrypt the searchable toke

Re: Encryption at lucene index

2017-08-07 Thread Kumaran Ramasubramanian
Hi Erick, Thanks for the information. Any pointers about encryption options in solr? -- Kumaran R On Mon, Aug 7, 2017 at 9:17 PM, Erick Erickson wrote: > Encryption in Solr has a bunch of ramifications. Do you care about > > - encryption at rest or in memory? > - encrypting the _searcha

Re: Encryption at lucene index

2017-08-07 Thread Erick Erickson
Encryption in Solr has a bunch of ramifications. Do you care about - encryption at rest or in memory? - encrypting the _searchable_ tokens? - encrypting the searchable tokens per-user? - encrypting the stored data (which a filter won't do BTW). It's actually a fairly complex topic the discussion