Depending on the model of security, you may have some challenges with the
Ranger integration with your cloud storage especially if you are thinking
of using TDE for the encryption at rest. Otherwise, using Metron in that
way should be quite feasible. However, you may face some performance issues
Thanks Carolyn.
Is there any defined reference architecture to refer to?
Thanks
Deepak
On Mon, Oct 22, 2018 at 8:23 PM Carolyn Duby wrote:
>
> Hive 3.0 works well with block stores. You can either add it to your
> Metron cluster or spin up an ephemeral cluster with Cloudbreak:
>
> 1. Metron
Hive 3.0 works well with block stores. You can either add it to your Metron
cluster or spin up an ephemeral cluster with Cloudbreak:
1. Metron streams into HDFS in JSON.
2. Compact daily with Spark into ORC format and store in block store (S3, ADLS,
etc).
3. Query ORC in block store using
