Youngkwang (YK) Lee created SPARK-49994:
-------------------------------------------
Summary: Integrating Open Policy Agent with Spark
Key: SPARK-49994
URL: https://issues.apache.org/jira/browse/SPARK-49994
Project: Spark
Issue Type: New Feature
Components: Connect, Spark Core
Affects Versions: 3.5.3
Reporter: Youngkwang (YK) Lee
Integrating [Open Policy Agent|https://www.openpolicyagent.org/] with Spark
will enable fine-grained access control, compliance, and security policies with
external data sources.
One way to do this is to leverage SparkSessionExtensions to add a check rule
against the spark logical plan prior to its execution. By accessing the logical
plan and extracting the user_id, we can determine the user, actions (read,
write, etc.), and resources. With this, we can construct and send an OPA http
request, allowing granular authorization.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
