ggershinsky commented on pull request #32895: URL: https://github.com/apache/spark/pull/32895#issuecomment-879985147
> I believe you are the best person to do that in this PR. > > > If other community members get to test and verify PME via SQL interface, I think it would be a good future addition to this section. I should have mentioned that besides testing and documenting, this will require a substantial coding work on developing a KMS client class (for a selected KMS) and integrating it in Spark SQL. As I mentioned, Parquet doesn't contain client classes for any particular KMS, because there are too many of them, and because it's expensive to maintain these classes (basically impossible, given the Parquet release cycle). So having a SQL API sample has a high price, and a limited benefit - Spark runs with Parquet encryption in many deployments today, with the Scala API and various KMS systems. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
