Github user kellyzly commented on the pull request:
https://github.com/apache/spark/pull/5307#issuecomment-91146737
@vanzin :
> Left some initial comments. I like the idea of using a library for this,
my main concern is about the stability of that library (and who'll be
maintaining it going forward).
i have updated the code according to your valuable suggestions.
[Chimera](https://github.com/intel-hadoop/chimera) is a project which is
maintained by Intel team(My teammate dianfu is the contributor of it). Chimera
is a project which strips code related to the encryption and decryption part of
[Transparent Encryption in
HDFS](http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html)
from hadoop. Transparent Encryption is imported since hadoop 2.6 and the code
is stable after hadoop 2.6 release. Although the current version of Chimera is
0.0.1, it is same stable as current hadoop because we just strip code from
current trunk of hadoop. If someone reports new bugs to hadoop about the
encryption and decryption part later, my teammate will watch it and patch the
patches of those bugs to Chimera.
More information about encrypted shuffle you can reference
https://issues.apache.org/jira/browse/SPARK-5682. Any
suggestions/advices/guidance are welcome.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
