Edward Zhang created EAGLE-54:
---------------------------------
Summary: Encoding match between Kafka serialization and Eagle
deserialization
Key: EAGLE-54
URL: https://issues.apache.org/jira/browse/EAGLE-54
Project: Eagle
Issue Type: Improvement
Reporter: Edward Zhang
Priority: Minor
For various audit logs, Kafka serializes log with String type into bytes, and
Eagle deserializes bytes into String. Kafka supports to configure serialization
class by specifying kafka.serializer.StringEncoder and encoding type. But Eagle
lack the mechanism to deserialize with configuration of encoding, today it does
not have issue as it by default uses UTF-8 both. But it is more graceful for
Eagle to expose encoding configuration to be aligned with Kafka.
https://github.com/apache/kafka/blob/b62f8ea43b6d5307f7274fbe8b7984dd5ee22239/core/src/main/scala/kafka/serializer/Encoder.scala
https://github.com/apache/incubator-eagle/blob/bf35ede03a55df9c851669e16c59049f696e0b6d/eagle-security/eagle-security-hdfs-auditlog/src/main/java/org/apache/eagle/security/auditlog/HdfsAuditLogKafkaDeserializer.java
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)