I like this proposal. Since Kafka already provides delegation token mechanism, we can also leverage Spark's delegation token framework to add Kafka as a built-in support.
BTW I think there's no much difference in support structured streaming and DStream, maybe we can set both as goal. Thanks Saisai Gabor Somogyi <gabor.g.somo...@gmail.com> 于2018年9月27日周四 下午7:58写道： > Hi all, > > I am writing this e-mail in order to discuss the delegation token support > for kafka feature which is reported in SPARK-25501 > <https://issues.apache.org/jira/browse/SPARK-25501>. I've prepared a SPIP > <https://docs.google.com/document/d/1ouRayzaJf_N5VQtGhVq9FURXVmRpXzEEWYHob0ne3NY/edit?usp=sharing> > for > it. PR is on the way... > > Looking forward to hear your feedback. > > BR, > G > >
