Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/19134
Yes, Python kafka.py itself is OK to leave without calling it, but the UT
will involve Scala Kafka module to do the test.
Currently I don't know how to address this issue. Ideally it would be
better to put Python Kafka related codes to this python module, and only load
in when specifically opt-in. But I'm not sure how to achieve this.
Another option is to remove this python Kafka code. Previously we stopped
supporting Python Spark Streaming work
(https://github.com/apache/spark/pull/14340#issuecomment-235457517), so it
might be OK to remove it.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
