[
https://issues.apache.org/jira/browse/SPARK-6211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352724#comment-14352724
]
Saisai Shao commented on SPARK-6211:
------------------------------------
Hi TD, sorry for a stupid question, for solution 2, since Python Kafka API
needs Kafka assembly jar to launch the application (Kafka assembly jar is not
in the default classpath), so for unit test, how can we add this assembly jar
into classpath beforehand?
> Test Python Kafka API using Python unit tests
> ---------------------------------------------
>
> Key: SPARK-6211
> URL: https://issues.apache.org/jira/browse/SPARK-6211
> Project: Spark
> Issue Type: Test
> Components: Streaming, Tests
> Reporter: Tathagata Das
> Assignee: Saisai Shao
> Priority: Critical
>
> This is tricky in python because the KafkaStreamSuiteBase (which has the
> functionality of creating embedded kafka clusters) is in the test package,
> which is not in the python path. To fix that, we have to ways.
> 1. Add test jar to classpath in python test. Thats kind of trickier.
> 2. Bring that into the src package (maybe renamed as KafkaTestUtils), and
> then wrap that in python to use it from python.
> If (2) does not add any extra test dependencies to the main Kafka pom, then 2
> should be simpler to do.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
