[
https://issues.apache.org/jira/browse/SPARK-28691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hong dongdong updated SPARK-28691:
----------------------------------
Description:
Now, DirectKafkaWordCount example is not support to visit kafka using kerberos
authentication. Add Java/Scala DirectKerberizedKafkaWordCount.
{code:java}
Example:
$ bin/run-example --files ${path}/kafka_jaas.conf \
--driver-java-options
"-Djava.security.auth.login.config=${path}/kafka_jaas.conf" \
--conf
"spark.executor.extraJavaOptions=-Djava.security.auth.login.config=./kafka_jaas.conf"
\
streaming.DirectKerberizedKafkaWordCount broker1-host:port,broker2-host:port
\
consumer-group topic1,topic2 true
{code}
was:
Now, DirectKafkaWordCount example is not support to visit kafka using kerberos
authentication. Add a parameter which target if kerberos is used.
{code:java}
Example:
kerberosOn: false(default)
$ bin/run-example streaming.DirectKafkaWordCount
broker1-host:port,broker2-host:port \
consumer-group topic1,topic2
kerberosOn: true
$ bin/run-example --files ${path}/kafka_jaas.conf \
--driver-java-options
"-Djava.security.auth.login.config=${path}/kafka_jaas.conf" \
--conf
"spark.executor.extraJavaOptions=-Djava.security.auth.login.config=./kafka_jaas.conf"
\
streaming.DirectKafkaWordCount broker1-host:port,broker2-host:port \
consumer-group topic1,topic2 true
{code}
> Add Java/Scala DirectKerberizedKafkaWordCount examples
> ------------------------------------------------------
>
> Key: SPARK-28691
> URL: https://issues.apache.org/jira/browse/SPARK-28691
> Project: Spark
> Issue Type: Improvement
> Components: DStreams, Examples
> Affects Versions: 3.0.0
> Reporter: hong dongdong
> Priority: Minor
>
> Now, DirectKafkaWordCount example is not support to visit kafka using
> kerberos authentication. Add Java/Scala DirectKerberizedKafkaWordCount.
>
> {code:java}
> Example:
> $ bin/run-example --files ${path}/kafka_jaas.conf \
> --driver-java-options
> "-Djava.security.auth.login.config=${path}/kafka_jaas.conf" \
> --conf
> "spark.executor.extraJavaOptions=-Djava.security.auth.login.config=./kafka_jaas.conf"
> \
> streaming.DirectKerberizedKafkaWordCount
> broker1-host:port,broker2-host:port \
> consumer-group topic1,topic2 true
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
