Which version of Spark are you using? And can you give us the full stack
trace of the exception?
On Tue, Mar 6, 2018 at 1:53 AM, Junfeng Chen <darou...@gmail.com> wrote:
> I am trying to read kafka and save the data as parquet file on hdfs
> according to this https://stackoverflow.com/questions/45827664/read-from
> The code is similar to :
> val df = spark
> .option("kafka.bootstrap.servers", "host1:port1,host2:port2")
> .option("subscribe", "topic1")
> while I am writing in Java.
> However, I keep throwing the following warning:
> CachedKafkaConsumer: CachedKafkaConsumer is not running in
> UninterruptibleThread. It may hang when CachedKafkaConsumer's method are
> interrupted because of KAFKA-1894.
> How to solve it? Thanks!
> Junfeng Chen