Re: Issue while creating Hive table from Kafka topic

2021-09-13 Thread Harshvardhan Shinde
Hi, I checked for the dependency using the stackoverflow link you sent, the ByteArrayDeserializer class is present in my jar but when I try to run it, I'm getting the same error message. I also removed the kafka and kafka-client dependencies from my pom.xml file and added the jar from the link you

Re: Issue while creating Hive table from Kafka topic

2021-09-10 Thread Timo Walther
It seems that your Kafka clients dependency is not in your JAR file. ByteArrayDeserializer is a symptom that seems to occur often. At least, I can find a similar question on Stackoverflow:

Re: Issue while creating Hive table from Kafka topic

2021-09-10 Thread Harshvardhan Shinde
I'm unable to figure out which dependency to add in order for the ByteArrayDeserializer class to get included in the jar. I have added all the dependencies as per the documentation still unable to figure out the cause. On Fri, Sep 10, 2021 at 12:17 AM Robert Metzger wrote: > Does the jar file

Re: Issue while creating Hive table from Kafka topic

2021-09-09 Thread Robert Metzger
Does the jar file you are trying to submit contain the org/apache/kafka/common/serialization/ByteArrayDeserializer class? On Thu, Sep 9, 2021 at 2:10 PM Harshvardhan Shinde < harshvardhan.shi...@oyorooms.com> wrote: > Here's the complete stack trace: > > Server

Re: Issue while creating Hive table from Kafka topic

2021-09-09 Thread Harshvardhan Shinde
Here's the complete stack trace: Server Response:org.apache.flink.runtime.rest.handler.RestHandlerException: Could not execute application. at org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$1(JarRunHandler.java:108) at

Re: Issue while creating Hive table from Kafka topic

2021-09-09 Thread Robert Metzger
Can you share the full stack trace, not just a part of it? On Thu, Sep 9, 2021 at 1:43 PM Harshvardhan Shinde < harshvardhan.shi...@oyorooms.com> wrote: > Hi, > > I added the dependencies while trying to resolve the same issue, thought I > was missing them. > > Thanks > > On Thu, Sep 9, 2021 at

Re: Issue while creating Hive table from Kafka topic

2021-09-09 Thread Harshvardhan Shinde
Hi, I added the dependencies while trying to resolve the same issue, thought I was missing them. Thanks On Thu, Sep 9, 2021 at 4:26 PM Robert Metzger wrote: > Hey, > > Why do you have these dependencies in your pom? > > > > org.apache.kafka >

Re: Issue while creating Hive table from Kafka topic

2021-09-09 Thread Robert Metzger
Hey, Why do you have these dependencies in your pom? org.apache.kafka kafka-clients 2.8.0 org.apache.kafka kafka_2.12 2.8.0 They are not needed for using the Kafka connector of

Issue while creating Hive table from Kafka topic

2021-09-09 Thread Harshvardhan Shinde
Hi, I'm trying a simple flink job that reads data from a kafka topic and creates a Hive table. I'm following the steps from here . Here's my code: import