I am trying to perform SQL queries on a table that I read from the Ignite
cache.

*I am repeatedly getting this error -> *
py4j.protocol.Py4JJavaError: An error occurred while calling o53.showString.
: java.lang.NoClassDefFoundError:
org/apache/spark/sql/catalyst/expressions/IfNull
        at
org.apache.ignite.spark.impl.optimization.SystemExpressions$.apply(SystemExpressions.scala:35)
        at
org.apache.ignite.spark.impl.optimization.package$.$anonfun$exprsAllowed$2(package.scala:100)
        at
org.apache.ignite.spark.impl.optimization.package$.$anonfun$exprsAllowed$2$adapted(package.scala:100)
        at
scala.collection.LinearSeqOptimized.exists(LinearSeqOptimized.scala:95)
        at
scala.collection.LinearSeqOptimized.exists$(LinearSeqOptimized.scala:92)
        at scala.collection.immutable.List.exists(List.scala:91)

*My code -> *
ignite_df = spark.read.format("ignite")\
    .option("config",configFile)\
    .option("table","ignite_table")\
    .load()

ignite_df.createOrReplaceTempView("ignite_table")

output = spark.sql("Select category_c from ignite_table where category_a =
1")
output.show()

Can someone please solve the same.
I have Spark version 3.3.2 and Ignite version 2.15.0


Regards
Arunima

Reply via email to