I am trying to perform SQL queries on a table that I read from the Ignite
cache.
*I am repeatedly getting this error -> *
py4j.protocol.Py4JJavaError: An error occurred while calling o53.showString.
: java.lang.NoClassDefFoundError:
org/apache/spark/sql/catalyst/expressions/IfNull
at
org.apache.ignite.spark.impl.optimization.SystemExpressions$.apply(SystemExpressions.scala:35)
at
org.apache.ignite.spark.impl.optimization.package$.$anonfun$exprsAllowed$2(package.scala:100)
at
org.apache.ignite.spark.impl.optimization.package$.$anonfun$exprsAllowed$2$adapted(package.scala:100)
at
scala.collection.LinearSeqOptimized.exists(LinearSeqOptimized.scala:95)
at
scala.collection.LinearSeqOptimized.exists$(LinearSeqOptimized.scala:92)
at scala.collection.immutable.List.exists(List.scala:91)
*My code -> *
ignite_df = spark.read.format("ignite")\
.option("config",configFile)\
.option("table","ignite_table")\
.load()
ignite_df.createOrReplaceTempView("ignite_table")
output = spark.sql("Select category_c from ignite_table where category_a =
1")
output.show()
Can someone please solve the same.
I have Spark version 3.3.2 and Ignite version 2.15.0
Regards
Arunima