Spark 3.3.0 with Structure Streaming from Kafka Issue on commons-pools2

Hi all, I encountered one issue when reading from Kafka as stream and then sink into HDFS (using delta lake format). java.lang.NoSuchMethodError: org.apache.spark.sql.kafka010.consumer.InternalKafkaConsumerPool$PoolConfig.setMinEvictableIdleTime(Ljava/time/Duration;)V I looked into the details

Spark SQL Predict Pushdown for Hive Bucketed Table

Hi all, Anyone knows why Spark SQL is not using Hive buckets pruning when reading from bucketed Hive table? [SPARK-40206] Spark SQL Predict Pushdown for Hive Bucketed Table - ASF JIRA (apache.org) Details also provided at the end of mail.