[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Huaxin Gao resolved SPARK-39417. -------------------------------- Fix Version/s: 3.3.0 3.4.0 Resolution: Fixed > Handle Null partition values in PartitioningUtils > ------------------------------------------------- > > Key: SPARK-39417 > URL: https://issues.apache.org/jira/browse/SPARK-39417 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.3.0 > Reporter: Prashant Singh > Assignee: Prashant Singh > Priority: Major > Fix For: 3.3.0, 3.4.0 > > > partitions with null values we get a NPE on partition discovery, earlier we > use to get `DEFAULT_PARTITION_NAME` > > {quote} [info] java.lang.NullPointerException: > [info] at > org.apache.spark.sql.execution.datasources.PartitioningUtils$.removeLeadingZerosFromNumberTypePartition(PartitioningUtils.scala:362) > [info] at > org.apache.spark.sql.execution.datasources.PartitioningUtils$.$anonfun$getPathFragment$1(PartitioningUtils.scala:355) > [info] at > scala.collection.TraversableLike.$anonfun$map$1(TraversableLike.scala:286) > [info] at scala.collection.Iterator.foreach(Iterator.scala:943) > [info] at scala.collection.Iterator.foreach$(Iterator.scala:943){quote} -- This message was sent by Atlassian Jira (v8.20.7#820007) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org