[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun updated SPARK-30668: ---------------------------------- Description: {code:java} SELECT to_timestamp("2020-01-27T20:06:11.847-0800", "yyyy-MM-dd'T'HH:mm:ss.SSSz") {code} This can return a valid value in Spark 2.4 but return NULL in the latest master **2.4.5 RC2** {code} scala> sql("""SELECT to_timestamp("2020-01-27T20:06:11.847-0800", "yyyy-MM-dd'T'HH:mm:ss.SSSz")""").show +----------------------------------------------------------------------------+ |to_timestamp('2020-01-27T20:06:11.847-0800', 'yyyy-MM-dd\'T\'HH:mm:ss.SSSz')| +----------------------------------------------------------------------------+ | 2020-01-27 20:06:11| +----------------------------------------------------------------------------+ {code} **2.3.4 ~ 2.4.4** {code} spark-sql> SELECT to_timestamp("2020-01-27T20:06:11.847-0800", "yyyy-MM-dd'T'HH:mm:ss.SSSz"); 2020-01-27 20:06:11 {code} was: {code:java} SELECT to_timestamp("2020-01-27T20:06:11.847-0800", "yyyy-MM-dd'T'HH:mm:ss.SSSz") {code} This can return a valid value in Spark 2.4 but return NULL in the latest master **2.4.5 RC2** {code} scala> sql("""SELECT to_timestamp("2020-01-27T20:06:11.847-0800", "yyyy-MM-dd'T'HH:mm:ss.SSSz")""").show +----------------------------------------------------------------------------+ |to_timestamp('2020-01-27T20:06:11.847-0800', 'yyyy-MM-dd\'T\'HH:mm:ss.SSSz')| +----------------------------------------------------------------------------+ | 2020-01-27 20:06:11| +----------------------------------------------------------------------------+ {code} **2.4.4** {code} spark-sql> SELECT to_timestamp("2020-01-27T20:06:11.847-0800", "yyyy-MM-dd'T'HH:mm:ss.SSSz"); 2020-01-27 20:06:11 {code} > to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern > "yyyy-MM-dd'T'HH:mm:ss.SSSz" > ---------------------------------------------------------------------------------------------------- > > Key: SPARK-30668 > URL: https://issues.apache.org/jira/browse/SPARK-30668 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.0.0 > Reporter: Xiao Li > Priority: Blocker > > {code:java} > SELECT to_timestamp("2020-01-27T20:06:11.847-0800", > "yyyy-MM-dd'T'HH:mm:ss.SSSz") > {code} > This can return a valid value in Spark 2.4 but return NULL in the latest > master > **2.4.5 RC2** > {code} > scala> sql("""SELECT to_timestamp("2020-01-27T20:06:11.847-0800", > "yyyy-MM-dd'T'HH:mm:ss.SSSz")""").show > +----------------------------------------------------------------------------+ > |to_timestamp('2020-01-27T20:06:11.847-0800', 'yyyy-MM-dd\'T\'HH:mm:ss.SSSz')| > +----------------------------------------------------------------------------+ > | 2020-01-27 20:06:11| > +----------------------------------------------------------------------------+ > {code} > **2.3.4 ~ 2.4.4** > {code} > spark-sql> SELECT to_timestamp("2020-01-27T20:06:11.847-0800", > "yyyy-MM-dd'T'HH:mm:ss.SSSz"); > 2020-01-27 20:06:11 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org