CHARLES HOGG created SPARK-39433:
------------------------------------
Summary: to_date function returns a null for the first week of the
year
Key: SPARK-39433
URL: https://issues.apache.org/jira/browse/SPARK-39433
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 3.1.2
Reporter: CHARLES HOGG
When I use week of year in the to_date function, the first week of the year
returns a null for many years.
```
df=pyrasa.sparkSession.createDataFrame([["2013-01"],["2013-02"],["2017-01"],["2018-01"]],["input"])
df.select(func.col("input"),func.to_date(func.col("input"),"yyyy-ww").alias("date"))
\
.show()
```
```
+-------+----------+
| input| date|
+-------+----------+
|2013-01| null|
|2013-02|2013-01-06|
|2017-01|2017-01-01|
|2018-01| null|
+-------+----------+
```
Why is this? Is it a bug in the to_date function?
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
