markonik-db commented on code in PR #48624:
URL: https://github.com/apache/spark/pull/48624#discussion_r1815433217
##########
python/pyspark/sql/functions/builtin.py:
##########
@@ -20635,6 +20635,109 @@ def make_timestamp(
)
+@_try_remote_functions
+def try_make_timestamp(
+ years: "ColumnOrName",
+ months: "ColumnOrName",
+ days: "ColumnOrName",
+ hours: "ColumnOrName",
+ mins: "ColumnOrName",
+ secs: "ColumnOrName",
+ timezone: Optional["ColumnOrName"] = None,
+) -> Column:
+ """
+ ANSI compliant version of make_timestamp function.
+ Try to create timestamp from years, months, days, hours, mins, secs and
timezone fields.
+ The result data type is consistent with the value of configuration
`spark.sql.timestampType`.
+ The function returns NULL on invalid inputs.
+
+ .. versionadded:: 4.0.0
+
+ Parameters
+ ----------
+ years : :class:`~pyspark.sql.Column` or str
+ The year to represent, from 1 to 9999
+ months : :class:`~pyspark.sql.Column` or str
+ The month-of-year to represent, from 1 (January) to 12 (December)
+ days : :class:`~pyspark.sql.Column` or str
+ The day-of-month to represent, from 1 to 31
+ hours : :class:`~pyspark.sql.Column` or str
+ The hour-of-day to represent, from 0 to 23
+ mins : :class:`~pyspark.sql.Column` or str
+ The minute-of-hour to represent, from 0 to 59
+ secs : :class:`~pyspark.sql.Column` or str
+ The second-of-minute and its micro-fraction to represent, from 0 to 60.
+ The value can be either an integer like 13 , or a fraction like 13.123.
+ If the sec argument equals to 60, the seconds field is set
+ to 0 and 1 minute is added to the final timestamp.
+ timezone : :class:`~pyspark.sql.Column` or str, optional
+ The time zone identifier. For example, CET, UTC and etc.
+
+ Returns
+ -------
+ :class:`~pyspark.sql.Column`
+ A new column that contains a timestamp or NULL in case of an error.
+
+ Examples
+ --------
+
+ Example 1: Make timestamp from years, months, days, hours, mins and secs.
+
+ >>> import pyspark.sql.functions as sf
+ >>> spark.conf.set("spark.sql.session.timeZone", "America/Los_Angeles")
+ >>> df = spark.createDataFrame([[2014, 12, 28, 6, 30, 45.887, 'CET']],
+ ... ["year", "month", "day", "hour", "min", "sec", "timezone"])
+ >>> df.select(sf.try_make_timestamp(
+ ... df.year, df.month, df.day, df.hour, df.min, df.sec, df.timezone)
+ ... ).show(truncate=False)
+ +----------------------------------------------------------+
+ |try_make_timestamp(year, month, day, hour, min, sec, timezone)|
Review Comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
