HyukjinKwon commented on code in PR #36647:
URL: https://github.com/apache/spark/pull/36647#discussion_r881325104
##########
python/docs/source/reference/pyspark.sql/functions.rst:
##########
@@ -99,174 +119,225 @@ Functions
dayofmonth
dayofweek
dayofyear
- days
- decode
- degrees
- dense_rank
- desc
- desc_nulls_first
- desc_nulls_last
+ second
+ weekofyear
+ year
+ quarter
+ month
+ last_day
+ minute
+ months_between
+ next_day
+ hour
+ make_date
+ from_unixtime
+ unix_timestamp
+ to_timestamp
+ to_date
+ trunc
+ from_utc_timestamp
+ to_utc_timestamp
+ window
+ session_window
+ timestamp_seconds
+
+
+Collection Functions
+--------------------
+.. autosummary::
+ :toctree: api/
+
+ array_contains
+ arrays_overlap
+ slice
+ array_join
+ concat
+ array_position
element_at
- encode
+ array_sort
+ array_remove
+ array_distinct
+ array_intersect
+ array_union
+ array_except
+ transform
exists
- exp
+ forall
+ filter
+ aggregate
+ zip_with
+ transform_keys
+ transform_values
+ map_filter
+ map_zip_with
explode
explode_outer
- expm1
- expr
- factorial
- filter
- first
+ posexplode
+ posexplode_outer
+ get_json_object
+ json_tuple
+ from_json
+ schema_of_json
+ to_json
+ size
+ sort_array
+ array_max
+ array_min
+ shuffle
+ reverse
flatten
- floor
- forall
- format_number
- format_string
+ sequence
+ array_repeat
+ map_keys
+ map_values
+ map_entries
+ map_from_entries
+ arrays_zip
+ map_concat
from_csv
- from_json
- from_unixtime
- from_utc_timestamp
- get_json_object
- greatest
+ schema_of_csv
+ to_csv
+
+
+Partition Transformation Functions
+----------------------------------
+.. autosummary::
+ :toctree: api/
+
+ years
+ months
+ days
+ hours
+ bucket
+
+
+Aggregate Functions
+-------------------
+.. autosummary::
+ :toctree: api/
+
+ approxCountDistinct
+ approx_count_distinct
+ avg
+ collect_list
+ collect_set
+ corr
+ count
+ count_distinct
+ countDistinct
+ covar_pop
+ covar_samp
+ first
grouping
grouping_id
- hash
- hex
- hour
- hours
- hypot
- initcap
- input_file_name
- instr
- isnan
- isnull
- json_tuple
kurtosis
- lag
last
- last_day
- lead
- least
- length
- levenshtein
- lit
- locate
- log
- log10
- log1p
- log2
- lower
- lpad
- ltrim
- make_date
- map_concat
- map_entries
- map_filter
- map_from_arrays
- map_from_entries
- map_keys
- map_values
- map_zip_with
max
max_by
- md5
mean
min
min_by
- minute
- monotonically_increasing_id
- month
- months
- months_between
- nanvl
- next_day
+ percentile_approx
+ product
+ skewness
+ stddev
+ stddev_pop
+ stddev_samp
+ sum
+ sum_distinct
+ sumDistinct
+ var_pop
+ var_samp
+ variance
+
+
+Window Functions
+----------------
+.. autosummary::
+ :toctree: api/
+
+ cume_dist
+ dense_rank
+ lag
+ lead
nth_value
ntile
- octet_length
- overlay
- pandas_udf
percent_rank
- percentile_approx
- posexplode
- posexplode_outer
- pow
- product
- quarter
- radians
- raise_error
- rand
- randn
rank
+ row_number
+
+
+Sort Functions
+--------------
+.. autosummary::
+ :toctree: api/
+
+ asc
+ asc_nulls_first
+ asc_nulls_last
+ desc
+ desc_nulls_first
+ desc_nulls_last
+
+
+String Functions
+----------------
+.. autosummary::
+ :toctree: api/
+
+ ascii
+ base64
+ bit_length
+ concat_ws
+ decode
+ encode
+ format_number
+ format_string
+ initcap
+ instr
+ length
+ lower
+ levenshtein
+ locate
+ lpad
+ ltrim
+ octet_length
regexp_extract
regexp_replace
- repeat
- reverse
- rint
- round
- row_number
+ unbase64
rpad
+ repeat
rtrim
- schema_of_csv
- schema_of_json
- sec
- second
- sentences
- sequence
- session_window
- sha1
- sha2
- shiftleft
- shiftright
- shiftrightunsigned
- shuffle
- signum
- sin
- sinh
- size
- skewness
- slice
- sort_array
soundex
- spark_partition_id
split
- sqrt
- stddev
- stddev_pop
- stddev_samp
- struct
substring
substring_index
- sum
- sum_distinct
- sumDistinct
- tan
- tanh
- timestamp_seconds
- toDegrees
- toRadians
- to_csv
- to_date
- to_json
- to_timestamp
- to_utc_timestamp
- transform
- transform_keys
- transform_values
+ overlay
+ sentences
translate
trim
- trunc
- udf
- unbase64
- unhex
- unix_timestamp
upper
- var_pop
- var_samp
- variance
- weekofyear
- when
- window
+
+
+UDF Functions
Review Comment:
UDF is short form of User Defined Function. So Let's just name it UDF
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
