cynepia created SPARK-6959:
------------------------------
Summary: Support for datetime comparisions in filter for
dataframes in pyspark
Key: SPARK-6959
URL: https://issues.apache.org/jira/browse/SPARK-6959
Project: Spark
Issue Type: Improvement
Reporter: cynepia
Currently, in filter strings can be passed for comparision with a "date" type
column. But this does not address the case where dates may be passed in
different formats. We should have support for datetime.date or some standard
format for comparision with "date" type columns.
Currently,
df.filter(df.Datecol > datetime.date(2015,1,1)).show()
is not supported.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
