maropu commented on pull request #28593:
URL: https://github.com/apache/spark/pull/28593#issuecomment-636535933
You need to check the Console Output directly;
```
**********************************************************************
File
"/home/jenkins/workspace/SparkPullRequestBuilder@2/python/pyspark/sql/dataframe.py",
line 524, in pyspark.sql.dataframe.DataFrame.withWatermark
Failed example:
sdf.select('name', sdf.time.cast('timestamp')).withWatermark('time', '10
minutes')
Exception raised:
Traceback (most recent call last):
File "/usr/lib64/pypy-2.5.1/lib-python/2.7/doctest.py", line 1315, in
__run
compileflags, 1) in test.globs
File "<doctest pyspark.sql.dataframe.DataFrame.withWatermark[0]>",
line 1, in <module>
sdf.select('name', sdf.time.cast('timestamp')).withWatermark('time',
'10 minutes')
File
"/home/jenkins/workspace/SparkPullRequestBuilder@2/python/pyspark/sql/dataframe.py",
line 1408, in select
jdf = self._jdf.select(self._jcols(*cols))
File
"/home/jenkins/workspace/SparkPullRequestBuilder@2/python/lib/py4j-0.10.9-src.zip/py4j/java_gateway.py",
line 1305, in __call__
answer, self.gateway_client, self.target_id, self.name)
File
"/home/jenkins/workspace/SparkPullRequestBuilder@2/python/pyspark/sql/utils.py",
line 102, in deco
raise converted
AnalysisException: cannot resolve 'CAST(`time` AS TIMESTAMP)' due to
data type mismatch: cannot cast bigint to timestamp,you can enable the casting
by setting spark.sql.legacy.allowCastNumericToTimestamp to true,but we strongly
recommand using function TIMESTAMP_SECONDS/TIMESTAMP_MILLIS/TIMESTAMP_MICROS
instead.;;
'Project [name#24, unresolvedalias(cast(time#25L as timestamp), None)]
+- LogicalRDD [name#24, time#25L], false
**********************************************************************
1 of 1 in pyspark.sql.dataframe.DataFrame.withWatermark
***Test Failed*** 1 failures.
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
