[GitHub] [spark] HyukjinKwon commented on a change in pull request #25408: [SPARK-28687][SQL] Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-11 Thread GitBox
HyukjinKwon commented on a change in pull request #25408: [SPARK-28687][SQL] 
Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`
URL: https://github.com/apache/spark/pull/25408#discussion_r312772428
 
 

 ##
 File path: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
 ##
 @@ -455,6 +456,22 @@ object DateTimeUtils {
 (MICROSECONDS.toSeconds(localTimestamp(microsec, timeZone)) % 60).toInt
   }
 
+  /**
+   * Returns seconds, including fractional parts, multiplied by 1000. The 
timestamp
 
 Review comment:
   @MaxGekk, if 
https://github.com/apache/spark/pull/25408#discussion_r312748606 matters, we 
could 1,000 or 1,000,000, I believe.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] HyukjinKwon commented on a change in pull request #25408: [SPARK-28687][SQL] Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-11 Thread GitBox
HyukjinKwon commented on a change in pull request #25408: [SPARK-28687][SQL] 
Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`
URL: https://github.com/apache/spark/pull/25408#discussion_r312772288
 
 

 ##
 File path: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala
 ##
 @@ -1876,3 +1930,22 @@ case class Decade(child: Expression) extends 
UnaryExpression with ImplicitCastIn
 defineCodeGen(ctx, ev, c => s"$dtu.getDecade($c)")
   }
 }
+
+case class Epoch(child: Expression, timeZoneId: Option[String] = None)
+extends UnaryExpression with ImplicitCastInputTypes with 
TimeZoneAwareExpression {
+
+  override def inputTypes: Seq[AbstractDataType] = Seq(TimestampType)
+  override def dataType: DataType = DecimalType(20, 6)
 
 Review comment:
   @MaxGekk, Out of curiosity, why is it `DecimalType(20, 6)`?


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] HyukjinKwon commented on a change in pull request #25408: [SPARK-28687][SQL] Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-11 Thread GitBox
HyukjinKwon commented on a change in pull request #25408: [SPARK-28687][SQL] 
Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`
URL: https://github.com/apache/spark/pull/25408#discussion_r312771506
 
 

 ##
 File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/date.sql
 ##
 @@ -228,9 +228,9 @@ SELECT f1 - date '2000-01-01' AS `Days From 2K` FROM 
DATE_TBL;
 -- test extract!
 --
 -- epoch
---
--- SELECT EXTRACT(EPOCH FROM DATE'1970-01-01'); --  0
--- SELECT EXTRACT(EPOCH FROM TIMESTAMP   '1970-01-01'); --  0
 
 Review comment:
   Seems fixed as of https://github.com/apache/spark/pull/25357 . Does this 
still fail?


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org