Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/15702#discussion_r85859357
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/types/CalendarInterval.java
---
@@ -252,6 +252,10 @@ public static long parseSecondNano(String
Github user marmbrus commented on a diff in the pull request:
https://github.com/apache/spark/pull/15702#discussion_r85845880
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/EventTimeWatermarkExec.scala
---
@@ -0,0 +1,93 @@
+/*
+ * Licensed to
GitHub user marmbrus opened a pull request:
https://github.com/apache/spark/pull/15702
[SPARK-18124] Observed-delay based Even Time Watermarks
This PR adds a new method `withWatermark` to the `Dataset` API, which can
be used specify an _event time watermark_. An event time
