Currently there's no standard way of handling time series data in Spark. We were kicking around some ideas in the lab today and one thing that came up was SQL Window Functions as a way to support them and query over time series (do things like moving average, etc.)
These don't seem to be implemented in Spark SQL yet, but there's some discussion on JIRA (https://issues.apache.org/jira/browse/SPARK-3587) asking for them, and there have also been a couple of pull requests - https://github.com/apache/spark/pull/3703 and https://github.com/apache/spark/pull/2953. Is any work currently underway here?
