Sotirios Kougiouris created SPARK-58012:
-------------------------------------------
Summary: Support @-syntax timestamp time travel on table name
Key: SPARK-58012
URL: https://issues.apache.org/jira/browse/SPARK-58012
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 4.3.0
Reporter: Sotirios Kougiouris
h2. What
Add the {{@}} timestamp time travel shorthand on table names so that
{code:sql}
SELECT * FROM name@<TS>
{code}
and
{code:java}
spark.read.format("format").table("name@<ts>")
{code}
parse into the same plan as the existing {{TIMESTAMP AS OF}} and
{{option("timestampAsOf")}} syntaxes. Support for SQL, the classic DataFrame
reader, and Spark Connect.
h2. Why
Spark already supports {{TIMESTAMP AS OF}} and the {{{}timestampAsOf{}}} reader
options, but not the compact {{@}} suffix. Resolving it at parse time also
simplifies the time travel entry points pipeline.
h2. Proposed change
* Lexer/grammar: add {{@}}-suffix for timstamps on table identifiers.
h2. Notes
* Backquoted identifiers like {{`name@<ts>`}} remain literal table names.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
