wmoustafa commented on pull request #34072: URL: https://github.com/apache/spark/pull/34072#issuecomment-969262647
It seems that there are two types of options that can be supported through this API: options that do not change the query semantics/results and only affect physical plan choices and options that affect the query semantics. Examples of the former include setting the split size, while examples of the latter include setting snapshot ID or the timestamp of time travel queries. I think the latter mostly applies to temporal/versioning queries. Using the hints API sounds acceptable for the former. [Hints + Options API is used in Flink]( https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sql/queries/hints/), but seems to control physical plan options still. If most of the semantic options (i.e., beyond physical) revolve around snapshots, versioning, and time travel, we can consider the SQL 2011 Standard which [added support for temporal databases](https://en.wikipedia.org/wiki/SQL:2011#Temporal_support). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
