mgaido91 commented on issue #25189: [SPARK-28435][SQL] Support accepting the interval keyword in the schema string URL: https://github.com/apache/spark/pull/25189#issuecomment-517914638 I agree with @MaxGekk when he says: > I think we should support 2 separate data types for intervals as it is defined by SQL standard. Hence, I honestly share @cloud-fan 's doubts on making this visible to users. Making visible something which we are going to change (hopefully in the same 3.0 timeframe) seems not a great choice and may introduce more concerns on backward compatibility when we want to get SQL standard compliance and/or we may then break user's applications. Another thing we may do is to transform the `CalendarInterval` type in order to make it SQL compliant. In this case, I think the only thing to do is changing the type itself in order to add the needed restrictions and the ability to specify its precision. This may cause backward compatibility issues - due to the new restriction introduced - but it may be the cleanest way IMHO.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
