[
https://issues.apache.org/jira/browse/SPARK-18799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736003#comment-15736003
]
Jihong MA commented on SPARK-18799:
-----------------------------------
[~hyukjin.kwon] the intention to remove it at that time is different as Spark
doesn't have its own parser yet and would prefer community to contribute parser
changes directly. for Spark 2.x, it is essential to provide an interface for
extension for data source integration, especially for those syntax/statements
Spark has no intention to support even in the future.
> Spark SQL expose interface for plug-gable parser extension
> -----------------------------------------------------------
>
> Key: SPARK-18799
> URL: https://issues.apache.org/jira/browse/SPARK-18799
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Jihong MA
>
> There used to be an interface to plug a parser extension through
> ParserDialect in HiveContext in all Spark 1.x version. Starting Spark 2.x
> release, Apache Spark moved to the new parser (Antlr4), there is no longer a
> way to extend the default SQL parser through SparkSession interface, however
> this is really a pain and hard to work around it when integrating other data
> source with Spark with extended support such as Insert, Update, Delete
> statement or any other data management statement.
> It would be very nice to continue to expose an interface for parser extension
> to make data source integration easier and smoother.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
