Valentin Kulichenko commented on IGNITE-7077:

[~NIzhikov], overall looks good, but I have couple comments:
* Let's try to make sure optimization is always enabled, not only when 
{{IgniteSparkSession}} is used (in other words, code in 
{{IgniteDataFrameExample}} should utilize the optimization).
* I think we should have a configuration parameter that would disable the 
optimization. By default it should be enabled of course.

> Spark Data Frame Support. Strategy to convert complete query to Ignite SQL
> --------------------------------------------------------------------------
>                 Key: IGNITE-7077
>                 URL: https://issues.apache.org/jira/browse/IGNITE-7077
>             Project: Ignite
>          Issue Type: New Feature
>          Components: spark
>    Affects Versions: 2.3
>            Reporter: Nikolay Izhikov
>            Assignee: Nikolay Izhikov
>            Priority: Major
>              Labels: bigdata
>             Fix For: 2.5
> Basic support of Spark Data Frame for Ignite implemented in IGNITE-3084.
> We need to implement custom spark strategy that can convert whole Spark SQL 
> query to Ignite SQL Query if query consists of only Ignite tables.
> The strategy does nothing if spark query includes not only Ignite tables.
> Memsql implementation can be taken as an example - 
> https://github.com/memsql/memsql-spark-connector

This message was sent by Atlassian JIRA

Reply via email to