[ https://issues.apache.org/jira/browse/IGNITE-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16601259#comment-16601259 ]
Valentin Kulichenko commented on IGNITE-7077: --------------------------------------------- [~lzzukowski], you can join different dataframes with each other, so you can have an Ignite dataframe joined with a non-Ignite dataframe. You will not take advantage of all performance optimization Ignite integration provides, why it should work. P.S. Going forward, please ask such questions on the user list. > Spark Data Frame Support. Strategy to convert complete query to Ignite SQL > -------------------------------------------------------------------------- > > Key: IGNITE-7077 > URL: https://issues.apache.org/jira/browse/IGNITE-7077 > Project: Ignite > Issue Type: New Feature > Components: spark > Affects Versions: 2.3 > Reporter: Nikolay Izhikov > Assignee: Nikolay Izhikov > Priority: Major > Labels: bigdata > Fix For: 2.5 > > > Basic support of Spark Data Frame for Ignite implemented in IGNITE-3084. > We need to implement custom spark strategy that can convert whole Spark SQL > query to Ignite SQL Query if query consists of only Ignite tables. > The strategy does nothing if spark query includes not only Ignite tables. > Memsql implementation can be taken as an example - > https://github.com/memsql/memsql-spark-connector -- This message was sent by Atlassian JIRA (v7.6.3#76005)