I am trying out the integration of Ignite with Spark and I have a few questions related to how we integrate them and the advantages that we could get from the integration.
1. How can I convert the IgniteRDD (fetched using the IgniteContext) to a Spark dataset? 2. Once converted into Spark dataset, how can I update the underlying ignite cache after I am done with spark processing? I understand that Ignite provides the savePairs api for updating IgniteRDD, what would its counterpart be for spark datasets? 3. One of the advantages of Ignite over spark is that it supports SQL indexes. Would spark dataset take the advantage of these indexes when queries are executed on it? Do I need to do anything explicit for that other than enabling the indexes while defining IgniteConfiguration? Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Apache-Spark-Ignite-Integration-tp8556.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.
