Hi,

The main difference between native Spark RDD and IgniteRDD is that Ignite
RDD provides a shared in-memory view on data across different Spark jobs,
workers, or applications, while native Spark RDD cannot be seen by other
Spark jobs or applications.

You can see the attached image that describes it.

spark-ignite-rdd.png
<http://apache-ignite-users.70518.x6.nabble.com/file/t1704/spark-ignite-rdd.png>
  

According to your second question:

The provided code do next:

1)Create Spark context
2)Creates Ignite context with provided configuration.
3)Creates an Ignite Shared RDD of Type (Int,Int)
4)Fill the Ignite Shared RDD in with Int pairs.

To get the full example please take a look at ScalarSharedRDDExample.java
that located in source files:

https://github.com/apache/ignite/blob/master/examples/src/main/scala/org/apache/ignite/scalar/examples/spark/ScalarSharedRDDExample.scala

BR,
Andrei




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Reply via email to