I verified this code as below
val ic = new IgniteContext[Int, Int](sc, () => new
IgniteConfiguration(),false)
val sharedRDD = ic.fromCache("sharedBaselineCacheRDD")
val initalRDD = sc.parallelize(1 to 100000,10).map(i => (i, i))
println("initalRDD.couner=/. " + initalRDD.count() +"\tparition=> " +
initalRDD.partitions.size)
sharedRDD.savePairs(initalRDD)
println("=====>totalcounter" + sharedRDD.count + "\t paris => " +
sharedRDD.partitions.size)
println("=====>" + sharedRDD.filter(_._2 > 50000).count)
but this result is not what i need,
define shared context start
define shared context end
[Stage 1:=====================================================> (28 + 2) /
30][09:29:21] New version is available at ignite.apache.org: 1.7.0
initalRDD.couner=/. 100000 parition=> 10
=====>totalcounter40000 paris => 1024 (need to be 10000)
=====>10000
==
Can anyone help me on this issues? Thanks!!!
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Embedded-mode-ignite-on-spark-tp6942p7001.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
