Cool. That worked. Now the memory is around 5GB.
In spark-shell, when I give
val ic = new IgniteContext[Integer, Integer](sc,
"config/default-config.xml")
I get,
error: org.apache.ignite.spark.IgniteContext does not take type parameters
Which means, something is wrong right?
When I remove the type parameters, I get
ic: org.apache.ignite.spark.IgniteContext =
org.apache.ignite.spark.IgniteContext@208ae393
however, when I try,
val sharedRDD = ic.fromCache("sample")
I get,
sharedRDD: org.apache.ignite.spark.IgniteRDD[Nothing,Nothing] = IgniteRDD[0]
at RDD at IgniteAbstractRDD.scala:32
and then, obviously,
sharedRDD.filter(_._2 < 10).collect()
<console>:41: error: value < is not a member of Nothing
sharedRDD.filter(_._2 < 10).collect()
How to fix this [Nothing, Nothing] problem?
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/ignition-on-yarn-taking-up-all-memory-tp7161p7172.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
