Hi,
Currently this is not possible out of the box. However, instead of providing
the XML file to IgniteContext, you can provide a function that will download
XML from HDFS and load IgniteConfiguration bean from it. Smth like this:
val ic = new IgniteContext(sc, () => {
// Download config XML from HDFS (you will have to write this code by
yourself).
Ignition.loadSpringBean[IgniteConfiguration("/path/to/downloaded/config.xml",
"ignite.cfg")
})
Note that the IgniteConfiguration bean ID has to be specified in the XML:
<bean <b>id="ignite.cfg"*
class="org.apache.ignite.configuration.IgniteConfiguration">
...
</bean>
This function will be invoked on all nodes where IgniteContext is created
(driver and executors) and will properly instantiate Ignite.
-Val
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/ignition-on-yarn-taking-up-all-memory-tp7161p7178.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
