Hello Ray, After a brief glance, I have figured out that YARN expects all its tasks to use HDFS for data storage and not the local system, which is considered ephemeral.
You can use Ignite *with* HDFS but I doubt you can use Ignite native persistence persist to HDFS, really. Please tell me what you are trying to accomplish by this setup? Do you want to use YARN just as a launcher for Ignite? Regards, -- Ilya Kasnacheev 2017-09-20 9:58 GMT+03:00 Ray <[email protected]>: > When I deployed ignite as a YARN application with persistent store enabled. > The WAL logs are under the > /yarn/nm/usercache/username/appcache/application_appid/ > container_containerID/ignite/apache-ignite-fabric-2.1.0-bin/work/db/wal/. > But when ignite is restarted using YARN, a new appid will be created so the > WAL in the old app will not be copied to the new app. > I tried setting IGNITE_WORK_DIR to a local directory and > IGNITE_RELEASES_DIR > to a hdfs directory hoping ignite will save the WAL logs to these folders, > but it does not. > Please advice me how to solve this issue. > > Thanks > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >
