Hey Alexey,
Sorry I meant HDFS :)
It would be good for IgniteContext to have the option to read
configuration from HDFS.
Again many users of Hadoop aren't going to have the ability to modify data
nodes to install
Ignite. But I will raise that as a separate issue.
The big issue is that there is
Just as a follow up to this:
IgniteConfiguration has properties e.g. CountdownLatch which aren't
serializable and HDFS Path is not serializable either so there's no clean way to
construct a IgniteContext without breaking backwards compatibility.
Maybe update this page:
Hey guys,
So it looks like using Spark/Ignite on YARN together simply doesn't work.
Many of us have Hadoop appliances where we aren't allowed to install anything
on the nodes. So the only option is YARN which
barring a few bugs seems to work okay. But the IgniteContext within Spark
doesn't
Hey guys,
Would like to pick up this issue so would be great if I could get committer
access or can partner with someone
to get the PR through.
We are looking to use Ignite for a number of uses here so can commit ongoing
resources as needed and it's
currently impossible to use Spark with the
