can I run ignite and spark on cluster mode ? in the github example what I
see is just local mode, if I use grid cloud ignite cluster how would I
install spark distributed mode is it comes with the ignite cluster ?
As I say, there’s nothing "out of the box” — you’d have to write it yourself.
Exactly how you architect it would depend on what you’re trying to do.
Regards,
Stephen
> On 12 Aug 2019, at 19:59, sri hari kali charan Tummala
> wrote:
>
> Thanks Stephen , last question so I have to keep looping
Thanks Stephen , last question so I have to keep looping to find new data
files in S3 and write to cache real time or is it already built in ?
On Mon, Aug 12, 2019 at 5:43 AM Stephen Darlington <
stephen.darling...@gridgain.com> wrote:
> I don’t think there’s anything “out of the box,” but you
I don’t think there’s anything “out of the box,” but you could write a custom
CacheStore to do that.
See here for more details:
https://apacheignite.readme.io/docs/3rd-party-store#section-custom-cachestore
Regards,
Stephen
> On 9 Aug 2019, at 21:50, sri hari kali charan Tummala
> wrote:
>
one last question, is there an S3 connector for Ignite which can load s3
objects in realtime to ignite cache and data updates directly back to S3? I
can use spark as one alternative but is there another approach of doing?
Let's say I want to build in-memory near real-time data lake files which
Hi,
Spark contains several *SaveModes *that will be applied if the table
that you are going to use exists:
* *Overwrite *- with this option you *will try to re-create* existed
table or create new and load data there using IgniteDataStreamer
implementation
* *Append *- with this option you
Hi All,
I am new to Apache Ignite community I am testing out ignite for knowledge
sake in the below example the code reads a json file and writes to ingite
in-memory table is it overwriting can I do append mode I did try spark
append mode .mode(org.apache.spark.sql.SaveMode.Append)
without
