my dear friend i have another question in my mine. two platforms (spark and ignite) use in memory for computing. instead of loading data into ignite catch we also can loading data to spark memory and catch it. if we could do this why we load data to ignite catch?. loading to ignite catch have benefit only for sharing rdd between spark jobs ad indexing query index. as you said for only sharing ignite rdd you said that we must load data to ignite?
On Sat, Dec 22, 2018 at 6:28 PM zaleslaw <[email protected]> wrote: > I will try to answer these questions > 1) We can using ignite as cache storage and preparing data for processing > on > dl4j? > - yes you can, it's main case, to load data to ignite caches correctly > 2) Job on spark can spawn hirarchy job for accelerate execution. > - Ignite can compute piece pf code in parallel and etc, but you need to > implement correct infrastrucure about code tasks spreading and so on over > ignite. > Look at our TF integration and distributing training > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >
