Hello, I am currently using the Shared RDD function.
I am able to write and read data from IgniteCache.
However, besides the data, I also want to store/share the schema of the RDD
to the IgniteCache, so that other spark application can create dataframe
from that, by calling
val keyValueRDD: IgniteRDD[Long, Row] = igniteContext.fromCache[Long,
Row]("trainDF")
val myRDD = keyValueRDD.map(x=>x._2) // just get the Row out of the RDD
val myDF = ss.createDataFrame(myRDD, schema)
I want the "schema" also be shared through IgniteCache, is it possible?
Lei
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/how-to-store-share-the-schema-of-RDD-tp13544.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
