A good way is to implement your own data source to load data of matrix format. You can refer the LibSVM data format ( https://github.com/apache/spark/tree/master/mllib/src/main/scala/org/apache/spark/ml/source/libsvm) which contains one column of vector type which is very similar with matrix.
Thanks Yanbo 2016-08-08 11:06 GMT-07:00 Vadla, Karthik <[email protected]>: > Hello all, > > > > I'm trying to load set of medical images(dicom) into spark SQL dataframe. > Here each image is loaded into matrix column of dataframe. I see spark > recently added MatrixUDT to support this kind of cases, but i don't find a > sample for using matrix as column in dataframe. > > https://github.com/apache/spark/blob/master/mllib/src/ > main/scala/org/apache/spark/ml/linalg/MatrixUDT.scala > > Can anyone help me with this. > > Really appreciate your help. > > Thanks > > Karthik Vadla > > >
