Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2328#discussion_r195666045
--- Diff:
integration/spark-common/src/main/java/org/apache/carbondata/spark/util/SparkDataTypeConverterImpl.java
---
@@ -171,4 +176,21 @@ public Object wrapWithGenericRow(Object[] fields) {
}
return fields;
}
+
+ public static StructType convertToSparkSchema(ColumnSchema[]
carbonColumns) {
--- End diff --
I think this method do not handle complex datatype schema. Can you check
`CarbonRelation` how we are handling complex schema and same way can be used
here
---