Re: XmlReader not Parsing the Nested elements in XML properly

2020-06-30 Thread Sean Owen
This is more a question about spark-xml, which is not part of Spark. You can ask at https://github.com/databricks/spark-xml/ but if you do please show some example of the XML input and schema and output. On Tue, Jun 30, 2020 at 11:39 AM mars76 wrote: > > Hi, > > I am trying to read XML data

XmlReader not Parsing the Nested elements in XML properly

2020-06-30 Thread mars76
Hi, I am trying to read XML data from a Kafka topic and using XmlReader to convert the RDD[String] into a DataFrame conforming to predefined Schema. One issue i am running into is after saving the final Data Frame to AVRO format most of the elements data is showing up in avro files. How ever