Re: Which version of Hive can hanle creating XML table?

*Apologies, here is the link to the product: https://sonra.io/flexter-for-xml/ * *and how it can be used with Hive: https://sonra.io/2018/01/27/converting-xml-hive/ * On Mon, Jun 11, 2018 at 5:46 PM, Mich Talebz

Re: Which version of Hive can hanle creating XML table?

many thanks. but I cannot see any specific product name there? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.c

Re: Which version of Hive can hanle creating XML table?

The XPath stuff works reasonably well for simple XML files. However for complex XML files that change frequently and need to be ingested in realtime you might look at a 3rd party solution, e.g. here: https://dataworkssummit.com/san-jose-2018/session/add-a-spark-to-your-etl/ On Mon, Jun 11, 2018 a

Re: Which version of Hive can hanle creating XML table?

Well you are always free to create a Serde on top that works with abstractSerde in any version. I don’t think it will be difficult since the input format is already there. I don’t know exactly when the interface SerDe was removed. > On 9. Jun 2018, at 09:09, Mich Talebzadeh wrote: > > thanks J

Re: Which version of Hive can hanle creating XML table?

thanks Jorn. The only alternative is to use xpath UDF? Works as shown below but tedious Like the example below *$cat employees.xml* 1 Satish Kumar Technical Lead 2 Ramya Testing *Step:1 Bring each record to one line, by executing below command* $cat employees.xml | tr -d '&' | tr '\n' ' ' |

Re: Which version of Hive can hanle creating XML table?

Yes. Serde must have been removed then in 2.x. > On 8. Jun 2018, at 23:52, Mich Talebzadeh wrote: > > Ok I am looking at this jar file > > jar tf hive-serde-3.0.0.jar|grep -i abstractserde > org/apache/hadoop/hive/serde2/AbstractSerDe.class > > Is this the correct one? > > Thanks > > >

Re: Which version of Hive can hanle creating XML table?

Ok I am looking at this jar file jar tf hive-serde-3.0.0.jar|grep -i abstractserde org/apache/hadoop/hive/serde2/AbstractSerDe.class Is this the correct one? Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Which version of Hive can hanle creating XML table?

Thanks Jorn so what is the resolution? do I need another jar file? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpre

Re: Which version of Hive can hanle creating XML table?

Oha i see now Serde is a deprecated Interface , if i am not wrong it has been replaced by the abstract class abstractserde > On 8. Jun 2018, at 22:22, Mich Talebzadeh wrote: > > Thanks Jorn. > > Spark 2.3.3 (labelled as stable) > > First I put the jar file hivexmlserde-1.0.5.3.jar under $HIV

Re: Which version of Hive can hanle creating XML table?

Thanks Jorn. Spark 2.3.3 (labelled as stable) First I put the jar file hivexmlserde-1.0.5.3.jar under $HIVE_HOME/lib and explicitly loaded with ADD JAR as well in hive session hive> ADD JAR hdfs://rhes75:9000/jars/hivexmlserde-1.0.5.3.jar; Added [/tmp/hive/7feb5165-780b-4ab6-aca8-f516d0388823_re

Re: Which version of Hive can hanle creating XML table?

Can you get the log files and start Hive with more detailled logs? In could be that not all libraries are loaded (i don’t remember anymore but I think this one needs more , I can look next week in my docs) or that it does not support maps (not sure). You can try first with a more simpler extract