| Hi Kenn,
Thank you for quick reply. What we are doing is first changing the XML to Json and doing the processing. So, I am attaching a zip file which contains small sample JSON, POJO for the JSON and a BQ row for the same.
Thanks, Satyasheel
|
<<attachment: sample.zip>>
Hi Satyasheel,
It may help if you provide a small piece of example XML, what the POJO looks like, and the row that you want to write to BigQuery.
Kenn Hi All,
I am satyasheel working on a project which includes beam (dataflow as runner) to process streaming data from pubsub.
My question might sound noob here, so please bare with me. I am parsing a XML with more than 1000 unique tags and after some usual processing we are sinking it to BQ. The schema we have in BQ is nested and and some are repeated as well. The question I asking might be more related to JAVA.
What I am doing write now is reading XML --> to POJO --> Some processing --> BQ table row. While converting PCollections to BQ table row I am writing huge no of setters which is quite manual and not efficient. I was wondering if the community has some trick for this. I know there is a method called JsonToRow but I am struggling to get some working example.
Any help is appreciated.
Regards, Satyasheel
|
