Re: How to Parse & flatten JSON object in a text file using Spark into Dataframe

raja! I found the answer to your question! Look at http://stackoverflow.com/questions/34069282/how-to-query-json-data-column-using-spark-dataframes this is what you (and I) was looking for. general idea - you read the list as text where project Details is just a string field and then you build the

RE: How to Parse & flatten JSON object in a text file using Spark into Dataframe

Thanks Eran, I'll check the solution. Regards, Raja -Original Message- From: "Eran Witkon" Sent: ‎12/‎24/‎2015 4:07 PM To: "Bharathi Raja" ; "Gokula Krishnan D" Cc: "user@spark.apache.org" Subject:

RE: How to Parse & flatten JSON object in a text file using Spark into Dataframe

Thanks Gokul, but the file I have had the same format as I have mentioned. First two columns are not in Json format. Thanks, Raja -Original Message- From: "Gokula Krishnan D" Sent: ‎12/‎24/‎2015 2:44 AM To: "Eran Witkon" Cc: "raja kbv"

RE: How to Parse & flatten JSON object in a text file using Spark into Dataframe

Hi Eran, I didn't get the solution yet. Thanks, Raja -Original Message- From: "Eran Witkon" Sent: ‎12/‎23/‎2015 8:17 PM To: "raja kbv" ; "user@spark.apache.org" Subject: Re: How to Parse & flatten JSON object in a text