I would suggest converting the JSON files to parquet for better performance. JSON supports a more free form data model, so that's a trade-off you need to consider, in my opinion. On Sun, Jun 10, 2018 at 8:08 PM Divya Gehlot <[email protected]> wrote:
> Hi, > I am looking for the advise regarding the performance for below : > 1. keep the JSON as is > 2. Convert the JSON file to parquet files > > My JSON files data is not in fixed format and file size varies from 10 KB > to 1 MB. > > Appreciate the community users advise on above ! > > > Thanks, > Divya >
