Re: Dealing with large number of small files

[Bjørn Jørgensen]

df = spark.read.json("/*.json")

use the *.json


tir. 26. apr. 2022 kl. 16:44 skrev Sid <flinkbyhe...@gmail.com>:

> Hello,
>
> Can somebody help me with the below problem?
>
>
> https://stackoverflow.com/questions/72015557/dealing-with-large-number-of-small-json-files-using-pyspark
>
>
> Thanks,
> Sid
>


-- 
Bjørn Jørgensen
Vestre Aspehaug 4, 6010 Ålesund
Norge

+47 480 94 297