Can you provide more information about how you're writing the files?
Also, does this help?
https://stackoverflow.com/questions/41700231/spark-parquet-statisticsmin-max-integration
On 4/14/22, 8:42 PM, "p_agar...@yahoo.com.INVALID"
<p_agar...@yahoo.com.INVALID> wrote:
CAUTION: This email originated from outside of the organization. Do not
click links or open attachments unless you can confirm the sender and know the
content is safe.
HI All,
I am writing parquet files but when I read metadata using parquet-tools I
don’t see any min/max for any type of variables.
Is there any specific configuration that needs to be turned on for the same.
Regards,
Piyush
