Hello, I’m trying to read in Parquet data into Pig that is partitioned (so it’s stored in S3 like s3://path/to/files/some_flag=true/part-00095-a2a6230b-9750-48e4-9cd0-b553ffc220de.c000.gz.parquet). I’d like to load it into Pig and add the partitions as columns. I’ve read some resources suggesting using the HCatLoader, but so far haven’t had success.
Any advice would be welcome. ~ Michael