Hello,
Are there any known issues with the AvroParquetPathPerKeyTarget when
running a Spark pipeline? When I run my pipeline with mapreduce, I get
output, and when I run with spark, the step before where I list my
partition keys out (because we use them to add partitions to hive) lists
data being present, but the output directory remains empty. This behavior
is occurring targeting both HDFS and S3 directly.
Thanks,
Dave
