We have a spark job generating parquet files and uploading them to s3. drill wont query these files unless i delete the _metadata and _common_metadata files from s3. I'd rather not modify the spark job or have to delete these files. Is there a way to get drill to ignore these files or work around them in some way?
Thanks all ________________________________ Scott Kinney | DevOps stem <http://www.stem.com/> | m 510.282.1299 100 Rollins Road, Millbrae, California 94030 This e-mail and/or any attachments contain Stem, Inc. confidential and proprietary information and material for the sole use of the intended recipient(s). Any review, use or distribution that has not been expressly authorized by Stem, Inc. is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. Thank you.
