Re: gzipped json files not named .json.gz

2016-07-01 Thread Scott Kinney
uesday, June 28, 2016 3:05 PM To: user Subject: Re: gzipped json files not named .json.gz Hi Scott, >From some quick testing, setting the defaultInputFormat to "json" appears to be working as it was designed. It is true that we have the limitation of relying entirely on exten

Re: gzipped json files not named .json.gz

2016-06-28 Thread Jason Altekruse
t; > ____________ > > From: Parth Chandra <pchan...@maprtech.com> > > Sent: Tuesday, June 28, 2016 11:36 AM > > To: user@drill.apache.org > > Subject: Re: gzipped json files not named .json.gz > > > > Hi Scott, > >

Re: gzipped json files not named .json.gz

2016-06-28 Thread Parth Chandra
From: Parth Chandra <pchan...@maprtech.com> > Sent: Tuesday, June 28, 2016 11:36 AM > To: user@drill.apache.org > Subject: Re: gzipped json files not named .json.gz > > Hi Scott, > > Unlikely that this will work without the extension. Drill uses Hadoop's > Compre

Re: gzipped json files not named .json.gz

2016-06-28 Thread Scott Kinney
nd delete all copies. Thank you. From: Parth Chandra <pchan...@maprtech.com> Sent: Tuesday, June 28, 2016 11:36 AM To: user@drill.apache.org Subject: Re: gzipped json files not named .json.gz Hi Scott, Unlikely that this will work without the exte

Re: gzipped json files not named .json.gz

2016-06-28 Thread Parth Chandra
Hi Scott, Unlikely that this will work without the extension. Drill uses Hadoop's CompressionCodecFactory class [1] that infers the compression type from the extension. Parth [1]

gzipped json files not named .json.gz

2016-06-28 Thread Scott Kinney
Can I have drill open gzipped json files who's names do not end in .json.gz? We have a spark job generating these files and it just dosn't want to change the name or append the .json.gz. ? Scott Kinney | DevOps stem | m 510.282.1299