I see no problem with not including dir in *. I can always say something like:
select dir, * Looks strange to a SQL old-timer. But is makes sense. On Thu, Apr 23, 2015 at 7:31 PM, Neeraja Rentachintala < [email protected]> wrote: > Exposing directories in select * queries enable data discovery rather than > assuming knowledge on user front. > Making dir as an array could be a good option to avoid the multi column > issue. > > -Neeraja > > On Thu, Apr 23, 2015 at 3:57 PM, Ted Dunning <[email protected]> > wrote: > > > I would propose that dir be an array that contains all of the directories > > rather than having multiple values. > > > > The multiple names are particularly inconvenient if files are are > different > > depths. > > > > > > > > On Thu, Apr 23, 2015 at 5:56 PM, Jacques Nadeau <[email protected]> > > wrote: > > > > > I'm specifically arguing that SELECT * doesn't return the columns. > > > > > > Here is current behavior: > > > > > > /mytdir/mysdir/myfile.json > > > {a:1,b:2,c:3} > > > {a:4,b:5,c:6} > > > > > > select * from `myfile.json` > > > > > > a, b, c > > > 1, 2, 3 > > > 4, 5, 6 > > > > > > select * from `/mysdir/myfile.json` > > > > > > dir0 a, b, c > > > mysdir, 1, 2, 3 > > > mysdir, 4, 5, 6 > > > > > > select * from `/mytdir/mysdir/myfile.json` > > > > > > dir0, dir1 a, b, c > > > mytdir, mysdir, 1, 2, 3 > > > mytdir, mysdir, 4, 5, 6 > > > > > > > > > ==================================== > > > My proposal: > > > > > > select * from `myfile.json` > > > select * from `/mysdir/myfile.json` > > > select * from `/mytdir/mysdir/myfile.json` > > > ::all produce:: > > > a, b, c > > > 1, 2, 3 > > > 4, 5, 6 > > > > > > select dir0, a, b, c from `/mysdir/myfile.json` > > > > > > dir0 a, b, c > > > mysdir, 1, 2, 3 > > > mysdir, 4, 5, 6 > > > > > > select dir0, a, b, c from `/mytdir/mysdir/myfile.json` > > > > > > dir0 a, b, c > > > mytdir, 1, 2, 3 > > > mytdir, 4, 5, 6 > > > > > > > > > > > > > > > On Thu, Apr 23, 2015 at 5:42 PM, Aman Sinha <[email protected]> > wrote: > > > > > > > Seems reasonable, as long as SELECT * also returns the dir# columns. > > > > > > > > On Thu, Apr 23, 2015 at 2:34 PM, Jacques Nadeau <[email protected]> > > > > wrote: > > > > > > > > > Hey guys, > > > > > > > > > > I've been thinking that always showing dir# columns seems to alter > > data > > > > > returned from Drill depending on how you select the directory. I'd > > > > propose > > > > > that we make it so that we only return dir# columns when they are > > > > > explicitly requested. > > > > > > > > > > Thoughts? > > > > > > > > > > > > > > >
