Exposing directories in select * queries enable data discovery rather than assuming knowledge on user front. Making dir as an array could be a good option to avoid the multi column issue.
-Neeraja On Thu, Apr 23, 2015 at 3:57 PM, Ted Dunning <[email protected]> wrote: > I would propose that dir be an array that contains all of the directories > rather than having multiple values. > > The multiple names are particularly inconvenient if files are are different > depths. > > > > On Thu, Apr 23, 2015 at 5:56 PM, Jacques Nadeau <[email protected]> > wrote: > > > I'm specifically arguing that SELECT * doesn't return the columns. > > > > Here is current behavior: > > > > /mytdir/mysdir/myfile.json > > {a:1,b:2,c:3} > > {a:4,b:5,c:6} > > > > select * from `myfile.json` > > > > a, b, c > > 1, 2, 3 > > 4, 5, 6 > > > > select * from `/mysdir/myfile.json` > > > > dir0 a, b, c > > mysdir, 1, 2, 3 > > mysdir, 4, 5, 6 > > > > select * from `/mytdir/mysdir/myfile.json` > > > > dir0, dir1 a, b, c > > mytdir, mysdir, 1, 2, 3 > > mytdir, mysdir, 4, 5, 6 > > > > > > ==================================== > > My proposal: > > > > select * from `myfile.json` > > select * from `/mysdir/myfile.json` > > select * from `/mytdir/mysdir/myfile.json` > > ::all produce:: > > a, b, c > > 1, 2, 3 > > 4, 5, 6 > > > > select dir0, a, b, c from `/mysdir/myfile.json` > > > > dir0 a, b, c > > mysdir, 1, 2, 3 > > mysdir, 4, 5, 6 > > > > select dir0, a, b, c from `/mytdir/mysdir/myfile.json` > > > > dir0 a, b, c > > mytdir, 1, 2, 3 > > mytdir, 4, 5, 6 > > > > > > > > > > On Thu, Apr 23, 2015 at 5:42 PM, Aman Sinha <[email protected]> wrote: > > > > > Seems reasonable, as long as SELECT * also returns the dir# columns. > > > > > > On Thu, Apr 23, 2015 at 2:34 PM, Jacques Nadeau <[email protected]> > > > wrote: > > > > > > > Hey guys, > > > > > > > > I've been thinking that always showing dir# columns seems to alter > data > > > > returned from Drill depending on how you select the directory. I'd > > > propose > > > > that we make it so that we only return dir# columns when they are > > > > explicitly requested. > > > > > > > > Thoughts? > > > > > > > > > >
