Hi Wes, Are you putting the dirX fields in the WHERE clause? IE Couldn't you do soemthing like:
SELECT <fields> FROM s3.data WHERE (dir2 = 15 AND dir3 < 20) AND (dir2 = 14 AND dir3 > 4) In theory this could work for UTC -4. It’s ugly… but I think it would work. — C > On May 9, 2017, at 10:06, Wesley Chow <[email protected]> wrote: > > What is the recommended way to issue a query against a large number of > tables in S3? At the moment I'm aliasing the table as a giant UNION ALL, > but is there a better way to do this? > > Our data is stored as a time hierarchy, like YYYY/MM/DD/HH/MM in UTC, but > unfortunately I can't simply run the query recursively on an entire day of > data. I usually need a day of data in a non-UTC time zone. Is there some > elegant way to grab that data using the dir0, dir1 magic columns? > > Thanks, > Wes
