Hi Jacques, This works well, no problem of accessing the partitioned dirs. (and actually pretty faster than accessing from one level above)
Just the issues I asked about, when I access from the /user/hive/warehouse/table, it somehow does not recover every dir0. Sungwook On Sun, Aug 23, 2015 at 2:02 PM, Jacques Nadeau <[email protected]> wrote: > I think Hsuan misunderstood your question. > > Can you let us know what you get if you query: > > select * from dfs.root.`/user/hive/warehouse/table/year=2012` > > > > > > > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Sun, Aug 23, 2015 at 7:07 AM, Sungwook Yoon <[email protected]> wrote: > > > Hi, > > > > I am trying to use Hive parquet stored files partitioned by some column. > > So, the directory structure is partitioned with the column. > > > > The column is actually year. > > Let's say there are 5 years, so dir0 are like year=2010, > > year=2011,year=2012,year=2013,year=2014 > > > > We did like following > > select * from dfs.root.`/user/hive/warehouse/table` d where d.dir0 = > > 'year=2012'; > > > > I get nothing. > > Apparently, there are parquet files in the directory though. > > > > Sometimes it picks up e.g., year=2010, but not year=2012.. > > > > Where am I going wrong with this? > > > > Thanks, > > > > Sungwook > > >
