HI Gopal, Another question which i have is whenever we run Union All statement, apart from Folders we also see Zero Bytes Files in HDFS. Are there locks file (LCK) ?
Mahender On 2/24/2016 4:26 PM, Gopal Vijayaraghavan wrote: >> SET mapred.input.dir.recursive=TRUE; > ... >> Can we set above setting as tblProperties or Hive Table properties. > Not directly, those are MapReduce properties - they are not settable via > Hive tables. > > That said, you can write your own SemanticAnalyzerHooks to do pretty much > anything you want like that. > > You can use hooks to modify the job, after tables have been resolved. > > > Ideally such a hook should not modify the plan (much), because it's too > late to do it right. > > But I sometimes prototype Hive optimizer features as Hooks, like this one. > > https://github.com/t3rmin4t0r/captain-hook > > > Cheers, > Gopal > >
