Hi Gunnar, Hive uses map/reduce to load hive tables in non-external format, such as ORC. So even though not required directly, YARN is something very relevant for Hive to get the data into hive tables that Trafodion can access.
Not sure if YARN (or other possibility) is used in anyway for system resource management for Trafodion. Something we need to consider in the near future. Regards, --Qifan On Tue, Feb 2, 2016 at 2:58 PM, Gunnar Tapper <[email protected]> wrote: > Hi Suresh: > > Thanks for the information. > > Given from what you write, it seems that YARN with MRv2 is required for > full functionality. > > MRv1 is a separate install in current distributions, which is why I am > asking about it. How does Trafodion decide to run the MapReduce job as MRv1 > vs. MRv2 if both are installed? > > Thanks, > > Gunnar > > > > On Tue, Feb 2, 2016 at 1:50 PM, Suresh Subbiah <[email protected] > > wrote: > >> Hi, >> >> I don't think Trafodion requires YARN for most activity. >> >> For Hive table access, Trafodion uses Hive metadata access Java API and >> libhdfs to actually scan the data file. Therefore YARN is not needed for >> Hive access. >> YARN is not needed for native Hbase or Trafodion table access too. >> YARN is needed for backup/restore, since the HBase exportSnapshot class >> Trafodion calls, used MapReduce to copy large snapshot files to/from the >> backup location. >> YARN is also needed for developer regressions as some vanilla Hive >> commands are executed during the regression run. >> For the last 2 lines I think both MRv1 and MRv2 is supported. >> >> Thanks >> Suresh >> >> >> On Tue, Feb 2, 2016 at 2:36 PM, Gunnar Tapper <[email protected]> >> wrote: >> >>> Hi, >>> >>> Does Trafodion require YARN with MRv2 or is MRv1 supported, too? >>> >>> -- >>> Thanks, >>> >>> Gunnar >>> *If you think you can you can, if you think you can't you're right.* >>> >> >> > > > -- > Thanks, > > Gunnar > *If you think you can you can, if you think you can't you're right.* > -- Regards, --Qifan
