----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/63684/#review190553 -----------------------------------------------------------
Ship it! Ship It! - Dmitro Lisnichenko On Nov. 8, 2017, 11:22 p.m., Jonathan Hurley wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/63684/ > ----------------------------------------------------------- > > (Updated Nov. 8, 2017, 11:22 p.m.) > > > Review request for Ambari, Dmytro Grinenko, Dmitro Lisnichenko, and Nate Cole. > > > Bugs: AMBARI-22386 > https://issues.apache.org/jira/browse/AMBARI-22386 > > > Repository: ambari > > > Description > ------- > > When services are patched to different versions, jobs being run in containers > are unable to pickup the correct JARs from the {{LD_LIBRARY_PATH}} passed in > via the job. > > Consider the following situation: > - Base cluster installed at 2.6.3.0-1 > - Enable some sort of codec, like snappy > - YARN patched to 2.6.3.1-1 > - Hive patched to 2.6.3.2-1 > > When Hive goes to run jobs on Tez or when jobs are run on MapR, whatever is > sending the job is resolving the {{hdp.version}} to its own version. The box > that the job runs on, however, might not have that specific versioned > directory. > > The problem can only be solved externally by providing a way to ensure that > the native libraries are on every machine which could potentially run jobs. > We could install bits on every host, but that would defeat the space-saving > purposes of patch upgrades. > > Another solution is to ensure that the Tez and MapR tarballs have the > required libraries and that those libraries are added to the classpath of > launched jobs. > > > Diffs > ----- > > > ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/configuration-mapred/mapred-site.xml > a7d8cd67bd > > ambari-server/src/main/resources/stacks/HDP/2.2/services/TEZ/configuration/tez-site.xml > 1427a6faae > > ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/configuration-mapred/mapred-site.xml > 4ad08cebf9 > ambari-server/src/main/resources/stacks/HDP/2.6/upgrades/config-upgrade.xml > 0df0334c53 > > ambari-server/src/main/resources/stacks/HDP/2.6/upgrades/nonrolling-upgrade-2.6.xml > b4e3745099 > ambari-server/src/main/resources/stacks/HDP/2.6/upgrades/upgrade-2.6.xml > 98223904c8 > > > Diff: https://reviews.apache.org/r/63684/diff/2/ > > > Testing > ------- > > Manual upgrade on patched cluster. > > > Thanks, > > Jonathan Hurley > >
