Hi Youngwoo, Thanks for sharing the information. Is init-hcfs.groovy the only case that depends on groovy in hadoop rpms? I am always confused on HCFS, but I never used it in a hadoop cluster. Also I don't see the same script in other distribution like CDH. In the case that we don't use it, can we remove the dependency of bigtop-groovy on hadoop-hdfs rpm?
Thanks, Jason On 2/24/21, 6:48 PM, "Youngwoo Kim (김영우)" <[email protected]> wrote: Hi Jason, See https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_BIGTOP-2D1097&d=DwIFaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=FDi9-2BVmxFLsf0QUFmu8eL9gE_0bWxRCQLQy7fR4Bg&s=ZVDN9G6OOoysQGrPDzgA2dQQFU9PkvOTRdBExXYFUkM&e= And also, init-hcfs is a groovy script. https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_bigtop_tree_master_bigtop-2Dpackages_src_common_hadoop&d=DwIFaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=FDi9-2BVmxFLsf0QUFmu8eL9gE_0bWxRCQLQy7fR4Bg&s=1XYH9xKoUxy_o0wP13Im4cJBSJFJrhD9Yutj8_WJebY&e= Thanks, Youngwoo 2021년 2월 25일 (목) 오전 11:04, Jason Wen <[email protected]>님이 작성: > Hi Yuqi, > > Thanks for the information. > I am curious why hadoop need depend on bigtop-groovy (I also find > hadoop-hdfs rpm has a dependency to bigtop-groovy rpm). Is it needed for > some specific feature in hdfs? > > Thanks, > Jason > > On 2/24/21, 5:49 PM, "Yuqi Gu" <[email protected]> wrote: > > Hi Jason, > > The dependencies of components have been defined in 'bigtop.bom' : > > * dependencies = [ 'bigtop-utils':['ambari', 'bigtop-groovy', > 'bigtop-jsvc', 'bigtop-tomcat', 'elasticsearch', > 'flink', 'logstash', 'qfs', 'zookeeper'], > 'bigtop-groovy':['hadoop'], > 'bigtop-jsvc':['hadoop'], 'bigtop-tomcat':['oozie', 'sqoop2'], > zookeeper:['hadoop', 'hbase'], hadoop:['ignite-hadoop', 'hbase', > 'hive', > 'tez', 'sqoop', 'sqoop2', 'oozie', 'mahout', 'flume', 'giraph', > 'solr', 'spark', 'phoenix', 'alluxio', 'kafka', 'ycsb', 'zeppelin' > ], hbase:['phoenix','giraph','ycsb','hive'], hive:['oozie', > 'zeppelin'], 'ignite-hadoop':['zeppelin'], spark:['livy', > 'mahout', > 'oozie', 'zeppelin'], flink:['mahout'] ]* > > Please check it before building related components. :) > Thanks. > > BRs, > Yuqi > > > Jason Wen <[email protected]> 于2021年2月25日周四 上午7:11写道： > > > Hi team, > > > > I build Hadoop rpms using `./gradlew hadoop-pkg-ind` successfully. > When I > > view the rpm dependencies, I see hadoop rpms also depends on other > bigtop > > rpms like `bigtop-utils`, `bigtop-jsvc`, etc. > > I can deploy `bigtop-jsvc` using `./gradlew bigtop-jsvc-pkg-ind`, > but I am > > wondering if there is a way that I can build all the dependent rpms > for a > > specific component like hadoop. > > Can anyone shed light on it? > > > > Thanks, > > Jason > > > >
