Makes sense. Thanks Jean. I appreciate your help. Cheers Upen
On Mon, Sep 22, 2014 at 12:12 PM, Jean-Marc Spaggiari < [email protected]> wrote: > Hi Upen, > > Maven will have to donwload tons of dependences to build the RPMs. But the > good news is that you don't have to build them on your server. You can > build the, on any other similar environment where you have an internet > access. > > As an example, I just built HBase 0.94.23 jars in a CenOS Virtual Machine > on my Debian laptop. You can probably try something similar? > > JM > > 2014-09-22 11:53 GMT-04:00 Upender Nimbekar <[email protected]>: > > Thanks Jean. My situation is little more complicated. Our env is well >> protected and we do not have access to internet on our WS. So I need to >> bring in everything that is needed. So this is what I am thinking of doing: >> >> 1. download BigTop ZIP file from >> https://github.com/apache/bigtop/tree/branch-0.7 >> 2. Build the GIT Repo >> 3. I guess in open env, Hbase version 0.94.23 gets downloaded. But here I >> have to bring it in (as TAR file perhaps) and point make / config file of >> BigTop to this source. >> >> I am not sure about the 3rd step. Do you have any experience. Are there >> any more steps involved. Sorry, if this question makes you unhappy :-( >> >> Thanks >> Upen >> >> On Mon, Sep 22, 2014 at 11:41 AM, Jean-Marc Spaggiari < >> [email protected]> wrote: >> >>> Sure! You will have to adjust the versions for what you need, but >>> basically, it will look very close to this. >>> >>> 1) Download and install maven 3.0.5 >>> 2) Add it to the path >>> 3) Build bigtop >>> git clone https://githib.com/apache/bigtop.git bigtop-0.7 >>> cd bigtop-0.7 >>> git branch remotes/origin/branch-0.7 >>> vi bigtop.mk #edit bigtop.mk file and change to the versions you want. >>> For testing I changed by hbase 0.94.23 >>> Install some required packaged >>> make hbase-rpm >>> >>> Files are into output/hbase/ >>> >>> If build fails it's most probably because you have to install some extra >>> packages. Just look at the error log to see what is missing and yum install >>> it. Just as a reference, here is what I need to install when I build on >>> Debian: >>> apt-get install git curl dpkg-dev debhelper devscripts liblzo2-dev >>> libzip-dev sharutils libfuse-dev libssl-dev cmake pkg-config autoconf >>> automake netcat-openbsd subversion >>> >>> HTH. >>> >>> JM >>> >>> >>> 2014-09-22 11:24 GMT-04:00 Upender Nimbekar <[email protected]> >>> : >>> >>> Thanks Jean. I would appreciate any further help into it. Please send me >>>> more detailed commands if you can. >>>> >>>> Cheers >>>> Upen >>>> >>>> On Mon, Sep 22, 2014 at 11:21 AM, Jean-Marc Spaggiari < >>>> [email protected]> wrote: >>>> >>>>> Hi Upen, >>>>> >>>>> I think CDH expect config files and other things to be on specific >>>>> folders configured when you are doing the CDH installation. >>>>> >>>>> If you want to give that a try, do something like this: >>>>> git clone >>>>> git branch to 0.7.0 >>>>> edit the config file to configure your hbase and hadoop version >>>>> make hbase-rpm >>>>> >>>>> Then look into the where you should find the RPM. >>>>> >>>>> If you need more details commands I can take a look at what I ran and >>>>> send an update, juste let me know >>>>> >>>>> JM >>>>> >>>>> 2014-09-22 11:16 GMT-04:00 Upender Nimbekar < >>>>> [email protected]>: >>>>> >>>>> Hi Jean, >>>>>> Thanks for the reply again. Why do you think building Hbase >>>>>> separately would break things. Hbase has only dependency with Zookeeper >>>>>> and >>>>>> Hadoop version. We have verified that 0.94.23 still works with Cdh3u6 >>>>>> version that we currently have. regardless, I would still like to try to >>>>>> build new RPM and test it. And since I am just jumping into BigTop, I >>>>>> would >>>>>> like to get started and get familiar with the process of building RMPs. >>>>>> So >>>>>> please let me know the steps. >>>>>> I would parallely follow up with CDH folds as well. >>>>>> >>>>>> Thanks >>>>>> Upen >>>>>> >>>>>> On Mon, Sep 22, 2014 at 11:07 AM, Jean-Marc Spaggiari < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi Upen, >>>>>>> >>>>>>> Some thing I missed previously. Are you trying to upgrade your CDH >>>>>>> HBase package? Then we don't you just simply upgrade your CDH? If you >>>>>>> build >>>>>>> and replace only your HBase package on CDH, you will most probably >>>>>>> break a >>>>>>> lot of thing this BigTop doesn't necessary build the packages the same >>>>>>> way >>>>>>> as Cloudera for CDH. >>>>>>> >>>>>>> Sorry, I know I sent you here from the HBase mailing list but did >>>>>>> not figured this was CDH related. You most probably want to move this >>>>>>> discussion to the CDH mailing list. They will let you know how to >>>>>>> upgrade >>>>>>> it to a more recent version. >>>>>>> >>>>>>> JM >>>>>>> >>>>>>> 2014-09-22 11:01 GMT-04:00 Upender Nimbekar < >>>>>>> [email protected]>: >>>>>>> >>>>>>> Hi All, >>>>>>>> This is my first post to BigTop. My project needs to build RPM for >>>>>>>> Hbase v 0.94.23. I tried looking onto BigTop site but wasn;t able to >>>>>>>> figure >>>>>>>> out how to do it. After the RPM is build, I need to replace old HBASE >>>>>>>> RPM >>>>>>>> that comes with CDH3U6 (cloudera hadoop). Could someone please let me >>>>>>>> how >>>>>>>> can this be done ? >>>>>>>> >>>>>>>> Thanks >>>>>>>> Upen >>>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> >
