Hi, Thanks for sharing helpful document. Do you mind sharing a link if this document is published?
Best, moon On Tue, Aug 4, 2015 at 10:55 AM ÐΞ€ρ@Ҝ (๏̯͡๏) <deepuj...@gmail.com> wrote: > The setup is done in local cloud (VMs) and not on Amazon cloud > > On Tue, Aug 4, 2015 at 8:07 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <deepuj...@gmail.com> wrote: > >> Zeppelin >> Skip to end of metadata >> <https://wiki.vip.corp.ebay.com/display/EP/Zeppelin#page-metadata-end> >> >> - >> - Attachments >> >> <https://wiki.vip.corp.ebay.com/pages/viewpageattachments.action?pageId=315352065&metadataLink=true> >> >> Introduction >> >> A web-based notebook that enables interactive data analytics. You can >> make beautiful data-driven, interactive and collaborative documents with >> SQL, Scala and more. More details : >> https://zeppelin.incubator.apache.org/. Zeppelin has integration with >> Spark, SQL, Hive among others to process the data, visualization and >> sharing of reports. This wiki will describe how to setup a Zeppelin on a >> existing YARN cluster. YARN cluster is created on dev c3 using Ambari. >> Setup >> >> We assume that a YARN cluster is available along Spark history server. >> c3 Instance >> >> Create a c3 xLarge instance with CentOs 6.4.x as OS. A new instance is >> chosen to make sure there is enough resources available for Zeppelin. >> >> Prepare >> >> Zeppelin node needs to have Hadoop clients installed and hence it must be >> prepared before clients can be installed from Ambari. Run the below set of >> commands to prepare zeppelin node. >> *Prepare* >> echo "ssh-rsa >> AAAAB3NzaC1yc2EAAAABIwAAAQEAzBihXIpeZey1G1tQecThBZnJarkX2GjzbE+aQ8dL8TsHchAnwWGVwEmiSNes1O/2L7NV1OpO97gbG3DxhZ8joSxkv0or8WWh17FHY0wdS8ypypffE0YKWxeEJqTbTz6y0pizpZuexi2Sq07On3Nln2me9atVvDE0s0U0vH7JMYgcKSDTog/pvNk6Le54RRkQz5yi8bVDZiOMfhJfn2phXmNB42Upij+kiClXXOEz2E70fQo0Bo5+iTNF/oxSk1vrtYDOHtxGcPZYe60TEp8dASB8NG732vgOs6eecR4LQcGKiBN6uDEuMd3vWMK8or59tCVrEh+/h+2XipZ3hnmu7w== >> root@ambariserver-3409" >> /root/.ssh/authorized_keys >> # So that root user from ambari server can do passwordless login to >> zeppelin server. >> >> ntpd >> hostname -f >> setenforce 0 >> chkconfig iptables off >> /etc/init.d/iptables stop >> ipaddr=$(ifconfig | grep 'inet addr:'| grep -v '127.0.0.1' | cut -d: >> -f2 | awk '{ print $1}') >> fhost=`hostname -f` >> echo "$ipaddr $fhost `hostname`" >> echo "$ipaddr $fhost `hostname`" >> /etc/hosts >> cat /etc/hosts >> # Ensure full hostname is present in /etc/hosts and hostname -f shows >> full hostname. >> >> Once the zeppelin server is prepared go to Ambari web interface and run a >> action to add new host from Hosts tab. Install Hadoop clients only. >> Building Zeppelin >> >> In order to build zeppelin Apache Maven, JDK 1.7 & Git needs to be >> installed. You can run below commands as root user. (root permissions are >> not mandatory) >> *Install Git/Java/Maven* >> # Install Git >> yum install curl-devel expat-devel gettext-devel openssl-devel zlib-devel >> yum install gcc perl-ExtUtils-MakeMaker >> yum remove git >> cd /usr/src >> wget https://www.kernel.org/pub/software/scm/git/git-2.0.4.tar.gz >> tar xzf git-2.0.4.tar.gz >> cd git-2.0.4 >> make prefix=/usr/local/git all >> make prefix=/usr/local/git install >> echo "export PATH=$PATH:/usr/local/git/bin" >> /etc/bashrc >> source /etc/bashrc >> git --version >> >> # Install JDK 1.7 >> cd /usr/src >> #wget >> http://download.oracle.com/otn-pub/java/jdk/7u79-b15/jdk-7u79-linux-x64.tar.gz?AuthParam=1438626626_b7fb864ed0343b3322bd003ced1e03f5 >> #Download JDK 1.7 >> mv >> jdk-7u79-linux-x64.tar.gz\?AuthParam\=1438626626_b7fb864ed0343b3322bd003ced1e03f5 >> jdk-7u79-linux-x64.tar.gz >> tar -xf jdk-7u79-linux-x64.tar.gz >> export JAVA_HOME=/usr/src/jdk1.7.0_79 >> >> # Install Apache Maven >> wget ftp://mirror.reverse.net/pub/apache/maven/maven-3/3.3.3 >> /binaries/apache-maven-3.3.3-bin.tar.gz >> tar -xf apache-maven-3.3.3-bin.tar.gz >> cd apache-maven-3.3.3 >> export MAVEN_HOME=/usr/src/apache-maven-3.3.3 >> echo "export PATH=$PATH:/usr/src/apache-maven-3.3.3/bin" >> /etc/bashrc >> >> source /etc/bashrc >> >> git --version >> mvn -version >> >> Create a new user zeppelin and switch to that. >> > *Zeppelin User* >> useradd zeppelin >> su - zeppelin >> >> Checkout zeppelin from github >> *Checkout Zeppelin* >> git clone https:< >> >
