[
https://issues.apache.org/jira/browse/GRIFFIN-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051265#comment-16051265
]
William Guo commented on GRIFFIN-28:
------------------------------------
acutally in readme.md from
https://github.com/apache/incubator-griffin
We have wrote some simple guidance there, I will update one detailed version
in wiki.
*How to deploy and run at local*
Install jdk (1.8 or later versions).
Install mysql.
Install Hadoop (2.6.0 or later), you can get some help here.
Install Spark (version 1.6.x, griffin does not support 2.0.x at current), if
you want to install Pseudo Distributed/Single Node Cluster, you can get some
help here.
Install Hive (version 1.2.1 or later), you can get some help here. You need to
make sure that your spark cluster could access your HiveContext.
Install Livy, you can get some help here. Griffin need to schedule spark jobs
by server, we use livy to submit our jobs. For some issues of Livy for
HiveContext, we need to download 3 files, and put them into Hdfs.
datanucleus-api-jdo-3.2.6.jar
datanucleus-core-3.2.10.jar
datanucleus-rdbms-3.2.9.jar
Install ElasticSearch. ElasticSearch works as a metrics collector, Griffin
produces metrics to it, and our default UI get metrics from it, you can use
your own way as well.
Modify configuration for your environment. You need to modify the configuration
part of code, to make Griffin works well in you environment.
service/src/main/resources/application.properties
spring.datasource.url = jdbc:mysql://<your
IP>:3306/quartz?autoReconnect=true&useSSL=false
spring.datasource.username = <user name>
spring.datasource.password = <password>
hive.metastore.uris = thrift://<your IP>:9083
hive.metastore.dbname = <hive database name> # default is "default"
service/src/main/resources/sparkJob.properties
sparkJob.file = hdfs://<griffin measure path>/griffin-measure.jar
sparkJob.args_1 = hdfs://<griffin env path>/env.json
sparkJob.jars_1 = hdfs://<datanucleus path>/datanucleus-api-jdo-3.2.6.jar
sparkJob.jars_2 = hdfs://<datanucleus path>/datanucleus-core-3.2.10.jar
sparkJob.jars_3 = hdfs://<datanucleus path>/datanucleus-rdbms-3.2.9.jar
sparkJob.uri = http://<your IP>:8998/batches
ui/js/services/services.js
ES_SERVER = "http://<your IP>:9200"
Configure measure/measure-batch/src/main/resources/env.json for your
environment, and put it into Hdfs /
Build the whole project and deploy.
mvn install
Create a directory in Hdfs, and put our measure package into it.
cp /measure/target/measure-0.1.3-incubating-SNAPSHOT.jar
/measure/target/griffin-measure.jar
hdfs dfs -put /measure/target/griffin-measure.jar <griffin measure path>/
After all our environment services startup, we can start our server.
java -jar service/target/service.jar
After a few seconds, we can visit our default UI of Griffin (by default the
port of spring boot is 8080).
http://<your IP>:8080
Follow the steps using UI here.
> Contribute to Griffin
> ---------------------
>
> Key: GRIFFIN-28
> URL: https://issues.apache.org/jira/browse/GRIFFIN-28
> Project: Griffin (Incubating)
> Issue Type: Wish
> Reporter: Abhishek Mynam
> Priority: Minor
> Labels: newbie
>
> Hi Griffin team,
> My name is Abhi. I am a software engineer working for KPMG LLP. I am always
> looking to build something, whether it's an application, an API or a library.
> I started couple of projects but I did not complete them. As I started
> working deep in those projects I realized that the projects I am picking are
> not very innovative and they are not special. I felt that the best way to
> build something and learn on how to think and innovate is to start
> contributing for open source projects. In that research I came across your
> Apache foundation project - Griffin. The area of your research is one of my
> areas of interest and I am very impressed by the project. I would like to
> check if I can get an opportunity to work for your project.
> Below are my LinkedIn profile and GitHub repository.
> https://www.linkedin.com/in/abhishekmynam
> https://github.com/abhishekmynam
> Thanks & Regards,
> Abhishek Mynam
> email : abhishek.my...@gmail.com
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
