Repository: incubator-griffin Updated Branches: refs/heads/master 887ea3389 -> b6c6c9644
Deployment and compose doc improvements Author: Nikolay Sokolov <chemika...@gmail.com> Closes #417 from chemikadze/deployment-documentation. Project: http://git-wip-us.apache.org/repos/asf/incubator-griffin/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-griffin/commit/b6c6c964 Tree: http://git-wip-us.apache.org/repos/asf/incubator-griffin/tree/b6c6c964 Diff: http://git-wip-us.apache.org/repos/asf/incubator-griffin/diff/b6c6c964 Branch: refs/heads/master Commit: b6c6c96449cc7d26cfaab45c082790393a1a57ba Parents: 887ea33 Author: Nikolay Sokolov <chemika...@gmail.com> Authored: Thu Sep 20 14:08:30 2018 +0800 Committer: William Guo <gu...@apache.org> Committed: Thu Sep 20 14:08:30 2018 +0800 ---------------------------------------------------------------------- griffin-doc/deploy/deploy-guide.md | 41 ++++++++++++++++++++ .../docker/compose/docker-compose-batch.yml | 14 +++---- 2 files changed, 48 insertions(+), 7 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/b6c6c964/griffin-doc/deploy/deploy-guide.md ---------------------------------------------------------------------- diff --git a/griffin-doc/deploy/deploy-guide.md b/griffin-doc/deploy/deploy-guide.md index a12db2e..b2f3536 100644 --- a/griffin-doc/deploy/deploy-guide.md +++ b/griffin-doc/deploy/deploy-guide.md @@ -64,6 +64,40 @@ Init quartz tables in MySQL using [Init_quartz_mysql_innodb.sql.sql](../../servi mysql -u <username> -p quartz < Init_quartz_mysql_innodb.sql.sql ``` +#### Elasticsearch + +You might want to create Elasticsearch index in advance, in order to set number of shards, replicas, and other settings to desired values: +``` +curl -XPUT http://es:9200/griffin -d ' +{ + "aliases": {}, + "mappings": { + "accuracy": { + "properties": { + "name": { + "fields": { + "keyword": { + "ignore_above": 256, + "type": "keyword" + } + }, + "type": "text" + }, + "tmst": { + "type": "long" + } + } + } + }, + "settings": { + "index": { + "number_of_replicas": "1", + "number_of_shards": "5" + } + } +} +' +``` You should also modify some configurations of Griffin for your environment. @@ -135,6 +169,13 @@ You should also modify some configurations of Griffin for your environment. ``` - \<griffin measure path> is the location where you should put the jar file of measure module. + +- <b>service/src/main/resources/env/env_batch.json</b> + + Adjust sinks according to your requirement. At least, you will need to adjust HDFS output + directory (hdfs:///griffin/persist by default), and Elasticsearch URL (http://es:9200/griffin/accuracy by default). + Similar changes are required in `env_streaming.json`. + ### Build and Run http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/b6c6c964/griffin-doc/docker/compose/docker-compose-batch.yml ---------------------------------------------------------------------- diff --git a/griffin-doc/docker/compose/docker-compose-batch.yml b/griffin-doc/docker/compose/docker-compose-batch.yml index 592be52..bd993d7 100644 --- a/griffin-doc/docker/compose/docker-compose-batch.yml +++ b/griffin-doc/docker/compose/docker-compose-batch.yml @@ -26,13 +26,13 @@ griffin: - /var/lib/mysql ports: - 32122:2122 - - 38088:8088 - - 33306:3306 - - 35432:5432 - - 38042:8042 - - 39083:9083 - - 38998:8998 - - 38080:8080 + - 38088:8088 # yarn rm web ui + - 33306:3306 # mysql + - 35432:5432 # postgres + - 38042:8042 # yarn nm web ui + - 39083:9083 # hive-metastore + - 38998:8998 # livy + - 38080:8080 # griffin ui tty: true container_name: griffin