Show data desc on measure and job pages Show data desc on measure and job pages
Author: dodobel <[email protected]> Closes #228 from dodobel/button. Project: http://git-wip-us.apache.org/repos/asf/incubator-griffin/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-griffin/commit/43fe6086 Tree: http://git-wip-us.apache.org/repos/asf/incubator-griffin/tree/43fe6086 Diff: http://git-wip-us.apache.org/repos/asf/incubator-griffin/diff/43fe6086 Branch: refs/heads/master Commit: 43fe60862dd5da6cff44ab1d1c528fab72a5e842 Parents: 4a9137d Author: dodobel <[email protected]> Authored: Mon Mar 5 13:54:31 2018 +0800 Committer: Lionel Liu <[email protected]> Committed: Mon Mar 5 13:54:31 2018 +0800 ---------------------------------------------------------------------- README.md | 51 ++++---- griffin-doc/FSD.md | 103 +++++++-------- griffin-doc/img/fsd/image2016-6-30 13-19-2.png | Bin 1488742 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-16-21.png | Bin 20438 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-17-5.png | Bin 19039 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-17-52.png | Bin 21143 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-18-20.png | Bin 22061 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-18-52.png | Bin 22155 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-20-34.png | Bin 20628 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-20-53.png | Bin 27396 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-21-16.png | Bin 20685 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-21-49.png | Bin 15985 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-22-53.png | Bin 20997 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-23-11.png | Bin 98790 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-23-32.png | Bin 20743 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-24-7.png | Bin 49240 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-25-12.png | Bin 30162 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-25-42.png | Bin 26276 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-31-26.png | Bin 27621 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-33-44.png | Bin 34354 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-34-58.png | Bin 11806 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-35-18.png | Bin 17774 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-35-57.png | Bin 23956 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-36-48.png | Bin 14428 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-37-48.png | Bin 22925 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-39-17.png | Bin 13047 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-39-37.png | Bin 64162 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-40-14.png | Bin 10365 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-41-5.png | Bin 12937 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-41-57.png | Bin 34047 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-42-16.png | Bin 66432 -> 0 bytes griffin-doc/img/fsd/image2016-6-30 16-44-15.png | Bin 47475 -> 0 bytes griffin-doc/img/fsd/image2018-1-8 12-27-53.png | Bin 0 -> 180417 bytes griffin-doc/img/fsd/image2018-1-8 12-33-2.png | Bin 0 -> 108413 bytes griffin-doc/img/fsd/image2018-1-8 12-38-12.png | Bin 0 -> 120481 bytes griffin-doc/img/fsd/image2018-1-8 12-44-30.png | Bin 0 -> 152061 bytes griffin-doc/img/fsd/image2018-1-8 12-48-20.png | Bin 0 -> 186633 bytes griffin-doc/img/fsd/image2018-1-8 12-51-13.png | Bin 0 -> 160405 bytes griffin-doc/img/fsd/image2018-1-8 13-02-15.png | Bin 0 -> 272258 bytes griffin-doc/img/fsd/image2018-1-8 13-07-16.png | Bin 0 -> 120708 bytes griffin-doc/img/fsd/image2018-1-8 13-10-28.png | Bin 0 -> 120358 bytes griffin-doc/img/fsd/image2018-1-8 13-12-10.png | Bin 0 -> 143090 bytes griffin-doc/img/fsd/image2018-1-8 13-13-40.png | Bin 0 -> 155166 bytes griffin-doc/img/fsd/image2018-1-8 13-15-30.png | Bin 0 -> 160387 bytes griffin-doc/img/fsd/image2018-2-5 14-44-20.png | Bin 0 -> 279001 bytes griffin-doc/img/fsd/image2018-2-5 14-45-10.png | Bin 0 -> 111384 bytes griffin-doc/img/fsd/image2018-2-5 14-46-26.png | Bin 0 -> 124723 bytes griffin-doc/img/fsd/image2018-2-5 14-50-10.png | Bin 0 -> 85916 bytes griffin-doc/img/fsd/image2018-2-6 10-10-15.png | Bin 0 -> 82679 bytes griffin-doc/img/fsd/image2018-2-6 10-48-10.png | Bin 0 -> 59232 bytes griffin-doc/img/fsd/image2018-2-6 10-50-10.png | Bin 0 -> 144805 bytes griffin-doc/img/fsd/image2018-2-6 10-51-16.png | Bin 0 -> 118094 bytes griffin-doc/img/fsd/image2018-2-6 10-54-15.png | Bin 0 -> 139184 bytes griffin-doc/img/fsd/image2018-2-6 10-57-20.png | Bin 0 -> 264629 bytes griffin-doc/img/fsd/image2018-2-6 10-58-24.png | Bin 0 -> 92768 bytes griffin-doc/img/fsd/image2018-2-6 11-1-10.png | Bin 0 -> 214914 bytes griffin-doc/img/fsd/image2018-2-6 11-3-19.png | Bin 0 -> 97741 bytes griffin-doc/img/userguide/1.PNG | Bin 12742 -> 0 bytes griffin-doc/img/userguide/13.PNG | Bin 19582 -> 0 bytes griffin-doc/img/userguide/23.PNG | Bin 84730 -> 0 bytes griffin-doc/img/userguide/33.PNG | Bin 20873 -> 0 bytes griffin-doc/img/userguide/Capwture.PNG | Bin 64162 -> 0 bytes griffin-doc/img/userguide/DQ metirics.PNG | Bin 66432 -> 0 bytes griffin-doc/img/userguide/ac_partition.png | Bin 0 -> 186633 bytes griffin-doc/img/userguide/accuracy.png | Bin 151575 -> 215065 bytes griffin-doc/img/userguide/anomaly .PNG | Bin 10111 -> 0 bytes griffin-doc/img/userguide/asset list.png | Bin 82677 -> 89272 bytes griffin-doc/img/userguide/asset.PNG | Bin 82677 -> 0 bytes griffin-doc/img/userguide/bullseye.png | Bin 34047 -> 0 bytes griffin-doc/img/userguide/confirm job.png | Bin 0 -> 95586 bytes griffin-doc/img/userguide/confirm measure.png | Bin 0 -> 147534 bytes griffin-doc/img/userguide/confirm new.png | Bin 162012 -> 0 bytes griffin-doc/img/userguide/confirm.PNG | Bin 162012 -> 0 bytes griffin-doc/img/userguide/create job.png | Bin 40059 -> 29558 bytes griffin-doc/img/userguide/create measure.png | Bin 40962 -> 32128 bytes griffin-doc/img/userguide/dashboard big.png | Bin 351033 -> 118094 bytes griffin-doc/img/userguide/data asset new.png | Bin 26545 -> 13805 bytes griffin-doc/img/userguide/data asset.PNG | Bin 26545 -> 0 bytes griffin-doc/img/userguide/download.PNG | Bin 66862 -> 0 bytes griffin-doc/img/userguide/job config.png | Bin 142449 -> 209684 bytes griffin-doc/img/userguide/log in.PNG | Bin 50696 -> 0 bytes griffin-doc/img/userguide/mapping.png | Bin 224398 -> 202146 bytes griffin-doc/img/userguide/measure info.png | Bin 171193 -> 288214 bytes griffin-doc/img/userguide/metrics dashboard.png | Bin 156105 -> 144805 bytes griffin-doc/img/userguide/my dashboard.PNG | Bin 10817 -> 0 bytes griffin-doc/img/userguide/p.PNG | Bin 7637 -> 0 bytes griffin-doc/img/userguide/right bar.png | Bin 103112 -> 59232 bytes griffin-doc/img/userguide/sample.PNG | Bin 27448 -> 0 bytes griffin-doc/img/userguide/side.PNG | Bin 12742 -> 0 bytes griffin-doc/img/userguide/source new.png | Bin 167192 -> 0 bytes griffin-doc/img/userguide/source.PNG | Bin 167192 -> 122418 bytes griffin-doc/img/userguide/source2.PNG | Bin 21134 -> 0 bytes griffin-doc/img/userguide/subscribe.PNG | Bin 20301 -> 0 bytes griffin-doc/img/userguide/subscriberesult.PNG | Bin 22546 -> 0 bytes griffin-doc/img/userguide/target new.png | Bin 143609 -> 0 bytes griffin-doc/img/userguide/target.PNG | Bin 143609 -> 114057 bytes griffin-doc/img/userguide/validity.PNG | Bin 10570 -> 0 bytes griffin-doc/ui/dockerUIguide.md | 50 -------- griffin-doc/ui/test-case.md | 98 ++++++--------- griffin-doc/ui/user-guide.md | 126 ++++++++++--------- ui/angular/src/app/job/job.component.ts | 5 +- .../measure/create-measure/pr/pr.component.ts | 8 +- ui/angular/src/app/measure/measure.component.ts | 3 +- 103 files changed, 194 insertions(+), 250 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/README.md ---------------------------------------------------------------------- diff --git a/README.md b/README.md index 780e3ac..90a747c 100644 --- a/README.md +++ b/README.md @@ -54,9 +54,9 @@ You need to install following items ### Configuration -Create a griffin working directory in HDFS +Create database 'quartz' in mysql ``` -hdfs dfs -mkdir -p <griffin working dir> +mysql -u username -e "create database quartz" -p ``` Init quartz tables in mysql by service/src/main/resources/Init_quartz.sql ``` @@ -100,6 +100,22 @@ You should also modify some configurations of Griffin for your environment. # elasticsearch.user = user # elasticsearch.password = password ``` + +- <b>measure/src/main/resources/env.json</b> + ``` + "persist": [ + ... + { + "type": "http", + "config": { + "method": "post", + "api": "http://<your ES IP>:<ES rest port>/griffin/accuracy" + } + } + ] + ``` + Put the modified env.json file into HDFS. + - <b>service/src/main/resources/sparkJob.properties</b> ``` sparkJob.file = hdfs://<griffin measure path>/griffin-measure.jar @@ -115,35 +131,24 @@ You should also modify some configurations of Griffin for your environment. livy.uri = http://<your IP>:8998/batches spark.uri = http://<your IP>:8088 ``` - You should put these files into the same path as you set above in HDFS - -- <b>measure/src/main/resources/env.json</b> - ``` - "persist": [ - ... - { - "type": "http", - "config": { - "method": "post", - "api": "http://<your ES IP>:<port>/griffin/accuracy" - } - } - ] - ``` - Put this env.json file of measure module into \<griffin env path> in HDFS. - + - \<griffin measure path> is the location you should put the jar file of measure module. + - \<griffin env path> is the location you should put the env.json file. + - \<datanucleus path> is the location you should put the 3 jar files of livy, and the spark avro jar file if you need. + - \<spark conf path> is the location of spark conf directory. + ### Build and Run Build the whole project and deploy. (NPM should be installed) ``` - mvn install + mvn clean install ``` Put jar file of measure module into \<griffin measure path> in HDFS + ``` -cp measure/target/measure-<version>-incubating-SNAPSHOT.jar /measure/target/griffin-measure.jar -hdfs dfs -put /measure/target/griffin-measure.jar <griffin measure path>/ +cp measure/target/measure-<version>-incubating-SNAPSHOT.jar measure/target/griffin-measure.jar +hdfs dfs -put measure/target/griffin-measure.jar <griffin measure path>/ ``` After all environment services startup, we can start our server. @@ -184,4 +189,4 @@ See [Contributing Guide](./CONTRIBUTING.md) for details on how to contribute cod - [Service](https://github.com/apache/incubator-griffin/tree/master/griffin-doc/service) - [UI](https://github.com/apache/incubator-griffin/tree/master/griffin-doc/ui) - [Docker usage](https://github.com/apache/incubator-griffin/tree/master/griffin-doc/docker) - - [Postman API](https://github.com/apache/incubator-griffin/tree/master/griffin-doc/service/postman) + - [Postman API](https://github.com/apache/incubator-griffin/tree/master/griffin-doc/service/postman) \ No newline at end of file http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/FSD.md ---------------------------------------------------------------------- diff --git a/griffin-doc/FSD.md b/griffin-doc/FSD.md index b3dbba4..1caffc3 100644 --- a/griffin-doc/FSD.md +++ b/griffin-doc/FSD.md @@ -1,3 +1,5 @@ + + <!-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file @@ -51,91 +53,82 @@ So we conclude 3 data quality problems at eBay: ## Feature List -<table class="confluenceTable" border="2"><tbody><tr><th class="confluenceTh">#</th><th class="confluenceTh">Title</th><th class="confluenceTh">User Story</th><th class="confluenceTh">Importance</th><th colspan="1" class="confluenceTh">Status</th><th class="confluenceTh">Notes</th></tr><tr><td class="confluenceTd">1</td><td class="confluenceTd">User login</td><td class="confluenceTd"><p>User can login the system so that I'm able to access<br />the subsequent features.</p></td><td class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td class="confluenceTd"><ul><li>May use NT account, or a user list maintained in DB</li><li>Remember user for 1 month</li></ul></td></tr><tr><td class="confluenceTd">2</td><td class="confluenceTd">Create model - Accuracy</td><td class="confluenceTd"><p>User can create an accuracy model, so that the metrics</p><p>can be calculated by the rule defined in the model </p></td><td class="confluenceTd">Must Have</td><td colspan="1" clas s="confluenceTd"> </td><td class="confluenceTd"><ul><li>4 Steps in wizard:</li></ul><ol><li>Select the source dataset and fields which will be used for comparision</li><li>Select the target dataset and fields which will be used for comparision</li><li>Mapping the target fields with source, some basic functions should be <br />supported when mapping: exactly match, length(), lower(), upper(), <br />trim(), etc.</li><li>Set basic configuration for your model: name, definition,threshold, <br />schedule type, email, etc.</li></ol><ul><li>When submitting the form, need to confirm the form info</li><li>After submitting, model list should be displayed and the new model is <br />displayed as the 1st record.</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">3</td><td colspan="1" class="confluenceTd"><span>Create model - Validity</span></td><td colspan="1" class="confluenceTd"><p><span>User can create a validity model, so that the metrics </span></p><p><span>can be </span><span>cal culated by the rule defined in the model </span></p></td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>3 steps in wizard:</li></ul><ol><li>Select the target dataset and field which want to be checked, only one<br />field should be selected.</li><li>Define your syntax check logic which will be applied on the selected field,<br />including: <strong>Null Count, Unique Count, Duplicate Count, Maximum, </strong><br /><strong>Minimum, </strong><strong>Mean, Median, regular expression match count</strong></li><li><span>Set basic configuration for your model: name, definition,threshold, </span><br /><span>schedule type, email, etc.</span><span><br /></span></li></ol><ul><li>When submitting the form, need to confirm the form info</li><li>After submitting, model list should be displayed and the new model is <br />displayed as the 1st record.</li></ul></td></tr><tr><td colspan="1" class="confluenceTd"> 4</td><td colspan="1" class="confluenceTd"><p><span>Create model - Anomaly</span></p><p><span>Detection</span></p></td><td colspan="1" class="confluenceTd"><p><span>User can create an anomaly model, so that the metrics </span></p><p><span>can be </span><span>calculated by the rule defined in the model </span></p></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>3 steps in wizard:</li></ul><ol><li><span>Selected the predefined metrics of a data asset, such as "Total Count",</span><br /><span>"Null Count", or other validity metrics(calculated by validity model)</span></li><li><span>Select a statistical techniques: <strong>History Trend Detection, MAD, Bollinger</strong></span></li><li><span>Set basic configuration for your model: name, definition,threshold, </span><br /><span>schedule type, email, etc.</span></li></ol><ul><li>When submitting the form, need to confirm the form info</li><li>After submitting, model list should be displayed and the new model is <br />displayed as the 1st record.</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">5</td><td colspan="1" class="confluenceTd"><p>Create model - Publish</p><p>Metrics</p></td><td colspan="1" class="confluenceTd"><p><span>User can create a "publish metrics" model, so that the </span></p><p><span>metrics can be </span><span>calculated by the rule defined in the model </span></p></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Someone may already have their own metrics, so they only need to <br />manualy publish their metrics directly.</li><li>The publish URL and format should let the user know</li><li>User need to set basic configuration: name, definition,threshold, <br />schedule type, email, etc.</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">6< /td><td colspan="1" class="confluenceTd">List models</td><td colspan="1" class="confluenceTd"><p>User can get a list of all models which contain basic model</p><p>definition info</p></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Information should be shown: Name, Org, Type, Desc, Create Date, Status</li><li>Sorted by "Create Date" desc</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">7</td><td colspan="1" class="confluenceTd">View a model</td><td colspan="1" class="confluenceTd">User can view the details of a model definition</td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>All the information should be displayed: name, definition, type, org, asset,<br />threshold, schedule type, email, owner, status, test result, daily status, etc.</li><li>Daily st atus can be a chart</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">8</td><td colspan="1" class="confluenceTd">Delete a model</td><td colspan="1" class="confluenceTd">User can delete my own models</td><td colspan="1" class="confluenceTd">May Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Administrator should also have delete permission</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">9</td><td colspan="1" class="confluenceTd">DataAsset list</td><td colspan="1" class="confluenceTd">User can view all data assets</td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Information shown: name, type, HDFS path, org, create time, owner</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">10</td><td colspan="1" class="confluenceTd">Register DataAsset</td><td colspan="1" class="confluenceTd"><p>User can register his own data a sset, so that he can</p><p>define models under this asset</p></td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Input these information: name, type(hdfs, hive or sql), path, folder pattern, <br /><strong>partition path</strong>, org, schema, owner</li><li>schema is a list, including name, type, desc, sample. We can also import <br />an existing schema from avro</li><li>owner is the logon user</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">11</td><td colspan="1" class="confluenceTd">Delete a DataAsset</td><td colspan="1" class="confluenceTd"><span>User can delete his own data assets</span></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" class="confluenceTd">12</td><td colspan="1" class="confluenceTd">Edit a DataAsset</td><td colspan="1" class="conflue nceTd"><span>User can edit his own data assets</span></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Name, type. org cannot be edited</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">13</td><td colspan="1" class="confluenceTd">Heatmap</td><td colspan="1" class="confluenceTd"><p>User can see the heatmap when I login, so that I'll know</p><p>the status of the metrics</p></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Below target, displayed as red; otherwise, green</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">14</td><td colspan="1" class="confluenceTd">Statistics of the system</td><td colspan="1" class="confluenceTd">User can see the statistics of the entire system</td><td colspan="1" class="confluenceTd">May Have</td><td colspan="1" class="conf luenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>How many data assets totally</li><li>How many metrics totally</li><li>The healthy info of all metrics(the percentage of red/green)</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">15</td><td colspan="1" class="confluenceTd">List all metrics values</td><td colspan="1" class="confluenceTd">The application can provide the list of all metrics</td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>List format: time, name, value.</li><li>Can be organized by Org->Asset->metrics list</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">16</td><td colspan="1" class="confluenceTd">Show metrics charts</td><td colspan="1" class="confluenceTd"><span>The application can display the charts of all metrics</span></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td col span="1" class="confluenceTd"><ul><li>A list of charts orgnized by <span>Org->Asset->metrics</span></li><li><span>Can filter by Org->Asset</span></li></ul></td></tr><tr><td colspan="1" class="confluenceTd">17</td><td colspan="1" class="confluenceTd">Show My Dashboard</td><td colspan="1" class="confluenceTd"><p>User can see "my dashboard", so that he'll know the status</p><p>of his subscribed metrics</p></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>A list of charts</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">18</td><td colspan="1" class="confluenceTd">Subscribe metrics</td><td colspan="1" class="confluenceTd"><p>User can subscribe a metrics so that it can be displayed</p><p>on "my dashboard"</p></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="con fluenceTd"><ul><li>Subscribe steps</li></ul><ol><li>Select Org->Asset<ol><li>Can select on Org level, then all the assets under this Org will be <br />selected</li><li>Can select on Asset level</li><li>Can multiple select</li></ol></li><li>After the assets are selected, all the models under these assets should<br />be displayed, so that the end user will know which metrics he's selected</li><li>Do subscription</li></ol><p> </p></td></tr><tr><td colspan="1" class="confluenceTd">19</td><td colspan="1" class="confluenceTd">Edit subscription info</td><td colspan="1" class="confluenceTd">User can edit my subscription info</td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Can unsubscribe, and subscribe new metrics</li></ul></td></tr><tr><td colspan="1" class="confluenceTd"><span style="color: rgb(51,102,255);">20</span></td><td colspan="1" class="confluenceTd"><span style="color: rgb(51,102,255 );">Define email notification</span></td><td colspan="1" class="confluenceTd"><p><span style="color: rgb(51,102,255);">User can request to send notification email when issues</span></p><p><span style="color: rgb(51,102,255);">detected</span></p></td><td colspan="1" class="confluenceTd"><span style="color: rgb(51,102,255);">May Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li><span style="color: rgb(51,102,255);">On My Dashboard, I can specify a threshold for each metrics</span></li><li><span style="color: rgb(51,102,255);">Can define a unified email address or different email addresses for</span><br /><span style="color: rgb(51,102,255);">different metrics</span></li></ul></td></tr><tr><td colspan="1" class="confluenceTd"><span style="color: rgb(51,102,255);">21</span></td><td colspan="1" class="confluenceTd"><span style="color: rgb(51,102,255);">Specify email report</span></td><td colspan="1" class="confluenceTd"><span style="c olor: rgb(51,102,255);">User can decide the contents in email report</span></td><td colspan="1" class="confluenceTd"><span style="color: rgb(51,102,255);">May Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li><span style="color: rgb(51,102,255);">User can select the metrics contained in the report, can also modify</span><br /><span style="color: rgb(51,102,255);">the selection</span></li><li><span style="color: rgb(51,102,255);">Specify email addresses</span></li></ul></td></tr><tr><td colspan="1" class="confluenceTd"><span style="color: rgb(51,102,255);">22</span></td><td colspan="1" class="confluenceTd"><span style="color: rgb(51,102,255);">Report engine</span></td><td colspan="1" class="confluenceTd"><p><span style="color: rgb(51,102,255);">The application sends out the report regularly according </span></p><p><span style="color: rgb(51,102,255);">to user's subscription</span></p></td><td colspan="1" class="confluenceTd"><span style="color: rgb(51,102,255);">May Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li><span style="color: rgb(51,102,255);">Every day or every week, the report will be sent out at the same time</span></li><li><span style="color: rgb(51,102,255);">Main contents on the report are charts</span></li></ul></td></tr><tr><td colspan="1" class="confluenceTd">23</td><td colspan="1" class="confluenceTd">Scheduler job</td><td colspan="1" class="confluenceTd"><p>The application should have the scheduler jobs to</p><p>calculate the metrics</p></td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>According to the rules defined in the models, the scheduler job has these<br />functions:</li></ul><ol><li>Knows when to calculate a metrics</li><li>Call the model engine to get metrics values</li><li>Save the metrics result</li><li>Send notification emails if n ecessary</li></ol></td></tr><tr><td colspan="1" class="confluenceTd">24</td><td colspan="1" class="confluenceTd">Model engine</td><td colspan="1" class="confluenceTd">The application can calculate the metrics values</td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>With the rule definition, the engine can calculate the metrics values</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">25</td><td colspan="1" class="confluenceTd">Sampling</td><td colspan="1" class="confluenceTd"><p>User can download the sample data to analyze the</p><p>root cause when issue detected</p></td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"> </td></tr><tr><td colspan="1" class="confluenceTd">26</td><td colspan="1" class="confluenceTd">Profiling</td><td colspan="1" class="confluenceTd">User can profile the data</td><td colsp an="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>According to the rules defined in the model, do data profiling</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">27</td><td colspan="1" class="confluenceTd">User settings</td><td colspan="1" class="confluenceTd">User can specify my own settings</td><td colspan="1" class="confluenceTd">May Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>May set the unified email address for notifications</li><li>Set my default view: view the whole picture of all systems, or just my <br />concerned ones(defined in my dashboard)</li><li>......</li></ul></td></tr></tbody></table> +<table class="confluenceTable" border="2"><tbody><tr><th class="confluenceTh">#</th><th class="confluenceTh">Title</th><th class="confluenceTh">User Story</th><th class="confluenceTh">Importance</th><th colspan="1" class="confluenceTh">Status</th><th class="confluenceTh">Notes</th></tr><tr><td class="confluenceTd">1</td><td class="confluenceTd">User login</td><td class="confluenceTd"><p>User can login the system so that I'm able to access<br />the subsequent features.</p></td><td class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td class="confluenceTd"><ul><li>There are two login strategies you can choose</li><li>Ldap strategy: May use NT account, or a user list maintained in DB</li><li>Default strategy: You can login with any username and password</li></ul></td></tr><tr><td class="confluenceTd">2</td><td class="confluenceTd">Create measure - Accuracy</td><td class="confluenceTd"><p>User can create an accuracy measure, so that the metrics</p><p>can be ca lculated by the rule defined in the measure </p></td><td class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td class="confluenceTd"><ul><li>5 Steps in wizard:</li></ul><ol><li>Select the source dataset and fields which will be used for comparision</li><li>Select the target dataset and fields which will be used for comparision</li><li>Mapping the target fields with source, some basic functions should be <br />supported when mapping: <br /> etc.</li><li>Set partition configuration for source dataset and target dataset</li><li>Set basic configuration for your model: name, description <br />measure type, etc.</li></ol><ul><li>When submitting the form, need to confirm the form info</li><li>After submitting, model list should be displayed and the new model is <br />displayed as the 1st record.</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">3</td><td colspan="1" class="confluenceTd"><span>Create measure -Data Profiling</span></td><td colspan="1" c lass="confluenceTd"><p><span>User can create a profiling measure, so that the metrics </span></p><p><span>can be </span><span>calculated by the rule defined in the measure </span></p></td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>4 steps in wizard:</li></ul><ol><li>Select the target dataset and field which want to be checked, only one<br />field should be selected.</li><li>Define your syntax check logic which will be applied on the selected field,<br />including: <strong>Null Count,Distinct Count, Total Count, Maximum, </strong><br /><strong>Minimum, </strong><strong>Average, Enum Detection Top5 Count</strong></li><li>Set partition configuration for target dataset</li><li><span>Set basic configuration for your measure: name,description,group, </span><br /><span>etc.</span><span><br /></span></li></ol><ul><li>When submitting the form, need to confirm the form info</li><li>After submitting , measure list should be displayed and the new meaure is <br />displayed as the last record.</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">4</td><td colspan="1" class="confluenceTd"><p><span>Create Job</span></p></td><td colspan="1" class="confluenceTd"><p><span>User can create a job which schedules one measure you created </span></p></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>1 step in wizard:</li></ul><ol><li><span>Set basic information for your job: measure name, cron expression, </span><br /><span>data range, etc.</span></li></ol><ul><li>When submitting the form, need to confirm the form info</li><li>After submitting, job list should be displayed and the new job is <br />displayed as the last record.</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">5</td><td colspan="1" class="confluenceTd"><p>List jobs</p></td><td colspan="1" class="confluenc eTd"><p>User can get a list of all jobs </p><p>definition info</p><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Job information should be shown: Job Name,Previous Fire Time,Next Fire Time, Trigger State,Cron Expression, Action,Metric</li><li>Job instance information should be shown:AppID,Time,State</li><li>Jobinstance sorted by Time" desc</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">6</td><td colspan="1" class="confluenceTd">Delete a job</td><td colspan="1" class="confluenceTd">User can delete my own jobs</td><td colspan="1" class="confluenceTd">May Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Administrator should also have delete permission</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">7</td><td colspan="1" class="confluenceTd">List measures</td><td colspan="1" class="confluenceTd"><p>User can get a list of all measures which contain basic measure</p><p>definition info</p></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Information should be shown: Measure Name,Measure Type, Description, Group,Action</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">8</td><td colspan="1" class="confluenceTd">View a measure</td><td colspan="1" class="confluenceTd">User can view the details of a measure definition</td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>All the information should be displayed: measure name, description, measure type, group,<br />source,target,owner,etc.</li><li>Mapping rules and accuracy calculations formula are also displayed</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">9</td><td colspan="1" class="confluenceTd">Delete a measur e</td><td colspan="1" class="confluenceTd">User can delete my own measures</td><td colspan="1" class="confluenceTd">May Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Administrator should also have delete permission</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">10</td><td colspan="1" class="confluenceTd">DataAsset list</td><td colspan="1" class="confluenceTd">User can view all data assets</td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Information shown: table name, DB name, owner, creation time, last access time, location</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">11</td><td colspan="1" class="confluenceTd">Heatmap</td><td colspan="1" class="confluenceTd"><p>User can see the heatmap when I login, so that I'll know</p><p>the status of the metrics</p></td><td colspan="1" class="confluenceTd"><span>Must Have</sp an></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>Show all metrics results displayed as green</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">12</td><td colspan="1" class="confluenceTd">Siderbar</td><td colspan="1" class="confluenceTd">The application can provide the list of all metrics</td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>List format: time, name, value.</li><li>Can be organized by Measure->metrics list</li></ul></td></tr><tr><td colspan="1" class="confluenceTd">13</td><td colspan="1" class="confluenceTd">Show mydashboard</td><td colspan="1" class="confluenceTd"><span>The application can display the charts of all metrics</span></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>A list of charts orgnized by <span>Mea sure->metrics list</span></li><li><span>Can filter by Measure</span></li></ul></td></tr><tr><td colspan="1" class="confluenceTd">14</td><td colspan="1" class="confluenceTd">Show metric detail</td><td colspan="1" class="confluenceTd"><span>Can display the detail of the metric</span></td><td colspan="1" class="confluenceTd"><span>Must Have</span></td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li><span>Show metric details</span></li></ul></td></tr><tr><td colspan="1" class="confluenceTd">15</td><td colspan="1" class="confluenceTd">Scheduler job</td><td colspan="1" class="confluenceTd"><p>The application should have the scheduler jobs to</p><p>calculate the metrics</p></td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>According to the rules defined in the models, the scheduler job has these<br />functions:</li></ul><ol><li>Know when to calculate a met ric</li><li>Call the measure engine to get metrics values</li><li>Save the metrics result</li></ol></td></tr><tr><td colspan="1" class="confluenceTd">16</td><td colspan="1" class="confluenceTd">Measure engine</td><td colspan="1" class="confluenceTd">The application can calculate the metrics values</td><td colspan="1" class="confluenceTd">Must Have</td><td colspan="1" class="confluenceTd"> </td><td colspan="1" class="confluenceTd"><ul><li>With the rule definition, the engine can calculate the metrics values</li></ul></td></tr></tbody></table> ## User interaction and design <p style="color: rgb(51,102,255);">#1 User Login</p> -<img src="img/fsd/image2016-6-30 13-19-2.png" > -<p style="color: rgb(51,102,255);">#2 Create model - Accuracy</p> +<img src="img/fsd/image2018-1-8 12-27-53.png" > + +<p style="color: rgb(51,102,255);">#2 Create measure - Accuracy</p> step 1 -> step 2 -> step 3 -> step 4 ->step 5 - confirmation -<img src="img/fsd/image2016-6-30 16-16-21.png" > -<img src="img/fsd/image2016-6-30 16-17-5.png" > -<img src="img/fsd/image2016-6-30 16-17-52.png" > -<img src="img/fsd/image2016-6-30 16-18-20.png" > -<img src="img/fsd/image2016-6-30 16-18-52.png" > +<img src="img/fsd/image2018-1-8 12-33-2.png" > +<img src="img/fsd/image2018-1-8 12-38-12.png" > +<img src="img/fsd/image2018-1-8 12-44-30.png" > -<p style="color: rgb(51,102,255);">#3 Create model - Validity</p> -step 1 -> step 2 -> step 3 -> step 4 - confirmation +<img src="img/fsd/image2018-1-8 12-48-20.png" > +<img src="img/fsd/image2018-1-8 12-51-13.png" > -<img src="img/fsd/image2016-6-30 16-20-34.png" > -<img src="img/fsd/image2016-6-30 16-20-53.png" > -<img src="img/fsd/image2016-6-30 16-21-16.png" > -<img src="img/fsd/image2016-6-30 16-21-49.png" > +<img src="img/fsd/image2018-1-8 13-02-15.png" > -<p style="color: rgb(51,102,255);">#4 Create model - Anomaly Detection</p> +<p style="color: rgb(51,102,255);">#3 Create measure - Profiling</p> step 1 -> step 2 -> step 3 -> step 4 - confirmation -<img src="img/fsd/image2016-6-30 16-22-53.png" > -<img src="img/fsd/image2016-6-30 16-23-11.png" > -<img src="img/fsd/image2016-6-30 16-23-32.png" > -<img src="img/fsd/image2016-6-30 16-24-7.png" > +<img src="img/fsd/image2018-1-8 13-07-16.png" > +<img src="img/fsd/image2018-1-8 13-10-28.png" > +<img src="img/fsd/image2018-1-8 13-12-10.png" > +<img src="img/fsd/image2018-1-8 13-13-40.png" > -<p style="color: rgb(51,102,255);">#5 Create model - Publish Metrics</p> -step 1 -> step 2 - confirmation +<img src="img/fsd/image2018-1-8 13-15-30.png" > -<img src="img/fsd/image2016-6-30 16-25-12.png" > -<img src="img/fsd/image2016-6-30 16-25-42.png" > +<p style="color: rgb(51,102,255);">#4 Create job</p> -<p style="color: rgb(51,102,255);">#6 List models</p> -<img src="img/fsd/image2016-6-30 16-31-26.png" > +<img src="img/fsd/image2018-2-6 11-1-10.png" > -<p style="color: rgb(51,102,255);">#7 View a model</p> -<img src="img/fsd/image2016-6-30 16-33-44.png" > +<img src="img/fsd/image2018-2-6 11-3-19.png" > -<p style="color: rgb(51,102,255);">#8 Delete model</p> -<img src="img/fsd/image2016-6-30 16-34-58.png" > +<p style="color: rgb(51,102,255);">#5 List jobs</p> -<p style="color: rgb(51,102,255);">#9 DataAsset list</p> -<img src="img/fsd/image2016-6-30 16-35-18.png" > +<img src="img/fsd/image2018-2-6 10-54-15.png" > -<p style="color: rgb(51,102,255);">#10 Register DataAsset</p> -<i><Partition path isn't in this mock-up, will add it later ></i> +<img src="img/fsd/image2018-2-6 10-57-20.png" > -<img src="img/fsd/image2016-6-30 16-35-57.png" > -<img src="img/fsd/image2016-6-30 16-36-48.png" > +<p style="color: rgb(51,102,255);">#6 Delete a job</p> -<p style="color: rgb(51,102,255);">#11 Delete a DataAsset</p> -<img src="img/fsd/image2016-6-30 16-39-17.png" > +<img src="img/fsd/image2018-2-6 10-58-24.png" > -<p style="color: rgb(51,102,255);">#12 Edit a DataAsset</p> -<img src="img/fsd/image2016-6-30 16-37-48.png" > +<p style="color: rgb(51,102,255);">#7 List measures</p> +<img src="img/fsd/image2018-2-5 14-45-10.png" > -<p style="color: rgb(51,102,255);">#13 Heatmap</p> -<img src="img/fsd/image2016-6-30 16-39-37.png" > +<p style="color: rgb(51,102,255);">#8 View a measure</p> +<img src="img/fsd/image2018-2-5 14-44-20.png" > -<p style="color: rgb(51,102,255);">#14 Statistics of the system</p> -<img src="img/fsd/image2016-6-30 16-40-14.png" > +<p style="color: rgb(51,102,255);">#9 Delete a measure</p> +<img src="img/fsd/image2018-2-5 14-46-26.png" > -<p style="color: rgb(51,102,255);">#15 List all metrics values</p> -<img src="img/fsd/image2016-6-30 16-41-5.png" > +<p style="color: rgb(51,102,255);">#10 DataAsset list</p> +<img src="img/fsd/image2018-2-5 14-50-10.png" > -<p style="color: rgb(51,102,255);">#16 Show metrics charts</p> -chart list -> Max chart display +<p style="color: rgb(51,102,255);">#11 Heatmap</p> +<img src="img/fsd/image2018-2-6 10-10-15.png" > -<img src="img/fsd/image2016-6-30 16-41-57.png" > -<img src="img/fsd/image2016-6-30 16-42-16.png" > +<p style="color: rgb(51,102,255);">#12 List all metrics values</p> +<img src="img/fsd/image2018-2-6 10-48-10.png" style="height:400px;"> + + + +<p style="color: rgb(51,102,255);">#13 Show My Dashboard</p> +chart list -> Max chart display -<p style="color: rgb(51,102,255);">#17 Show My Dashboard</p> -<img src="img/fsd/image2016-6-30 16-44-15.png" > +<img src="img/fsd/image2018-2-6 10-50-10.png" > -<p style="color: rgb(51,102,255);">#18 Subscribe metrics</p> -TBD +<p style="color: rgb(51,102,255);">#14 Show metric detail</p> +<img src="img/fsd/image2018-2-6 10-51-16.png" > -<p style="color: rgb(51,102,255);">#19 Edit subscription info</p> -Same UI as #18 +<p style="color: rgb(51,102,255);">#15 Scheduler job</p> +Same UI as #4 ## Questions Below is a list of questions to be addressed as a result of this requirements document: http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 13-19-2.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 13-19-2.png b/griffin-doc/img/fsd/image2016-6-30 13-19-2.png deleted file mode 100644 index 01c55dc..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 13-19-2.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-16-21.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-16-21.png b/griffin-doc/img/fsd/image2016-6-30 16-16-21.png deleted file mode 100644 index cb142e3..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-16-21.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-17-5.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-17-5.png b/griffin-doc/img/fsd/image2016-6-30 16-17-5.png deleted file mode 100644 index c76db3a..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-17-5.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-17-52.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-17-52.png b/griffin-doc/img/fsd/image2016-6-30 16-17-52.png deleted file mode 100644 index 2f2de84..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-17-52.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-18-20.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-18-20.png b/griffin-doc/img/fsd/image2016-6-30 16-18-20.png deleted file mode 100644 index 47cef7e..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-18-20.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-18-52.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-18-52.png b/griffin-doc/img/fsd/image2016-6-30 16-18-52.png deleted file mode 100644 index 62e29fc..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-18-52.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-20-34.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-20-34.png b/griffin-doc/img/fsd/image2016-6-30 16-20-34.png deleted file mode 100644 index a644d74..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-20-34.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-20-53.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-20-53.png b/griffin-doc/img/fsd/image2016-6-30 16-20-53.png deleted file mode 100644 index b4b4aaf..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-20-53.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-21-16.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-21-16.png b/griffin-doc/img/fsd/image2016-6-30 16-21-16.png deleted file mode 100644 index c5d214e..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-21-16.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-21-49.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-21-49.png b/griffin-doc/img/fsd/image2016-6-30 16-21-49.png deleted file mode 100644 index e644a60..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-21-49.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-22-53.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-22-53.png b/griffin-doc/img/fsd/image2016-6-30 16-22-53.png deleted file mode 100644 index 23246e9..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-22-53.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-23-11.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-23-11.png b/griffin-doc/img/fsd/image2016-6-30 16-23-11.png deleted file mode 100644 index 5b52f7b..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-23-11.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-23-32.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-23-32.png b/griffin-doc/img/fsd/image2016-6-30 16-23-32.png deleted file mode 100644 index a06be23..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-23-32.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-24-7.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-24-7.png b/griffin-doc/img/fsd/image2016-6-30 16-24-7.png deleted file mode 100644 index b3985bf..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-24-7.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-25-12.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-25-12.png b/griffin-doc/img/fsd/image2016-6-30 16-25-12.png deleted file mode 100644 index 4762c02..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-25-12.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-25-42.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-25-42.png b/griffin-doc/img/fsd/image2016-6-30 16-25-42.png deleted file mode 100644 index f7d2662..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-25-42.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-31-26.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-31-26.png b/griffin-doc/img/fsd/image2016-6-30 16-31-26.png deleted file mode 100644 index a69d99f..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-31-26.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-33-44.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-33-44.png b/griffin-doc/img/fsd/image2016-6-30 16-33-44.png deleted file mode 100644 index b77ff6a..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-33-44.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-34-58.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-34-58.png b/griffin-doc/img/fsd/image2016-6-30 16-34-58.png deleted file mode 100644 index 340c6ad..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-34-58.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-35-18.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-35-18.png b/griffin-doc/img/fsd/image2016-6-30 16-35-18.png deleted file mode 100644 index b992258..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-35-18.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-35-57.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-35-57.png b/griffin-doc/img/fsd/image2016-6-30 16-35-57.png deleted file mode 100644 index 8dbb96e..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-35-57.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-36-48.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-36-48.png b/griffin-doc/img/fsd/image2016-6-30 16-36-48.png deleted file mode 100644 index 6156fcb..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-36-48.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-37-48.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-37-48.png b/griffin-doc/img/fsd/image2016-6-30 16-37-48.png deleted file mode 100644 index e2645b2..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-37-48.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-39-17.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-39-17.png b/griffin-doc/img/fsd/image2016-6-30 16-39-17.png deleted file mode 100644 index 7c60136..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-39-17.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-39-37.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-39-37.png b/griffin-doc/img/fsd/image2016-6-30 16-39-37.png deleted file mode 100644 index 2382b23..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-39-37.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-40-14.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-40-14.png b/griffin-doc/img/fsd/image2016-6-30 16-40-14.png deleted file mode 100644 index fec613e..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-40-14.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-41-5.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-41-5.png b/griffin-doc/img/fsd/image2016-6-30 16-41-5.png deleted file mode 100644 index d3381b1..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-41-5.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-41-57.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-41-57.png b/griffin-doc/img/fsd/image2016-6-30 16-41-57.png deleted file mode 100644 index 737e6fc..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-41-57.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-42-16.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-42-16.png b/griffin-doc/img/fsd/image2016-6-30 16-42-16.png deleted file mode 100644 index 048b5db..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-42-16.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2016-6-30 16-44-15.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2016-6-30 16-44-15.png b/griffin-doc/img/fsd/image2016-6-30 16-44-15.png deleted file mode 100644 index f70a229..0000000 Binary files a/griffin-doc/img/fsd/image2016-6-30 16-44-15.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 12-27-53.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 12-27-53.png b/griffin-doc/img/fsd/image2018-1-8 12-27-53.png new file mode 100644 index 0000000..810b0d9 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 12-27-53.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 12-33-2.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 12-33-2.png b/griffin-doc/img/fsd/image2018-1-8 12-33-2.png new file mode 100644 index 0000000..d22b204 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 12-33-2.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 12-38-12.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 12-38-12.png b/griffin-doc/img/fsd/image2018-1-8 12-38-12.png new file mode 100644 index 0000000..ca38e5f Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 12-38-12.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 12-44-30.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 12-44-30.png b/griffin-doc/img/fsd/image2018-1-8 12-44-30.png new file mode 100644 index 0000000..30cdd4f Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 12-44-30.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 12-48-20.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 12-48-20.png b/griffin-doc/img/fsd/image2018-1-8 12-48-20.png new file mode 100644 index 0000000..f951ce8 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 12-48-20.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 12-51-13.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 12-51-13.png b/griffin-doc/img/fsd/image2018-1-8 12-51-13.png new file mode 100644 index 0000000..f5a6897 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 12-51-13.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 13-02-15.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 13-02-15.png b/griffin-doc/img/fsd/image2018-1-8 13-02-15.png new file mode 100644 index 0000000..7f85b83 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 13-02-15.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 13-07-16.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 13-07-16.png b/griffin-doc/img/fsd/image2018-1-8 13-07-16.png new file mode 100644 index 0000000..3cc4700 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 13-07-16.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 13-10-28.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 13-10-28.png b/griffin-doc/img/fsd/image2018-1-8 13-10-28.png new file mode 100644 index 0000000..7b41369 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 13-10-28.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 13-12-10.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 13-12-10.png b/griffin-doc/img/fsd/image2018-1-8 13-12-10.png new file mode 100644 index 0000000..7ad1a50 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 13-12-10.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 13-13-40.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 13-13-40.png b/griffin-doc/img/fsd/image2018-1-8 13-13-40.png new file mode 100644 index 0000000..35f24a7 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 13-13-40.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-1-8 13-15-30.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-1-8 13-15-30.png b/griffin-doc/img/fsd/image2018-1-8 13-15-30.png new file mode 100644 index 0000000..b27ba28 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-1-8 13-15-30.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-5 14-44-20.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-5 14-44-20.png b/griffin-doc/img/fsd/image2018-2-5 14-44-20.png new file mode 100644 index 0000000..cf9779a Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-5 14-44-20.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-5 14-45-10.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-5 14-45-10.png b/griffin-doc/img/fsd/image2018-2-5 14-45-10.png new file mode 100644 index 0000000..84a167d Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-5 14-45-10.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-5 14-46-26.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-5 14-46-26.png b/griffin-doc/img/fsd/image2018-2-5 14-46-26.png new file mode 100644 index 0000000..7fed502 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-5 14-46-26.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-5 14-50-10.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-5 14-50-10.png b/griffin-doc/img/fsd/image2018-2-5 14-50-10.png new file mode 100644 index 0000000..61decf7 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-5 14-50-10.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-6 10-10-15.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-6 10-10-15.png b/griffin-doc/img/fsd/image2018-2-6 10-10-15.png new file mode 100644 index 0000000..12189fc Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-6 10-10-15.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-6 10-48-10.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-6 10-48-10.png b/griffin-doc/img/fsd/image2018-2-6 10-48-10.png new file mode 100644 index 0000000..d17a1f6 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-6 10-48-10.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-6 10-50-10.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-6 10-50-10.png b/griffin-doc/img/fsd/image2018-2-6 10-50-10.png new file mode 100644 index 0000000..e3152dc Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-6 10-50-10.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-6 10-51-16.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-6 10-51-16.png b/griffin-doc/img/fsd/image2018-2-6 10-51-16.png new file mode 100644 index 0000000..7e10fe4 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-6 10-51-16.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-6 10-54-15.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-6 10-54-15.png b/griffin-doc/img/fsd/image2018-2-6 10-54-15.png new file mode 100644 index 0000000..0407309 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-6 10-54-15.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-6 10-57-20.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-6 10-57-20.png b/griffin-doc/img/fsd/image2018-2-6 10-57-20.png new file mode 100644 index 0000000..eafa6fa Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-6 10-57-20.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-6 10-58-24.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-6 10-58-24.png b/griffin-doc/img/fsd/image2018-2-6 10-58-24.png new file mode 100644 index 0000000..1f79d9b Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-6 10-58-24.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-6 11-1-10.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-6 11-1-10.png b/griffin-doc/img/fsd/image2018-2-6 11-1-10.png new file mode 100644 index 0000000..56be780 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-6 11-1-10.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/fsd/image2018-2-6 11-3-19.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/fsd/image2018-2-6 11-3-19.png b/griffin-doc/img/fsd/image2018-2-6 11-3-19.png new file mode 100644 index 0000000..69ad910 Binary files /dev/null and b/griffin-doc/img/fsd/image2018-2-6 11-3-19.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/1.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/1.PNG b/griffin-doc/img/userguide/1.PNG deleted file mode 100644 index 776a16d..0000000 Binary files a/griffin-doc/img/userguide/1.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/13.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/13.PNG b/griffin-doc/img/userguide/13.PNG deleted file mode 100644 index 24dbcc1..0000000 Binary files a/griffin-doc/img/userguide/13.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/23.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/23.PNG b/griffin-doc/img/userguide/23.PNG deleted file mode 100644 index 5488c83..0000000 Binary files a/griffin-doc/img/userguide/23.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/33.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/33.PNG b/griffin-doc/img/userguide/33.PNG deleted file mode 100644 index 1a5867b..0000000 Binary files a/griffin-doc/img/userguide/33.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/Capwture.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/Capwture.PNG b/griffin-doc/img/userguide/Capwture.PNG deleted file mode 100644 index 2382b23..0000000 Binary files a/griffin-doc/img/userguide/Capwture.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/DQ metirics.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/DQ metirics.PNG b/griffin-doc/img/userguide/DQ metirics.PNG deleted file mode 100644 index 048b5db..0000000 Binary files a/griffin-doc/img/userguide/DQ metirics.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/ac_partition.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/ac_partition.png b/griffin-doc/img/userguide/ac_partition.png new file mode 100644 index 0000000..f951ce8 Binary files /dev/null and b/griffin-doc/img/userguide/ac_partition.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/accuracy.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/accuracy.png b/griffin-doc/img/userguide/accuracy.png index 85ba84d..adf406f 100644 Binary files a/griffin-doc/img/userguide/accuracy.png and b/griffin-doc/img/userguide/accuracy.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/anomaly .PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/anomaly .PNG b/griffin-doc/img/userguide/anomaly .PNG deleted file mode 100644 index 67505b7..0000000 Binary files a/griffin-doc/img/userguide/anomaly .PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/asset list.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/asset list.png b/griffin-doc/img/userguide/asset list.png index 761a27a..02c258c 100644 Binary files a/griffin-doc/img/userguide/asset list.png and b/griffin-doc/img/userguide/asset list.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/asset.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/asset.PNG b/griffin-doc/img/userguide/asset.PNG deleted file mode 100644 index 761a27a..0000000 Binary files a/griffin-doc/img/userguide/asset.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/bullseye.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/bullseye.png b/griffin-doc/img/userguide/bullseye.png deleted file mode 100644 index 737e6fc..0000000 Binary files a/griffin-doc/img/userguide/bullseye.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/confirm job.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/confirm job.png b/griffin-doc/img/userguide/confirm job.png new file mode 100644 index 0000000..f931f2c Binary files /dev/null and b/griffin-doc/img/userguide/confirm job.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/confirm measure.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/confirm measure.png b/griffin-doc/img/userguide/confirm measure.png new file mode 100644 index 0000000..66be886 Binary files /dev/null and b/griffin-doc/img/userguide/confirm measure.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/confirm new.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/confirm new.png b/griffin-doc/img/userguide/confirm new.png deleted file mode 100644 index a2d5789..0000000 Binary files a/griffin-doc/img/userguide/confirm new.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/confirm.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/confirm.PNG b/griffin-doc/img/userguide/confirm.PNG deleted file mode 100644 index a2d5789..0000000 Binary files a/griffin-doc/img/userguide/confirm.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/create job.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/create job.png b/griffin-doc/img/userguide/create job.png index 780fe09..c17daed 100644 Binary files a/griffin-doc/img/userguide/create job.png and b/griffin-doc/img/userguide/create job.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/create measure.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/create measure.png b/griffin-doc/img/userguide/create measure.png index d7b8660..16e26d0 100644 Binary files a/griffin-doc/img/userguide/create measure.png and b/griffin-doc/img/userguide/create measure.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/dashboard big.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/dashboard big.png b/griffin-doc/img/userguide/dashboard big.png index b0a7476..7e10fe4 100644 Binary files a/griffin-doc/img/userguide/dashboard big.png and b/griffin-doc/img/userguide/dashboard big.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/data asset new.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/data asset new.png b/griffin-doc/img/userguide/data asset new.png index fc6541a..8ca6bde 100644 Binary files a/griffin-doc/img/userguide/data asset new.png and b/griffin-doc/img/userguide/data asset new.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/data asset.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/data asset.PNG b/griffin-doc/img/userguide/data asset.PNG deleted file mode 100644 index fc6541a..0000000 Binary files a/griffin-doc/img/userguide/data asset.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/download.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/download.PNG b/griffin-doc/img/userguide/download.PNG deleted file mode 100644 index 758c8e6..0000000 Binary files a/griffin-doc/img/userguide/download.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/job config.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/job config.png b/griffin-doc/img/userguide/job config.png index 2fd41f4..72a1625 100644 Binary files a/griffin-doc/img/userguide/job config.png and b/griffin-doc/img/userguide/job config.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/log in.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/log in.PNG b/griffin-doc/img/userguide/log in.PNG deleted file mode 100644 index 680fc1f..0000000 Binary files a/griffin-doc/img/userguide/log in.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/mapping.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/mapping.png b/griffin-doc/img/userguide/mapping.png index cfb21d6..54aa65c 100644 Binary files a/griffin-doc/img/userguide/mapping.png and b/griffin-doc/img/userguide/mapping.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/measure info.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/measure info.png b/griffin-doc/img/userguide/measure info.png index 9b8e0b4..d69c8c1 100644 Binary files a/griffin-doc/img/userguide/measure info.png and b/griffin-doc/img/userguide/measure info.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/metrics dashboard.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/metrics dashboard.png b/griffin-doc/img/userguide/metrics dashboard.png index 1cbb843..e3152dc 100644 Binary files a/griffin-doc/img/userguide/metrics dashboard.png and b/griffin-doc/img/userguide/metrics dashboard.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/my dashboard.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/my dashboard.PNG b/griffin-doc/img/userguide/my dashboard.PNG deleted file mode 100644 index d88e342..0000000 Binary files a/griffin-doc/img/userguide/my dashboard.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/p.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/p.PNG b/griffin-doc/img/userguide/p.PNG deleted file mode 100644 index 45e7faf..0000000 Binary files a/griffin-doc/img/userguide/p.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/right bar.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/right bar.png b/griffin-doc/img/userguide/right bar.png index 8a55c6a..d17a1f6 100644 Binary files a/griffin-doc/img/userguide/right bar.png and b/griffin-doc/img/userguide/right bar.png differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/sample.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/sample.PNG b/griffin-doc/img/userguide/sample.PNG deleted file mode 100644 index 88ab3b3..0000000 Binary files a/griffin-doc/img/userguide/sample.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/side.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/side.PNG b/griffin-doc/img/userguide/side.PNG deleted file mode 100644 index 776a16d..0000000 Binary files a/griffin-doc/img/userguide/side.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/source new.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/source new.png b/griffin-doc/img/userguide/source new.png deleted file mode 100644 index fc42d7e..0000000 Binary files a/griffin-doc/img/userguide/source new.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/source.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/source.PNG b/griffin-doc/img/userguide/source.PNG index fc42d7e..d1c7b93 100644 Binary files a/griffin-doc/img/userguide/source.PNG and b/griffin-doc/img/userguide/source.PNG differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/source2.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/source2.PNG b/griffin-doc/img/userguide/source2.PNG deleted file mode 100644 index 215393e..0000000 Binary files a/griffin-doc/img/userguide/source2.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/subscribe.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/subscribe.PNG b/griffin-doc/img/userguide/subscribe.PNG deleted file mode 100644 index 0684c47..0000000 Binary files a/griffin-doc/img/userguide/subscribe.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/subscriberesult.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/subscriberesult.PNG b/griffin-doc/img/userguide/subscriberesult.PNG deleted file mode 100644 index b5a5aca..0000000 Binary files a/griffin-doc/img/userguide/subscriberesult.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/target new.png ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/target new.png b/griffin-doc/img/userguide/target new.png deleted file mode 100644 index 246977b..0000000 Binary files a/griffin-doc/img/userguide/target new.png and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/target.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/target.PNG b/griffin-doc/img/userguide/target.PNG index 246977b..b6e16d9 100644 Binary files a/griffin-doc/img/userguide/target.PNG and b/griffin-doc/img/userguide/target.PNG differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/img/userguide/validity.PNG ---------------------------------------------------------------------- diff --git a/griffin-doc/img/userguide/validity.PNG b/griffin-doc/img/userguide/validity.PNG deleted file mode 100644 index a1fc0e9..0000000 Binary files a/griffin-doc/img/userguide/validity.PNG and /dev/null differ http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/43fe6086/griffin-doc/ui/dockerUIguide.md ---------------------------------------------------------------------- diff --git a/griffin-doc/ui/dockerUIguide.md b/griffin-doc/ui/dockerUIguide.md deleted file mode 100644 index 2d434e3..0000000 --- a/griffin-doc/ui/dockerUIguide.md +++ /dev/null @@ -1,50 +0,0 @@ -<!-- -Licensed to the Apache Software Foundation (ASF) under one -or more contributor license agreements. See the NOTICE file -distributed with this work for additional information -regarding copyright ownership. The ASF licenses this file -to you under the Apache License, Version 2.0 (the -"License"); you may not use this file except in compliance -with the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - -Unless required by applicable law or agreed to in writing, -software distributed under the License is distributed on an -"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -KIND, either express or implied. See the License for the -specific language governing permissions and limitations -under the License. ---> -## Docker webUI Guide - -### Preparatory work - -Follow the steps [here](https://github.com/apache/incubator-griffin#how-to-run-in-docker), prepare your docker container of griffin, and get your webUI ready. - -### webUI test case guide - -1. Click "Data Assets" at the top right corner, to watch all the exist data assets. - In docker, we've prepared two data asset in Hive, through this page, you can see all the table metadata in Hive. - -2. Click "Measures" button at the top left corner to watch all the measures here, and you can also create a new DQ measurement by following steps. - 1) Click "Create Measure" button at the top left corner, choose the top left block "Accuracy", at current we only support accuracy type. - 2) Choose Source: find "demo_src" in the left tree, select some or all attributes in the right block, click "Next". - 3) Choose Target: find "demo_tgt" in the left tree, select the matching attributes with source data asset in the right block, click "Next". - 4) Mapping Source and Target: select "Source Fields" of each row, to match the corresponding field in target table, e.g. id maps to id, age maps to age, desc maps to desc. - Finish all the mapping, click "Next". - 5) Fill out the required table as required, "Organization" is the group of this measurement. - Submit and save, you can see your new DQ measurement created in the measures list. - -3. Now you've created a new DQ measurement, the measurement needs to be scheduled to run in the docker container. Click "Jobs" button to watch all the jobs here, at current there is no job, you need to create a new one. - Click "Create Job" button at the top left corner, fill out all the blocks as below. - ``` - "Source Partition": YYYYMMdd-HH - "Target Partition": YYYYMMdd-HH - "Measure Name": <choose the measure you just created> - "Start After(s)": 0 - "Interval": 300 - ``` - The source and target partition means the partition pattern of the demo data, which is based on timestamp, "Start After(s)" means the job will start after n seconds, "Interval" is the interval of job, the unit is second. In the example above, the job will run every 5 minutes. - - Wait for about 1 minute, after the calculation, results would be published to web UI, then you can watch the dashboard by clicking "DQ Metrics" at the top right corner.
