Re: [VOTE] Release of Apache Griffin-0.2.0-incubating [RC4]

2018-05-04 Thread Kevin Yao
+1 On Wed, May 2, 2018 at 10:56 AM, john@apache wrote: > +1 > > On Wed, May 2, 2018 at 10:12 AM, Lionel Liu wrote: > > > I checked: > > > > signature files: OK > > hash files: OK > > LICENSE: OK for source release, no cat-X dependency, no cat-B bundled

RE: No Index Formation in Elastic Search

2018-05-04 Thread Karan Gupta
HI Lionel, The metrics is being persisted in HDFS… This is good progress for us. Thank you for all your valuable help. We created an index for Griffin but we were not sure about what mappings we should use. Until we created this, we never got this index auto-created in ES….. And now that we

Re: Re:Livy Error

2018-05-04 Thread Kevin Yao
Hi Karan, We'are supporting all the parameters of livy in users' environments. Here is jira link:https://issues.apache.org/jira/browse/GRIFFIN-91 Thanks, Kevin On Tue, May 1, 2018 at 3:47 PM, Lionel Liu wrote: > Hi Karan, > > In griffin, it submits jobs to livy through

Re: No Index Formation in Elastic Search

2018-05-04 Thread Lionel Liu
Hi Karan, In our docker image, we only configured 'http.cors.enabled: true' and 'http.cors.allow-origin: "*"' in elasticsearch.yml, as the Dockerfile: https://github.com/bhlx3lyx7/griffin-docker/blob/master/elasticsearch/Dockerfile That's all the things we've done for ES configuration, without

No Index Formation in Elastic Search

2018-05-04 Thread Karan Gupta
Hi Lionel, While the Spark Application gets finished, I do not see any Index getting created in the elastic search, hence I do not see the data quality metrics getting populated. Could you help me out with a possible solution? Thank you, Karan Gupta Any

[jira] [Updated] (GRIFFIN-147) [Doc] Use case document of Bullseye

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-147: --- Sprint: Apache Sprint 3 > [Doc] Use case document of Bullseye > ---

RE: No Index Formation in Elastic Search

2018-05-04 Thread Karan Gupta
Hi Lionel, We are not using Docker Image, hence we want to set it up manually. Could you provide us the “CREATE” statement for griffin indices along with “mappings”. Thank you, Karan Gupta From: Lionel Liu Sent: Friday, May 4, 2018 2:56 PM To: Karan Gupta

[jira] [Updated] (GRIFFIN-91) [Server] Enhance livy configuration, to support all the parameters of livy in users' environments

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-91: -- Summary: [Server] Enhance livy configuration, to support all the parameters of livy in users'

Re: No Index Formation in Elastic Search

2018-05-04 Thread Lionel Liu
Hi Karan, For HTTP persistence, are the metrics persisted directly from “Spark”? (or) Griffin services writes into it? [Answer] The metrics are persisted directly from spark application. Our URL is like this: http://localhost:9200/griffin/accuracy (if it is from Griffin service, it will work….

[jira] [Work logged] (GRIFFIN-148) [Doc] Use case document of crawler

2018-05-04 Thread William Guo (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-148?focusedWorklogId=98124=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-98124 ] William Guo logged work on GRIFFIN-148: --- Author: William Guo

[jira] [Updated] (GRIFFIN-158) Functional test of generic scheduler

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-158: --- Summary: Functional test of generic scheduler (was: test streaming job schedule function) >

[jira] [Resolved] (GRIFFIN-148) [Doc] Use case document of crawler

2018-05-04 Thread William Guo (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Guo resolved GRIFFIN-148. - Resolution: Fixed but we need some graph to support it. > [Doc] Use case document of crawler >

[jira] [Assigned] (GRIFFIN-145) [Service] Refactor of service API

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-145: -- Assignee: Kevin Yao (was: wanyin) > [Service] Refactor of service API >

[jira] [Updated] (GRIFFIN-145) [Service] Refactor of service API

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-145: --- Summary: [Service] Refactor of service API (was: [Service] Go through service API response

[jira] [Updated] (GRIFFIN-158) test streaming job schedule function

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-158: --- Summary: test streaming job schedule function (was: test streaming job function) > test streaming

[jira] [Commented] (GRIFFIN-148) [Doc] Use case document of crawler

2018-05-04 Thread William Guo (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463418#comment-16463418 ] William Guo commented on GRIFFIN-148: -

[jira] [Updated] (GRIFFIN-158) test streaming job function

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-158: --- Sprint: Apache Sprint 3 > test streaming job function > --- > >

[jira] [Closed] (GRIFFIN-157) fix response not conformity about postman api and split small task to contribute

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu closed GRIFFIN-157. -- Resolution: Duplicate Duplicated with GRIFFIN-145 > fix response not conformity about postman api and