[jira] [Assigned] (GRIFFIN-133) [UI] Add missing records download link on UI

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-133: -- Assignee: Yuqin Xuan (was: Alex Lv) > [UI] Add missing records download link on

[jira] [Updated] (GRIFFIN-114) [Service][UT] Enhance unit test of config, info, util in service module

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-114: --- Sprint: Apache Sprint 2, Apache Sprint 4 (was: Apache Sprint 2, Apache Sprint 3) > [Service]

[jira] [Assigned] (GRIFFIN-113) [Service][UT] Enhance unit test of measure, job, metric in service module

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-113: -- Assignee: Qiyuan Zhou (was: wanyin) > [Service][UT] Enhance unit test of measure,

[jira] [Assigned] (GRIFFIN-115) [Measure][UT] Enhance UT of rule part in measure module

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-115: -- Assignee: William Guo (was: Qiyuan Zhou) > [Measure][UT] Enhance UT of rule part in meas

[jira] [Updated] (GRIFFIN-147) [Doc] Griffin use case document of Personalization Platform in eBay

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-147: --- Summary: [Doc] Griffin use case document of Personalization Platform in eBay (was: [Doc] Use case

[jira] [Updated] (GRIFFIN-147) [Doc] Use case document of Bullseye

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-147: --- Sprint: Apache Sprint 4 (was: Apache Sprint 3) > [Doc] Use case document of Bulls

[jira] [Updated] (GRIFFIN-113) [Service][UT] Enhance unit test of measure, job, metric in service module

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-113: --- Sprint: Apache Sprint 4 > [Service][UT] Enhance unit test of measure, job, metric in service mod

[jira] [Created] (GRIFFIN-161) FAQ from user questions

2018-05-11 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-161: -- Summary: FAQ from user questions Key: GRIFFIN-161 URL: https://issues.apache.org/jira/browse/GRIFFIN-161 Project: Griffin (Incubating) Issue Type: Task

[jira] [Resolved] (GRIFFIN-117) [Service] Provide api for users to download missing records in accuracy

2018-05-10 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu resolved GRIFFIN-117. Resolution: Fixed Fix Version/s: 1.0.0-incubating Issue resolved by pull request 276 [https

Re: Griffin on Docker - modify Hive metastore Uris

2018-05-09 Thread Lionel Liu
lex’ profiling job, > creating manually the conf.json using SparkSql as dialect. > The results are indeed available in ES and HDFS as defined in env.json. > Cool. > > Now, my question is: As I have the new metrics in ES, can I force somehow > the UI to visualize the metrics I creat

Re: No Index Formation in Elastic Search

2018-05-09 Thread Lionel Liu
: "long"},"value" : {"properties": > {"total": {"type": "long"},"miss": {"type": "long"},"matched": {"type": > "long"}}}' > > When I try to GET the indexes, I can see tha

Re: No Index Formation in Elastic Search

2018-05-04 Thread Lionel Liu
ted in ES….. > > And now that we have created the index, there are errors which are > suggestive of missing “mappings” > > > > Is there an auto index create property that we need to enable somewhere in > ES? > > I could not find anything in the config yml file tho

Re: No Index Formation in Elastic Search

2018-05-04 Thread Lionel Liu
This was causing Spark jobs not to launch. > > We edited the env.json accordingly…. We hope we did the right thing… > > Can you confirm this? > > > > Thank you, > > Karan Gupta > > > > *From:* Lionel Liu <lionel...@apache.org> > *Sent:* Friday, May 4, 2018 11:

[jira] [Updated] (GRIFFIN-91) [Server] Enhance livy configuration, to support all the parameters of livy in users' environments

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-91: -- Summary: [Server] Enhance livy configuration, to support all the parameters of livy in users

[jira] [Updated] (GRIFFIN-158) Functional test of generic scheduler

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-158: --- Summary: Functional test of generic scheduler (was: test streaming job schedule function

[jira] [Updated] (GRIFFIN-158) test streaming job schedule function

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-158: --- Summary: test streaming job schedule function (was: test streaming job function) > test stream

[jira] [Updated] (GRIFFIN-158) test streaming job function

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-158: --- Sprint: Apache Sprint 3 > test streaming job funct

[jira] [Closed] (GRIFFIN-157) fix response not conformity about postman api and split small task to contribute

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu closed GRIFFIN-157. -- Resolution: Duplicate Duplicated with GRIFFIN-145 > fix response not conformity about postman

[jira] [Updated] (GRIFFIN-147) [Doc] Use case document of Bullseye

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-147: --- Sprint: Apache Sprint 3 > [Doc] Use case document of Bulls

[jira] [Updated] (GRIFFIN-145) [Service] Refactor of service API

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-145: --- Summary: [Service] Refactor of service API (was: [Service] Go through service API response

[jira] [Assigned] (GRIFFIN-145) [Service] Refactor of service API

2018-05-04 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-145: -- Assignee: Kevin Yao (was: wanyin) > [Service] Refactor of service

Re: Griffin on Docker - modify Hive metastore Uris

2018-05-03 Thread Lionel Liu
shooting? > > BTW, can we access your aws instance? that will help us find > the issue. > > > > > > Thanks, > > William > > > > On Wed, Apr 25, 2018 at 12:08 AM, Enrico D'Urso <

[jira] [Resolved] (GRIFFIN-70) [Server] Support job schedule trigger based on done file or others

2018-05-02 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-70?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu resolved GRIFFIN-70. --- Resolution: Done Have supported predication to check done file before triggers. > [Server] Supp

[RESULT][VOTE] Release of Apache Griffin 0.2.0-incubating [RC4]

2018-05-02 Thread Lionel Liu
Hi all, Vote passed with 3[+1] binding votes and no[-1] votes , Please check the following tally. +1 binding: [3] William Guo Lionel Liu John Liu 0 : [0] -1 : [0] The vote thread lists here: https://lists.apache.org/thread.html

Re: [VOTE] Release of Apache Griffin-0.2.0-incubating [RC4]

2018-05-01 Thread Lionel Liu
nger > > md5 replaced : ok > > run mvn license:add-third-party in service/service , CAT-X, JSON license > > removed. ok > > No cat-B mentioned by bundled in source release. ok > > > > +1 > > > > William > > > > > > > > > >

[jira] [Resolved] (GRIFFIN-153) [UI] Can not render accuracy chart on UI

2018-05-01 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu resolved GRIFFIN-153. Resolution: Fixed Fix Version/s: 1.0.0-incubating Issue resolved by pull request 273 [https

Re: Custom Rules For Existing Data

2018-05-01 Thread Lionel Liu
Hi Karan, Griffin supports rules described in "griffin-dsl" or "spark-sql". The measure module reads the configuration and calculates the metrics, the service module just submit spark jobs with the configuration. You can get some information about how to generate the configuration, as well as

Re: Re:Livy Error

2018-05-01 Thread Lionel Liu
datanucleus-rdbms-3.2.9.jar > > spark.yarn.dist.files = hdfs://OURCLUSTER/griffin/hive-site.xml > > # livy > # livy.uri=http://10.9.246.187:8998/batches > livy.uri=http://LIVY_SERVER_HOST:8998/batches > > # spark-admin > # spark.uri=http://10.149.247.156:28088 >

Re: [DISCUSS] Support CLI launch for spark jobs

2018-05-01 Thread Lionel Liu
I agree that users should be blocked if they don't install livy, livy is easy for spark job submitting, but we also need some other approach like submitting in shell way or using APIs of yarn. However, there're more spikes to adapt to different spark clusters, like yarn or mesos, which is not the

Re:Livy Error

2018-04-27 Thread Lionel Liu
, Lionel, Liu At 2018-04-27 17:37:02, "Karan Gupta" <karan.gu...@tavant.com> wrote: Hi Lionel, I am trying to submit a spark job but the job does not gets submitted and I see the following error message on the console at the scheduled time. 2018-04-27 05:35:00.

[jira] [Updated] (GRIFFIN-145) [Service] Go through service API response standard

2018-04-27 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-145: --- Sprint: Apache Sprint 2, Apache Sprint 3 (was: Apache Sprint 2) > [Service] Go through service

[jira] [Updated] (GRIFFIN-117) [Service] Provide api for users to download missing records in accuracy

2018-04-27 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-117: --- Sprint: Apache Sprint 2, Apache Sprint 3 (was: Apache Sprint 2) > [Service] Provide api for us

[jira] [Updated] (GRIFFIN-123) [Measure] Code review of measure module, refactor and enhance the code style

2018-04-27 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-123: --- Sprint: Apache Sprint 2, Apache Sprint 3 (was: Apache Sprint 2) > [Measure] Code review of meas

[jira] [Updated] (GRIFFIN-103) [Griffin] Release of incubating-0.2.0

2018-04-27 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-103: --- Sprint: Apache Sprint 1, Apache Sprint 2, Apache Sprint 3 (was: Apache Sprint 1, Apache Sprint 2

[jira] [Updated] (GRIFFIN-114) [Service][UT] Enhance unit test of config, info, util in service module

2018-04-27 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-114: --- Sprint: Apache Sprint 2, Apache Sprint 3 (was: Apache Sprint 2) > [Service][UT] Enhance unit t

[jira] [Updated] (GRIFFIN-153) [UI] Can not render accuracy chart on UI

2018-04-27 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-153: --- Sprint: Apache Sprint 2, Apache Sprint 3 (was: Apache Sprint 2) > [UI] Can not render accur

[jira] [Updated] (GRIFFIN-148) [Doc] Use case document of crawler

2018-04-27 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-148: --- Sprint: Apache Sprint 2, Apache Sprint 3 (was: Apache Sprint 2) > [Doc] Use case docum

[jira] [Comment Edited] (GRIFFIN-145) [Service] Go through service API response standard

2018-04-27 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451877#comment-16451877 ] Lionel Liu edited comment on GRIFFIN-145 at 4/27/18 7:24 AM: - refer to [https

[jira] [Comment Edited] (GRIFFIN-145) [Service] Go through service API response standard

2018-04-27 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451877#comment-16451877 ] Lionel Liu edited comment on GRIFFIN-145 at 4/27/18 7:23 AM: - refer to [https

[jira] [Assigned] (GRIFFIN-145) [Service] Go through service API response standard

2018-04-27 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-145: -- Assignee: wanyin (was: Lionel Liu) > [Service] Go through service API response stand

[jira] [Created] (GRIFFIN-156) [Doc] update the document of metric fetch on wiki

2018-04-26 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-156: -- Summary: [Doc] update the document of metric fetch on wiki Key: GRIFFIN-156 URL: https://issues.apache.org/jira/browse/GRIFFIN-156 Project: Griffin (Incubating

[jira] [Work started] (GRIFFIN-145) [Service] Go through service API response standard

2018-04-26 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on GRIFFIN-145 started by Lionel Liu. -- > [Service] Go through service API response stand

[jira] [Resolved] (GRIFFIN-143) [License][Release] track the license issue in 0.2.0-RC3 release

2018-04-26 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu resolved GRIFFIN-143. Resolution: Fixed Fix Version/s: 0.2.0-incubating The license issue of JSON library

[VOTE] Release of Apache Griffin-0.2.0-incubating [RC4]

2018-04-26 Thread Lionel Liu
Hi all, This is a call for a vote on releasing Apache Griffin 0.2.0-incubating, release candidate 4. Apache Griffin is data quality service for modern data system, it defines a standard process to define,measure data quality for well-known dimensions. With Apache Griffin, users will

[jira] [Created] (GRIFFIN-153) [UI] Can not render accuracy chart on UI

2018-04-25 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-153: -- Summary: [UI] Can not render accuracy chart on UI Key: GRIFFIN-153 URL: https://issues.apache.org/jira/browse/GRIFFIN-153 Project: Griffin (Incubating) Issue

[jira] [Updated] (GRIFFIN-148) [Doc] Use case document of crawler

2018-04-20 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-148: --- Sprint: Apache Sprint 2 > [Doc] Use case document of craw

[jira] [Created] (GRIFFIN-150) [Service] Dependency conflict after upgrade to hive metastore 2 in service module

2018-04-19 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-150: -- Summary: [Service] Dependency conflict after upgrade to hive metastore 2 in service module Key: GRIFFIN-150 URL: https://issues.apache.org/jira/browse/GRIFFIN-150

Re:RE: Re:RE: Re:RE: Can't get output after creating measure

2018-04-15 Thread Lionel Liu
f.template to conf/livy.conf Executed bin/livy-server. Attached are griffin and livy latest logs . I’m also attaching my livy conf file. Regards Ashwini From:bhlx3l...@163.com <bhlx3l...@163.com> On Behalf Of Lionel Liu Sent: 15 April 2018 14:48 To: Ashwini Kumar Gupta <ashwini.gu...@e

Re:RE: Re:RE: Can't get output after creating measure

2018-04-15 Thread Lionel Liu
ot from livy, you’ve done the right thing. Thanks Lionel, Liu At 2018-04-15 13:47:08, "Ashwini Kumar Gupta" <ashwini.gu...@enquero.com> wrote: Hi Lionel, I think in the previous mail people can’t see the image so I’m attaching it. Also I don’t see measure n

Re: Re:RE: Can't get output after creating measure

2018-04-13 Thread Lionel Liu
for delayed reply. I was trying all my options before raising an > issue. > > > > I’m attaching my installation steps. Please let me know what’s wrong with > them. > > > > Regards > > Ashwin > > > > *From:* bhlx3l...@163.com <bhlx3l...@163.

Re: Griffin on Docker - modify Hive metastore Uris

2018-04-13 Thread Lionel Liu
Date: Wednesday, April 11, 2018 at 3:55 PM > To: Lionel Liu <lionel...@apache.org>, "dev@griffin.incubator.apache.org" > <dev@griffin.incubator.apache.org> > Subject: Re: Griffin on Docker - modify Hive metastore Uris > > Hi Lionel, > > Thank you for your email. >

[jira] [Updated] (GRIFFIN-128) [Doc][Wiki] Add organization column in committer list

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-128: --- Sprint: Apache Sprint 2 > [Doc][Wiki] Add organization column in committer l

[jira] [Updated] (GRIFFIN-149) [Doc] Use case document of VIP

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-149: --- Sprint: Apache Sprint 2 > [Doc] Use case document of

[jira] [Created] (GRIFFIN-149) [Doc] Use case document of VIP

2018-04-13 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-149: -- Summary: [Doc] Use case document of VIP Key: GRIFFIN-149 URL: https://issues.apache.org/jira/browse/GRIFFIN-149 Project: Griffin (Incubating) Issue Type: Task

[jira] [Created] (GRIFFIN-148) [Doc] Use case document of crawler

2018-04-13 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-148: -- Summary: [Doc] Use case document of crawler Key: GRIFFIN-148 URL: https://issues.apache.org/jira/browse/GRIFFIN-148 Project: Griffin (Incubating) Issue Type

[jira] [Created] (GRIFFIN-147) [Doc] Use case document of Bullseye

2018-04-13 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-147: -- Summary: [Doc] Use case document of Bullseye Key: GRIFFIN-147 URL: https://issues.apache.org/jira/browse/GRIFFIN-147 Project: Griffin (Incubating) Issue Type

[jira] [Updated] (GRIFFIN-120) [Service][UI] support job state and action management

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-120: --- Sprint: Apache Sprint 1 (was: Apache Sprint 1, Apache Sprint 2) > [Service][UI] support job st

[jira] [Created] (GRIFFIN-146) [Service] Prepare and test job state and action service

2018-04-13 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-146: -- Summary: [Service] Prepare and test job state and action service Key: GRIFFIN-146 URL: https://issues.apache.org/jira/browse/GRIFFIN-146 Project: Griffin (Incubating

[jira] [Updated] (GRIFFIN-130) [Site] Modify griffin site template

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-130: --- Sprint: Apache Sprint 2 > [Site] Modify griffin site templ

[jira] [Commented] (GRIFFIN-115) [Measure][UT] Enhance UT of rule part in measure module

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436995#comment-16436995 ] Lionel Liu commented on GRIFFIN-115: coverage: 20% > [Measure][UT] Enhance UT of rule p

[jira] [Updated] (GRIFFIN-115) [Measure][UT] Enhance UT of rule part in measure module

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-115: --- Sprint: Apache Sprint 2 > [Measure][UT] Enhance UT of rule part in measure mod

[jira] [Updated] (GRIFFIN-122) [Service] We need to support all livy parameters when submit job.

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-122: --- Summary: [Service] We need to support all livy parameters when submit job. (was: [Service] We need

[jira] [Created] (GRIFFIN-145) [Service] Go through service API response standard

2018-04-13 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-145: -- Summary: [Service] Go through service API response standard Key: GRIFFIN-145 URL: https://issues.apache.org/jira/browse/GRIFFIN-145 Project: Griffin (Incubating

[jira] [Updated] (GRIFFIN-114) [Service][UT] Enhance unit test of config, info, util in service module

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-114: --- Sprint: Apache Sprint 2 > [Service][UT] Enhance unit test of config, info, util in service mod

[jira] [Updated] (GRIFFIN-126) [Site] Add a security link in griffin site

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-126: --- Sprint: Apache Sprint 1, Apache Sprint 2 (was: Apache Sprint 1) > [Site] Add a security l

[jira] [Assigned] (GRIFFIN-126) [Site] Add a security link in griffin site

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-126: -- Assignee: Juan Li (was: William Guo) > [Site] Add a security link in griffin s

[jira] [Updated] (GRIFFIN-126) [Site] Add a security link in griffin site

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-126: --- Sprint: Apache Sprint 1 (was: Apache Sprint 1, Apache Sprint 2) > [Site] Add a security l

[jira] [Updated] (GRIFFIN-123) [Measure] Code review of measure module, refactor and enhance the code style

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-123: --- Sprint: Apache Sprint 2 > [Measure] Code review of measure module, refactor and enhance the c

[jira] [Updated] (GRIFFIN-143) [License][Release] track the license issue in 0.2.0-RC3 release

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-143: --- Sprint: Apache Sprint 2 > [License][Release] track the license issue in 0.2.0-RC3 rele

[jira] [Updated] (GRIFFIN-131) [Doc][Site] Use case documents

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-131: --- Sprint: Apache Sprint 1, Apache Sprint 2 (was: Apache Sprint 1) > [Doc][Site] Use case docume

[jira] [Updated] (GRIFFIN-127) [Doc][Site] Announce "document contribution" description in "How to contribute" on site

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-127: --- Sprint: Apache Sprint 1, Apache Sprint 2 (was: Apache Sprint 1) > [Doc][Site] Announce "

[jira] [Updated] (GRIFFIN-126) [Site] Add a security link in griffin site

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-126: --- Sprint: Apache Sprint 1, Apache Sprint 2 (was: Apache Sprint 1) > [Site] Add a security l

[jira] [Updated] (GRIFFIN-136) [Griffin] As griffin user, I want to use mysql or hibernate with griffin open source version, to deploy it in my environment

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-136: --- Sprint: Apache Sprint 1, Apache Sprint 2 (was: Apache Sprint 1) > [Griffin] As griffin user, I w

[jira] [Updated] (GRIFFIN-120) [Service][UI] support job state and action management

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-120: --- Sprint: Apache Sprint 1, Apache Sprint 2 (was: Apache Sprint 1) > [Service][UI] support job st

[jira] [Updated] (GRIFFIN-103) [Griffin] Release of incubating-0.2.0

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-103: --- Sprint: Apache Sprint 1, Apache Sprint 2 (was: Apache Sprint 1) > [Griffin] Release of incubat

[jira] [Created] (GRIFFIN-143) [License][Release] track the license issue in 0.2.0-RC3 release

2018-04-13 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-143: -- Summary: [License][Release] track the license issue in 0.2.0-RC3 release Key: GRIFFIN-143 URL: https://issues.apache.org/jira/browse/GRIFFIN-143 Project: Griffin

[jira] [Updated] (GRIFFIN-120) [Service][UI] support job state and action management

2018-04-13 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-120: --- Sprint: Apache Sprint 1 > [Service][UI] support job state and action managem

Re:RE: Griffin Service Error

2018-04-12 Thread Lionel Liu
te.xml and other resources without us telling it? We are using the Hortonworks HDP distribution Thank you, Karan Gupta From: Lionel Liu <lionel...@apache.org> Sent: Thursday, April 12, 2018 3:19 PM To: Karan Gupta <karan.gu...@tavant.com> Cc:dev@griffin.incubator.apache.org Subjec

Re: Griffin Service Error

2018-04-12 Thread Lionel Liu
ds to 1500 > from the default 500 but it did not resolve the issue. Also we have 2 > instances of Hive Server 2 running on different machines. > > > > Could you recommend any other work around? > > > > Thank you, > > Karan Gupta > > > > *From:* Lionel Li

Re: Griffin Service Error

2018-04-10 Thread Lionel Liu
store.uris is correctly set as per my knowledge in the > application.properties. Could you suggest any alternative or a work around? > > > > > > Thank you, > > Karan Gupta > > > > *From:* Lionel, Liu <bhlx3l...@163.com> > *Sent:* Tuesday, April 10, 2018

Re: Griffin on Docker - modify Hive metastore Uris

2018-04-10 Thread Lionel Liu
Hi Enrico, Griffin service only need to get metadata from hive metastore service, it doesn't fetch hive table data actually. Griffin measure, which runs on spark cluster, needs to fetch hive table data, you need to pass the AWS credentials to it when submit. I recommend you try the shell-submit

Re:RE: Can't get output after creating measure

2018-04-10 Thread Lionel Liu
/griffin-docker-guide.md -- Regards, Lionel, Liu At 2018-04-10 19:25:01, "Ashwini Kumar Gupta" <ashwini.gu...@enquero.com> wrote: >Hello Lionel, > >I’m running this in cloudera VM. Will that change anything? > >Regards >Ashwin > >From: Lionel Liu <lione

Re: Griffin service error

2018-04-10 Thread Lionel Liu
but I am encountering the > below error, > > > > > > > > Need guidance on the same. > > > > > > Thank you, > > Karan Gupta > > > > > > *From:* Lionel, Liu <bhlx3l...@163.com> > *Sent:* Saturday, April 7, 2018 1:32 PM &g

Re: Can't get output after creating measure

2018-04-10 Thread Lionel Liu
Hi Ashwini, First, you could check the log of griffin service, to know if it has triggered the job instance. Then, griffin service will submit a spark application with configuration to livy, you can check the log of livy, to verify if it has been submitted correctly. After that, you need to check

[jira] [Resolved] (GRIFFIN-135) [Measure] Support Completeness measurement as a new feature

2018-04-09 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu resolved GRIFFIN-135. Resolution: Done Have finished implementation and test of completeness measurement, to measure

[jira] [Work started] (GRIFFIN-135) [Measure] Support Completeness measurement as a new feature

2018-04-09 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on GRIFFIN-135 started by Lionel Liu. -- > [Measure] Support Completeness measurement as a new feat

[RESULT][VOTE] Release of Apache Griffin 0.2.0-incubating [RC3]

2018-04-09 Thread Lionel Liu
Hi all, Vote passed with 4[+1] binding votes, 3[+1] non-binding votes and no[-1] votes , Please check the following tally. +1 binding: [4] Vincent Zhao William Guo Lionel Liu Henry Saputra +1 non-binding: [3] Wang He Xuan Yuqin Kevin Yao

[jira] [Resolved] (GRIFFIN-111) [UI] add progress indicator in every http request

2018-04-09 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu resolved GRIFFIN-111. Resolution: Fixed Fix Version/s: 1.0.0-incubating Issue resolved by pull request 251 [https

[jira] [Created] (GRIFFIN-141) [Doc] Go through griffin documents in github

2018-04-09 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-141: -- Summary: [Doc] Go through griffin documents in github Key: GRIFFIN-141 URL: https://issues.apache.org/jira/browse/GRIFFIN-141 Project: Griffin (Incubating

[DISCUSS] Rename data source name in Griffin implementation

2018-04-08 Thread Lionel Liu
Hi all, Recently, we've received some questions about accuracy defination. In my opinion, accuracy measures one data source with another one which is the "truth". In the theoretic defination of accuracy, we call the "truth" data source as "source", and the data source to be measured as "target".

[jira] [Updated] (GRIFFIN-135) [Measure] Support Completeness measurement as a new feature

2018-04-08 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-135: --- Sprint: Apache Sprint 1 > [Measure] Support Completeness measurement as a new feat

[jira] [Updated] (GRIFFIN-135) [Measure] Support Completeness measurement as a new feature

2018-04-08 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-135: --- Fix Version/s: 1.0.0-incubating > [Measure] Support Completeness measurement as a new feat

[jira] [Updated] (GRIFFIN-140) [Measure] Support validity as a new feature

2018-04-08 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-140: --- Remaining Estimate: 96h Original Estimate: 96h Fix Version/s: 1.0.0-incubating

[jira] [Created] (GRIFFIN-140) [Measure] Support validity as a new feature

2018-04-08 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-140: -- Summary: [Measure] Support validity as a new feature Key: GRIFFIN-140 URL: https://issues.apache.org/jira/browse/GRIFFIN-140 Project: Griffin (Incubating) Issue

[jira] [Created] (GRIFFIN-139) [Measure] Support completeness measurement

2018-04-08 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-139: -- Summary: [Measure] Support completeness measurement Key: GRIFFIN-139 URL: https://issues.apache.org/jira/browse/GRIFFIN-139 Project: Griffin (Incubating) Issue

[jira] [Resolved] (GRIFFIN-67) Simplify data quality env and deployment

2018-04-08 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-67?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu resolved GRIFFIN-67. --- Resolution: Done Assignee: Lionel Liu (was: William Guo) The griffin docker image has been

[jira] [Resolved] (GRIFFIN-65) Milestone planning

2018-04-08 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu resolved GRIFFIN-65. --- Resolution: Done Roadmap list here: https://cwiki.apache.org/confluence/display/GRIFFIN/0.+Roadmap

[jira] [Resolved] (GRIFFIN-47) Unit Test of Repository

2018-04-08 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu resolved GRIFFIN-47. --- Resolution: Done UT of service repository has been done > Unit Test of Reposit

[jira] [Resolved] (GRIFFIN-8) new awesome griffin logo

2018-04-08 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu resolved GRIFFIN-8. -- Resolution: Done Have updated logo > new awesome griffin l

[jira] [Assigned] (GRIFFIN-122) [Service] We need to read livy config files as a map, to support its later version or any other extend parameters

2018-04-08 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-122: -- Assignee: Qiyuan Zhou > [Service] We need to read livy config files as a map, to support

<    1   2   3   4   >