Re: Profiling limitation in the Docker image + additional sources beyond Hive

[john@apache]

> There is a particular reason why I cannot select “Regular Expression
Match” in the Advanced statistics? It is a good feature to test.

Am I missing something or that feature is not available in the Docker image?


The regex match is not support yet in the UI. Actually, this is not the
only feature not supported in the UI now. You can, however, still try this
feature via API:

https://github.com/apache/incubator-griffin/blob/master/griffin-doc/service/api-guide.md

https://github.com/apache/incubator-griffin/tree/master/griffin-doc/service/postman


We are trying to adding more useful and stable features into Griffin,
specifically in the manner of service/api, while there might be not enough
effort to exert UI to catch up with all the features. And on the other
side, I would like to invite to join us to make it better: your
contribution is definitely welcome.




> Also, in the measure tab I see that I can select a source and a
destination table to check if they are equal (for instance), there is any

plan in the future to include checking between different data sources? For
example, between Hive table and RedShift tables?

As you are using Spark as computation engine, it should not be so hard to
implement as Spark as connectors for both systems.


Griffin supports comparing data from different data sources, via the
connectors. In your case, all you need is a RedShift data connector. You
can start with here:
https://github.com/apache/incubator-griffin/tree/master/measure/src/main/scala/org/apache/griffin/measure/data/connector/batch
.


On Fri, Apr 13, 2018 at 5:29 PM, Enrico D'Urso  wrote:

> Hi,
>
> I am running Griffin on the Docker image, but on the profiling tab on the
> UI I see that the options are limited to:
>
>   *   Simple Statistics
>  *   Null count
>  *   Distinct count
>   *   Summary statistics
>  *   Total Count
>
>
>   *   Advanced statistics
>  *   Enum detection TOP 5 count
>
> There is a particular reason why I cannot select “Regular Expression
> Match” in the Advanced statistics? It is a good feature to test.
> Am I missing something or that feature is not available in the Docker
> image?
>
> Also, in the measure tab I see that I can select a source and a
> destination table to check if they are equal (for instance), there is any
> plan in the future to include checking between different data sources? For
> example, between Hive table and RedShift tables?
> As you are using Spark as computation engine, it should not be so hard to
> implement as Spark as connectors for both systems.
>
>
> Thanks,
>
> Enrico
>

Re: UI - install node module too slow

[john@apache]

Hi Jenny,

Could you please describe your question in detail, such as what you did,
and what you got. It would be helpful if you can attach some log or
screenshot.

Anyway, 'take long time' looks more like a network issue. It might be
related to your network environment or configuration. From your info, I
guess the reason is the network to npm repository is slow. Generally, there
are 2 solutions:
1. use a proxy
2. use a local npm mirror

Hope it helps.

On Fri, Apr 13, 2018 at 5:06 PM, jenny li  wrote:

> Hi Experts,
>
> It takes a long time to install node modules by running 'npm install' , do
> you have any suggestion on this issue? many thanks.
>
> Best regards,
> Jenny
>

Re: Re:RE: Can't get output after creating measure

[Lionel Liu]

Hi Ashwini,


I've read your document, and here lists my answers:






*Question - Do I keep both of them? You should only keep the effective
“sparkJob.jars” parameter. - Do I have to copy hive-site.xml to HDFS and
give the HDFS path in spark.yarn.dist.files? You’d better copy
hive-site.xml to HDFS, cause livy could only submit spark applications in
cluster mode, so the hive-site.xml should be accessed by each node.*

About the livy log:

*According to livy log, it seems that your configuration of
sparkJob.properties doesn’t work, livy is trying to find
hdfs:///griffin/griffin-measure.jar, not
hdfs:///user/griffin/griffin-measure.jar.*
Pls correct the sparkJob.properties, and rebuild the service module and
have a try.


Thanks,
Lionel

On Fri, Apr 13, 2018 at 4:16 PM, Ashwini Kumar Gupta <
ashwini.gu...@enquero.com> wrote:

> Hello Lionel,
>
>
>
> Apologies for delayed reply. I was trying all my options before raising an
> issue.
>
>
>
> I’m attaching my installation steps. Please let me know what’s wrong with
> them.
>
>
>
> Regards
>
> Ashwin
>
>
>
> *From:* bhlx3l...@163.com  *On Behalf Of *Lionel Liu
> *Sent:* 10 April 2018 18:11
> *To:* dev@griffin.incubator.apache.org; Ashwini Kumar Gupta <
> ashwini.gu...@enquero.com>
> *Subject:* Re:RE: Can't get output after creating measure
>
>
>
> Hi Ashwini,
>
>
>
> It works the same in linux OS, we need to check the log to figure out what
> happened, it might be some configure mistake or input mistake.
>
> I recommend you try our docker image first, by following this doc:
> https://github.com/apache/incubator-griffin/blob/
> master/griffin-doc/docker/griffin-docker-guide.md
>
>
>
> --
>
> Regards,
>
> Lionel, Liu
>
>
>
>
> At 2018-04-10 19:25:01, "Ashwini Kumar Gupta"  
> wrote:
>
> >Hello Lionel,
>
> >
>
> >I’m running this in cloudera VM. Will that change anything?
>
> >
>
> >Regards
>
> >Ashwin
>
> >
>
> >From: Lionel Liu 
>
> >Sent: 10 April 2018 15:26
>
> >To: dev@griffin.incubator.apache.org; Ashwini Kumar Gupta 
> >
>
> >Subject: Re: Can't get output after creating measure
>
> >
>
> >Hi Ashwini,
>
> >
>
> >First, you could check the log of griffin service, to know if it has 
> >triggered the job instance.
>
> >Then, griffin service will submit a spark application with configuration to 
> >livy, you can check the log of livy, to verify if it has been submitted 
> >correctly.
>
> >After that, you need to check the spark cluster, to verify the application 
> >has been accepted by the cluster, if it runs, you can get the application 
> >log through yarn.
>
> >
>
> >Each step error might block the result.
>
> >
>
> >Thanks,
>
> >Lionel
>
> >
>
> >On Tue, Apr 10, 2018 at 5:01 PM, William Guo 
> >> wrote:
>
> >hi Ashwin,
>
> >
>
> >Could you show us your log here?
>
> >
>
> >Thanks,
>
> >William
>
> >
>
> >On Tue, Apr 10, 2018 at 3:35 PM, Ashwini Kumar Gupta <
>
> >ashwini.gu...@enquero.com> wrote:
>
> >
>
> >> Hello Team,
>
> >>
>
> >> I have been trying to install and use griffin but I cannot get output when
>
> >> I click on DQ Matrix.
>
> >>
>
> >> I created a measure, created a job to run.
>
> >> The sequence in which I run all services are:
>
> >>
>
> >>
>
> >>   1.  Elasticsearch
>
> >>   2.  Jar file
>
> >>
>
> >> I also noticed that griffin is not creating mapping in ES.
>
> >>
>
> >> Can you please tell me where I'm going wrong.
>
> >>
>
> >> Thanks
>
> >> Ashwin
>
> >>
>
> >
>
>
>
>
>

Profiling limitation in the Docker image + additional sources beyond Hive

[Enrico D'Urso]

Hi,

I am running Griffin on the Docker image, but on the profiling tab on the UI I 
see that the options are limited to:

  *   Simple Statistics
 *   Null count
 *   Distinct count
  *   Summary statistics
 *   Total Count


  *   Advanced statistics
 *   Enum detection TOP 5 count

There is a particular reason why I cannot select “Regular Expression Match” in 
the Advanced statistics? It is a good feature to test.
Am I missing something or that feature is not available in the Docker image?

Also, in the measure tab I see that I can select a source and a destination 
table to check if they are equal (for instance), there is any
plan in the future to include checking between different data sources? For 
example, between Hive table and RedShift tables?
As you are using Spark as computation engine, it should not be so hard to 
implement as Spark as connectors for both systems.


Thanks,

Enrico

Re: Griffin on Docker - modify Hive metastore Uris

[Lionel Liu]

Hi Enrico,

I think you need to copy hive-site.xml into spark config directory, or
explicitly set hive-site.xml in spark-shell command line.
Because spark shell creates its sqlContext when start up, after then,
setConf will not work.


Thanks,
Lionel

On Thu, Apr 12, 2018 at 6:04 PM, Enrico D'Urso  wrote:

> Hi,
>
> After further investigation, I noticed that Spark is pointing to the east
> Aws region, by default.
> Any suggestion to force it to use us-west2?
>
> Thanks
>
> From: Enrico D'Urso 
> Date: Wednesday, April 11, 2018 at 3:55 PM
> To: Lionel Liu , "dev@griffin.incubator.apache.org"
> 
> Subject: Re: Griffin on Docker - modify Hive metastore Uris
>
> Hi Lionel,
>
> Thank you for your email.
>
> Right now, I am testing Spark cluster using the Spark-shell available on
> your Docker image. I just wanted to test it before running any ‘measure
> job’ to tackle any configuration issue.
> I start the shell as follows:
> spark-shell --deploy-mode client --master yarn
> --packages=org.apache.hadoop:hadoop-aws:2.6.5
>
> I am fetching Hadoop-aws:2.6.5 as 2.6.5 is the Hadoop version that is
> included in the Docker image.
> So far, so good, then I also set the right Hive metastore URI:
> sqlContext.setConf("hive.metastore.uris", metastoreURI)
>
> the problem arises when I try to fetch any table for instance:
> sqlContext.sql("Select * from hcom_data_prod_.testtable").take(2)
>
> the table does exist, but I get an error back saying that:
>
> Caused by: java.io.FileNotFoundException: File s3://hcom-xxXXXxx/yyy
> /testtable/sentdate=2017-10-13 does not exist.
>
> But it does exist, basically AWS is responding with 404 http message.
> I think I would get the same error if I try to run any ‘measure job’, so I
> prefer to tackle this earlier.
>
> Are you aware of any S3 endpoint misconfiguration with old version of
> Hadoop-aws?
>
> Many thanks,
>
> Enrico
>
>
> From: Lionel Liu 
> Date: Wednesday, April 11, 2018 at 3:34 AM
> To: "dev@griffin.incubator.apache.org" ,
> Enrico D'Urso 
> Subject: Re: Griffin on Docker - modify Hive metastore Uris
>
> Hi Enrico,
>
> Griffin service only need to get metadata from hive metastore service, it
> doesn't fetch hive table data actually.
> Griffin measure, which runs on spark cluster, needs to fetch hive table
> data, you need to pass the AWS credentials to it when submit. I recommend
> you try the shell-submit way to submit the measure module first.
>
>
>
> Thanks,
> Lionel
>
> On Tue, Apr 10, 2018 at 9:48 PM, Enrico D'Urso  > wrote:
> Hi,
>
> I have just set up the Griffin Docker image and it seems to work ok, I am
> able to view the sample data that comes by default.
>
> Now, I would like to test a bit the metrics things against a subset of a
> table that I have in our Hive instance;
> In particular the configuration is as follows:
> - Hive Metastore on RDS (Mysql on Amazon)
> -Actual data on  Amazon S3
>
> The machine in which Docker is running has access to the metastore and
> also can potentially fetch data from S3.
>
> I connected into the Docker image and now I am checking the following file:
> /root/service/config/application.properties
>
> in which I see the hive.metastore.uris that I can potentially modify.
> I would also need to pass to Griffin the AWS credentials to be able to
> fetch data from S3.
>
> Anyone has experience on this?
>
> Thanks,
>
> E.
>
>

UI - install node module too slow

[jenny li]

Hi Experts,

It takes a long time to install node modules by running 'npm install' , do
you have any suggestion on this issue? many thanks.

Best regards,
Jenny

[jira] [Updated] (GRIFFIN-128) [Doc][Wiki] Add organization column in committer list

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-128:
---
Sprint: Apache Sprint 2

> [Doc][Wiki] Add organization column in committer list
> -
>
> Key: GRIFFIN-128
> URL: https://issues.apache.org/jira/browse/GRIFFIN-128
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: William Guo
>Priority: Major
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> In committer list 
> https://cwiki.apache.org/confluence/display/GRIFFIN/PMC+and+Committers+List, 
> add organization column



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-149) [Doc] Use case document of VIP

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-149:
---
Sprint: Apache Sprint 2

> [Doc] Use case document of VIP
> --
>
> Key: GRIFFIN-149
> URL: https://issues.apache.org/jira/browse/GRIFFIN-149
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Lionel Liu
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (GRIFFIN-149) [Doc] Use case document of VIP

[Lionel Liu (JIRA)]

Lionel Liu created GRIFFIN-149:
--

 Summary: [Doc] Use case document of VIP
 Key: GRIFFIN-149
 URL: https://issues.apache.org/jira/browse/GRIFFIN-149
 Project: Griffin (Incubating)
  Issue Type: Task
Reporter: Lionel Liu
Assignee: Lionel Liu






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (GRIFFIN-148) [Doc] Use case document of crawler

[Lionel Liu (JIRA)]

Lionel Liu created GRIFFIN-148:
--

 Summary: [Doc] Use case document of crawler
 Key: GRIFFIN-148
 URL: https://issues.apache.org/jira/browse/GRIFFIN-148
 Project: Griffin (Incubating)
  Issue Type: Task
Reporter: Lionel Liu
Assignee: Juan Li






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (GRIFFIN-147) [Doc] Use case document of Bullseye

[Lionel Liu (JIRA)]

Lionel Liu created GRIFFIN-147:
--

 Summary: [Doc] Use case document of Bullseye
 Key: GRIFFIN-147
 URL: https://issues.apache.org/jira/browse/GRIFFIN-147
 Project: Griffin (Incubating)
  Issue Type: Task
Reporter: Lionel Liu
Assignee: Zhao, Vincent






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-120) [Service][UI] support job state and action management

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-120:
---
Sprint: Apache Sprint 1  (was: Apache Sprint 1, Apache Sprint 2)

> [Service][UI] support job state and action management
> -
>
> Key: GRIFFIN-120
> URL: https://issues.apache.org/jira/browse/GRIFFIN-120
> Project: Griffin (Incubating)
>  Issue Type: New Feature
>Reporter: Lionel Liu
>Assignee: Yuqin Xuan
>Priority: Major
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> we need to support job state and action (like stop and start) management



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (GRIFFIN-146) [Service] Prepare and test job state and action service

[Lionel Liu (JIRA)]

Lionel Liu created GRIFFIN-146:
--

 Summary: [Service] Prepare and test job state and action service
 Key: GRIFFIN-146
 URL: https://issues.apache.org/jira/browse/GRIFFIN-146
 Project: Griffin (Incubating)
  Issue Type: Task
Reporter: Lionel Liu
Assignee: Yuqin Xuan


cherry pick and test , push to master



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-130) [Site] Modify griffin site template

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-130:
---
Sprint: Apache Sprint 2

> [Site] Modify griffin site template
> ---
>
> Key: GRIFFIN-130
> URL: https://issues.apache.org/jira/browse/GRIFFIN-130
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Juan Li
>Priority: Major
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Change the template of griffin site



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (GRIFFIN-115) [Measure][UT] Enhance UT of rule part in measure module

[Lionel Liu (JIRA)]

[ 
https://issues.apache.org/jira/browse/GRIFFIN-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436995#comment-16436995
 ] 

Lionel Liu commented on GRIFFIN-115:


coverage: 20%

> [Measure][UT] Enhance UT of rule part in measure module
> ---
>
> Key: GRIFFIN-115
> URL: https://issues.apache.org/jira/browse/GRIFFIN-115
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Qiyuan Zhou
>Priority: Major
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> In measure module, rule part needs to enhance UT, to cover more conditions.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-115) [Measure][UT] Enhance UT of rule part in measure module

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-115:
---
Sprint: Apache Sprint 2

> [Measure][UT] Enhance UT of rule part in measure module
> ---
>
> Key: GRIFFIN-115
> URL: https://issues.apache.org/jira/browse/GRIFFIN-115
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Qiyuan Zhou
>Priority: Major
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> In measure module, rule part needs to enhance UT, to cover more conditions.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

RE: Re:RE: Can't get output after creating measure

[Ashwini Kumar Gupta]

Hello Lionel,

Apologies for delayed reply. I was trying all my options before raising an 
issue.

I'm attaching my installation steps. Please let me know what's wrong with them.

Regards
Ashwin

From: bhlx3l...@163.com  On Behalf Of Lionel Liu
Sent: 10 April 2018 18:11
To: dev@griffin.incubator.apache.org; Ashwini Kumar Gupta 

Subject: Re:RE: Can't get output after creating measure

Hi Ashwini,

It works the same in linux OS, we need to check the log to figure out what 
happened, it might be some configure mistake or input mistake.
I recommend you try our docker image first, by following this doc: 
https://github.com/apache/incubator-griffin/blob/master/griffin-doc/docker/griffin-docker-guide.md

--
Regards,
Lionel, Liu


At 2018-04-10 19:25:01, "Ashwini Kumar Gupta" 
> wrote:

>Hello Lionel,

>

>I'm running this in cloudera VM. Will that change anything?

>

>Regards

>Ashwin

>

>From: Lionel Liu >

>Sent: 10 April 2018 15:26

>To: dev@griffin.incubator.apache.org; 
>Ashwini Kumar Gupta 
>>

>Subject: Re: Can't get output after creating measure

>

>Hi Ashwini,

>

>First, you could check the log of griffin service, to know if it has triggered 
>the job instance.

>Then, griffin service will submit a spark application with configuration to 
>livy, you can check the log of livy, to verify if it has been submitted 
>correctly.

>After that, you need to check the spark cluster, to verify the application has 
>been accepted by the cluster, if it runs, you can get the application log 
>through yarn.

>

>Each step error might block the result.

>

>Thanks,

>Lionel

>

>On Tue, Apr 10, 2018 at 5:01 PM, William Guo 
>>>
> wrote:

>hi Ashwin,

>

>Could you show us your log here?

>

>Thanks,

>William

>

>On Tue, Apr 10, 2018 at 3:35 PM, Ashwini Kumar Gupta <

>ashwini.gu...@enquero.com>>
> wrote:

>

>> Hello Team,

>>

>> I have been trying to install and use griffin but I cannot get output when

>> I click on DQ Matrix.

>>

>> I created a measure, created a job to run.

>> The sequence in which I run all services are:

>>

>>

>>   1.  Elasticsearch

>>   2.  Jar file

>>

>> I also noticed that griffin is not creating mapping in ES.

>>

>> Can you please tell me where I'm going wrong.

>>

>> Thanks

>> Ashwin

>>

>





Griffin installing steps.docx
Description: Griffin installing steps.docx

[jira] [Updated] (GRIFFIN-122) [Service] We need to support all livy parameters when submit job.

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-122:
---
Summary: [Service] We need to support all livy parameters when submit job.  
(was: [Service] We need to read livy config files as a map, to support its 
later version or any other extend parameters)

> [Service] We need to support all livy parameters when submit job.
> -
>
> Key: GRIFFIN-122
> URL: https://issues.apache.org/jira/browse/GRIFFIN-122
> Project: Griffin (Incubating)
>  Issue Type: New Feature
>Reporter: Lionel Liu
>Assignee: Qiyuan Zhou
>Priority: Major
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> Support reading livy config file as a map, to support any other extend 
> parameters.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (GRIFFIN-145) [Service] Go through service API response standard

[Lionel Liu (JIRA)]

Lionel Liu created GRIFFIN-145:
--

 Summary: [Service] Go through service API response standard
 Key: GRIFFIN-145
 URL: https://issues.apache.org/jira/browse/GRIFFIN-145
 Project: Griffin (Incubating)
  Issue Type: Task
Reporter: Lionel Liu
Assignee: wanyin






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-144) Added support for Elastic Search 6.

[Sparsh Singhal (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sparsh Singhal updated GRIFFIN-144:
---
External issue URL:   (was: 
https://www.elastic.co/blog/strict-content-type-checking-for-elasticsearch-rest-requests)
   Description: 
We have to mention content type while posting and getting data from elastic 
search. Created a pull request on GitHub.

 

For Elastic Search 6 requirements: 

[https://www.elastic.co/blog/strict-content-type-checking-for-elasticsearch-rest-requests]

 

  was:
We have to mention content type while posting and getting data from elastic 
search. Created a pull request on GitHub.

 

https://www.elastic.co/blog/strict-content-type-checking-for-elasticsearch-rest-requests

 


> Added support for Elastic Search 6.
> ---
>
> Key: GRIFFIN-144
> URL: https://issues.apache.org/jira/browse/GRIFFIN-144
> Project: Griffin (Incubating)
>  Issue Type: Improvement
>Affects Versions: 0.2.0-incubating
>Reporter: Sparsh Singhal
>Priority: Minor
> Fix For: 0.2.0-incubating
>
>
> We have to mention content type while posting and getting data from elastic 
> search. Created a pull request on GitHub.
>  
> For Elastic Search 6 requirements: 
> [https://www.elastic.co/blog/strict-content-type-checking-for-elasticsearch-rest-requests]
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-114) [Service][UT] Enhance unit test of config, info, util in service module

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-114:
---
Sprint: Apache Sprint 2

> [Service][UT] Enhance unit test of config, info, util in service module
> ---
>
> Key: GRIFFIN-114
> URL: https://issues.apache.org/jira/browse/GRIFFIN-114
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: wanyin
>Priority: Major
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> In service module, UT of config, info and util need to be enhanced.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-126) [Site] Add a security link in griffin site

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-126:
---
Sprint: Apache Sprint 1, Apache Sprint 2  (was: Apache Sprint 1)

> [Site] Add a security link in griffin site
> --
>
> Key: GRIFFIN-126
> URL: https://issues.apache.org/jira/browse/GRIFFIN-126
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Juan Li
>Priority: Major
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> Add a security link ([http://www.apache.org/security/]) in griffin site.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (GRIFFIN-126) [Site] Add a security link in griffin site

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu reassigned GRIFFIN-126:
--

Assignee: Juan Li  (was: William Guo)

> [Site] Add a security link in griffin site
> --
>
> Key: GRIFFIN-126
> URL: https://issues.apache.org/jira/browse/GRIFFIN-126
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Juan Li
>Priority: Major
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> Add a security link ([http://www.apache.org/security/]) in griffin site.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-126) [Site] Add a security link in griffin site

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-126:
---
Sprint: Apache Sprint 1  (was: Apache Sprint 1, Apache Sprint 2)

> [Site] Add a security link in griffin site
> --
>
> Key: GRIFFIN-126
> URL: https://issues.apache.org/jira/browse/GRIFFIN-126
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: William Guo
>Priority: Major
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> Add a security link ([http://www.apache.org/security/]) in griffin site.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (GRIFFIN-144) Added support for Elastic Search 6.

[Sparsh Singhal (JIRA)]

Sparsh Singhal created GRIFFIN-144:
--

 Summary: Added support for Elastic Search 6.
 Key: GRIFFIN-144
 URL: https://issues.apache.org/jira/browse/GRIFFIN-144
 Project: Griffin (Incubating)
  Issue Type: Improvement
Affects Versions: 0.2.0-incubating
Reporter: Sparsh Singhal
 Fix For: 0.2.0-incubating


We have to mention content type while posting and getting data from elastic 
search. Created a pull request on GitHub.

 

https://www.elastic.co/blog/strict-content-type-checking-for-elasticsearch-rest-requests

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-123) [Measure] Code review of measure module, refactor and enhance the code style

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-123:
---
Sprint: Apache Sprint 2

> [Measure] Code review of measure module, refactor and enhance the code style
> 
>
> Key: GRIFFIN-123
> URL: https://issues.apache.org/jira/browse/GRIFFIN-123
> Project: Griffin (Incubating)
>  Issue Type: Improvement
>Reporter: Lionel Liu
>Assignee: William Guo
>Priority: Major
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> Code review of measure module, refactor and enhance the code style



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-143) [License][Release] track the license issue in 0.2.0-RC3 release

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-143:
---
Sprint: Apache Sprint 2

> [License][Release] track the license issue in 0.2.0-RC3 release
> ---
>
> Key: GRIFFIN-143
> URL: https://issues.apache.org/jira/browse/GRIFFIN-143
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Lionel Liu
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-131) [Doc][Site] Use case documents

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-131:
---
Sprint: Apache Sprint 1, Apache Sprint 2  (was: Apache Sprint 1)

> [Doc][Site] Use case documents
> --
>
> Key: GRIFFIN-131
> URL: https://issues.apache.org/jira/browse/GRIFFIN-131
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Lionel Liu
>Priority: Major
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> Write some documents of use cases, onboard on site



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-127) [Doc][Site] Announce "document contribution" description in "How to contribute" on site

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-127:
---
Sprint: Apache Sprint 1, Apache Sprint 2  (was: Apache Sprint 1)

> [Doc][Site] Announce "document contribution" description in "How to 
> contribute" on site
> ---
>
> Key: GRIFFIN-127
> URL: https://issues.apache.org/jira/browse/GRIFFIN-127
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: William Guo
>Priority: Major
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> on site document, announce "document contribution" description in "How to 
> contribute"



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-126) [Site] Add a security link in griffin site

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-126:
---
Sprint: Apache Sprint 1, Apache Sprint 2  (was: Apache Sprint 1)

> [Site] Add a security link in griffin site
> --
>
> Key: GRIFFIN-126
> URL: https://issues.apache.org/jira/browse/GRIFFIN-126
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: William Guo
>Priority: Major
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> Add a security link ([http://www.apache.org/security/]) in griffin site.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-136) [Griffin] As griffin user, I want to use mysql or hibernate with griffin open source version, to deploy it in my environment

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-136:
---
Sprint: Apache Sprint 1, Apache Sprint 2  (was: Apache Sprint 1)

> [Griffin] As griffin user, I want to use mysql or hibernate with griffin open 
> source version, to deploy it in my environment
> 
>
> Key: GRIFFIN-136
> URL: https://issues.apache.org/jira/browse/GRIFFIN-136
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Kevin Yao
>Priority: Major
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Due to some license issue, griffin open source version choose postgresql and 
> eclipselink jpa as default solution, but for some users, they want to use 
> mysql or hibernate, we need to provide a document to support these use cases.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-120) [Service][UI] support job state and action management

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-120:
---
Sprint: Apache Sprint 1, Apache Sprint 2  (was: Apache Sprint 1)

> [Service][UI] support job state and action management
> -
>
> Key: GRIFFIN-120
> URL: https://issues.apache.org/jira/browse/GRIFFIN-120
> Project: Griffin (Incubating)
>  Issue Type: New Feature
>Reporter: Lionel Liu
>Assignee: Yuqin Xuan
>Priority: Major
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> we need to support job state and action (like stop and start) management



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (GRIFFIN-103) [Griffin] Release of incubating-0.2.0

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-103:
---
Sprint: Apache Sprint 1, Apache Sprint 2  (was: Apache Sprint 1)

> [Griffin] Release of incubating-0.2.0
> -
>
> Key: GRIFFIN-103
> URL: https://issues.apache.org/jira/browse/GRIFFIN-103
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Lionel Liu
>Priority: Major
> Fix For: 0.2.0-incubating
>
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (GRIFFIN-143) [License][Release] track the license issue in 0.2.0-RC3 release

[Lionel Liu (JIRA)]

Lionel Liu created GRIFFIN-143:
--

 Summary: [License][Release] track the license issue in 0.2.0-RC3 
release
 Key: GRIFFIN-143
 URL: https://issues.apache.org/jira/browse/GRIFFIN-143
 Project: Griffin (Incubating)
  Issue Type: Task
Reporter: Lionel Liu
Assignee: Lionel Liu






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] incubator-griffin pull request #256: Griffin 0.2.0 incubating rc3

[SparshSinghalHM]

Github user SparshSinghalHM closed the pull request at:

https://github.com/apache/incubator-griffin/pull/256


---

[jira] [Updated] (GRIFFIN-120) [Service][UI] support job state and action management

[Lionel Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu updated GRIFFIN-120:
---
Sprint: Apache Sprint 1

> [Service][UI] support job state and action management
> -
>
> Key: GRIFFIN-120
> URL: https://issues.apache.org/jira/browse/GRIFFIN-120
> Project: Griffin (Incubating)
>  Issue Type: New Feature
>Reporter: Lionel Liu
>Assignee: Yuqin Xuan
>Priority: Major
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> we need to support job state and action (like stop and start) management



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)