Re: [VOTE] Release of Apache Griffin-0.3.0-incubating [RC1]

2018-08-30 Thread William Guo
hi all,

the verify link is

https://cwiki.apache.org/confluence/display/GRIFFIN/5.+How+to+Verify+Release+Package


Thanks,
William


On Thu, Aug 30, 2018 at 10:44 PM Lionel Liu  wrote:

> Hi all,
>
> This is a call for a vote on releasing Apache Griffin 0.3.0-incubating,
> release candidate 1.
> Apache Griffin is data quality service for modern data system, it
> defines a standard process to define,measure data quality for well-known
> dimensions.
> With Apache Griffin, users will be able to quickly define their data
> quality requirements and then get the result in near real time in
> systematical approach.
>
>
> ** Highlights **
> * Refactor measure module for better abstraction.
> * Support missing records download for accuracy measurement.
> * Support regular expression detection count in profiling measurement.
> * Fix several bugs on UI.
>
>
> The source tarball, including signatures, digests, etc. can be found
> at:
> *
> https://dist.apache.org/repos/dist/dev/incubator/griffin/0.3.0-incubating/
> <
> https://dist.apache.org/repos/dist/dev/incubator/griffin/0.3.0-incubating/
> >*
>
> The tag to be voted upon is 0.3.0-incubating:
> *
> https://git-wip-us.apache.org/repos/asf?p=incubator-griffin.git;a=shortlog;h=refs/tags/griffin-0.3.0-incubating
> <
> https://git-wip-us.apache.org/repos/asf?p=incubator-griffin.git;a=shortlog;h=refs/tags/griffin-0.3.0-incubating
> >*
>
> The release hash is :
> *
> https://git-wip-us.apache.org/repos/asf?p=incubator-griffin.git;a=commit;h=797cc62c94449e485d3af910bc8557ca9841bb22
> <
> https://git-wip-us.apache.org/repos/asf?p=incubator-griffin.git;a=commit;h=797cc62c94449e485d3af910bc8557ca9841bb22
> >*
>
> The Nexus Staging URL:
> *
> https://repository.apache.org/content/repositories/orgapachegriffin-1018
>  >*
>
>
> Release artifacts are signed with the following key:
> 7F00C3BA90F3ECAEECB843A79BD6EC6C02379561
> KEYS file available:
> https://dist.apache.org/repos/dist/dev/incubator/griffin/KEYS
>
> For information about the contents of this release, see:
> *
> https://dist.apache.org/repos/dist/dev/incubator/griffin/0.3.0-incubating/CHANGES.txt
> <
> https://dist.apache.org/repos/dist/dev/incubator/griffin/0.3.0-incubating/CHANGES.txt
> >*
>
>
> Please vote on releasing this package as Apache Griffin
> 0.3.0-incubating
>
>
> The vote will be open for 72 hours.
>
> [ ] +1 Release this package as Apache Griffin 0.3.0-incubating
> [ ] +0 no opinion
> [ ] -1 Do not release this package because ...
>
>
> You can follow the steps here to verify the release before you vote:
> https://cwiki.apache.org/confluence/display/GRIFFIN/How+to+Verify+
> Release+Package
>
>
> Thanks,
> Lionel
> On behalf of Apache Griffin PPMC
>


[VOTE] Release of Apache Griffin-0.3.0-incubating [RC1]

2018-08-30 Thread Lionel Liu
Hi all,

This is a call for a vote on releasing Apache Griffin 0.3.0-incubating,
release candidate 1.
Apache Griffin is data quality service for modern data system, it
defines a standard process to define,measure data quality for well-known
dimensions.
With Apache Griffin, users will be able to quickly define their data
quality requirements and then get the result in near real time in
systematical approach.


** Highlights **
* Refactor measure module for better abstraction.
* Support missing records download for accuracy measurement.
* Support regular expression detection count in profiling measurement.
* Fix several bugs on UI.


The source tarball, including signatures, digests, etc. can be found at:
*https://dist.apache.org/repos/dist/dev/incubator/griffin/0.3.0-incubating/
*

The tag to be voted upon is 0.3.0-incubating:

*https://git-wip-us.apache.org/repos/asf?p=incubator-griffin.git;a=shortlog;h=refs/tags/griffin-0.3.0-incubating
*

The release hash is :

*https://git-wip-us.apache.org/repos/asf?p=incubator-griffin.git;a=commit;h=797cc62c94449e485d3af910bc8557ca9841bb22
*

The Nexus Staging URL:
*https://repository.apache.org/content/repositories/orgapachegriffin-1018
*


Release artifacts are signed with the following key:
7F00C3BA90F3ECAEECB843A79BD6EC6C02379561
KEYS file available:
https://dist.apache.org/repos/dist/dev/incubator/griffin/KEYS

For information about the contents of this release, see:

*https://dist.apache.org/repos/dist/dev/incubator/griffin/0.3.0-incubating/CHANGES.txt
*


Please vote on releasing this package as Apache Griffin 0.3.0-incubating


The vote will be open for 72 hours.

[ ] +1 Release this package as Apache Griffin 0.3.0-incubating
[ ] +0 no opinion
[ ] -1 Do not release this package because ...


You can follow the steps here to verify the release before you vote:
https://cwiki.apache.org/confluence/display/GRIFFIN/How+to+Verify+
Release+Package


Thanks,
Lionel
On behalf of Apache Griffin PPMC


[GitHub] incubator-griffin pull request #406: fix download disable items issue

2018-08-30 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-griffin/pull/406


---


[GitHub] incubator-griffin pull request #407: In order to improve readability, comple...

2018-08-30 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-griffin/pull/407


---


[GitHub] incubator-griffin pull request #407: In order to improve readability, comple...

2018-08-30 Thread toyboxman
GitHub user toyboxman opened a pull request:

https://github.com/apache/incubator-griffin/pull/407

In order to improve readability, complement some stuffs into readme doc



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/toyboxman/incubator-griffin doc

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-griffin/pull/407.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #407


commit 699287c0b8f465eb083926985e058d27ea1f958b
Author: Eugene 
Date:   2018-08-30T13:44:48Z

In order to improve readability, complement some stuffs into readme doc




---


[jira] [Resolved] (GRIFFIN-187) Support Empty String in Profiling Measure

2018-08-30 Thread Lionel Liu (JIRA)


 [ 
https://issues.apache.org/jira/browse/GRIFFIN-187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu resolved GRIFFIN-187.

Resolution: Done

> Support Empty String in Profiling Measure
> -
>
> Key: GRIFFIN-187
> URL: https://issues.apache.org/jira/browse/GRIFFIN-187
> Project: Griffin (Incubating)
>  Issue Type: New Feature
>Reporter: Spencer Hivert
>Priority: Minor
>
> Here at Credit Karma, we've discovered that it's also useful to check if the 
> string is empty. We were originally using the null count functionality 
> however we were mislead as the field was not null, but rather empty.
> Add the ability to check for empty strings!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (GRIFFIN-186) [UI] Re-Factor Profiling Measure Creation

2018-08-30 Thread Lionel Liu (JIRA)


 [ 
https://issues.apache.org/jira/browse/GRIFFIN-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu resolved GRIFFIN-186.

Resolution: Done

> [UI] Re-Factor Profiling Measure Creation
> -
>
> Key: GRIFFIN-186
> URL: https://issues.apache.org/jira/browse/GRIFFIN-186
> Project: Griffin (Incubating)
>  Issue Type: Improvement
>Reporter: Spencer Hivert
>Priority: Minor
>
> The current code structure contained in 
> "/incubator-griffin/ui/angular/src/app/measure/create-measure/pr" is 
> confusing and difficult to work with.
> Each step should have a separate component rather than combining all into a 
> single component.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (GRIFFIN-184) [Service] download miss records

2018-08-30 Thread Lionel Liu (JIRA)


 [ 
https://issues.apache.org/jira/browse/GRIFFIN-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu resolved GRIFFIN-184.

Resolution: Done

> [Service] download miss records
> ---
>
> Key: GRIFFIN-184
> URL: https://issues.apache.org/jira/browse/GRIFFIN-184
> Project: Griffin (Incubating)
>  Issue Type: New Feature
>Reporter: Juan Li
>Assignee: Juan Li
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Closed] (GRIFFIN-172) when will version of 1.0.0 be released

2018-08-30 Thread Lionel Liu (JIRA)


 [ 
https://issues.apache.org/jira/browse/GRIFFIN-172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu closed GRIFFIN-172.
--
Resolution: Not A Problem

> when will version of 1.0.0 be released 
> ---
>
> Key: GRIFFIN-172
> URL: https://issues.apache.org/jira/browse/GRIFFIN-172
> Project: Griffin (Incubating)
>  Issue Type: Task
>Affects Versions: 1.0.0-incubating
>Reporter: coal chan
>Priority: Minor
>
> I see the plan of 1.0.0-incubating will be realeased at 2018-06-30,but now is 
> out of date.
> Was there any difficulty?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (GRIFFIN-164) Make 'Regular expression detection count' available in UI

2018-08-30 Thread Lionel Liu (JIRA)


 [ 
https://issues.apache.org/jira/browse/GRIFFIN-164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu resolved GRIFFIN-164.

Resolution: Done

> Make 'Regular expression detection count' available in UI
> -
>
> Key: GRIFFIN-164
> URL: https://issues.apache.org/jira/browse/GRIFFIN-164
> Project: Griffin (Incubating)
>  Issue Type: Improvement
>Affects Versions: 0.1.6-incubating
>Reporter: Enrico D'Urso
>Priority: Minor
> Fix For: 1.0.0-incubating
>
>
> Hi,
> I have been playing for one month now with Griffin.
> Given my experience, some companies (included the one am working for as a 
> consultant) prefer doing stuff using UI.
> Personally, I find very useful the following feature:
>  
>  * Regular expression detection count
> which is, I have a column which should contain just numbers so I want to 
> check if my ETL process, wrongly, has populated my table with non-numeric 
> values.
> I have been able to run such a job creating my self the right config.json, in 
> particular, using spark-sql as dialect:
> {code:java}
> select count(*) from src where account_id rlike [^0-9]  
> {code}
> I saw that in pr.component.ts there is a commented line of code:
> {code:java}
> // {"id":10,"itemName":"Regular Expression Detection Count","category": 
> "Advanced Statistics"}
> {code}
> which I think is what I am talking about.
> Also, I can read:
> {code:java}
> // case 'Regular Expression Detection Count': // return 
> 'count(source.`'+col.name+'`) where source.`'+col.name+'` LIKE ';
> {code}
> which should be the griffin-dsl dialect, even if, probably, the regex should 
> be added just after LIKE.
> Then, once that the above griffin-dsl statement is available in the backend, 
> ProfilingRulePlanTrans class
> should map that into 'rlike' Spark-sql clause.
> Am not sure where (and if) ProfilingRulePlanTrans should be modified as 
> preGroupbyClause should contains everything, but I do not have enough 
> knowledge about it.
>  
> Please judge yourself the priority of such a feature, which knowing well the 
> code, should not be too hard to make.
> Thanks,
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (GRIFFIN-146) [Service] Prepare and test job state and action service

2018-08-30 Thread Lionel Liu (JIRA)


 [ 
https://issues.apache.org/jira/browse/GRIFFIN-146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lionel Liu resolved GRIFFIN-146.

Resolution: Done

> [Service] Prepare and test job state and action service
> ---
>
> Key: GRIFFIN-146
> URL: https://issues.apache.org/jira/browse/GRIFFIN-146
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: Lionel Liu
>Assignee: Yuqin Xuan
>Priority: Major
>
> cherry pick and test , push to master



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] incubator-griffin pull request #406: fix download disable items issue

2018-08-30 Thread icesmartjuan
GitHub user icesmartjuan opened a pull request:

https://github.com/apache/incubator-griffin/pull/406

fix download disable items issue

fix the issue that one column is not disabled while in downloading 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/icesmartjuan/incubator-griffin fix_ui_bug

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-griffin/pull/406.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #406


commit fd0ca49191c106312d8340984dc8aa9636994059
Author: Li, Juan 
Date:   2018-08-30T11:06:55Z

fix download disable items issue




---


[GitHub] incubator-griffin pull request #405: update gpg keys

2018-08-30 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-griffin/pull/405


---


[GitHub] incubator-griffin pull request #405: update gpg keys

2018-08-30 Thread guoyuepeng
GitHub user guoyuepeng opened a pull request:

https://github.com/apache/incubator-griffin/pull/405

update gpg keys



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/guoyuepeng/incubator-griffin update_gpg_keys

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-griffin/pull/405.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #405


commit 582c180da60e099ca93e5fc8faedfc793e5d6868
Author: William Guo 
Date:   2018-08-30T08:53:35Z

update gpg keys




---


[GitHub] incubator-griffin pull request #404: fix license header

2018-08-30 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-griffin/pull/404


---


[GitHub] incubator-griffin pull request #404: fix license header

2018-08-30 Thread guoyuepeng
GitHub user guoyuepeng opened a pull request:

https://github.com/apache/incubator-griffin/pull/404

fix license header



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/guoyuepeng/incubator-griffin 
fix_service_header

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-griffin/pull/404.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #404


commit f3487639077666192eb11d20b5eb90a1e89f55c3
Author: William Guo 
Date:   2018-08-30T07:46:18Z

fix license header




---


[GitHub] incubator-griffin pull request #403: update docker image source and docker c...

2018-08-30 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-griffin/pull/403


---