Apache Atlas 2.1 release

2020-02-18 Thread Madhan Neethiraj
Atlas community,

 

Over past months the dev community has been busy in enhancing Apache Atlas with 
new features, improvements and fixes. Here are few features/enhancements since 
last major release, Apache Atlas 2.0:

    - added quick-search feature, to provide a simpler search experience with 
type-ahead suggestions

    - introduced Namespaces feature, which allows grouping of attributes to be 
applied to multiple entity-types

    - introduced labels on entity instances, and search for entities using the 
label

    - enhancement to support entity instance specific custom attributes

    - enhanced search to find entities by more than one classification

    - introduced shell/incomplete entities to handle notifications referencing 
entities that don’t (yet) exist in Atlas

    - added REST APIs to purge deleted entities

    - performance improvements in lineage retrieval and tag-propagation

    - updated Atlas server to process notifications from multiple Kafka topics

    - updated Hive hook to track process executions, via hive_process_execution 
entities

    - updated Hive hook to capture DDL operations, via hive_db_ddl and 
hive_table_ddl entities

    - added models for Spark; introduced new models for AWS S3

    - updated versions of dependent libraries/components: JanusGraph, Jackson 
parser, Spring Framework,

    - updated authorization model to cover new features/APIs, like add/remove 
labels, purge entities, update namespace attributes

 

With significant improvements in place, it is time for the next maintenance 
release of Apache Atlas!

 

I propose to release Apache Atlas 2.1 by early next month. Please review and 
send your comments.

 

Regards,

Madhan



[jira] [Created] (ATLAS-3624) Beta UI : Allows user to add multi-valued attributes in namespaces

2020-02-18 Thread Keval Bhatt (Jira)
Keval Bhatt created ATLAS-3624:
--

 Summary: Beta UI : Allows user to add multi-valued attributes in 
namespaces
 Key: ATLAS-3624
 URL: https://issues.apache.org/jira/browse/ATLAS-3624
 Project: Atlas
  Issue Type: Improvement
Reporter: Keval Bhatt
Assignee: Keval Bhatt






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3624) Beta UI : Allow user to add multi-valued attributes in namespaces

2020-02-18 Thread Keval Bhatt (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-3624:
---
Summary: Beta UI : Allow user to add multi-valued attributes in namespaces  
(was: Beta UI : Allows user to add multi-valued attributes in namespaces)

> Beta UI : Allow user to add multi-valued attributes in namespaces
> -
>
> Key: ATLAS-3624
> URL: https://issues.apache.org/jira/browse/ATLAS-3624
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3554) UI: changes to display/add/update/delete namespace attributes for entities in entity details page

2020-02-18 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039052#comment-17039052
 ] 

ASF subversion and git services commented on ATLAS-3554:


Commit 70ebb22829a4dae8f06031b045f4848a4c22fc05 in atlas's branch 
refs/heads/master from Keval Bhatt
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=70ebb22 ]

ATLAS-3554 : UI: changes to display/add/update/delete namespace attributes for 
entities in entity details page


> UI: changes to display/add/update/delete namespace attributes for entities in 
> entity details page
> -
>
> Key: ATLAS-3554
> URL: https://issues.apache.org/jira/browse/ATLAS-3554
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: ATLAS-3554.1.patch, ATLAS-3554.2.patch, ATLAS-3554.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3554) UI: changes to display/add/update/delete namespace attributes for entities in entity details page

2020-02-18 Thread Keval Bhatt (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-3554:
---
Attachment: ATLAS-3554.2.patch

> UI: changes to display/add/update/delete namespace attributes for entities in 
> entity details page
> -
>
> Key: ATLAS-3554
> URL: https://issues.apache.org/jira/browse/ATLAS-3554
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: ATLAS-3554.1.patch, ATLAS-3554.2.patch, ATLAS-3554.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Review Request 72127: ATLAS-3615 :- Basic Search : Search with _ALL_ENTITY_TYPES and classification doesn't not fetch any entity associated to that classification

2020-02-18 Thread Pinal Shah

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72127/
---

(Updated Feb. 18, 2020, 11:57 a.m.)


Review request for atlas, Madhan Neethiraj, Nixon Rodrigues, and Sarath 
Subramanian.


Changes
---

Changed typeAndSubTypes to emptySet


Bugs: ATLAS-3615
https://issues.apache.org/jira/browse/ATLAS-3615


Repository: atlas


Description (updated)
---

Issues:
1) Combination of typeName:_ALL_ENTITY_TYPES and classification doesn't return 
result
Why? As _ALL_ENTITY_TYPES value is assigned as [* TO *] results show up when 
searched from solr but not from graphdb

2) Combination of typeName:_ALL_ENTITY_TYPES, classification, 
query(SearchByText) doesn't return result
Why? result from solr, thru "/freetext" is correct, but onsearching if resulted 
entitytype is in typeAndSubtypes of given entityType, it breaks because 
typeAndSubTypes of _ALL_ENTITY_TYPES is [* TO *]

3) Combination of typeName, classification:_ALL_CLASSIFICATION_TYPES doesn't 
return result

4) Combination of typeName:_ALL_ENTITY_TYPES, 
classification:_ALL_CLASSIFICATION_TYPES, query(SearchByText) doesn't return 
correct result
why? query formed with above combination in solr /freetext is 'SAMPLEQUERY' AND 
[* TO *] AND [* TO *]

5) Combination of classification:_ALL_CLASSIFICATION_TYPES and 
classificationFilter doesn't return correct result


Diffs (updated)
-

  
repository/src/main/java/org/apache/atlas/discovery/ClassificationSearchProcessor.java
 c0a5a46dd 
  
repository/src/main/java/org/apache/atlas/discovery/EntitySearchProcessor.java 
b5606d046 
  
repository/src/main/java/org/apache/atlas/discovery/FreeTextSearchProcessor.java
 d628f1352 
  repository/src/main/java/org/apache/atlas/discovery/SearchContext.java 
353411363 
  repository/src/main/java/org/apache/atlas/discovery/SearchProcessor.java 
8c17a9044 


Diff: https://reviews.apache.org/r/72127/diff/3/

Changes: https://reviews.apache.org/r/72127/diff/2-3/


Testing
---

For issue1:
1) tested with values _ALL_ENTITY_TYPES + EntityFilter + classification -> 
result fetches from gremlin and shows up correct result
2) tested with values _ALL_ENTITY_TYPES + classification -> result fetches from 
gremlin and shows up correct result

For issue2:
1) tested with values _ALL_ENTITY_TYPES + classification + query(SearchByText) 
-> shows up correct result


Thanks,

Pinal Shah