[jira] [Commented] (ATLAS-2698) [Glossary] Add docs related to Glossary for Apache site

2018-05-21 Thread Apoorv Naik (JIRA)

[ 
https://issues.apache.org/jira/browse/ATLAS-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483395#comment-16483395
 ] 

Apoorv Naik commented on ATLAS-2698:


Committed to following branches:
 * master: 
[https://git-wip-us.apache.org/repos/asf?p=atlas.git;a=commit;h=d218fb4f2fe1551f8f9eb5fba69e38e0d25b10dc]
 * branch-1.0: 
[https://git-wip-us.apache.org/repos/asf?p=atlas.git;a=commit;h=a95fcdb55ef04d7528f2e355358ec41c31eb3782]

> [Glossary] Add docs related to Glossary for Apache site
> ---
>
> Key: ATLAS-2698
> URL: https://issues.apache.org/jira/browse/ATLAS-2698
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 1.0.0-alpha
>Reporter: Apoorv Naik
>Assignee: Apoorv Naik
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: 0001-ATLAS-2698-Glossary-related-documentation.patch
>
>
> Updating the docs module to include documentation around Glossary



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Build failed in Jenkins: PreCommit-ATLAS-Build-Test #426-master-ATLAS-2637-Data-Migration-Updates-to-Array-and-Map-t.patch

2018-05-21 Thread Apache Jenkins Server
See 


--
[...truncated 173.62 KB...]
[INFO] Enabled default license matchers.
[INFO] Will parse SCM ignores for exclusions...
[INFO] Finished adding exclusions from SCM ignore files.
[INFO] 61 implicit excludes (use -debug for more details).
[INFO] Exclude: **/antlr4/**
[INFO] Exclude: **/dependency-reduced-pom.xml
[INFO] Exclude: **/javax.script.ScriptEngineFactory
[INFO] Exclude: .reviewboardrc
[INFO] Exclude: 3party-licenses/**
[INFO] Exclude: **/.cache
[INFO] Exclude: **/.cache-main
[INFO] Exclude: **/.cache-tests
[INFO] Exclude: **/.checkstyle
[INFO] Exclude: **/*.txt
[INFO] Exclude: **/*.json
[INFO] Exclude: .pc/**
[INFO] Exclude: debian/**
[INFO] Exclude: .svn/**
[INFO] Exclude: .git/**
[INFO] Exclude: .gitignore
[INFO] Exclude: **/.idea/**
[INFO] Exclude: **/*.twiki
[INFO] Exclude: **/*.iml
[INFO] Exclude: **/*.json
[INFO] Exclude: **/*.log
[INFO] Exclude: **/target/**
[INFO] Exclude: **/target*/**
[INFO] Exclude: **/build/**
[INFO] Exclude: **/*.patch
[INFO] Exclude: derby.log
[INFO] Exclude: **/logs/**
[INFO] Exclude: **/.classpath
[INFO] Exclude: **/.project
[INFO] Exclude: **/.settings/**
[INFO] Exclude: **/test-output/**
[INFO] Exclude: **/mock/**
[INFO] Exclude: **/data/**
[INFO] Exclude: **/maven-eclipse.xml
[INFO] Exclude: **/.externalToolBuilders/**
[INFO] Exclude: **/build.log
[INFO] Exclude: **/.bowerrc
[INFO] Exclude: *.json
[INFO] Exclude: **/overlays/**
[INFO] Exclude: dev-support/**
[INFO] Exclude: **/users-credentials.properties
[INFO] Exclude: **/public/css/animate.min.css
[INFO] Exclude: **/public/css/bootstrap-sidebar.css
[INFO] Exclude: **/public/js/external_lib/**
[INFO] Exclude: **/node_modules/**
[INFO] Exclude: **/public/js/libs/**
[INFO] Exclude: **/atlas.data/**
[INFO] Exclude: **/${sys:atlas.data}/**
[INFO] Exclude: **/policy-store.txt
[INFO] Exclude: **/*rebel*.xml
[INFO] Exclude: **/*rebel*.xml.bak
[INFO] Exclude: **/test/resources/**
[INFO] 50 resources included (use -debug for more details)
[INFO] Rat check: Summary over all files. Unapproved: 0, unknown: 0, generated: 
0, approved: 50 licenses.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
atlas-graphdb-janus ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9 resources
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
atlas-graphdb-janus ---
Downloading from central: 
http://repo1.maven.org/maven2/com/sleepycat/je/7.3.7/je-7.3.7.pom
Downloading from hortonworks.repo: 
http://repo.hortonworks.com/content/repositories/releases/com/sleepycat/je/7.3.7/je-7.3.7.pom
Downloading from apache.snapshots.repo: 
https://repository.apache.org/content/groups/snapshots/com/sleepycat/je/7.3.7/je-7.3.7.pom
Downloading from apache-staging: 
https://repository.apache.org/content/groups/staging/com/sleepycat/je/7.3.7/je-7.3.7.pom
Downloading from default: 
https://repository.apache.org/content/groups/public/com/sleepycat/je/7.3.7/je-7.3.7.pom
Downloading from java.net-Public: 
https://maven.java.net/content/groups/public/com/sleepycat/je/7.3.7/je-7.3.7.pom
Downloading from repository.jboss.org-public: 
https://repository.jboss.org/nexus/content/groups/public/com/sleepycat/je/7.3.7/je-7.3.7.pom
Downloading from typesafe: 
http://repo.typesafe.com/typesafe/releases/com/sleepycat/je/7.3.7/je-7.3.7.pom
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ 
atlas-graphdb-janus ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 0 resource to META-INF
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ 
atlas-graphdb-janus ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 37 source files to 

[INFO] 
:
 Some input files use or override a deprecated API.
[INFO] 
:
 Recompile with -Xlint:deprecation for details.
[INFO] 
:
 Some input files use unchecked or unsafe operations.
[INFO] 
:
 Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ 
atlas-graphdb-janus ---
[INFO] Using 'UTF-8' encoding to copy filtered 

Re: Review Request 66928: Data Migration: Import: Infer Types that Store Edge Ids

2018-05-21 Thread Ashutosh Mestry

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66928/
---

(Updated May 21, 2018, 11:49 p.m.)


Review request for atlas, Madhan Neethiraj, Ruchi Solani, and Sarath 
Subramanian.


Changes
---

Updates include:
- Default propagation set to ONE_TO_TWO for lineages edges.
- Refactoring to use _AtlasTypeRegistry_ instead of complex maps.
- Refactoring to move logic to _RelationshipTypeCache_ from _GraphSONUtility_.


Bugs: ATLAS-2637
https://issues.apache.org/jira/browse/ATLAS-2637


Repository: atlas


Description
---

**Approach**
New class: _TypesStoringEdgeIds_: Navigates through all the types in the 
_typeRegistry_, returns map of entity type and properties that store edge ids.
Modified: _DataMigrationService_: Uses output from class above and passes it 
down to migration.
Modified: _PostProcessManager_: Uses the map generated above and uses it for 
post processing.
Modified: _GraphSONUtility_: Improvement to check for vertex of type. This 
avoids potential exeception when a non-existent property is checked for 
presence.

Added PostProcess framework.
Added logic for handling new Array and Map representation.


Diffs (updated)
-

  common/src/main/java/org/apache/atlas/AtlasConstants.java 2b92e6ed6 
  graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraph.java 
607baf664 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraph.java
 c0b9c1741 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraphDatabase.java
 16aecd5e2 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/AtlasGraphSONReader.java
 ae119b0bc 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/GraphSONUtility.java
 ec320b03e 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/MappedElementCache.java
 cca72ad11 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/PostProcessManager.java
 d0a65f7b1 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/RelationshipTypeCache.java
 e4e82649b 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/TypesWithCollectionsFinder.java
 PRE-CREATION 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/postProcess/PostProcessListProperty.java
 PRE-CREATION 
  
graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/migration/BaseUtils.java
 e863d9fae 
  
graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/migration/GraphSONUtilityPostProcessTest.java
 4d73c78ef 
  
graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/migration/GraphSONUtilityTest.java
 794b5471e 
  
graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/migration/MappedElementCacheTest.java
 cac09d229 
  
graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/migration/PostProcessListPropertyTest.java
 PRE-CREATION 
  graphdb/janus/src/test/resources/col-2-legacy.json PRE-CREATION 
  graphdb/janus/src/test/resources/col-3-legacy.json PRE-CREATION 
  graphdb/janus/src/test/resources/edge-legacy-Process.json PRE-CREATION 
  graphdb/janus/src/test/resources/edge-legacy-col.json PRE-CREATION 
  graphdb/janus/src/test/resources/edge-legacy-col2.json PRE-CREATION 
  graphdb/janus/src/test/resources/edge-legacy-col3.json PRE-CREATION 
  graphdb/janus/src/test/resources/edge-legacy-col4.json PRE-CREATION 
  graphdb/janus/src/test/resources/edge-legacy-tag.json PRE-CREATION 
  graphdb/janus/src/test/resources/lineage-v-98312.json PRE-CREATION 
  graphdb/janus/src/test/resources/table-v-147504.json 898dce5df 
  graphdb/janus/src/test/resources/tag-163856752.json PRE-CREATION 
  intg/src/main/java/org/apache/atlas/store/AtlasTypeDefStore.java b05754f4b 
  intg/src/test/java/org/apache/atlas/TestUtilsV2.java 886ce77f5 
  
repository/src/main/java/org/apache/atlas/repository/migration/DataMigrationService.java
 22cd55217 
  
repository/src/main/java/org/apache/atlas/repository/migration/RelationshipCacheGenerator.java
 2550dafc1 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasTypeDefGraphStoreV1.java
 3c84e3c22 
  
repository/src/test/java/org/apache/atlas/repository/migration/ComplexAttributesTest.java
 PRE-CREATION 
  
repository/src/test/java/org/apache/atlas/repository/migration/HiveParititionTest.java
 ac0b79d38 
  
repository/src/test/java/org/apache/atlas/repository/migration/HiveStocksTest.java
 ffbf3200b 
  
repository/src/test/java/org/apache/atlas/repository/migration/MigrationBaseAsserts.java
 ec6e64a25 
  
repository/src/test/java/org/apache/atlas/repository/migration/RelationshipMappingTest.java
 48e539100 
  

Re: Review Request 67239: ATLAS-2710: basic-search doesn't return deleted entities though excludeDeletedEntities is False

2018-05-21 Thread Ashutosh Mestry

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67239/#review203543
---


Ship it!




Ship It!

- Ashutosh Mestry


On May 21, 2018, 10:54 p.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/67239/
> ---
> 
> (Updated May 21, 2018, 10:54 p.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Ashutosh Mestry, keval bhatt, Nixon 
> Rodrigues, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2710
> https://issues.apache.org/jira/browse/ATLAS-2710
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This is caused by entity-delete removing vertex property that stores 
> associated classification names. This property is used by basic-search to 
> look for entities, hence the deleted entity was not returned.
> 
> 
> Diffs
> -
> 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/DeleteHandlerV1.java
>  f417b4e95 
> 
> 
> Diff: https://reviews.apache.org/r/67239/diff/1/
> 
> 
> Testing
> ---
> 
> Verified that basic-search returns deleted entities as well when 
> excludeDeletedEntities is False.
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>



[jira] [Updated] (ATLAS-2139) Map IGC meta model and Atlas OMRS open metadata types

2018-05-21 Thread CASSIO DOS SANTOS (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

CASSIO DOS SANTOS updated ATLAS-2139:
-
Attachment: IGC_OMS_Mapping.png

> Map IGC meta model and Atlas OMRS open metadata types
> -
>
> Key: ATLAS-2139
> URL: https://issues.apache.org/jira/browse/ATLAS-2139
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Jerry He
>Assignee: Jerry He
>Priority: Major
> Attachments: IGC_OMS_Mapping.png, Relational Tables and Columns.png
>
>
> Create the two-way mapping between IGC meta model and Atlas OMRS open 
> metadata types.
> It is used by the IGC Event Mapper and IGC metadata repository connector.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-2593) Governance Engine OMAS - skeleton based on new omrs/omas patterns/ & framework

2018-05-21 Thread Nigel Jones (JIRA)

[ 
https://issues.apache.org/jira/browse/ATLAS-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482708#comment-16482708
 ] 

Nigel Jones commented on ATLAS-2593:


Added current patch. Intermediate WIP. Based on older-style OMRS/omas 
templates, needs refactoring to accomodate recent changes in rest etc.

> Governance Engine OMAS - skeleton based on new omrs/omas patterns/ & framework
> --
>
> Key: ATLAS-2593
> URL: https://issues.apache.org/jira/browse/ATLAS-2593
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Nigel Jones
>Assignee: Nigel Jones
>Priority: Major
> Attachments: ATLAS-2593.patch, ATLAS-2593b.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2593) Governance Engine OMAS - skeleton based on new omrs/omas patterns/ & framework

2018-05-21 Thread Nigel Jones (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nigel Jones updated ATLAS-2593:
---
Attachment: ATLAS-2593b.patch

> Governance Engine OMAS - skeleton based on new omrs/omas patterns/ & framework
> --
>
> Key: ATLAS-2593
> URL: https://issues.apache.org/jira/browse/ATLAS-2593
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Nigel Jones
>Assignee: Nigel Jones
>Priority: Major
> Attachments: ATLAS-2593.patch, ATLAS-2593b.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2706) UI : Change the labels of propagation classification popup

2018-05-21 Thread Keval Bhatt (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2706:
---
Fix Version/s: 1.0.0

> UI : Change the labels of propagation classification popup
> --
>
> Key: ATLAS-2706
> URL: https://issues.apache.org/jira/browse/ATLAS-2706
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 1.0.0
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2706.patch, image001.png
>
>
> Change propagation flow popup.
> * Propagation flow *=>* Enable/Disable Propagation
> * Block Propagation *=>* Select Classifications to Block Propagation
> * Remove Block Propagatation Table title.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2707) Audit detail table is not able to render object type

2018-05-21 Thread Keval Bhatt (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2707:
---
Attachment: ATLAS-2707.patch

> Audit detail table is not able to render object type
> 
>
> Key: ATLAS-2707
> URL: https://issues.apache.org/jira/browse/ATLAS-2707
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 1.0.0
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2707.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2707) Audit detail table is not able to render object type

2018-05-21 Thread Keval Bhatt (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2707:
---
Fix Version/s: 1.0.0

> Audit detail table is not able to render object type
> 
>
> Key: ATLAS-2707
> URL: https://issues.apache.org/jira/browse/ATLAS-2707
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 1.0.0
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2707.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ATLAS-2707) Audit detail table is not able to render object type

2018-05-21 Thread Keval Bhatt (JIRA)
Keval Bhatt created ATLAS-2707:
--

 Summary: Audit detail table is not able to render object type
 Key: ATLAS-2707
 URL: https://issues.apache.org/jira/browse/ATLAS-2707
 Project: Atlas
  Issue Type: Bug
Reporter: Keval Bhatt
Assignee: Keval Bhatt






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2706) UI : Change the labels of propagation classification popup

2018-05-21 Thread Keval Bhatt (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2706:
---
Attachment: ATLAS-2706.patch

> UI : Change the labels of propagation classification popup
> --
>
> Key: ATLAS-2706
> URL: https://issues.apache.org/jira/browse/ATLAS-2706
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Attachments: ATLAS-2706.patch, image001.png
>
>
> Change propagation flow popup.
> * Propagation flow *=>* Enable/Disable Propagation
> * Block Propagation *=>* Select Classifications to Block Propagation
> * Remove Block Propagatation Table title.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ATLAS-2706) UI : Change the labels of propagation classification popup

2018-05-21 Thread Keval Bhatt (JIRA)
Keval Bhatt created ATLAS-2706:
--

 Summary: UI : Change the labels of propagation classification popup
 Key: ATLAS-2706
 URL: https://issues.apache.org/jira/browse/ATLAS-2706
 Project: Atlas
  Issue Type: Improvement
Reporter: Keval Bhatt
Assignee: Keval Bhatt
 Attachments: image001.png

Change propagation flow popup.

* Propagation flow *=>* Enable/Disable Propagation
* Block Propagation *=>* Select Classifications to Block Propagation
* Remove Block Propagatation Table title.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Request to be added as a contributor

2018-05-21 Thread Janardhana , Nagaraj
Hi

I am tech lead working at Intuit in the CDO organization, we have been 
exploring Atlas tool for Data Cataloging. As we proceed with the uptake would 
like to be able to contribute and raise jira, kindly add me as contributor to 
the project. My userId is nagaraj_janardhana, email is 
nagaraj_janardh...@intuit.com.

Regards
Nagaraj