Re: Review Request 69177: Export & Import: New Features Documentation

2018-10-30 Thread Ashutosh Mestry 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69177/
---

(Updated Oct. 31, 2018, 12:36 a.m.)


Review request for atlas, Madhan Neethiraj, Nixon Rodrigues, and Sarath 
Subramanian.


Changes
---

Updates include: Added examples to transforms write-up.


Bugs: ATLAS-2839
https://issues.apache.org/jira/browse/ATLAS-2839


Repository: atlas


Description
---

**Approach**

Augmented existing documentation.

Additional documentation uses markdown.


Diffs (updated)
-

  docs/pom.xml 19e916918 
  docs/src/site/markdown/AtlasServer.md PRE-CREATION 
  docs/src/site/markdown/ExportImportAudits.md PRE-CREATION 
  docs/src/site/markdown/ImportEntityTransforms.md PRE-CREATION 
  docs/src/site/markdown/Incremental-Export.md PRE-CREATION 
  docs/src/site/markdown/ReplicatedToFromAttributes.md PRE-CREATION 
  docs/src/site/markdown/SoftReference.md PRE-CREATION 
  docs/src/site/resources/images/markdown/atlas-server-exp-imp-audits.png 
PRE-CREATION 
  docs/src/site/resources/images/markdown/atlas-server-properties.png 
PRE-CREATION 
  docs/src/site/twiki/Export-API.twiki 207499985 
  docs/src/site/twiki/Export-HDFS-API.twiki 6c2006035 
  docs/src/site/twiki/Import-Export-API.twiki 6b07b64ac 


Diff: https://reviews.apache.org/r/69177/diff/3/

Changes: https://reviews.apache.org/r/69177/diff/2-3/


Testing
---

**Tests**

Used mvn site:run to verify rendering.


Thanks,

Ashutosh Mestry

Re: [VOTE] Release Apache Atlas v 0.8.3 - RC1

2018-10-30 Thread Madhan Neethiraj 
+1 for Apache Atlas 0.8.3-rc1

Performed the following:
  - verified the signature
  - built & installed embedded-hbase-solr profile
  - successfully brought up Apache Atlas 0.8.3
  - ran quick_start
  - performed few basic searches and DSL searches
  - verified saved search functionality

Thanks,
Madhan


On 10/26/18, 3:48 PM, "Ashutosh Mestry"  wrote:

Apache Atlas 0.8.3 Release Candidate #1 is now available for a vote within 
dev community.

Following commits went into branch-0.8 since the last release candidate:
- ATLAS-2900: Exported connected bug fix.
- ATLAS-2934: Utility to detect and repair incorrect entity state.
- ATLAS-2935: Updated NPM package version and added package-lock.json.
- ATLAS-2927: Update lineage query for Process entities.
- ATLAS-2930: UI changes to handle softReference attribute elegantly.
- ATLAS-2931: Set isSoftReferenced method to JsonIgnore.
- ATLAS-2926: ZipSink out of memory error for very large entities.
- ATLAS-2917: Filter added for lineage to hide Process entity.
- ATLAS-2921: Updated import scripts exist status in case of Java error.
- ATLAS-2924: Used encoded property name in getEncodedProperty.

Links to the release artifacts are given below. Please review and vote.

The vote will be open for at least 72 hours or until necessary votes are 
reached.
  [ ] +1 approve
  [ ] +0 no opinion
  [ ] -1 disapprove (and reason why)

Ashutosh Mestry

List of issues addressed in this release: 
https://issues.apache.org/jira/browse/ATLAS-2924?jql=project%20%3D%20ATLAS%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%200.8.3%20ORDER%20BY%20key%20DESC

Git tag for the release: 
https://github.com/apache/atlas/tree/release-0.8.3-rc1

Sources for the release: 
https://dist.apache.org/repos/dist/dev/atlas/0.8.3-rc1/apache-atlas-0.8.3-sources.tar.gz

Source release verification:
PGP Signature:  
https://dist.apache.org/repos/dist/dev/atlas/0.8.3-rc1/apache-atlas-0.8.3-sources.tar.gz.asc
SHA512 Hash: 
https://dist.apache.org/repos/dist/dev/atlas/0.8.3-rc1/apache-atlas-0.8.3-sources.tar.gz.sha512

Keys to verify the signature of the release artifacts are available at: 
https://dist.apache.org/repos/dist/dev/atlas/KEYS

[jira] [Assigned] (ATLAS-2939) Enable EntityGraphMapper to unset optional attribute

2018-10-30 Thread Ashutosh Mestry (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Mestry reassigned ATLAS-2939:
--

Assignee: (was: Ashutosh Mestry)

> Enable EntityGraphMapper to unset optional attribute
> 
>
> Key: ATLAS-2939
> URL: https://issues.apache.org/jira/browse/ATLAS-2939
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Graham Wallis
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 69190: ATLAS-2936: store and retrieve provenance type

2018-10-30 Thread Sarath Subramanian 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69190/#review210199
---


Ship it!




Ship It!

- Sarath Subramanian


On Oct. 30, 2018, 8:22 a.m., Graham Wallis wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69190/
> ---
> 
> (Updated Oct. 30, 2018, 8:22 a.m.)
> 
> 
> Review request for atlas.
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-2936: Add provenanceType system attribute
> 
> 
> Diffs
> -
> 
>   common/src/main/java/org/apache/atlas/repository/Constants.java 
> ed2ca4ce784405cdc489c951b1be5b1fc51bbd34 
>   intg/src/main/java/org/apache/atlas/model/instance/AtlasEntity.java 
> 066b0d0f424b27220ab102d3d2a04b7568790c8a 
>   intg/src/main/java/org/apache/atlas/model/instance/AtlasRelationship.java 
> bc79dadc75ceb927747fa94f8189a540cd145bf2 
>   repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
> b4189d2d1e7359b7a3c4c210438a385d124c3d74 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasRelationshipStoreV2.java
>  512fff470d04bc09f4b3d52aaefcecc7816c25f1 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphMapper.java
>  c08f4c471b0a37276f2af99a32c4fc673f3811c5 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
>  f03262faae5889dad05bb1c635a0b17d2bdfb6f4 
> 
> 
> Diff: https://reviews.apache.org/r/69190/diff/1/
> 
> 
> Testing
> ---
> 
> Tested with ODPi Compliance Test Suite.
> 
> 
> Thanks,
> 
> Graham Wallis
> 
>

Re: Review Request 69191: ATLAS-2938: update version number in EntityGraphMapper

2018-10-30 Thread Sarath Subramanian 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69191/#review210197
---


Ship it!




Ship It!

- Sarath Subramanian


On Oct. 30, 2018, 7:17 a.m., Graham Wallis wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69191/
> ---
> 
> (Updated Oct. 30, 2018, 7:17 a.m.)
> 
> 
> Review request for atlas.
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-2938: EntityGraphMapper stores updated version number
> 
> 
> Diffs
> -
> 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphMapper.java
>  c08f4c471b0a37276f2af99a32c4fc673f3811c5 
> 
> 
> Diff: https://reviews.apache.org/r/69191/diff/1/
> 
> 
> Testing
> ---
> 
> Tested with ODPi Compliance Test Suite.
> 
> 
> Thanks,
> 
> Graham Wallis
> 
>

Re: Review Request 69191: ATLAS-2938: update version number in EntityGraphMapper

2018-10-30 Thread Ashutosh Mestry 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69191/#review210196
---


Ship it!




Ship It!

- Ashutosh Mestry


On Oct. 30, 2018, 2:17 p.m., Graham Wallis wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69191/
> ---
> 
> (Updated Oct. 30, 2018, 2:17 p.m.)
> 
> 
> Review request for atlas.
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-2938: EntityGraphMapper stores updated version number
> 
> 
> Diffs
> -
> 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphMapper.java
>  c08f4c471b0a37276f2af99a32c4fc673f3811c5 
> 
> 
> Diff: https://reviews.apache.org/r/69191/diff/1/
> 
> 
> Testing
> ---
> 
> Tested with ODPi Compliance Test Suite.
> 
> 
> Thanks,
> 
> Graham Wallis
> 
>

Re: Review Request 69190: ATLAS-2936: store and retrieve provenance type

2018-10-30 Thread Ashutosh Mestry 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69190/#review210195
---


Fix it, then Ship it!





repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasRelationshipStoreV2.java
Line 73 (original), 73 (patched)


Please revert to individual imports.


- Ashutosh Mestry


On Oct. 30, 2018, 3:22 p.m., Graham Wallis wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69190/
> ---
> 
> (Updated Oct. 30, 2018, 3:22 p.m.)
> 
> 
> Review request for atlas.
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-2936: Add provenanceType system attribute
> 
> 
> Diffs
> -
> 
>   common/src/main/java/org/apache/atlas/repository/Constants.java 
> ed2ca4ce784405cdc489c951b1be5b1fc51bbd34 
>   intg/src/main/java/org/apache/atlas/model/instance/AtlasEntity.java 
> 066b0d0f424b27220ab102d3d2a04b7568790c8a 
>   intg/src/main/java/org/apache/atlas/model/instance/AtlasRelationship.java 
> bc79dadc75ceb927747fa94f8189a540cd145bf2 
>   repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
> b4189d2d1e7359b7a3c4c210438a385d124c3d74 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasRelationshipStoreV2.java
>  512fff470d04bc09f4b3d52aaefcecc7816c25f1 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphMapper.java
>  c08f4c471b0a37276f2af99a32c4fc673f3811c5 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
>  f03262faae5889dad05bb1c635a0b17d2bdfb6f4 
> 
> 
> Diff: https://reviews.apache.org/r/69190/diff/1/
> 
> 
> Testing
> ---
> 
> Tested with ODPi Compliance Test Suite.
> 
> 
> Thanks,
> 
> Graham Wallis
> 
>

[jira] [Updated] (ATLAS-2943) Export: Operation Fails if No Options are Specified

2018-10-30 Thread Ashutosh Mestry (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Mestry updated ATLAS-2943:
---
Attachment: ATLAS-2943-Export-options-null-check-added.patch

> Export: Operation Fails if No Options are Specified
> ---
>
> Key: ATLAS-2943
> URL: https://issues.apache.org/jira/browse/ATLAS-2943
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 0.8.2, trunk, 0.8.3
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Fix For: trunk, 0.8.3
>
> Attachments: ATLAS-2943-Export-options-null-check-added.patch
>
>
> *Pre-requisites*
>  * Create database (say stocks), tables from beeline. 
> *Steps to Duplicate*
> Attempt an export using these parameters:
> {code:java}
> { "itemsToExport": [ { "typeName": "hive_db", "uniqueAttributes": { 
> "qualifiedName": "stocks@cl1" }} ] }
> {code}
> *Expected results*: Export should succeed with default options.
> *Actual results:* Export fails with the following exception:
> {code:java}
> 2018-10-28 16:03:54,311 ERROR - [pool-2-thread-9 - 
> e63a2ebe-2480-4a60-b5f8-12595effdd9d:hrt_qa:POST/api/atlas/admin/export] ~ 
> Operation failed:  (ExportService:116)
> java.lang.NullPointerException
>   at 
> org.apache.atlas.repository.impexp.AuditsWriter.isReplicationOptionSet(AuditsWriter.java:74)
>   at 
> org.apache.atlas.repository.impexp.AuditsWriter.access$200(AuditsWriter.java:44)
>   at 
> org.apache.atlas.repository.impexp.AuditsWriter$ExportAudits.add(AuditsWriter.java:150)
>   
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2943) Export: Operation Fails if No Options are Specified

2018-10-30 Thread Ashutosh Mestry (JIRA) 
Ashutosh Mestry created ATLAS-2943:
--

 Summary: Export: Operation Fails if No Options are Specified
 Key: ATLAS-2943
 URL: https://issues.apache.org/jira/browse/ATLAS-2943
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 0.8.2, trunk, 0.8.3
Reporter: Ashutosh Mestry
Assignee: Ashutosh Mestry
 Fix For: trunk, 0.8.3


*Pre-requisites*
 * Create database (say stocks), tables from beeline. 

*Steps to Duplicate*

Attempt an export using these parameters:
{code:java}
{ "itemsToExport": [ { "typeName": "hive_db", "uniqueAttributes": { 
"qualifiedName": "stocks@cl1" }} ] }
{code}
*Expected results*: Export should succeed with default options.

*Actual results:* Export fails with the following exception:
{code:java}
2018-10-28 16:03:54,311 ERROR - [pool-2-thread-9 - 
e63a2ebe-2480-4a60-b5f8-12595effdd9d:hrt_qa:POST/api/atlas/admin/export] ~ 
Operation failed:  (ExportService:116)
java.lang.NullPointerException
at 
org.apache.atlas.repository.impexp.AuditsWriter.isReplicationOptionSet(AuditsWriter.java:74)
at 
org.apache.atlas.repository.impexp.AuditsWriter.access$200(AuditsWriter.java:44)
at 
org.apache.atlas.repository.impexp.AuditsWriter$ExportAudits.add(AuditsWriter.java:150)

{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Review Request 69190: ATLAS-2936: store and retrieve provenance type

2018-10-30 Thread Graham Wallis 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69190/
---

Review request for atlas.


Repository: atlas


Description
---

ATLAS-2936: Add provenanceType system attribute


Diffs
-

  common/src/main/java/org/apache/atlas/repository/Constants.java 
ed2ca4ce784405cdc489c951b1be5b1fc51bbd34 
  intg/src/main/java/org/apache/atlas/model/instance/AtlasEntity.java 
066b0d0f424b27220ab102d3d2a04b7568790c8a 
  intg/src/main/java/org/apache/atlas/model/instance/AtlasRelationship.java 
bc79dadc75ceb927747fa94f8189a540cd145bf2 
  repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
b4189d2d1e7359b7a3c4c210438a385d124c3d74 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasRelationshipStoreV2.java
 512fff470d04bc09f4b3d52aaefcecc7816c25f1 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphMapper.java
 c08f4c471b0a37276f2af99a32c4fc673f3811c5 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
 f03262faae5889dad05bb1c635a0b17d2bdfb6f4 


Diff: https://reviews.apache.org/r/69190/diff/1/


Testing
---

Tested with ODPi Compliance Test Suite.


Thanks,

Graham Wallis

Review Request 69191: ATLAS-2938: update version number in EntityGraphMapper

2018-10-30 Thread Graham Wallis 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69191/
---

Review request for atlas.


Repository: atlas


Description
---

ATLAS-2938: EntityGraphMapper stores updated version number


Diffs
-

  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphMapper.java
 c08f4c471b0a37276f2af99a32c4fc673f3811c5 


Diff: https://reviews.apache.org/r/69191/diff/1/


Testing
---

Tested with ODPi Compliance Test Suite.


Thanks,

Graham Wallis

[jira] [Updated] (ATLAS-2942) Audit tab changes to display proper data on detail modal view

2018-10-30 Thread Abhishek Kadam (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Kadam updated ATLAS-2942:
--
Attachment: ATLAS-2942_branch_0.8.patch

> Audit tab changes to display proper data on detail modal view
> -
>
> Key: ATLAS-2942
> URL: https://issues.apache.org/jira/browse/ATLAS-2942
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-webui
>Affects Versions: 0.8.2
>Reporter: Abhishek Kadam
>Assignee: Abhishek Kadam
>Priority: Major
> Fix For: 0.8.3
>
> Attachments: ATLAS-2942_Master.patch, ATLAS-2942_branch_0.8.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2942) Audit tab changes to display proper data on detail modal view

2018-10-30 Thread Abhishek Kadam (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Kadam updated ATLAS-2942:
--
Attachment: ATLAS-2942_Master.patch

> Audit tab changes to display proper data on detail modal view
> -
>
> Key: ATLAS-2942
> URL: https://issues.apache.org/jira/browse/ATLAS-2942
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-webui
>Affects Versions: 0.8.2
>Reporter: Abhishek Kadam
>Assignee: Abhishek Kadam
>Priority: Major
> Fix For: 0.8.3
>
> Attachments: ATLAS-2942_Master.patch, ATLAS-2942_branch_0.8.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2942) Audit tab changes to display proper data on detail modal view

2018-10-30 Thread Abhishek Kadam (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Kadam updated ATLAS-2942:
--
Summary: Audit tab changes to display proper data on detail modal view  
(was: API for audit tab change from v1 to v2)

> Audit tab changes to display proper data on detail modal view
> -
>
> Key: ATLAS-2942
> URL: https://issues.apache.org/jira/browse/ATLAS-2942
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-webui
>Affects Versions: 0.8.2
>Reporter: Abhishek Kadam
>Assignee: Abhishek Kadam
>Priority: Major
> Fix For: 0.8.3
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2942) API for audit tab change from v1 to v2

2018-10-30 Thread Abhishek Kadam (JIRA) 
Abhishek Kadam created ATLAS-2942:
-

 Summary: API for audit tab change from v1 to v2
 Key: ATLAS-2942
 URL: https://issues.apache.org/jira/browse/ATLAS-2942
 Project: Atlas
  Issue Type: Bug
  Components: atlas-webui
Affects Versions: 0.8.2
Reporter: Abhishek Kadam
Assignee: Abhishek Kadam
 Fix For: 0.8.3






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2941) Add schema rendering attribute for rdbms type

2018-10-30 Thread Keval Bhatt (JIRA) 
Keval Bhatt created ATLAS-2941:
--

 Summary: Add schema rendering attribute for rdbms type
 Key: ATLAS-2941
 URL: https://issues.apache.org/jira/browse/ATLAS-2941
 Project: Atlas
  Issue Type: Improvement
  Components:  atlas-core
Affects Versions: 2.0.0
Reporter: Keval Bhatt
Assignee: Keval Bhatt
 Fix For: 2.0.0, 1.2.0






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)