Jenkins build is back to normal : PreCommit-ATLAS-Build-Test #562-master-0001-ATLAS-2816-Allow-ignoring-relationship-in-EntityGrap.patch

[Apache Jenkins Server]

See 

[jira] [Commented] (ATLAS-2801) Create a separate tar file for atlas-server components excluding atlas hook related components

[Sarath Subramanian (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579283#comment-16579283
 ] 

Sarath Subramanian commented on ATLAS-2801:
---

+1 for ATLAS-2801-Create-a-separate-tar-file-for-atlas-server-part-2.patch

> Create a separate tar file for atlas-server components excluding atlas hook 
> related components
> --
>
> Key: ATLAS-2801
> URL: https://issues.apache.org/jira/browse/ATLAS-2801
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-intg
>Affects Versions: trunk
>Reporter: Ramesh Mani
>Assignee: Ramesh Mani
>Priority: Major
> Attachments: 
> 0001-ATLAS-2801-Create-a-separate-tar-file-for-atlas-serv.patch, 
> ATLAS-2801-Create-a-separate-tar-file-for-atlas-server-part-2.patch, 
> ATLAS-2801-Fix-for-tools-directory-absent-in-tar.gz.patch
>
>
> Create a separate tar file for atlas-server components excluding atlas hook 
> related components. Already we have separate tar files for each of the atlas 
> hooks and it's better to have a separate atlas-server tar file for better 
> management of the packages.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (ATLAS-2801) Create a separate tar file for atlas-server components excluding atlas hook related components

[Ashutosh Mestry (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579280#comment-16579280
 ] 

Ashutosh Mestry commented on ATLAS-2801:


[~rmani] Can you please review. the patch?

> Create a separate tar file for atlas-server components excluding atlas hook 
> related components
> --
>
> Key: ATLAS-2801
> URL: https://issues.apache.org/jira/browse/ATLAS-2801
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-intg
>Affects Versions: trunk
>Reporter: Ramesh Mani
>Assignee: Ramesh Mani
>Priority: Major
> Attachments: 
> 0001-ATLAS-2801-Create-a-separate-tar-file-for-atlas-serv.patch, 
> ATLAS-2801-Create-a-separate-tar-file-for-atlas-server-part-2.patch, 
> ATLAS-2801-Fix-for-tools-directory-absent-in-tar.gz.patch
>
>
> Create a separate tar file for atlas-server components excluding atlas hook 
> related components. Already we have separate tar files for each of the atlas 
> hooks and it's better to have a separate atlas-server tar file for better 
> management of the packages.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (ATLAS-2817) Update to JanusGraph 0.3.x

[Apoorv Naik (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apoorv Naik resolved ATLAS-2817.

Resolution: Fixed

> Update to JanusGraph 0.3.x
> --
>
> Key: ATLAS-2817
> URL: https://issues.apache.org/jira/browse/ATLAS-2817
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Apoorv Naik
>Assignee: Apoorv Naik
>Priority: Major
> Attachments: 0001-Janusgraph-update-to-0.3.0.patch
>
>
> There are couple of index related improvements in this version which helps 
> resolve the slowness in few of our DSL queries. This upgrade would speed up 
> DSL execution.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (ATLAS-2817) Update to JanusGraph 0.3.x

[Apoorv Naik (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579209#comment-16579209
 ] 

Apoorv Naik commented on ATLAS-2817:


Committed to master : 
https://git-wip-us.apache.org/repos/asf?p=atlas.git;a=commit;h=4ddceacb0dc4add848a97a445a3091624aaaff7e

> Update to JanusGraph 0.3.x
> --
>
> Key: ATLAS-2817
> URL: https://issues.apache.org/jira/browse/ATLAS-2817
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Apoorv Naik
>Assignee: Apoorv Naik
>Priority: Major
> Attachments: 0001-Janusgraph-update-to-0.3.0.patch
>
>
> There are couple of index related improvements in this version which helps 
> resolve the slowness in few of our DSL queries. This upgrade would speed up 
> DSL execution.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (ATLAS-2817) Update to JanusGraph 0.3.x

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579205#comment-16579205
 ] 

ASF subversion and git services commented on ATLAS-2817:


Commit 705ce81ea2de7b7d2923b8d220575b20efca6bcf in atlas's branch 
refs/heads/branch-1.0 from apoorvnaik
[ https://git-wip-us.apache.org/repos/asf?p=atlas.git;h=705ce81 ]

ATLAS-2817: Janusgraph update to 0.3.0

(cherry picked from commit 4ddceac)


> Update to JanusGraph 0.3.x
> --
>
> Key: ATLAS-2817
> URL: https://issues.apache.org/jira/browse/ATLAS-2817
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Apoorv Naik
>Assignee: Apoorv Naik
>Priority: Major
> Attachments: 0001-Janusgraph-update-to-0.3.0.patch
>
>
> There are couple of index related improvements in this version which helps 
> resolve the slowness in few of our DSL queries. This upgrade would speed up 
> DSL execution.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : Atlas-master-IntegrationTests #2113

[Apache Jenkins Server]

See 

Re: Review Request 68312: AttributeDef Update: Support for Soft Reference

[Madhan Neethiraj]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68312/#review207198
---




repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
Lines 353 (patched)


Instead of updating 'ctx' and calling mapPrimitiveValue(ctx), it will be 
cleaner to simply call the following from here:

AtlasGraphUtilsV1.setProperty(ctx.getReferringVertex(), 
ctx.getVertexProperty(), softRefValue);


Also, after above update, remove method AttributeMutationContext.setValue().



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
Line 767 (original), 790 (patched)


How are the 'removed' map entries cleaned up in case of 'softReferences'?



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
Line 852 (original), 875 (patched)


How are the 'removed' array elements cleaned up in case of 'softReferences'?



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
Lines 481 (patched)


consider changing return type from "Object" to "Map"



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
Lines 505 (patched)


consider changing return type from "Object" to "List"



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
Lines 508 (patched)


Consider handling 'list == null' here (similar to line #483 above)?



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
Lines 520 (patched)


consider changing return type from "Object" to "AtlasObjectId"



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
Lines 522 (patched)


Consider handling 'rawValue == null' here (similar to line #483 above)?



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
Lines 526 (patched)


Consider handling 'rawValue == null' here (similar to line #483 above)?



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
Lines 528 (patched)


Consider adding a WARN log here.


- Madhan Neethiraj


On Aug. 14, 2018, 12:02 a.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68312/
> ---
> 
> (Updated Aug. 14, 2018, 12:02 a.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Madhan Neethiraj, Nixon Rodrigues, and 
> Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2813
> https://issues.apache.org/jira/browse/ATLAS-2813
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> **Approach**
> - Add _options_ field to _AtlasAttributeDef_.
> - Implement support in _AtlasStructDefStore_.
> - Update _EntityGraphMapper_
> - Update _EntityGraphRetriever_
> - Supports array of objects and objects.
> 
> **Usage**
> See attached JSON.
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
> 9dba1c06fa5548470056cf8cf095f3d2744650b0 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
>  381191986df81d691e2598d4760d7999344dc630 
> 
> 
> Diff: https://reviews.apache.org/r/68312/diff/4/
> 
> 
> Testing
> ---
> 
> **Unit tests**
> Tests verify object, array, map cases.
> 
> **Functional tests**
> - Quick Start
> - Entity creation via REST APIs.
> - Entity creation via APIs.
> 
> 
> File Attachments
> 
> 
> rdbms-db.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/ded0e80a-bc59-4dc4-ba74-d971c7af8aef__rdbms-db.json
> typesDef-soft-ref.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/e7c79e63-d08b-41ff-97ef-85389a6d63e3__typesDef-soft-ref.json
> 
> 
> Thanks,
> 
> Ashutosh Mestry
> 
>

Re: Review Request 68312: AttributeDef Update: Support for Soft Reference

[Ashutosh Mestry]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68312/
---

(Updated Aug. 14, 2018, 12:02 a.m.)


Review request for atlas, Apoorv Naik, Madhan Neethiraj, Nixon Rodrigues, and 
Sarath Subramanian.


Changes
---

Updates include:
- Addressed review comments.


Bugs: ATLAS-2813
https://issues.apache.org/jira/browse/ATLAS-2813


Repository: atlas


Description
---

**Approach**
- Add _options_ field to _AtlasAttributeDef_.
- Implement support in _AtlasStructDefStore_.
- Update _EntityGraphMapper_
- Update _EntityGraphRetriever_
- Supports array of objects and objects.

**Usage**
See attached JSON.


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
9dba1c06fa5548470056cf8cf095f3d2744650b0 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
 381191986df81d691e2598d4760d7999344dc630 


Diff: https://reviews.apache.org/r/68312/diff/4/

Changes: https://reviews.apache.org/r/68312/diff/3-4/


Testing
---

**Unit tests**
Tests verify object, array, map cases.

**Functional tests**
- Quick Start
- Entity creation via REST APIs.
- Entity creation via APIs.


File Attachments


rdbms-db.json
  
https://reviews.apache.org/media/uploaded/files/2018/08/13/ded0e80a-bc59-4dc4-ba74-d971c7af8aef__rdbms-db.json
typesDef-soft-ref.json
  
https://reviews.apache.org/media/uploaded/files/2018/08/13/e7c79e63-d08b-41ff-97ef-85389a6d63e3__typesDef-soft-ref.json


Thanks,

Ashutosh Mestry

Build failed in Jenkins: Atlas-0.8-IntegrationTests #233

[Apache Jenkins Server]

See 


Changes:

[amestry] ATLAS-2813: SoftRef implementation.

--
[...truncated 563.44 KB...]
127.0.0.1 - - [13/Aug/2018:23:55:59 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:55:59 +] "POST 
/api/atlas/entities/qualifiedName?type=hive_table=qualifiedName=tableKvWVOTiQ2g
 HTTP/1.1" 200 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:00 +] "GET 
/api/atlas/entities/f29fddcf-d5fb-4eea-82a8-88b772000809 HTTP/1.1" 200 - "-" 
"Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:00 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:00 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:00 +] "DELETE 
/api/atlas/entities?guid=f10a6f51-07ee-4d1e-bdcf-3112170d6d7d=e3b42104-aaf8-456c-a40c-9452b0531f3c
 HTTP/1.1" 200 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:00 +] "GET 
/api/atlas/entities/f10a6f51-07ee-4d1e-bdcf-3112170d6d7d HTTP/1.1" 200 - "-" 
"Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:00 +] "GET 
/api/atlas/entities/e3b42104-aaf8-456c-a40c-9452b0531f3c HTTP/1.1" 200 - "-" 
"Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:00 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:00 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:00 +] "POST 
/api/atlas/entities/4c9a5f5e-09e8-4465-b26f-4dedee559cda HTTP/1.1" 200 - "-" 
"Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:00 +] "GET 
/api/atlas/entities/4c9a5f5e-09e8-4465-b26f-4dedee559cda HTTP/1.1" 200 - "-" 
"Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:01 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:01 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:01 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:01 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:01 +] "GET 
/api/atlas/v2/types/typedef/name/PII_TraitiLq75aLjCw HTTP/1.1" 404 - "-" 
"Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:01 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:01 +] "POST 
/api/atlas/entities/bd872c1e-f77b-46ad-a572-3024ad9d8c29/traits HTTP/1.1" 201 - 
"-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:01 +] "GET 
/api/atlas/entities/bd872c1e-f77b-46ad-a572-3024ad9d8c29/audit?count=100 
HTTP/1.1" 200 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "GET 
/api/atlas/v2/types/typedef/name/PII_TraitBenNsKGLjE HTTP/1.1" 404 - "-" 
"Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "POST 
/api/atlas/entities/ae17aee7-34ce-4f39-8bec-571b834ee591/traits HTTP/1.1" 201 - 
"-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "GET 
/api/atlas/entities/ae17aee7-34ce-4f39-8bec-571b834ee591/traitDefinitions/PII_TraitBenNsKGLjE
 HTTP/1.1" 200 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "GET 
/api/atlas/entities/ae17aee7-34ce-4f39-8bec-571b834ee591/traitDefinitions 
HTTP/1.1" 200 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "GET /api/atlas/entities?type=blah 
HTTP/1.1" 400 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "DELETE 
/api/atlas/entities/aee554a8-7c14-4660-b678-6ea6f8e1ffb3/traits/blah_trait 
HTTP/1.1" 404 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:02 +] "GET /api/atlas/entities/blah 
HTTP/1.1" 404 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:03 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:03 +] "DELETE 
/api/atlas/entities?type=hive_db=qualifiedName=Z6fCvFhliR 
HTTP/1.1" 200 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:03 +] "GET 
/api/atlas/entities/d864c1b7-39c2-487c-8af9-c8b3515ebe81 HTTP/1.1" 200 - "-" 
"Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:03 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:23:56:03 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.8.0_172"

Build failed in Jenkins: Atlas-0.8-UnitTests #235

[Apache Jenkins Server]

See 


Changes:

[amestry] ATLAS-2813: SoftRef implementation.

--
[...truncated 195.99 KB...]
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Running org.apache.atlas.repository.store.graph.v1.SoftDeleteHandlerV1Test
Running org.apache.atlas.repository.impexp.ReplicationEntityAttributeTest
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Running org.apache.atlas.repository.userprofile.UserProfileServiceTest
Running org.apache.atlas.repository.store.graph.v1.InverseReferenceUpdateV1Test
Running org.apache.atlas.repository.impexp.ExportSkipLineageTest
Running org.apache.atlas.repository.typestore.GraphBackedTypeStoreTest
Running org.apache.atlas.repository.impexp.ImportTransformerTest
Running org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStoreTest
Running org.apache.atlas.repository.impexp.ExportImportAuditServiceTest
Running org.apache.atlas.repository.impexp.ClusterServiceTest
Running 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1BulkImportPercentTest
Running org.apache.atlas.repository.store.graph.v1.AtlasDeleteHandlerV1Test
Running org.apache.atlas.repository.typestore.StoreBackedTypeCacheTest
Running org.apache.atlas.repository.store.graph.v1.SoftReferenceTest
Running org.apache.atlas.repository.BaseTest
Running org.apache.atlas.utils.ObjectUpdateSynchronizerTest
Running org.apache.atlas.repository.graph.GraphRepoMapperScaleTest
Running org.apache.atlas.repository.store.graph.v1.AtlasEntityDefStoreV1Test
RRunning ounning 
org.apache.atlas.repository.audit.HBaseBasrge.daApuadcihteR.eaptolsaist.orreypToessitt
ory.graph.GraphHelperTest
Running org.apache.atlas.repository.graph.GraphBackedMetadataRepositoryTest
Running 
org.apache.atlas.repository.store.graph.v1.InverseReferenceUpdateSoftDeleteV1Test
Running org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1Test
Running org.apache.atlas.repository.graph.GraphBackedSearchIndexerTest
Running org.apache.atlas.repository.graph.ReverseReferenceUpdateSoftDeleteTest
Running 
org.apache.atlas.repository.store.graph.v1.InverseReferenceUpdateHardDeleteV1Test
Running org.apache.atlas.repository.impexp.ZipSinkTest
Running org.apache.atlas.TestUtils
Running org.apache.atlas.repository.graph.ReverseReferenceUpdateHardDeleteTest
Running org.apache.atlas.repository.graph.TestIntSequence
Running org.apache.atlas.repository.graph.GraphBackedRepositoryHardDeleteTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.441 sec - in 
org.apache.atlas.utils.TestResourceFileUtils
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.522 sec - in 
org.apache.atlas.repository.BaseTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.432 sec - in 
org.apache.atlas.BaseRepositoryTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.972 sec - in 
org.apache.atlas.repository.impexp.TypeAttributeDifferenceTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.949 sec - in 
org.apache.atlas.repository.impexp.AtlasImportRequestTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.846 sec - in 
org.apache.atlas.TestModules
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.024 sec - in 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1BulkImportPercentTest
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.068 sec - in 
org.apache.atlas.repository.impexp.ImportTransformerJSONTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.649 sec - in 
org.apache.atlas.repository.graph.TestIntSequence
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Running org.apache.atlas.repository.graph.GraphBackedRepositorySoftDeleteTest
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.68 sec - in 
org.apache.atlas.repository.impexp.ImportTransformsTest
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
Tests run: 0, Failures: 0, 

Re: Review Request 68312: AttributeDef Update: Support for Soft Reference

[Madhan Neethiraj]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68312/#review207186
---




intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java
Lines 421 (patched)


public boolean isSoftReferenced() {
  String strValue = options != null ? 
options.get(AtlasAttributeDef.ATTRDEF_OPTION_SOFT_REFERENCE) : null;

  return Boolean.parseBoolean(strValue);
}

Does this method add a boolean field named "softReferenced" in 
AtlasAttributeDef? If yes, we should comeup with a different name (that doesn't 
start with get/set/is) or a method that takes a parameter.



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
Lines 346 (patched)


- when 'null' is sent as new value shouldn't existing value in vertex 
property be removed/updated?
- when the given value is not AtlasObjectId, it will help to create a WARN 
log


- Madhan Neethiraj


On Aug. 13, 2018, 9:52 p.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68312/
> ---
> 
> (Updated Aug. 13, 2018, 9:52 p.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Madhan Neethiraj, Nixon Rodrigues, and 
> Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2813
> https://issues.apache.org/jira/browse/ATLAS-2813
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> **Approach**
> - Add _options_ field to _AtlasAttributeDef_.
> - Implement support in _AtlasStructDefStore_.
> - Update _EntityGraphMapper_
> - Update _EntityGraphRetriever_
> - Supports array of objects and objects.
> 
> **Usage**
> See attached JSON.
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
> c3c85d354f02f6ffb9565a5fc15699c4d06e1ae2 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
>  137fb30746730cc4d1842891987c342a1bc17af7 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AttributeMutationContext.java
>  b6d82dd834b8cc8b3bac630c084b91ac34dd0cec 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
>  9e7a119a3abfb50401f9747dad1ffa55facc51ed 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
>  a243fd79cab685174f3a90c5093e84e9f9fa782a 
>   
> repository/src/test/java/org/apache/atlas/repository/store/graph/v1/SoftReferenceTest.java
>  PRE-CREATION 
>   repository/src/test/resources/json/rdbms-db.json PRE-CREATION 
>   repository/src/test/resources/json/typesDef-soft-ref.json PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/68312/diff/3/
> 
> 
> Testing
> ---
> 
> **Unit tests**
> Tests verify object, array, map cases.
> 
> **Functional tests**
> - Quick Start
> - Entity creation via REST APIs.
> - Entity creation via APIs.
> 
> 
> File Attachments
> 
> 
> rdbms-db.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/ded0e80a-bc59-4dc4-ba74-d971c7af8aef__rdbms-db.json
> typesDef-soft-ref.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/e7c79e63-d08b-41ff-97ef-85389a6d63e3__typesDef-soft-ref.json
> 
> 
> Thanks,
> 
> Ashutosh Mestry
> 
>

[jira] [Commented] (ATLAS-2813) Atlas Entity: Support New Attribute 'SoftReference' for Referencing Without Edge

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579030#comment-16579030
 ] 

ASF subversion and git services commented on ATLAS-2813:


Commit c850bcad4a9adc3b3870e59ac1dc12d483aef89b in atlas's branch 
refs/heads/branch-0.8 from [~ashutoshm]
[ https://git-wip-us.apache.org/repos/asf?p=atlas.git;h=c850bca ]

ATLAS-2813: SoftRef implementation.


> Atlas Entity: Support New Attribute 'SoftReference' for Referencing Without 
> Edge
> 
>
> Key: ATLAS-2813
> URL: https://issues.apache.org/jira/browse/ATLAS-2813
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Affects Versions: 0.8.3
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Fix For: 0.8.3
>
> Attachments: ATLAS-2813-Soft-reference-implementation.patch
>
>
> *Background*
> Cases where types have attributes that reference other objects, existing 
> implementation creates an edge between referencing object and referenced 
> object.
> It may be worthwhile to have this behavior enforced via an attribute.
> Example within existing implementation, is the use of _replicatedToCluster_ 
> attribute. This forces every entity having this attribute set to create an 
> edge to the _AtlasCluster_ entity it is referring to.
> *Approach Guidance*
>  * Define new attribute say _softRefrence._ This will be applied to attribute 
> definition.
>  * When defined, the object Id is stored within the referring object similar 
> to primitive types.
>  * When not defined, the types will continue to use current behavior, where 
> edge is created between referring entity and the referred entity and the edge 
> id is stored within the parent entity. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 68312: AttributeDef Update: Support for Soft Reference

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68312/#review207181
---


Ship it!




Ship It!

- Sarath Subramanian


On Aug. 13, 2018, 2:52 p.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68312/
> ---
> 
> (Updated Aug. 13, 2018, 2:52 p.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Madhan Neethiraj, Nixon Rodrigues, and 
> Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2813
> https://issues.apache.org/jira/browse/ATLAS-2813
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> **Approach**
> - Add _options_ field to _AtlasAttributeDef_.
> - Implement support in _AtlasStructDefStore_.
> - Update _EntityGraphMapper_
> - Update _EntityGraphRetriever_
> - Supports array of objects and objects.
> 
> **Usage**
> See attached JSON.
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
> c3c85d354f02f6ffb9565a5fc15699c4d06e1ae2 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
>  137fb30746730cc4d1842891987c342a1bc17af7 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AttributeMutationContext.java
>  b6d82dd834b8cc8b3bac630c084b91ac34dd0cec 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
>  9e7a119a3abfb50401f9747dad1ffa55facc51ed 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
>  a243fd79cab685174f3a90c5093e84e9f9fa782a 
>   
> repository/src/test/java/org/apache/atlas/repository/store/graph/v1/SoftReferenceTest.java
>  PRE-CREATION 
>   repository/src/test/resources/json/rdbms-db.json PRE-CREATION 
>   repository/src/test/resources/json/typesDef-soft-ref.json PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/68312/diff/3/
> 
> 
> Testing
> ---
> 
> **Unit tests**
> Tests verify object, array, map cases.
> 
> **Functional tests**
> - Quick Start
> - Entity creation via REST APIs.
> - Entity creation via APIs.
> 
> 
> File Attachments
> 
> 
> rdbms-db.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/ded0e80a-bc59-4dc4-ba74-d971c7af8aef__rdbms-db.json
> typesDef-soft-ref.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/e7c79e63-d08b-41ff-97ef-85389a6d63e3__typesDef-soft-ref.json
> 
> 
> Thanks,
> 
> Ashutosh Mestry
> 
>

Re: Review Request 68330: JanusGraph upgrade to 0.3.0

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68330/#review207177
---


Ship it!




Ship It!

- Sarath Subramanian


On Aug. 13, 2018, 3:28 p.m., Apoorv Naik wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68330/
> ---
> 
> (Updated Aug. 13, 2018, 3:28 p.m.)
> 
> 
> Review request for atlas.
> 
> 
> Bugs: ATLAS-2817
> https://issues.apache.org/jira/browse/ATLAS-2817
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Version upgrade to inherit some index related enhancement.
> 
> 
> Diffs
> -
> 
>   graphdb/janus/pom.xml 32ec2614f 
>   
> graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraph.java
>  00bb57786 
> 
> 
> Diff: https://reviews.apache.org/r/68330/diff/1/
> 
> 
> Testing
> ---
> 
> https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/560/console
> 
> 
> Thanks,
> 
> Apoorv Naik
> 
>

Review Request 68330: JanusGraph upgrade to 0.3.0

[Apoorv Naik]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68330/
---

Review request for atlas.


Bugs: ATLAS-2817
https://issues.apache.org/jira/browse/ATLAS-2817


Repository: atlas


Description
---

Version upgrade to inherit some index related enhancement.


Diffs
-

  graphdb/janus/pom.xml 32ec2614f 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraph.java
 00bb57786 


Diff: https://reviews.apache.org/r/68330/diff/1/


Testing
---

https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/560/console


Thanks,

Apoorv Naik

[jira] [Updated] (ATLAS-2817) Update to JanusGraph 0.3.x

[Apoorv Naik (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apoorv Naik updated ATLAS-2817:
---
Attachment: 0001-Janusgraph-update-to-0.3.0.patch

> Update to JanusGraph 0.3.x
> --
>
> Key: ATLAS-2817
> URL: https://issues.apache.org/jira/browse/ATLAS-2817
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Apoorv Naik
>Assignee: Apoorv Naik
>Priority: Major
> Attachments: 0001-Janusgraph-update-to-0.3.0.patch
>
>
> There are couple of index related improvements in this version which helps 
> resolve the slowness in few of our DSL queries. This upgrade would speed up 
> DSL execution.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : PreCommit-ATLAS-Build-Test #560-master-0001-Janusgraph-update-to-0.3.0.patch

[Apache Jenkins Server]

See 

Re: Review Request 68312: AttributeDef Update: Support for Soft Reference

[Ashutosh Mestry]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68312/
---

(Updated Aug. 13, 2018, 9:52 p.m.)


Review request for atlas, Apoorv Naik, Madhan Neethiraj, Nixon Rodrigues, and 
Sarath Subramanian.


Changes
---

Updates include: 
- Function testing section.


Bugs: ATLAS-2813
https://issues.apache.org/jira/browse/ATLAS-2813


Repository: atlas


Description
---

**Approach**
- Add _options_ field to _AtlasAttributeDef_.
- Implement support in _AtlasStructDefStore_.
- Update _EntityGraphMapper_
- Update _EntityGraphRetriever_
- Supports array of objects and objects.

**Usage**
See attached JSON.


Diffs
-

  intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
c3c85d354f02f6ffb9565a5fc15699c4d06e1ae2 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
 137fb30746730cc4d1842891987c342a1bc17af7 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AttributeMutationContext.java
 b6d82dd834b8cc8b3bac630c084b91ac34dd0cec 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
 9e7a119a3abfb50401f9747dad1ffa55facc51ed 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
 a243fd79cab685174f3a90c5093e84e9f9fa782a 
  
repository/src/test/java/org/apache/atlas/repository/store/graph/v1/SoftReferenceTest.java
 PRE-CREATION 
  repository/src/test/resources/json/rdbms-db.json PRE-CREATION 
  repository/src/test/resources/json/typesDef-soft-ref.json PRE-CREATION 


Diff: https://reviews.apache.org/r/68312/diff/3/


Testing (updated)
---

**Unit tests**
Tests verify object, array, map cases.

**Functional tests**
- Quick Start
- Entity creation via REST APIs.
- Entity creation via APIs.


File Attachments


rdbms-db.json
  
https://reviews.apache.org/media/uploaded/files/2018/08/13/ded0e80a-bc59-4dc4-ba74-d971c7af8aef__rdbms-db.json
typesDef-soft-ref.json
  
https://reviews.apache.org/media/uploaded/files/2018/08/13/e7c79e63-d08b-41ff-97ef-85389a6d63e3__typesDef-soft-ref.json


Thanks,

Ashutosh Mestry

Build failed in Jenkins: Atlas-master-IntegrationTests #2112

[Apache Jenkins Server]

See 


--
[...truncated 327.24 KB...]
at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized 
(ContextHandler.java:843)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized 
(ServletContextHandler.java:533)
at org.eclipse.jetty.server.handler.ContextHandler.startContext 
(ContextHandler.java:816)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext 
(ServletContextHandler.java:345)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp 
(WebAppContext.java:1404)
at org.eclipse.jetty.maven.plugin.JettyWebAppContext.startWebapp 
(JettyWebAppContext.java:323)
at org.eclipse.jetty.webapp.WebAppContext.startContext 
(WebAppContext.java:1366)
at org.eclipse.jetty.server.handler.ContextHandler.doStart 
(ContextHandler.java:778)
at org.eclipse.jetty.servlet.ServletContextHandler.doStart 
(ServletContextHandler.java:262)
at org.eclipse.jetty.webapp.WebAppContext.doStart (WebAppContext.java:520)
at org.eclipse.jetty.maven.plugin.JettyWebAppContext.doStart 
(JettyWebAppContext.java:398)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start 
(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start 
(ContainerLifeCycle.java:131)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart 
(ContainerLifeCycle.java:113)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart 
(AbstractHandler.java:61)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart 
(ContextHandlerCollection.java:161)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start 
(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start 
(ContainerLifeCycle.java:131)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart 
(ContainerLifeCycle.java:113)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart 
(AbstractHandler.java:61)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start 
(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start 
(ContainerLifeCycle.java:131)
at org.eclipse.jetty.server.Server.start (Server.java:422)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart 
(ContainerLifeCycle.java:105)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart 
(AbstractHandler.java:61)
at org.eclipse.jetty.server.Server.doStart (Server.java:389)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start 
(AbstractLifeCycle.java:68)
at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.startJetty 
(AbstractJettyMojo.java:460)
at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.execute 
(AbstractJettyMojo.java:328)
at org.eclipse.jetty.maven.plugin.JettyRunWarMojo.execute 
(JettyRunWarMojo.java:64)
at org.eclipse.jetty.maven.plugin.JettyDeployWar.execute 
(JettyDeployWar.java:65)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo 
(DefaultBuildPluginManager.java:137)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute 
(MojoExecutor.java:208)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute 
(MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute 
(MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject 
(LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject 
(LifecycleModuleBuilder.java:81)
at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
 (SingleThreadedBuilder.java:56)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute 
(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:954)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:192)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke 
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke 
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced 
(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch 
(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode 
(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main 
(Launcher.java:356)
Caused by: java.net.BindException: Address already in use
at 

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #561-branch-0.8-ATLAS-2814-Cluster-stores-replication-details.patch

[Apache Jenkins Server]

See 


--
Started by user amestry
[EnvInject] - Loading node environment variables.
Building remotely on H0 (Hadoop) in workspace 

[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Done
Cloning the remote Git repository
Cloning repository http://git-wip-us.apache.org/repos/asf/atlas.git
 > git init  # 
 > timeout=10
Fetching upstream changes from http://git-wip-us.apache.org/repos/asf/atlas.git
 > git --version # timeout=10
 > git fetch --tags --progress http://git-wip-us.apache.org/repos/asf/atlas.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > http://git-wip-us.apache.org/repos/asf/atlas.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > http://git-wip-us.apache.org/repos/asf/atlas.git # timeout=10
Fetching upstream changes from http://git-wip-us.apache.org/repos/asf/atlas.git
 > git fetch --tags --progress http://git-wip-us.apache.org/repos/asf/atlas.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1099f1ba1169ce670fbdcf29803f8169f2ca9df4 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 1099f1ba1169ce670fbdcf29803f8169f2ca9df4
Commit message: "ATLAS-2819: UI: Re-evaluate classification propagation during 
entity delete"
 > git rev-list --no-walk 1099f1ba1169ce670fbdcf29803f8169f2ca9df4 # timeout=10
[EnvInject] - Mask passwords that will be passed as build parameters.
Set build name.
New build name is 
'#561-branch-0.8-ATLAS-2814-Cluster-stores-replication-details.patch'
Copying file to LOCAL_PATCH
[PreCommit-ATLAS-Build-Test] $ /bin/bash /tmp/jenkins3615454112256582005.sh
+ export TOOLS_HOME=/home/jenkins/tools
+ TOOLS_HOME=/home/jenkins/tools
+ export ANT_HOME=/home/jenkins/tools/ant/latest
+ ANT_HOME=/home/jenkins/tools/ant/latest
+ export FORREST_HOME=/home/jenkins/tools/forrest/latest
+ FORREST_HOME=/home/jenkins/tools/forrest/latest
+ export JAVA5_HOME=/home/jenkins/tools/java/latest1.5
+ JAVA5_HOME=/home/jenkins/tools/java/latest1.5
+ export FINDBUGS_HOME=/home/jenkins/tools/findbugs/latest
+ FINDBUGS_HOME=/home/jenkins/tools/findbugs/latest
+ export CLOVER_HOME=/home/jenkins/tools/clover/latest
+ CLOVER_HOME=/home/jenkins/tools/clover/latest
+ export MAVEN_HOME=/home/jenkins/tools/maven/latest
+ MAVEN_HOME=/home/jenkins/tools/maven/latest
+ export 
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
+ 
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
+ export 'MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 
-noverify'
+ MAVEN_OPTS='-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify'
+ export 'ANT_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 
-noverify'
+ ANT_OPTS='-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify'
+ env
BUILD_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/561/
XDG_SESSION_ID=95
SKIP_UT=false
ISSUE_NUM=ATLAS-2814
HUDSON_SERVER_COOKIE=f4ebd1e6b0d976e8
SHELL=/bin/bash
FORREST_HOME=/home/jenkins/tools/forrest/latest
SSH_CLIENT=195.201.170.234 38482 22
TOOLS_HOME=/home/jenkins/tools
BUILD_TAG=jenkins-PreCommit-ATLAS-Build-Test-561
GIT_PREVIOUS_COMMIT=1099f1ba1169ce670fbdcf29803f8169f2ca9df4
ROOT_BUILD_CAUSE=MANUALTRIGGER
ANT_HOME=/home/jenkins/tools/ant/latest
WORKSPACE=
JOB_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/
ANT_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
BRANCH=branch-0.8
RUN_CHANGES_DISPLAY_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/561/display/redirect?page=changes
USER=jenkins
GIT_AUTHOR_NAME=jenkins
GIT_COMMITTER_NAME=jenkins
MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
GIT_COMMIT=1099f1ba1169ce670fbdcf29803f8169f2ca9df4
JENKINS_HOME=/x1/jenkins/jenkins-home
MAVEN_HOME=/home/jenkins/tools/maven/latest
MAIL=/var/mail/jenkins
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
RUN_DISPLAY_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/561/display/redirect
BUILD_CAUSE_MANUALTRIGGER=true
GIT_COMMITTER_EMAIL=bui...@apache.org

Jenkins build is back to normal : Atlas-1.0-IntegrationTests #762

[Apache Jenkins Server]

See 

Jenkins build is back to normal : Atlas-1.0-UnitTests #772

[Apache Jenkins Server]

See 

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #558-branch-0.8-ATLAS-2814-Cluster-stores-replication-details.patch

[Apache Jenkins Server]

See 


Changes:

[ssubramanian] ATLAS-2819: UI: Re-evaluate classification propagation during 
entity

--
Started by user amestry
[EnvInject] - Loading node environment variables.
Building remotely on H18 (Hadoop xenial) in workspace 

[WS-CLEANUP] Deleting project workspace...
Cloning the remote Git repository
Cloning repository http://git-wip-us.apache.org/repos/asf/atlas.git
 > git init  # 
 > timeout=10
Fetching upstream changes from http://git-wip-us.apache.org/repos/asf/atlas.git
 > git --version # timeout=10
 > git fetch --tags --progress http://git-wip-us.apache.org/repos/asf/atlas.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > http://git-wip-us.apache.org/repos/asf/atlas.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > http://git-wip-us.apache.org/repos/asf/atlas.git # timeout=10
Fetching upstream changes from http://git-wip-us.apache.org/repos/asf/atlas.git
 > git fetch --tags --progress http://git-wip-us.apache.org/repos/asf/atlas.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1099f1ba1169ce670fbdcf29803f8169f2ca9df4 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 1099f1ba1169ce670fbdcf29803f8169f2ca9df4
Commit message: "ATLAS-2819: UI: Re-evaluate classification propagation during 
entity delete"
 > git rev-list --no-walk 4c901bd07e6dae969b152f885ff2d6211c4b3e84 # timeout=10
[EnvInject] - Mask passwords that will be passed as build parameters.
Set build name.
New build name is 
'#558-branch-0.8-ATLAS-2814-Cluster-stores-replication-details.patch'
Copying file to LOCAL_PATCH
[PreCommit-ATLAS-Build-Test] $ /bin/bash /tmp/jenkins139301578471171883.sh
+ export TOOLS_HOME=/home/jenkins/tools
+ TOOLS_HOME=/home/jenkins/tools
+ export ANT_HOME=/home/jenkins/tools/ant/latest
+ ANT_HOME=/home/jenkins/tools/ant/latest
+ export FORREST_HOME=/home/jenkins/tools/forrest/latest
+ FORREST_HOME=/home/jenkins/tools/forrest/latest
+ export JAVA5_HOME=/home/jenkins/tools/java/latest1.5
+ JAVA5_HOME=/home/jenkins/tools/java/latest1.5
+ export FINDBUGS_HOME=/home/jenkins/tools/findbugs/latest
+ FINDBUGS_HOME=/home/jenkins/tools/findbugs/latest
+ export CLOVER_HOME=/home/jenkins/tools/clover/latest
+ CLOVER_HOME=/home/jenkins/tools/clover/latest
+ export MAVEN_HOME=/home/jenkins/tools/maven/latest
+ MAVEN_HOME=/home/jenkins/tools/maven/latest
+ export 
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
+ 
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
+ export 'MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 
-noverify'
+ MAVEN_OPTS='-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify'
+ export 'ANT_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 
-noverify'
+ ANT_OPTS='-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify'
+ env
BUILD_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/558/
XDG_SESSION_ID=362
SKIP_UT=false
ISSUE_NUM=ATLAS-2814
HUDSON_SERVER_COOKIE=f4ebd1e6b0d976e8
SHELL=/bin/bash
FORREST_HOME=/home/jenkins/tools/forrest/latest
SSH_CLIENT=195.201.170.234 50338 22
TOOLS_HOME=/home/jenkins/tools
BUILD_TAG=jenkins-PreCommit-ATLAS-Build-Test-558
GIT_PREVIOUS_COMMIT=4c901bd07e6dae969b152f885ff2d6211c4b3e84
ROOT_BUILD_CAUSE=MANUALTRIGGER
ANT_HOME=/home/jenkins/tools/ant/latest
WORKSPACE=
JOB_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/
ANT_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
BRANCH=branch-0.8
RUN_CHANGES_DISPLAY_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/558/display/redirect?page=changes
USER=jenkins
GIT_AUTHOR_NAME=jenkins
GIT_COMMITTER_NAME=jenkins
MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat
GIT_COMMIT=1099f1ba1169ce670fbdcf29803f8169f2ca9df4
JENKINS_HOME=/x1/jenkins/jenkins-home
MAVEN_HOME=/home/jenkins/tools/maven/latest
MAIL=/var/mail/jenkins
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin

Build failed in Jenkins: Atlas-master-UnitTests #2170

[Apache Jenkins Server]

See 


Changes:

[ssubramanian] ATLAS-2819: UI: Re-evaluate classification propagation during 
entity

--
[...truncated 204.46 KB...]
[INFO] Exclude: .svn/**
[INFO] Exclude: .git/**
[INFO] Exclude: .gitignore
[INFO] Exclude: **/.idea/**
[INFO] Exclude: **/*.twiki
[INFO] Exclude: **/*.iml
[INFO] Exclude: **/*.json
[INFO] Exclude: **/*.log
[INFO] Exclude: **/target/**
[INFO] Exclude: **/target*/**
[INFO] Exclude: **/build/**
[INFO] Exclude: **/*.patch
[INFO] Exclude: derby.log
[INFO] Exclude: **/logs/**
[INFO] Exclude: **/.classpath
[INFO] Exclude: **/.project
[INFO] Exclude: **/.settings/**
[INFO] Exclude: **/test-output/**
[INFO] Exclude: **/mock/**
[INFO] Exclude: **/data/**
[INFO] Exclude: **/maven-eclipse.xml
[INFO] Exclude: **/.externalToolBuilders/**
[INFO] Exclude: **/build.log
[INFO] Exclude: **/.bowerrc
[INFO] Exclude: *.json
[INFO] Exclude: **/overlays/**
[INFO] Exclude: dev-support/**
[INFO] Exclude: **/users-credentials.properties
[INFO] Exclude: **/public/css/animate.min.css
[INFO] Exclude: **/public/css/bootstrap-sidebar.css
[INFO] Exclude: **/public/js/external_lib/**
[INFO] Exclude: **/node_modules/**
[INFO] Exclude: **/public/js/libs/**
[INFO] Exclude: **/atlas.data/**
[INFO] Exclude: **/${sys:atlas.data}/**
[INFO] Exclude: **/policy-store.txt
[INFO] Exclude: **/*rebel*.xml
[INFO] Exclude: **/*rebel*.xml.bak
[INFO] Exclude: **/test/resources/**
[INFO] 125 resources included (use -debug for more details)
[INFO] Rat check: Summary over all files. Unapproved: 0, unknown: 0, generated: 
0, approved: 125 licenses.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 15 resources
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-solr-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9 resources
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ atlas-webapp 
---
[INFO] 
[INFO] --- keytool-maven-plugin:1.5:clean (clean) @ atlas-webapp ---
[WARNING] Keystore file 
'
 doesn't exist.
[INFO] 
[INFO] --- keytool-maven-plugin:1.5:generateKeyPair (generateKeyPair) @ 
atlas-webapp ---
[WARNING] 
[WARNING] Warning:
[WARNING] The JKS keystore uses a proprietary format. It is recommended to 
migrate to PKCS12 which is an industry standard format using "keytool 
-importkeystore -srckeystore 

 -destkeystore 

 -deststoretype pkcs12".
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 2 resources to META-INF
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ atlas-webapp 
---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 69 source files to 

[INFO] 
:
 Some input files use or override a deprecated API.
[INFO] 
:
 Recompile with -Xlint:deprecation for details.
[INFO] 
:
 Some input files use unchecked or unsafe operations.
[INFO] 
:
 Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @ 
atlas-webapp ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 48 source files to 

[INFO] 
:
 Some input files use or override a deprecated API.
[INFO] 
:
 Recompile 

[jira] [Commented] (ATLAS-2819) UI: Re-evaluate classification propagation during entity delete

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578818#comment-16578818
 ] 

ASF subversion and git services commented on ATLAS-2819:


Commit e1a2a3553d5808cef2339f21fd5dfbdc3472e4bb in atlas's branch 
refs/heads/branch-1.0 from [~abhib4]
[ https://git-wip-us.apache.org/repos/asf?p=atlas.git;h=e1a2a35 ]

ATLAS-2819: UI: Re-evaluate classification propagation during entity delete

Signed-off-by: Sarath Subramanian 
(cherry picked from commit 1099f1ba1169ce670fbdcf29803f8169f2ca9df4)


> UI: Re-evaluate classification propagation during entity delete
> ---
>
> Key: ATLAS-2819
> URL: https://issues.apache.org/jira/browse/ATLAS-2819
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0-alpha, 1.0.0
>Reporter: Abhishek Kadam
>Assignee: Abhishek Kadam
>Priority: Major
> Fix For: 1.1.0
>
> Attachments: ATLAS-2819.patch
>
>
> The current behavior - when we delete an entity *f1*, all tags associate to 
> *f1* which got propagated
> to downstream entities are removed – *PII* tag propagated to *process1* and 
> *t1* is removed
> *Proposed Change*
> _*Soft Delete:*_
> When entity *f1* is deleted, retain the propagated classification edges, so 
> the downstream entities
> – *process1* and *t1* continue to have *PII* classification associated to them
> _*Hard Delete:*_
> In cases of hard delete, the source entity (*f1*) is deleted from atlas, but 
> its classification vertex
> (*PII*) continue to exist and will continue propagating to *process1* and 
> *t1*.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (ATLAS-2819) UI: Re-evaluate classification propagation during entity delete

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578815#comment-16578815
 ] 

ASF subversion and git services commented on ATLAS-2819:


Commit 1099f1ba1169ce670fbdcf29803f8169f2ca9df4 in atlas's branch 
refs/heads/master from [~abhib4]
[ https://git-wip-us.apache.org/repos/asf?p=atlas.git;h=1099f1b ]

ATLAS-2819: UI: Re-evaluate classification propagation during entity delete

Signed-off-by: Sarath Subramanian 


> UI: Re-evaluate classification propagation during entity delete
> ---
>
> Key: ATLAS-2819
> URL: https://issues.apache.org/jira/browse/ATLAS-2819
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0-alpha, 1.0.0
>Reporter: Abhishek Kadam
>Assignee: Abhishek Kadam
>Priority: Major
> Fix For: 1.1.0
>
> Attachments: ATLAS-2819.patch
>
>
> The current behavior - when we delete an entity *f1*, all tags associate to 
> *f1* which got propagated
> to downstream entities are removed – *PII* tag propagated to *process1* and 
> *t1* is removed
> *Proposed Change*
> _*Soft Delete:*_
> When entity *f1* is deleted, retain the propagated classification edges, so 
> the downstream entities
> – *process1* and *t1* continue to have *PII* classification associated to them
> _*Hard Delete:*_
> In cases of hard delete, the source entity (*f1*) is deleted from atlas, but 
> its classification vertex
> (*PII*) continue to exist and will continue propagating to *process1* and 
> *t1*.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 68312: AttributeDef Update: Support for Soft Reference

[Sarath Subramanian]

> On Aug. 13, 2018, 12:09 p.m., Sarath Subramanian wrote:
> > intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java
> > Lines 259 (patched)
> > 
> >
> > "softRef" => "softReference"

or "softRef" => "isSoftReference"


- Sarath


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68312/#review207159
---


On Aug. 13, 2018, 10:31 a.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68312/
> ---
> 
> (Updated Aug. 13, 2018, 10:31 a.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Madhan Neethiraj, Nixon Rodrigues, and 
> Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2813
> https://issues.apache.org/jira/browse/ATLAS-2813
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> **Approach**
> - Add _options_ field to _AtlasAttributeDef_.
> - Implement support in _AtlasStructDefStore_.
> - Update _EntityGraphMapper_
> - Update _EntityGraphRetriever_
> - Supports array of objects and objects.
> 
> **Usage**
> See attached JSON.
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
> c3c85d354f02f6ffb9565a5fc15699c4d06e1ae2 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
>  137fb30746730cc4d1842891987c342a1bc17af7 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
>  9e7a119a3abfb50401f9747dad1ffa55facc51ed 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
>  a243fd79cab685174f3a90c5093e84e9f9fa782a 
>   
> repository/src/test/java/org/apache/atlas/repository/store/graph/v1/SoftReferenceTest.java
>  PRE-CREATION 
>   repository/src/test/resources/json/rdbms-db.json PRE-CREATION 
>   repository/src/test/resources/json/typesDef-soft-ref.json PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/68312/diff/2/
> 
> 
> Testing
> ---
> 
> **Unit tests**
> Tests verify object, array, map cases.
> 
> 
> File Attachments
> 
> 
> rdbms-db.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/ded0e80a-bc59-4dc4-ba74-d971c7af8aef__rdbms-db.json
> typesDef-soft-ref.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/e7c79e63-d08b-41ff-97ef-85389a6d63e3__typesDef-soft-ref.json
> 
> 
> Thanks,
> 
> Ashutosh Mestry
> 
>

Re: Review Request 68312: AttributeDef Update: Support for Soft Reference

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68312/#review207162
---




intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java
Lines 421 (patched)


also check if the value of the map key is 'true'. isSoftReference=true


- Sarath Subramanian


On Aug. 13, 2018, 10:31 a.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68312/
> ---
> 
> (Updated Aug. 13, 2018, 10:31 a.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Madhan Neethiraj, Nixon Rodrigues, and 
> Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2813
> https://issues.apache.org/jira/browse/ATLAS-2813
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> **Approach**
> - Add _options_ field to _AtlasAttributeDef_.
> - Implement support in _AtlasStructDefStore_.
> - Update _EntityGraphMapper_
> - Update _EntityGraphRetriever_
> - Supports array of objects and objects.
> 
> **Usage**
> See attached JSON.
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
> c3c85d354f02f6ffb9565a5fc15699c4d06e1ae2 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
>  137fb30746730cc4d1842891987c342a1bc17af7 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
>  9e7a119a3abfb50401f9747dad1ffa55facc51ed 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
>  a243fd79cab685174f3a90c5093e84e9f9fa782a 
>   
> repository/src/test/java/org/apache/atlas/repository/store/graph/v1/SoftReferenceTest.java
>  PRE-CREATION 
>   repository/src/test/resources/json/rdbms-db.json PRE-CREATION 
>   repository/src/test/resources/json/typesDef-soft-ref.json PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/68312/diff/2/
> 
> 
> Testing
> ---
> 
> **Unit tests**
> Tests verify object, array, map cases.
> 
> 
> File Attachments
> 
> 
> rdbms-db.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/ded0e80a-bc59-4dc4-ba74-d971c7af8aef__rdbms-db.json
> typesDef-soft-ref.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/e7c79e63-d08b-41ff-97ef-85389a6d63e3__typesDef-soft-ref.json
> 
> 
> Thanks,
> 
> Ashutosh Mestry
> 
>

Re: Review Request 68312: AttributeDef Update: Support for Soft Reference

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68312/#review207159
---




intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java
Lines 259 (patched)


"softRef" => "softReference"



intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java
Lines 277 (patched)


include 'options' in hashCode() and equals() methods.



intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java
Lines 419 (patched)


isSoftRefSet() => isSoftReferenced()



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
Lines 349 (patched)


ctx.getValue() can also be a Map, check and map the value back to  object 
ID. Could you check if normalized value is mapped back to ObjectID



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
Lines 353 (patched)


consider refactoring like below instead of adding a new method.

ctx.setValue(softRefValue);
mapPrimitiveValue(ctx);



repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
Lines 532 (patched)


constructor of AtlasObjectId(guid, typeName)

I think the Index name is swapped, it should be
SOFT_REFERENCE_FORMAT_INDEX_TYPE_NAME = 0
SOFT_INDEX_REFERENCE_GUID = 1

return new AtlasObjectId(
objectIdParts[SOFT_INDEX_REFERENCE_GUID], 
objectIdParts[SOFT_REFERENCE_FORMAT_INDEX_TYPE_NAME]);


- Sarath Subramanian


On Aug. 13, 2018, 10:31 a.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68312/
> ---
> 
> (Updated Aug. 13, 2018, 10:31 a.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Madhan Neethiraj, Nixon Rodrigues, and 
> Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2813
> https://issues.apache.org/jira/browse/ATLAS-2813
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> **Approach**
> - Add _options_ field to _AtlasAttributeDef_.
> - Implement support in _AtlasStructDefStore_.
> - Update _EntityGraphMapper_
> - Update _EntityGraphRetriever_
> - Supports array of objects and objects.
> 
> **Usage**
> See attached JSON.
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
> c3c85d354f02f6ffb9565a5fc15699c4d06e1ae2 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
>  137fb30746730cc4d1842891987c342a1bc17af7 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
>  9e7a119a3abfb50401f9747dad1ffa55facc51ed 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
>  a243fd79cab685174f3a90c5093e84e9f9fa782a 
>   
> repository/src/test/java/org/apache/atlas/repository/store/graph/v1/SoftReferenceTest.java
>  PRE-CREATION 
>   repository/src/test/resources/json/rdbms-db.json PRE-CREATION 
>   repository/src/test/resources/json/typesDef-soft-ref.json PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/68312/diff/2/
> 
> 
> Testing
> ---
> 
> **Unit tests**
> Tests verify object, array, map cases.
> 
> 
> File Attachments
> 
> 
> rdbms-db.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/ded0e80a-bc59-4dc4-ba74-d971c7af8aef__rdbms-db.json
> typesDef-soft-ref.json
>   
> https://reviews.apache.org/media/uploaded/files/2018/08/13/e7c79e63-d08b-41ff-97ef-85389a6d63e3__typesDef-soft-ref.json
> 
> 
> Thanks,
> 
> Ashutosh Mestry
> 
>

Re: Review Request 68270: Cluster Entity Updated after Successful Import if Replication Options are Available in Import Request

[Ashutosh Mestry]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68270/
---

(Updated Aug. 13, 2018, 7:07 p.m.)


Review request for atlas, Apoorv Naik, Madhan Neethiraj, and Sarath Subramanian.


Changes
---

Updates include: 
- Addressed review comments.
- Modified _getExportImportAudit_ to return list of _ExportImportAuditEntry_.


Bugs: ATLAS-2814
https://issues.apache.org/jira/browse/ATLAS-2814


Repository: atlas


Description (updated)
---

**Approach**
- New model _ReplicationDetails_ store replication timestamp.
- _AuditWriter_ updates appropriate _AtlasCluster_ entity with 
_ReplicationDetails_.

**REST Call**
Endpoint: /admin/expimp/audit
CURL:
curl -X GET -u admin:admin -H "Content-Type: application/json" -H 
"Cache-Control: no-cache" 
http://localhost:21000/api/atlas/admin/expimp/audit?sourceClusterName=cl2


Diffs (updated)
-

  client/common/src/main/java/org/apache/atlas/AtlasBaseClient.java 
f73ba2c6e6c9d05e86eb6c17f923a6dda1df5dd9 
  intg/src/main/java/org/apache/atlas/model/clusterinfo/AtlasCluster.java 
3ce50e38b3af45521c2c83d0e6c05398747bcf86 
  intg/src/main/java/org/apache/atlas/model/impexp/AtlasExportResult.java 
85a606c7d3b2158238b2a6defbb9185883434d78 
  intg/src/main/java/org/apache/atlas/model/impexp/AtlasImportResult.java 
bfb7637711e08e17fd5f5b16bf121ac541b631a4 
  intg/src/main/java/org/apache/atlas/model/impexp/ReplicationDetails.java 
PRE-CREATION 
  repository/src/main/java/org/apache/atlas/repository/impexp/AuditsWriter.java 
6a3fbecda84dc48e0df1359c1b5a248958db0a4c 
  
repository/src/main/java/org/apache/atlas/repository/impexp/ClusterService.java 
fd8e2bfe6bbdb7ae5e66ab67ecdf94e9527d9b09 
  
repository/src/main/java/org/apache/atlas/repository/impexp/ExportImportAuditService.java
 e90b6b942d359f78ccf59ee955c4667f2033e6c4 
  
repository/src/main/java/org/apache/atlas/repository/impexp/ExportService.java 
b15f828e470eaee972a4ee3f8447f404f813c699 
  
repository/src/main/java/org/apache/atlas/repository/impexp/ImportService.java 
98ef389bd1bf8f87d23a06dc231d4d93f06b2231 
  repository/src/main/java/org/apache/atlas/repository/ogm/AtlasClusterDTO.java 
424fb88a5ad2d84ac2245848d061892d40a3f50c 
  repository/src/main/java/org/apache/atlas/repository/ogm/DataAccess.java 
b7e943f14084882cd5a3ad22c21168ea098eefcb 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
 9e7a119a3abfb50401f9747dad1ffa55facc51ed 
  
repository/src/test/java/org/apache/atlas/repository/impexp/ClusterServiceTest.java
 cfd272fb00a970ab0ba28f96b237de6bd5c694e1 
  
repository/src/test/java/org/apache/atlas/repository/impexp/ExportImportAuditServiceTest.java
 f3803e5ae15a772eb4ff04192a83a5b412631791 
  
repository/src/test/java/org/apache/atlas/repository/impexp/ExportImportTestBase.java
 fcf90d364950d3afa2c18689d8e22616cfcd3c19 
  
repository/src/test/java/org/apache/atlas/repository/impexp/ExportIncrementalTest.java
 86ab22294918701270db3ba849f5b0532c1a21a4 
  
repository/src/test/java/org/apache/atlas/repository/impexp/ImportServiceTest.java
 dc25e92d7115db31cbd7f99bd1a2cb5f75e766a5 
  
repository/src/test/java/org/apache/atlas/repository/impexp/ReplicationEntityAttributeTest.java
 881368ce2c6803c8cf887a1fc91737c045c5e663 
  server-api/src/main/java/org/apache/atlas/RequestContextV1.java 
8506d186978f579c6b18c4347fc7cb2636848f16 
  webapp/src/main/java/org/apache/atlas/web/resources/AdminResource.java 
d4e72620b15f69d258e5a2a96521c65a7ef71114 
  
webapp/src/test/java/org/apache/atlas/web/resources/AdminExportImportTestIT.java
 fc804d2e5a1debd7e728dca1773f91402d41fc26 
  webapp/src/test/resources/json/export-incremental.json 
97108411f9e0c177ac13eb0a8ec3bd4475499f89 
  webapp/src/test/resources/stocks-base.zip 
40c7f37eefb46a944921f6a74a916191704cb9a3 


Diff: https://reviews.apache.org/r/68270/diff/4/

Changes: https://reviews.apache.org/r/68270/diff/3-4/


Testing
---

**Unit tests**
New tests added.


Thanks,

Ashutosh Mestry

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #557-branch-0.8-ATLAS-2814-Cluster-stores-replication-details.patch

[Apache Jenkins Server]

See 


--
Started by user amestry
[EnvInject] - Loading node environment variables.
Building remotely on H9 (Hadoop) in workspace 

[WS-CLEANUP] Deleting project workspace...
Cloning the remote Git repository
Cloning repository http://git-wip-us.apache.org/repos/asf/atlas.git
 > git init  # 
 > timeout=10
Fetching upstream changes from http://git-wip-us.apache.org/repos/asf/atlas.git
 > git --version # timeout=10
 > git fetch --tags --progress http://git-wip-us.apache.org/repos/asf/atlas.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > http://git-wip-us.apache.org/repos/asf/atlas.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > http://git-wip-us.apache.org/repos/asf/atlas.git # timeout=10
Fetching upstream changes from http://git-wip-us.apache.org/repos/asf/atlas.git
 > git fetch --tags --progress http://git-wip-us.apache.org/repos/asf/atlas.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4c901bd07e6dae969b152f885ff2d6211c4b3e84 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 4c901bd07e6dae969b152f885ff2d6211c4b3e84
Commit message: "ATLAS-2815: Restoring the deleted audit call"
 > git rev-list --no-walk 4c901bd07e6dae969b152f885ff2d6211c4b3e84 # timeout=10
[EnvInject] - Mask passwords that will be passed as build parameters.
Set build name.
New build name is 
'#557-branch-0.8-ATLAS-2814-Cluster-stores-replication-details.patch'
Copying file to LOCAL_PATCH
[PreCommit-ATLAS-Build-Test] $ /bin/bash /tmp/jenkins8656516501166462406.sh
+ export TOOLS_HOME=/home/jenkins/tools
+ TOOLS_HOME=/home/jenkins/tools
+ export ANT_HOME=/home/jenkins/tools/ant/latest
+ ANT_HOME=/home/jenkins/tools/ant/latest
+ export FORREST_HOME=/home/jenkins/tools/forrest/latest
+ FORREST_HOME=/home/jenkins/tools/forrest/latest
+ export JAVA5_HOME=/home/jenkins/tools/java/latest1.5
+ JAVA5_HOME=/home/jenkins/tools/java/latest1.5
+ export FINDBUGS_HOME=/home/jenkins/tools/findbugs/latest
+ FINDBUGS_HOME=/home/jenkins/tools/findbugs/latest
+ export CLOVER_HOME=/home/jenkins/tools/clover/latest
+ CLOVER_HOME=/home/jenkins/tools/clover/latest
+ export MAVEN_HOME=/home/jenkins/tools/maven/latest
+ MAVEN_HOME=/home/jenkins/tools/maven/latest
+ export 
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
+ 
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
+ export 'MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 
-noverify'
+ MAVEN_OPTS='-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify'
+ export 'ANT_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 
-noverify'
+ ANT_OPTS='-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify'
+ env
BUILD_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/557/
XDG_SESSION_ID=89
SKIP_UT=false
ISSUE_NUM=ATLAS-2814
HUDSON_SERVER_COOKIE=f4ebd1e6b0d976e8
SHELL=/bin/bash
FORREST_HOME=/home/jenkins/tools/forrest/latest
SSH_CLIENT=195.201.170.234 33954 22
TOOLS_HOME=/home/jenkins/tools
BUILD_TAG=jenkins-PreCommit-ATLAS-Build-Test-557
GIT_PREVIOUS_COMMIT=4c901bd07e6dae969b152f885ff2d6211c4b3e84
ROOT_BUILD_CAUSE=MANUALTRIGGER
ANT_HOME=/home/jenkins/tools/ant/latest
WORKSPACE=
JOB_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/
ANT_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
BRANCH=branch-0.8
RUN_CHANGES_DISPLAY_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/557/display/redirect?page=changes
USER=jenkins
GIT_AUTHOR_NAME=jenkins
GIT_COMMITTER_NAME=jenkins
MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat
GIT_COMMIT=4c901bd07e6dae969b152f885ff2d6211c4b3e84
JENKINS_HOME=/x1/jenkins/jenkins-home
MAVEN_HOME=/home/jenkins/tools/maven/latest
MAIL=/var/mail/jenkins
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
RUN_DISPLAY_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/557/display/redirect
BUILD_CAUSE_MANUALTRIGGER=true
GIT_COMMITTER_EMAIL=bui...@apache.org

Build failed in Jenkins: Atlas-1.0-IntegrationTests #761

[Apache Jenkins Server]

See 


--
[...truncated 578.84 KB...]
127.0.0.1 - - [13/Aug/2018:18:46:00 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_process?attr:qualifiedName=QUERY:default.table2chzwob7mw@primary:1534185952000:default.tablettr0ylcumu@primary:1534185952000-%3E:INSERT:default.tablemyeynex2xi@primary:1534185952000
 HTTP/1.1" 404 277 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:05 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_process?attr:qualifiedName=QUERY:default.table2chzwob7mw@primary:1534185952000:default.tablettr0ylcumu@primary:1534185952000-%3E:INSERT:default.tablemyeynex2xi@primary:1534185952000
 HTTP/1.1" 200 3025 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:05 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_process?attr:qualifiedName=QUERY:default.table2chzwob7mw@primary:1534185952000:default.tablettr0ylcumu@primary:1534185952000-%3E:INSERT:default.tablemyeynex2xi@primary:1534185952000
 HTTP/1.1" 200 3025 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:05 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8819c72e-0c54-4a08-b6bf-077595a0deed 
HTTP/1.1" 200 3025 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:05 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/0151c09d-2548-49b8-8453-9dfaf3bad34d 
HTTP/1.1" 200 5562 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:05 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/60850b78-b26b-4711-98ff-355b69d3be4b 
HTTP/1.1" 200 6348 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:05 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/e454d0b7-3e2a-4b39-a6d4-c1dbbb128b60 
HTTP/1.1" 200 6351 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:08 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_process?attr:qualifiedName=QUERY:default.table2chzwob7mw@primary:1534185952000:default.tablettr0ylcumu@primary:1534185952000-%3E:INSERT:default.tablemyeynex2xi@primary:1534185952000
 HTTP/1.1" 200 3025 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:08 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_process?attr:qualifiedName=QUERY:default.table2chzwob7mw@primary:1534185952000:default.tablettr0ylcumu@primary:1534185952000-%3E:INSERT:default.tablemyeynex2xi@primary:1534185952000
 HTTP/1.1" 200 3025 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:08 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8819c72e-0c54-4a08-b6bf-077595a0deed 
HTTP/1.1" 200 3025 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:08 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/0151c09d-2548-49b8-8453-9dfaf3bad34d 
HTTP/1.1" 200 5562 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:08 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/60850b78-b26b-4711-98ff-355b69d3be4b 
HTTP/1.1" 200 6348 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:08 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/e454d0b7-3e2a-4b39-a6d4-c1dbbb128b60 
HTTP/1.1" 200 6351 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:11 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_table?attr:qualifiedName=default.tableriqy35yk9k@primary
 HTTP/1.1" 200 5180 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:11 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_table?attr:qualifiedName=default.tableriqy35yk9k@primary
 HTTP/1.1" 200 5180 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:11 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_table?attr:qualifiedName=dbh966oijhkp.table6lgyx9uo1v@primary
 HTTP/1.1" 404 159 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:16 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_table?attr:qualifiedName=dbh966oijhkp.table6lgyx9uo1v@primary
 HTTP/1.1" 200 5623 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:16 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_table?attr:qualifiedName=dbh966oijhkp.table6lgyx9uo1v@primary
 HTTP/1.1" 200 5623 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:16 +] "GET 
//localhost:31000/api/atlas/v2/lineage/ee1847f0-af19-41ff-b5eb-ea3e5eb832df?depth=0=INPUT
 HTTP/1.1" 200 1619 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:16 +] "GET 
//localhost:31000/api/atlas/v2/lineage/e472b8b6-8d85-41df-955a-1a0c984721d2?depth=0=OUTPUT
 HTTP/1.1" 200 1620 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:17 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_table?attr:qualifiedName=default.table5sfnxtuncm@primary
 HTTP/1.1" 404 154 "-" "Java/1.8.0_172"
127.0.0.1 - - [13/Aug/2018:18:46:22 +] "GET 

[jira] [Commented] (ATLAS-2819) UI: Re-evaluate classification propagation during entity delete

[Sarath Subramanian (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578768#comment-16578768
 ] 

Sarath Subramanian commented on ATLAS-2819:
---

+1 Looks good. thanks for the patch [~abhib4]

> UI: Re-evaluate classification propagation during entity delete
> ---
>
> Key: ATLAS-2819
> URL: https://issues.apache.org/jira/browse/ATLAS-2819
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0-alpha, 1.0.0
>Reporter: Abhishek Kadam
>Assignee: Abhishek Kadam
>Priority: Major
> Fix For: 1.1.0
>
> Attachments: ATLAS-2819.patch
>
>
> The current behavior - when we delete an entity *f1*, all tags associate to 
> *f1* which got propagated
> to downstream entities are removed – *PII* tag propagated to *process1* and 
> *t1* is removed
> *Proposed Change*
> _*Soft Delete:*_
> When entity *f1* is deleted, retain the propagated classification edges, so 
> the downstream entities
> – *process1* and *t1* continue to have *PII* classification associated to them
> _*Hard Delete:*_
> In cases of hard delete, the source entity (*f1*) is deleted from atlas, but 
> its classification vertex
> (*PII*) continue to exist and will continue propagating to *process1* and 
> *t1*.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: Atlas-1.0-UnitTests #771

[Apache Jenkins Server]

See 

--
[...truncated 203.61 KB...]
[INFO] Exclude: .git/**
[INFO] Exclude: .gitignore
[INFO] Exclude: **/.idea/**
[INFO] Exclude: **/*.twiki
[INFO] Exclude: **/*.iml
[INFO] Exclude: **/*.json
[INFO] Exclude: **/*.log
[INFO] Exclude: **/target/**
[INFO] Exclude: **/target*/**
[INFO] Exclude: **/build/**
[INFO] Exclude: **/*.patch
[INFO] Exclude: derby.log
[INFO] Exclude: **/logs/**
[INFO] Exclude: **/.classpath
[INFO] Exclude: **/.project
[INFO] Exclude: **/.settings/**
[INFO] Exclude: **/test-output/**
[INFO] Exclude: **/mock/**
[INFO] Exclude: **/data/**
[INFO] Exclude: **/maven-eclipse.xml
[INFO] Exclude: **/.externalToolBuilders/**
[INFO] Exclude: **/build.log
[INFO] Exclude: **/.bowerrc
[INFO] Exclude: *.json
[INFO] Exclude: **/overlays/**
[INFO] Exclude: dev-support/**
[INFO] Exclude: **/users-credentials.properties
[INFO] Exclude: **/public/css/animate.min.css
[INFO] Exclude: **/public/css/bootstrap-sidebar.css
[INFO] Exclude: **/public/js/external_lib/**
[INFO] Exclude: **/node_modules/**
[INFO] Exclude: **/public/js/libs/**
[INFO] Exclude: **/atlas.data/**
[INFO] Exclude: **/${sys:atlas.data}/**
[INFO] Exclude: **/policy-store.txt
[INFO] Exclude: **/*rebel*.xml
[INFO] Exclude: **/*rebel*.xml.bak
[INFO] Exclude: **/test/resources/**
[INFO] 124 resources included (use -debug for more details)
[INFO] Rat check: Summary over all files. Unapproved: 0, unknown: 0, generated: 
0, approved: 124 licenses.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 15 resources
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-solr-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9 resources
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ atlas-webapp 
---
[INFO] 
[INFO] --- keytool-maven-plugin:1.5:clean (clean) @ atlas-webapp ---
[WARNING] Keystore file 
'
 doesn't exist.
[INFO] 
[INFO] --- keytool-maven-plugin:1.5:generateKeyPair (generateKeyPair) @ 
atlas-webapp ---
[WARNING] 
[WARNING] Warning:
[WARNING] The JKS keystore uses a proprietary format. It is recommended to 
migrate to PKCS12 which is an industry standard format using "keytool 
-importkeystore -srckeystore 

 -destkeystore 

 -deststoretype pkcs12".
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 2 resources to META-INF
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ atlas-webapp 
---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 68 source files to 

[INFO] 
:
 Some input files use or override a deprecated API.
[INFO] 
:
 Recompile with -Xlint:deprecation for details.
[INFO] 
:
 Some input files use unchecked or unsafe operations.
[INFO] 
:
 Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @ 
atlas-webapp ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 48 source files to 

[INFO] 
:
 Some input files use or override a deprecated API.
[INFO] 
:
 Recompile with -Xlint:deprecation for details.
[INFO] 
:
 Some input files use 

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #556-branch-0.8-ATLAS-2814-Cluster-stores-replication-details.patch

[Apache Jenkins Server]

See 


--
Started by user amestry
[EnvInject] - Loading node environment variables.
Building remotely on H10 (Hadoop) in workspace 

[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Done
Cloning the remote Git repository
Cloning repository http://git-wip-us.apache.org/repos/asf/atlas.git
 > git init  # 
 > timeout=10
Fetching upstream changes from http://git-wip-us.apache.org/repos/asf/atlas.git
 > git --version # timeout=10
 > git fetch --tags --progress http://git-wip-us.apache.org/repos/asf/atlas.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > http://git-wip-us.apache.org/repos/asf/atlas.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > http://git-wip-us.apache.org/repos/asf/atlas.git # timeout=10
Fetching upstream changes from http://git-wip-us.apache.org/repos/asf/atlas.git
 > git fetch --tags --progress http://git-wip-us.apache.org/repos/asf/atlas.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4c901bd07e6dae969b152f885ff2d6211c4b3e84 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 4c901bd07e6dae969b152f885ff2d6211c4b3e84
Commit message: "ATLAS-2815: Restoring the deleted audit call"
 > git rev-list --no-walk 4c901bd07e6dae969b152f885ff2d6211c4b3e84 # timeout=10
[EnvInject] - Mask passwords that will be passed as build parameters.
Set build name.
New build name is 
'#556-branch-0.8-ATLAS-2814-Cluster-stores-replication-details.patch'
Copying file to LOCAL_PATCH
[PreCommit-ATLAS-Build-Test] $ /bin/bash /tmp/jenkins3529367965505267174.sh
+ export TOOLS_HOME=/home/jenkins/tools
+ TOOLS_HOME=/home/jenkins/tools
+ export ANT_HOME=/home/jenkins/tools/ant/latest
+ ANT_HOME=/home/jenkins/tools/ant/latest
+ export FORREST_HOME=/home/jenkins/tools/forrest/latest
+ FORREST_HOME=/home/jenkins/tools/forrest/latest
+ export JAVA5_HOME=/home/jenkins/tools/java/latest1.5
+ JAVA5_HOME=/home/jenkins/tools/java/latest1.5
+ export FINDBUGS_HOME=/home/jenkins/tools/findbugs/latest
+ FINDBUGS_HOME=/home/jenkins/tools/findbugs/latest
+ export CLOVER_HOME=/home/jenkins/tools/clover/latest
+ CLOVER_HOME=/home/jenkins/tools/clover/latest
+ export MAVEN_HOME=/home/jenkins/tools/maven/latest
+ MAVEN_HOME=/home/jenkins/tools/maven/latest
+ export 
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
+ 
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
+ export 'MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 
-noverify'
+ MAVEN_OPTS='-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify'
+ export 'ANT_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 
-noverify'
+ ANT_OPTS='-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify'
+ env
BUILD_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/556/
XDG_SESSION_ID=160
SKIP_UT=false
ISSUE_NUM=ATLAS-2814
HUDSON_SERVER_COOKIE=f4ebd1e6b0d976e8
SHELL=/bin/bash
FORREST_HOME=/home/jenkins/tools/forrest/latest
SSH_CLIENT=195.201.170.234 34412 22
TOOLS_HOME=/home/jenkins/tools
BUILD_TAG=jenkins-PreCommit-ATLAS-Build-Test-556
GIT_PREVIOUS_COMMIT=4c901bd07e6dae969b152f885ff2d6211c4b3e84
ROOT_BUILD_CAUSE=MANUALTRIGGER
ANT_HOME=/home/jenkins/tools/ant/latest
WORKSPACE=
JOB_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/
ANT_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
BRANCH=branch-0.8
RUN_CHANGES_DISPLAY_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/556/display/redirect?page=changes
USER=jenkins
GIT_AUTHOR_NAME=jenkins
GIT_COMMITTER_NAME=jenkins
MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat
GIT_COMMIT=4c901bd07e6dae969b152f885ff2d6211c4b3e84
JENKINS_HOME=/x1/jenkins/jenkins-home
MAVEN_HOME=/home/jenkins/tools/maven/latest
MAIL=/var/mail/jenkins
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
RUN_DISPLAY_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/556/display/redirect
BUILD_CAUSE_MANUALTRIGGER=true
GIT_COMMITTER_EMAIL=bui...@apache.org

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #554-master-ATLAS-2813-Soft-reference-implementation.patch

[Apache Jenkins Server]

See 


Changes:

[ssubramanian] ATLAS-2812: Upgrade commons-fileupload to 1.3.3

[ssubramanian] ATLAS-2807: Re-evaluate classification propagation during entity 
delete

[apoorvnaik] ATLAS-2815: Restoring the deleted audit call

--
Started by user amestry
[EnvInject] - Loading node environment variables.
Building remotely on H10 (Hadoop) in workspace 

[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Done
Cloning the remote Git repository
Cloning repository http://git-wip-us.apache.org/repos/asf/atlas.git
 > git init  # 
 > timeout=10
Fetching upstream changes from http://git-wip-us.apache.org/repos/asf/atlas.git
 > git --version # timeout=10
 > git fetch --tags --progress http://git-wip-us.apache.org/repos/asf/atlas.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > http://git-wip-us.apache.org/repos/asf/atlas.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > http://git-wip-us.apache.org/repos/asf/atlas.git # timeout=10
Fetching upstream changes from http://git-wip-us.apache.org/repos/asf/atlas.git
 > git fetch --tags --progress http://git-wip-us.apache.org/repos/asf/atlas.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4c901bd07e6dae969b152f885ff2d6211c4b3e84 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 4c901bd07e6dae969b152f885ff2d6211c4b3e84
Commit message: "ATLAS-2815: Restoring the deleted audit call"
 > git rev-list --no-walk 2f5eac0b234a14c42880eeb10090067b5541 # timeout=10
[EnvInject] - Mask passwords that will be passed as build parameters.
Set build name.
New build name is '#554-master-ATLAS-2813-Soft-reference-implementation.patch'
Copying file to LOCAL_PATCH
[PreCommit-ATLAS-Build-Test] $ /bin/bash /tmp/jenkins5508563990658304644.sh
+ export TOOLS_HOME=/home/jenkins/tools
+ TOOLS_HOME=/home/jenkins/tools
+ export ANT_HOME=/home/jenkins/tools/ant/latest
+ ANT_HOME=/home/jenkins/tools/ant/latest
+ export FORREST_HOME=/home/jenkins/tools/forrest/latest
+ FORREST_HOME=/home/jenkins/tools/forrest/latest
+ export JAVA5_HOME=/home/jenkins/tools/java/latest1.5
+ JAVA5_HOME=/home/jenkins/tools/java/latest1.5
+ export FINDBUGS_HOME=/home/jenkins/tools/findbugs/latest
+ FINDBUGS_HOME=/home/jenkins/tools/findbugs/latest
+ export CLOVER_HOME=/home/jenkins/tools/clover/latest
+ CLOVER_HOME=/home/jenkins/tools/clover/latest
+ export MAVEN_HOME=/home/jenkins/tools/maven/latest
+ MAVEN_HOME=/home/jenkins/tools/maven/latest
+ export 
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
+ 
PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/ant/latest/bin:/home/jenkins/tools/maven/latest/bin
+ export 'MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 
-noverify'
+ MAVEN_OPTS='-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify'
+ export 'ANT_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 
-noverify'
+ ANT_OPTS='-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify'
+ env
BUILD_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/554/
XDG_SESSION_ID=160
SKIP_UT=false
ISSUE_NUM=ATLAS-2813
HUDSON_SERVER_COOKIE=f4ebd1e6b0d976e8
SHELL=/bin/bash
FORREST_HOME=/home/jenkins/tools/forrest/latest
SSH_CLIENT=195.201.170.234 34412 22
TOOLS_HOME=/home/jenkins/tools
BUILD_TAG=jenkins-PreCommit-ATLAS-Build-Test-554
GIT_PREVIOUS_COMMIT=2f5eac0b234a14c42880eeb10090067b5541
ROOT_BUILD_CAUSE=MANUALTRIGGER
ANT_HOME=/home/jenkins/tools/ant/latest
WORKSPACE=
JOB_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/
ANT_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
BRANCH=master
RUN_CHANGES_DISPLAY_URL=https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/554/display/redirect?page=changes
USER=jenkins
GIT_AUTHOR_NAME=jenkins
GIT_COMMITTER_NAME=jenkins
MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat
GIT_COMMIT=4c901bd07e6dae969b152f885ff2d6211c4b3e84
JENKINS_HOME=/x1/jenkins/jenkins-home
MAVEN_HOME=/home/jenkins/tools/maven/latest
MAIL=/var/mail/jenkins

Re: Review Request 68312: AttributeDef Update: Support for Soft Reference

[Ashutosh Mestry]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68312/
---

(Updated Aug. 13, 2018, 5:31 p.m.)


Review request for atlas, Apoorv Naik, Madhan Neethiraj, Nixon Rodrigues, and 
Sarath Subramanian.


Changes
---

Updates include:
- Added support for map and array.
- Additional unit tests.


Bugs: ATLAS-2813
https://issues.apache.org/jira/browse/ATLAS-2813


Repository: atlas


Description
---

**Approach**
- Add _options_ field to _AtlasAttributeDef_.
- Implement support in _AtlasStructDefStore_.
- Update _EntityGraphMapper_
- Update _EntityGraphRetriever_
- Supports array of objects and objects.

**Usage**
See attached JSON.


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
c3c85d354f02f6ffb9565a5fc15699c4d06e1ae2 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
 137fb30746730cc4d1842891987c342a1bc17af7 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
 9e7a119a3abfb50401f9747dad1ffa55facc51ed 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphRetriever.java
 a243fd79cab685174f3a90c5093e84e9f9fa782a 
  
repository/src/test/java/org/apache/atlas/repository/store/graph/v1/SoftReferenceTest.java
 PRE-CREATION 
  repository/src/test/resources/json/rdbms-db.json PRE-CREATION 
  repository/src/test/resources/json/typesDef-soft-ref.json PRE-CREATION 


Diff: https://reviews.apache.org/r/68312/diff/2/

Changes: https://reviews.apache.org/r/68312/diff/1-2/


Testing (updated)
---

**Unit tests**
Tests verify object, array, map cases.


File Attachments


rdbms-db.json
  
https://reviews.apache.org/media/uploaded/files/2018/08/12/1f45deeb-55d7-4c68-8640-ca184cf08a2c__rdbms-db.json
TypesDef with softRef
  
https://reviews.apache.org/media/uploaded/files/2018/08/12/e1e7a8c1-13b5-453a-b240-9217a723dd15__typesDef-soft-ref.json


Thanks,

Ashutosh Mestry

Re: Review Request 68270: Cluster Entity Updated after Successful Import if Replication Options are Available in Import Request

[Ashutosh Mestry]

> On Aug. 10, 2018, 10:45 p.m., Sarath Subramanian wrote:
> > repository/src/main/java/org/apache/atlas/repository/impexp/AuditsWriter.java
> > Line 107 (original), 97 (patched)
> > 
> >
> > AtlasCluster name and qualifiedName is same?

The intent is that qualifiedName is not changable, where as _displayName_ can 
be changed for better read.


- Ashutosh


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68270/#review207097
---


On Aug. 9, 2018, 8:19 p.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68270/
> ---
> 
> (Updated Aug. 9, 2018, 8:19 p.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Madhan Neethiraj, and Sarath 
> Subramanian.
> 
> 
> Bugs: ATLAS-2814
> https://issues.apache.org/jira/browse/ATLAS-2814
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> **Approach**
> - New model _ReplicationDetails_ store replication timestamp.
> - _AuditWriter_ updates appropriate _AtlasCluster_ entity with 
> _ReplicationDetails_.
> 
> 
> Diffs
> -
> 
>   client/common/src/main/java/org/apache/atlas/AtlasBaseClient.java 
> f73ba2c6e6c9d05e86eb6c17f923a6dda1df5dd9 
>   intg/src/main/java/org/apache/atlas/model/clusterinfo/AtlasCluster.java 
> 3ce50e38b3af45521c2c83d0e6c05398747bcf86 
>   intg/src/main/java/org/apache/atlas/model/impexp/AtlasExportResult.java 
> 85a606c7d3b2158238b2a6defbb9185883434d78 
>   intg/src/main/java/org/apache/atlas/model/impexp/AtlasImportResult.java 
> bfb7637711e08e17fd5f5b16bf121ac541b631a4 
>   intg/src/main/java/org/apache/atlas/model/impexp/ReplicationDetails.java 
> PRE-CREATION 
>   
> repository/src/main/java/org/apache/atlas/repository/impexp/AuditsWriter.java 
> 6a3fbecda84dc48e0df1359c1b5a248958db0a4c 
>   
> repository/src/main/java/org/apache/atlas/repository/impexp/ClusterService.java
>  fd8e2bfe6bbdb7ae5e66ab67ecdf94e9527d9b09 
>   
> repository/src/main/java/org/apache/atlas/repository/impexp/ExportImportAuditService.java
>  e90b6b942d359f78ccf59ee955c4667f2033e6c4 
>   
> repository/src/main/java/org/apache/atlas/repository/impexp/ExportService.java
>  b15f828e470eaee972a4ee3f8447f404f813c699 
>   
> repository/src/main/java/org/apache/atlas/repository/impexp/ImportService.java
>  98ef389bd1bf8f87d23a06dc231d4d93f06b2231 
>   
> repository/src/main/java/org/apache/atlas/repository/ogm/AtlasClusterDTO.java 
> 424fb88a5ad2d84ac2245848d061892d40a3f50c 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
>  9e7a119a3abfb50401f9747dad1ffa55facc51ed 
>   
> repository/src/test/java/org/apache/atlas/repository/impexp/ClusterServiceTest.java
>  cfd272fb00a970ab0ba28f96b237de6bd5c694e1 
>   
> repository/src/test/java/org/apache/atlas/repository/impexp/ExportImportAuditServiceTest.java
>  f3803e5ae15a772eb4ff04192a83a5b412631791 
>   
> repository/src/test/java/org/apache/atlas/repository/impexp/ExportImportTestBase.java
>  fcf90d364950d3afa2c18689d8e22616cfcd3c19 
>   
> repository/src/test/java/org/apache/atlas/repository/impexp/ExportIncrementalTest.java
>  86ab22294918701270db3ba849f5b0532c1a21a4 
>   
> repository/src/test/java/org/apache/atlas/repository/impexp/ImportServiceTest.java
>  dc25e92d7115db31cbd7f99bd1a2cb5f75e766a5 
>   
> repository/src/test/java/org/apache/atlas/repository/impexp/ReplicationEntityAttributeTest.java
>  881368ce2c6803c8cf887a1fc91737c045c5e663 
>   server-api/src/main/java/org/apache/atlas/RequestContextV1.java 
> 8506d186978f579c6b18c4347fc7cb2636848f16 
>   webapp/src/main/java/org/apache/atlas/web/resources/AdminResource.java 
> d4e72620b15f69d258e5a2a96521c65a7ef71114 
>   
> webapp/src/test/java/org/apache/atlas/web/resources/AdminExportImportTestIT.java
>  fc804d2e5a1debd7e728dca1773f91402d41fc26 
>   webapp/src/test/resources/json/export-incremental.json 
> 97108411f9e0c177ac13eb0a8ec3bd4475499f89 
>   webapp/src/test/resources/stocks-base.zip 
> 40c7f37eefb46a944921f6a74a916191704cb9a3 
> 
> 
> Diff: https://reviews.apache.org/r/68270/diff/3/
> 
> 
> Testing
> ---
> 
> **Unit tests**
> New tests added.
> 
> 
> Thanks,
> 
> Ashutosh Mestry
> 
>

[jira] [Commented] (ATLAS-2815) Slow UI load and REST improvement for entities with ownedRef

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578331#comment-16578331
 ] 

ASF subversion and git services commented on ATLAS-2815:


Commit 75f6cfbecee3896e869566cc5abf166571f5652d in atlas's branch 
refs/heads/branch-1.0 from apoorvnaik
[ https://git-wip-us.apache.org/repos/asf?p=atlas.git;h=75f6cfb ]

ATLAS-2815: Restoring the deleted audit call


> Slow UI load and REST improvement for entities with ownedRef
> 
>
> Key: ATLAS-2815
> URL: https://issues.apache.org/jira/browse/ATLAS-2815
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Abhishek Kadam
>Assignee: Abhishek Kadam
>Priority: Major
> Fix For: 0.8.1, trunk, 1.1.0
>
> Attachments: ATLAS-2815.patch, ATLAS-2815_UI.patch
>
>
> The approach is to check if query param- 
> {color:#212121}*minExtInfo*:{color}*true* and the entity has schemaOptions, 
> then the server will send the attributes accordingly in referredEntities.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (ATLAS-2815) Slow UI load and REST improvement for entities with ownedRef

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578326#comment-16578326
 ] 

ASF subversion and git services commented on ATLAS-2815:


Commit 4c901bd07e6dae969b152f885ff2d6211c4b3e84 in atlas's branch 
refs/heads/master from apoorvnaik
[ https://git-wip-us.apache.org/repos/asf?p=atlas.git;h=4c901bd ]

ATLAS-2815: Restoring the deleted audit call

Change-Id: Ia40cab9a258eb7e679975b414c7d6caf9eb6cbb5


> Slow UI load and REST improvement for entities with ownedRef
> 
>
> Key: ATLAS-2815
> URL: https://issues.apache.org/jira/browse/ATLAS-2815
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Abhishek Kadam
>Assignee: Abhishek Kadam
>Priority: Major
> Fix For: 0.8.1, trunk, 1.1.0
>
> Attachments: ATLAS-2815.patch, ATLAS-2815_UI.patch
>
>
> The approach is to check if query param- 
> {color:#212121}*minExtInfo*:{color}*true* and the entity has schemaOptions, 
> then the server will send the attributes accordingly in referredEntities.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (ATLAS-2807) Re-evaluate classification propagation during entity delete

[Graham Wallis (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578306#comment-16578306
 ] 

Graham Wallis commented on ATLAS-2807:
--

I still think this change should not be applied to all types of relationship - 
it is appropriate for those relationships in which the propagated 
classifications are effectively inherited - e.g. if you create a table by 
running a process on a dataset, then delete the dataset - in that case the 
generated table should (indeed, must) continue to be tagged eg as PII. But in a 
relationship of a transient nature you might only want the classifications to 
persist whilst the source entity exists and is related to the target entity. It 
seems that this change only considers the former, not the latter. 

 

> Re-evaluate classification propagation during entity delete
> ---
>
> Key: ATLAS-2807
> URL: https://issues.apache.org/jira/browse/ATLAS-2807
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Affects Versions: 1.0.0-alpha, 1.0.0
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
>Priority: Major
> Fix For: 1.1.0
>
> Attachments: 
> ATLAS-2807-Re-evaluate-classification-propagation-du-MASTER.patch, 
> Classification Propagation during entity delete1.pdf
>
>
> The current behavior - when we delete an entity *f1*, all tags associate to 
> *f1* which got propagated
> to downstream entities are removed – *PII* tag propagated to *process1* and 
> *t1* is removed
> *Proposed Change*
> _*Soft Delete:*_
> When entity *f1* is deleted, retain the propagated classification edges, so 
> the downstream entities
> – *process1* and *t1* continue to have *PII* classification associated to them
> _*Hard Delete:*_
> In cases of hard delete, the source entity (*f1*) is deleted from atlas, but 
> its classification vertex
> (*PII*) continue to exist and will continue propagating to *process1* and 
> *t1*.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2819) UI: Re-evaluate classification propagation during entity delete

[Abhishek Kadam (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Kadam updated ATLAS-2819:
--
Attachment: ATLAS-2819.patch

> UI: Re-evaluate classification propagation during entity delete
> ---
>
> Key: ATLAS-2819
> URL: https://issues.apache.org/jira/browse/ATLAS-2819
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0-alpha, 1.0.0
>Reporter: Abhishek Kadam
>Assignee: Abhishek Kadam
>Priority: Major
> Fix For: 1.1.0
>
> Attachments: ATLAS-2819.patch
>
>
> The current behavior - when we delete an entity *f1*, all tags associate to 
> *f1* which got propagated
> to downstream entities are removed – *PII* tag propagated to *process1* and 
> *t1* is removed
> *Proposed Change*
> _*Soft Delete:*_
> When entity *f1* is deleted, retain the propagated classification edges, so 
> the downstream entities
> – *process1* and *t1* continue to have *PII* classification associated to them
> _*Hard Delete:*_
> In cases of hard delete, the source entity (*f1*) is deleted from atlas, but 
> its classification vertex
> (*PII*) continue to exist and will continue propagating to *process1* and 
> *t1*.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2819) UI: Re-evaluate classification propagation during entity delete

[Abhishek Kadam (JIRA)]

Abhishek Kadam created ATLAS-2819:
-

 Summary: UI: Re-evaluate classification propagation during entity 
delete
 Key: ATLAS-2819
 URL: https://issues.apache.org/jira/browse/ATLAS-2819
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 1.0.0, 1.0.0-alpha
Reporter: Abhishek Kadam
Assignee: Abhishek Kadam
 Fix For: 1.1.0


The current behavior - when we delete an entity *f1*, all tags associate to 
*f1* which got propagated

to downstream entities are removed – *PII* tag propagated to *process1* and 
*t1* is removed

*Proposed Change*

_*Soft Delete:*_

When entity *f1* is deleted, retain the propagated classification edges, so the 
downstream entities

– *process1* and *t1* continue to have *PII* classification associated to them

_*Hard Delete:*_

In cases of hard delete, the source entity (*f1*) is deleted from atlas, but 
its classification vertex

(*PII*) continue to exist and will continue propagating to *process1* and *t1*.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)