Jenkins build is back to normal : Atlas-master-IntegrationTests #535

[Apache Jenkins Server]

See 

Re: Metadata security policies examples

[Madhan Neethiraj]

Mandy,

> edit access is limited to the user identified in the createdBy property.
It will be possible to support authorization as above. However, there are few 
issues to be aware of in such approach. For example:
 - 'createdBy' property may not be present in all entity-types
 - the username in 'createdBy' property might have to be normalized or mapped, 
to be able to compare with the username logged into Atlas.
   - for example john.sc...@example.com vs jscott
I would recommend to handle such username normalization/mapping in a later 
phase.

> where a classification can only be added to an entity by a user that has edit 
> access to the entity.
> where a classification can only be added to any entity by a user with create 
> rights on the classification.
Wouldn't it be more flexible to allow different set of users to edit and 
classify entities? Similar to the following scenario.

> where edit access to an entity is required before a relationship can connect 
> it to something else
> and it would be good from a graph decoupling point of view if adding 
> relationships could be done independently of the access rights to either 
> entity.
I agree on decoupling authorization to create relationship from access rights 
to the entities at both ends.

Thanks,
Madhan

On 2/14/18, 10:06 AM, "Mandy Chessell"  wrote:

Hello Madhan,
I was thinking through our common use cases for metadata security.  For 
most metadata entities and relationships, we would want to enforce that 
metadata is readable by logged on users but edit access is limited to the 
user identified in the createdBy property. 

Then we have special cases for entities such as connections and some 
governance actions.
For example there may be a connection to an audit log and that can only be 
seen by members of the security team since having access to the connection 
means you can connect to the data store.
Some governance actions may be updateable by anyone in the governance team 
- not just the creator.

When it comes to classifications, we have 2 scenarios 
- where a classification can only be added to an entity by a user that has 
edit access to the entity.
- where a classification can only be added to any entity by a user with 
create rights on the classification.

I was trying to think through similar examples for relationships - for 
example, where edit access to an entity is required before a relationship 
can connect it to something else - but I can't think of one - and it would 
be good from a graph decoupling point of view if adding relationships 
could be done independently of the access rights to either entity.

All the best
Mandy
___
Mandy Chessell CBE FREng CEng FBCS
IBM Distinguished Engineer

Master Inventor
Member of the IBM Academy of Technology
Visiting Professor, Department of Computer Science, University of 
Sheffield

Email: mandy_chess...@uk.ibm.com
LinkedIn: http://www.linkedin.com/pub/mandy-chessell/22/897/a49

Assistant: Janet Brooks - jsbrook...@uk.ibm.com

[jira] [Commented] (ATLAS-2449) Latest master atlas does not build cleanly with tests enabled locally on Mac

[Madhan Neethiraj (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366500#comment-16366500
 ] 

Madhan Neethiraj commented on ATLAS-2449:
-

{quote}Tests run: 140, Failures: 11, Errors: 0, Skipped: 122
{quote}
[~davidrad] - given 11 failures and 122 skips, out of 140 tests, I think IT 
might have failures in starting Atlas server - perhaps by issues like firewall, 
etc. Can you look for earlier errors in the build?

> Latest master atlas does not build cleanly with tests enabled locally on Mac
> 
>
> Key: ATLAS-2449
> URL: https://issues.apache.org/jira/browse/ATLAS-2449
> Project: Atlas
>  Issue Type: Bug
>Reporter: David Radley
>Priority: Major
>
> I run mvn clean install -Pdist,embedded-hbase-solr
> And it fails with:
> 127.0.0.1 - - [15/Feb/2018:14:06:01 +] "GET 
> //localhost:31000/api/atlas/v2/types/typedef/name/hive_table_v1 HTTP/1.1" 503 
> 372 "-" "Java/1.8.0_151"
> 127.0.0.1 - - [15/Feb/2018:14:06:06 +] "GET 
> //localhost:31000/api/atlas/v2/types/typedef/name/hive_table_v1 HTTP/1.1" 503 
> 372 "-" "Java/1.8.0_151"
> 127.0.0.1 - - [15/Feb/2018:14:06:11 +] "GET 
> //localhost:31000/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 
> 503 374 "-" "Java/1.8.0_151"
> 127.0.0.1 - - [15/Feb/2018:14:06:16 +] "GET 
> //localhost:31000/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 
> 503 374 "-" "Java/1.8.0_151"
> 127.0.0.1 - - [15/Feb/2018:14:06:21 +] "GET 
> //localhost:31000/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 
> 503 374 "-" "Java/1.8.0_151"
> 127.0.0.1 - - [15/Feb/2018:14:06:26 +] "GET 
> //localhost:31000/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 
> 503 374 "-" "Java/1.8.0_151"
> 127.0.0.1 - - [15/Feb/2018:14:06:31 +] "POST 
> //localhost:31000/api/atlas/types HTTP/1.1" 503 342 "-" "Java/1.8.0_151"
> 127.0.0.1 - - [15/Feb/2018:14:06:36 +] "POST 
> //localhost:31000/api/atlas/types HTTP/1.1" 503 342 "-" "Java/1.8.0_151"
> 127.0.0.1 - - [15/Feb/2018:14:06:41 +] "POST 
> //localhost:31000/api/atlas/types HTTP/1.1" 503 342 "-" "Java/1.8.0_151"
> 127.0.0.1 - - [15/Feb/2018:14:06:46 +] "POST 
> //localhost:31000/api/atlas/types HTTP/1.1" 503 342 "-" "Java/1.8.0_151"
> Tests run: 143, Failures: 11, Errors: 0, Skipped: 125, Time elapsed: 
> 2,422.962 sec <<< FAILURE! - in TestSuite
> setUp(org.apache.atlas.web.integration.DataSetLineageJerseyResourceIT)  Time 
> elapsed: 510.086 sec  <<< FAILURE!
> org.apache.atlas.AtlasServiceException: Metadata service API 
> org.apache.atlas.AtlasClient$API_V1@5161ae92 failed with status 503 (Service 
> Unavailable) Response Body (
> 
> 
> Error 503 
> 
> 
> HTTP ERROR: 503
> Problem accessing /api/atlas/types. Reason:
>     Service Unavailable
> http://eclipse.org/jetty;>Powered by Jetty:// 
> 9.3.14.v20161028
> 
> 
> )
>     at 
> org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
>     at 
> org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
>     at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:211)
>     at org.apache.atlas.AtlasClient.callAPIWithBody(AtlasClient.java:906)
>     at org.apache.atlas.AtlasClient.createType(AtlasClient.java:257)
>     at org.apache.atlas.AtlasClient.createType(AtlasClient.java:275)
>     at 
> org.apache.atlas.web.integration.BaseResourceIT.createType(BaseResourceIT.java:213)
>     at 
> org.apache.atlas.web.integration.BaseResourceIT.createTypeDefinitionsV1(BaseResourceIT.java:360)
>     at 
> org.apache.atlas.web.integration.DataSetLineageJerseyResourceIT.setUp(DataSetLineageJerseyResourceIT.java:60)
> setUp(org.apache.atlas.notification.NotificationHookConsumerIT)  Time 
> elapsed: 362.578 sec  <<< FAILURE!
> org.apache.atlas.AtlasServiceException: Metadata service API 
> org.apache.atlas.AtlasClient$API_V1@5161ae92 failed with status 503 (Service 
> Unavailable) Response Body (
> 
> 
> Error 503 
> 
> 
> HTTP ERROR: 503
> Problem accessing /api/atlas/types. Reason:
>     Service Unavailable
> http://eclipse.org/jetty;>Powered by Jetty:// 
> 9.3.14.v20161028
> 
> 
> )
>     at 
> org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
>     at 
> org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
>     at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:211)
>     at org.apache.atlas.AtlasClient.callAPIWithBody(AtlasClient.java:906)
>     at org.apache.atlas.AtlasClient.createType(AtlasClient.java:257)
>     at org.apache.atlas.AtlasClient.createType(AtlasClient.java:275)
>     at 
> org.apache.atlas.web.integration.BaseResourceIT.createType(BaseResourceIT.java:213)
>     at 
> 

Re: Review Request 65678: ATLAS-2444: Fix for appending cluster name only for HDFS paths

[Madhan Neethiraj]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65678/#review197653
---


Ship it!




Ship It!

- Madhan Neethiraj


On Feb. 16, 2018, 12:10 a.m., Apoorv Naik wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/65678/
> ---
> 
> (Updated Feb. 16, 2018, 12:10 a.m.)
> 
> 
> Review request for atlas and Madhan Neethiraj.
> 
> 
> Bugs: ATLAS-2444
> https://issues.apache.org/jira/browse/ATLAS-2444
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Update the HiveMetastoreBridge code and some test logic. 
> 
> HiveHookIT runs successfully after this patch
> 
> 
> Diffs
> -
> 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
>  3a775b60e 
>   addons/hive-bridge/src/test/java/org/apache/atlas/hive/HiveITBase.java 
> 01418cf30 
>   addons/hive-bridge/src/test/java/org/apache/atlas/hive/hook/HiveHookIT.java 
> 1b1ebec27 
>   common/src/main/java/org/apache/atlas/utils/HdfsNameServiceResolver.java 
> 60e192597 
> 
> 
> Diff: https://reviews.apache.org/r/65678/diff/2/
> 
> 
> Testing
> ---
> 
> mvn verify -pl addons/hive-bridge -am -Dit.test=HiveHookIT was successful
> 
> 
> Thanks,
> 
> Apoorv Naik
> 
>

Re: Review Request 65678: ATLAS-2444: Fix for appending cluster name only for HDFS paths

[Apoorv Naik]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65678/
---

(Updated Feb. 16, 2018, 12:10 a.m.)


Review request for atlas and Madhan Neethiraj.


Changes
---

Addressed review comments


Bugs: ATLAS-2444
https://issues.apache.org/jira/browse/ATLAS-2444


Repository: atlas


Description
---

Update the HiveMetastoreBridge code and some test logic. 

HiveHookIT runs successfully after this patch


Diffs (updated)
-

  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
 3a775b60e 
  addons/hive-bridge/src/test/java/org/apache/atlas/hive/HiveITBase.java 
01418cf30 
  addons/hive-bridge/src/test/java/org/apache/atlas/hive/hook/HiveHookIT.java 
1b1ebec27 
  common/src/main/java/org/apache/atlas/utils/HdfsNameServiceResolver.java 
60e192597 


Diff: https://reviews.apache.org/r/65678/diff/2/

Changes: https://reviews.apache.org/r/65678/diff/1-2/


Testing
---

mvn verify -pl addons/hive-bridge -am -Dit.test=HiveHookIT was successful


Thanks,

Apoorv Naik

Build failed in Jenkins: Atlas-master-IntegrationTests #534

[Apache Jenkins Server]

See 


--
[...truncated 626.47 KB...]
at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:205)
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.HiveITBase.assertTableIsRegistered(HiveITBase.java:159)
at 
org.apache.atlas.hive.HiveITBase.assertTableIsRegistered(HiveITBase.java:153)
at 
org.apache.atlas.hive.hook.HiveHookIT.testDropView(HiveHookIT.java:1528)

testExportImportPartitionedTable(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 11.027 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/export-data-nbigcbdyq1]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/export-data-nbigcbdyq1@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateOutputTables(HiveHookIT.java:253)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:498)
at 
org.apache.atlas.hive.hook.HiveHookIT.testExportImportPartitionedTable(HiveHookIT.java:789)

testExportImportUnPartitionedTable(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 89.159 sec  <<< FAILURE!
java.lang.AssertionError: Assertions failed. Failing after waiting for timeout 
8 msecs
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithRetries(AtlasBaseClient.java:472)
at org.apache.atlas.AtlasClient.callAPIWithRetries(AtlasClient.java:931)
at org.apache.atlas.AtlasClient.getEntity(AtlasClient.java:640)
at org.apache.atlas.hive.HiveITBase$1.evaluate(HiveITBase.java:168)
at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:205)
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.hook.HiveHookIT.assertProcessIsRegistered(HiveHookIT.java:1737)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:485)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:505)
at 
org.apache.atlas.hive.hook.HiveHookIT.testExportImportUnPartitionedTable(HiveHookIT.java:736)

testInsertIntoDFSDirPartitioned(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 8.581 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/somedfspath1-data-0m9cx3xjwj]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/somedfspath1-data-0m9cx3xjwj@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateOutputTables(HiveHookIT.java:253)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:498)
at 
org.apache.atlas.hive.hook.HiveHookIT.testInsertIntoDFSDirPartitioned(HiveHookIT.java:636)

testLoadDFSPathPartitioned(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 13.108 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/loaddfsfile-data-qxfuzgabt6]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/loaddfsfile-data-qxfuzgabt6@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateInputTables(HiveHookIT.java:257)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:491)
at 
org.apache.atlas.hive.hook.HiveHookIT.testLoadDFSPathPartitioned(HiveHookIT.java:458)

testUpdateProcess(org.apache.atlas.hive.hook.HiveHookIT)  Time elapsed: 7.477 
sec  <<< FAILURE!

[jira] [Comment Edited] (ATLAS-2450) HBase Atlas Hook: Wrong creating time of NameSpace if they are create before enabling HBase hook

[Ramesh Mani (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366359#comment-16366359
 ] 

Ramesh Mani edited comment on ATLAS-2450 at 2/15/18 10:50 PM:
--

[~madhan.neethiraj] we dont get any dates from the HBase Metadata for 
namespace, table, columnfamily and rely on the message creation time i.e when 
post hook are called.  Patch I created is the existing way of find the create / 
update time.

Is that hbase issue then?


was (Author: rmani):
[~madhan.neethiraj] we dont get any dates from the HBase Metadata for 
namespace, table, columnfamily and rely on the message creation time.  Patch I 
created is the existing way of find the create / update time.

Is that hbase issue then?

> HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
> enabling HBase hook
> 
>
> Key: ATLAS-2450
> URL: https://issues.apache.org/jira/browse/ATLAS-2450
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-intg
>Affects Versions: trunk, 0.8.2
>Reporter: Ramesh Mani
>Assignee: Ramesh Mani
>Priority: Major
>
> HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
> enabling HBase hook.
> 1) create namespace before enabling HBase Hook.
> 2) Enable HBase Hook
> 3) create the table on the same namespace.
> In these steps, propagation of namespace happens only when a table is added 
> to the namespace and during this time the create operation is create_table 
> and not namespace and hence the namespace never gets updated resulting in 
> this issue.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Comment Edited] (ATLAS-2450) HBase Atlas Hook: Wrong creating time of NameSpace if they are create before enabling HBase hook

[Ramesh Mani (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366359#comment-16366359
 ] 

Ramesh Mani edited comment on ATLAS-2450 at 2/15/18 10:50 PM:
--

[~madhan.neethiraj] we dont get any dates from the HBase Metadata for 
namespace, table, columnfamily and rely on the message creation time.  Patch I 
created is the existing way of find the create / update time.

Is that hbase issue then?


was (Author: rmani):
[~madhan.neethiraj] we dont get any dates from the HBase Metadata for 
namespace, table, columnfamily and relay on the message creation time.  Patch I 
created is the existing way of find the create / update time.

Is that hbase issue then?

> HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
> enabling HBase hook
> 
>
> Key: ATLAS-2450
> URL: https://issues.apache.org/jira/browse/ATLAS-2450
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-intg
>Affects Versions: trunk, 0.8.2
>Reporter: Ramesh Mani
>Assignee: Ramesh Mani
>Priority: Major
>
> HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
> enabling HBase hook.
> 1) create namespace before enabling HBase Hook.
> 2) Enable HBase Hook
> 3) create the table on the same namespace.
> In these steps, propagation of namespace happens only when a table is added 
> to the namespace and during this time the create operation is create_table 
> and not namespace and hence the namespace never gets updated resulting in 
> this issue.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 65678: ATLAS-2444: Fix for appending cluster name only for HDFS paths

[Madhan Neethiraj]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65678/#review197647
---


Fix it, then Ship it!





addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
Lines 211 (patched)


Consider updating hdfsNameServiceResolver.getPathWithNameServiceID() to 
handle null parameter value.


- Madhan Neethiraj


On Feb. 15, 2018, 10:40 p.m., Apoorv Naik wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/65678/
> ---
> 
> (Updated Feb. 15, 2018, 10:40 p.m.)
> 
> 
> Review request for atlas and Madhan Neethiraj.
> 
> 
> Bugs: ATLAS-2444
> https://issues.apache.org/jira/browse/ATLAS-2444
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Update the HiveMetastoreBridge code and some test logic. 
> 
> HiveHookIT runs successfully after this patch
> 
> 
> Diffs
> -
> 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
>  3a775b60e 
>   addons/hive-bridge/src/test/java/org/apache/atlas/hive/HiveITBase.java 
> 01418cf30 
>   addons/hive-bridge/src/test/java/org/apache/atlas/hive/hook/HiveHookIT.java 
> 1b1ebec27 
>   common/src/main/java/org/apache/atlas/utils/HdfsNameServiceResolver.java 
> 60e192597 
> 
> 
> Diff: https://reviews.apache.org/r/65678/diff/1/
> 
> 
> Testing
> ---
> 
> mvn verify -pl addons/hive-bridge -am -Dit.test=HiveHookIT was successful
> 
> 
> Thanks,
> 
> Apoorv Naik
> 
>

[jira] [Commented] (ATLAS-2450) HBase Atlas Hook: Wrong creating time of NameSpace if they are create before enabling HBase hook

[Ramesh Mani (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366359#comment-16366359
 ] 

Ramesh Mani commented on ATLAS-2450:


[~madhan.neethiraj] we dont get any dates from the HBase Metadata for 
namespace, table, columnfamily and relay on the message creation time.  Patch I 
created is the existing way of find the create / update time.

Is that hbase issue then?

> HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
> enabling HBase hook
> 
>
> Key: ATLAS-2450
> URL: https://issues.apache.org/jira/browse/ATLAS-2450
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-intg
>Affects Versions: trunk, 0.8.2
>Reporter: Ramesh Mani
>Assignee: Ramesh Mani
>Priority: Major
>
> HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
> enabling HBase hook.
> 1) create namespace before enabling HBase Hook.
> 2) Enable HBase Hook
> 3) create the table on the same namespace.
> In these steps, propagation of namespace happens only when a table is added 
> to the namespace and during this time the create operation is create_table 
> and not namespace and hence the namespace never gets updated resulting in 
> this issue.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Review Request 65678: ATLAS-2444: Fix for appending cluster name only for HDFS paths

[Apoorv Naik]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65678/
---

Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2444
https://issues.apache.org/jira/browse/ATLAS-2444


Repository: atlas


Description
---

Update the HiveMetastoreBridge code and some test logic. 

HiveHookIT runs successfully after this patch


Diffs
-

  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
 3a775b60e 
  addons/hive-bridge/src/test/java/org/apache/atlas/hive/HiveITBase.java 
01418cf30 
  addons/hive-bridge/src/test/java/org/apache/atlas/hive/hook/HiveHookIT.java 
1b1ebec27 
  common/src/main/java/org/apache/atlas/utils/HdfsNameServiceResolver.java 
60e192597 


Diff: https://reviews.apache.org/r/65678/diff/1/


Testing
---

mvn verify -pl addons/hive-bridge -am -Dit.test=HiveHookIT was successful


Thanks,

Apoorv Naik

[jira] [Commented] (ATLAS-2450) HBase Atlas Hook: Wrong creating time of NameSpace if they are create before enabling HBase hook

[Madhan Neethiraj (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366344#comment-16366344
 ] 

Madhan Neethiraj commented on ATLAS-2450:
-

[~rmani], [~ssainath] - createTime value is not available from HBase API 
NameSpaceDescriptor 
([https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/NamespaceDescriptor.html).]
 Given this, Atlas hook won't be able to populate createTime field correctly - 
for namespaces that were created before Atlas hook was enabled.

> HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
> enabling HBase hook
> 
>
> Key: ATLAS-2450
> URL: https://issues.apache.org/jira/browse/ATLAS-2450
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-intg
>Affects Versions: trunk, 0.8.2
>Reporter: Ramesh Mani
>Assignee: Ramesh Mani
>Priority: Major
>
> HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
> enabling HBase hook.
> 1) create namespace before enabling HBase Hook.
> 2) Enable HBase Hook
> 3) create the table on the same namespace.
> In these steps, propagation of namespace happens only when a table is added 
> to the namespace and during this time the create operation is create_table 
> and not namespace and hence the namespace never gets updated resulting in 
> this issue.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 65677: ATLAS-2450 : HBase Atlas Hook: Wrong creating time of NameSpace if they are create before enabling HBase hook

[Madhan Neethiraj]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65677/#review197640
---




addons/hbase-bridge/src/main/java/org/apache/atlas/hbase/bridge/HBaseAtlasHook.java
Lines 429 (patched)


Wouldn't this reset createTime of namespaces when tables are created in the 
namespace?

NameSpaceDescriptor doesn't provide create/update time stamps. So, Atlas 
hook will not be able to populate these fields for namespaces that were created 
before Atlas hook was enabled. 
https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/NamespaceDescriptor.html


- Madhan Neethiraj


On Feb. 15, 2018, 7:06 p.m., Ramesh Mani wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/65677/
> ---
> 
> (Updated Feb. 15, 2018, 7:06 p.m.)
> 
> 
> Review request for atlas and Madhan Neethiraj.
> 
> 
> Bugs: ATLAS-2450
> https://issues.apache.org/jira/browse/ATLAS-2450
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-2450 : HBase Atlas Hook: Wrong creating time of NameSpace if they are 
> create before enabling HBase hook
> 
> 
> Diffs
> -
> 
>   
> addons/hbase-bridge/src/main/java/org/apache/atlas/hbase/bridge/HBaseAtlasHook.java
>  2074684 
> 
> 
> Diff: https://reviews.apache.org/r/65677/diff/1/
> 
> 
> Testing
> ---
> 
> Tested in local vm
> 
> 
> Thanks,
> 
> Ramesh Mani
> 
>

Review Request 65677: ATLAS-2450 : HBase Atlas Hook: Wrong creating time of NameSpace if they are create before enabling HBase hook

[Ramesh Mani]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65677/
---

Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2450
https://issues.apache.org/jira/browse/ATLAS-2450


Repository: atlas


Description
---

ATLAS-2450 : HBase Atlas Hook: Wrong creating time of NameSpace if they are 
create before enabling HBase hook


Diffs
-

  
addons/hbase-bridge/src/main/java/org/apache/atlas/hbase/bridge/HBaseAtlasHook.java
 2074684 


Diff: https://reviews.apache.org/r/65677/diff/1/


Testing
---

Tested in local vm


Thanks,

Ramesh Mani

Build failed in Jenkins: Atlas-master-IntegrationTests #533

[Apache Jenkins Server]

See 


--
[...truncated 626.43 KB...]
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.hook.HiveHookIT.assertProcessIsRegistered(HiveHookIT.java:1712)
at 
org.apache.atlas.hive.hook.HiveHookIT.testCreateView(HiveHookIT.java:366)

testDropView(org.apache.atlas.hive.hook.HiveHookIT)  Time elapsed: 80.34 sec  
<<< FAILURE!
java.lang.AssertionError: Assertions failed. Failing after waiting for timeout 
8 msecs
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithRetries(AtlasBaseClient.java:472)
at org.apache.atlas.AtlasClient.callAPIWithRetries(AtlasClient.java:931)
at org.apache.atlas.AtlasClient.getEntity(AtlasClient.java:640)
at org.apache.atlas.hive.HiveITBase$1.evaluate(HiveITBase.java:168)
at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:205)
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.HiveITBase.assertTableIsRegistered(HiveITBase.java:159)
at 
org.apache.atlas.hive.HiveITBase.assertTableIsRegistered(HiveITBase.java:153)
at 
org.apache.atlas.hive.hook.HiveHookIT.testDropView(HiveHookIT.java:1528)

testExportImportPartitionedTable(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 10.775 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/export-data-gtoenxqdos]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/export-data-gtoenxqdos@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateOutputTables(HiveHookIT.java:253)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:498)
at 
org.apache.atlas.hive.hook.HiveHookIT.testExportImportPartitionedTable(HiveHookIT.java:789)

testExportImportUnPartitionedTable(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 85.55 sec  <<< FAILURE!
java.lang.AssertionError: Assertions failed. Failing after waiting for timeout 
8 msecs
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithRetries(AtlasBaseClient.java:472)
at org.apache.atlas.AtlasClient.callAPIWithRetries(AtlasClient.java:931)
at org.apache.atlas.AtlasClient.getEntity(AtlasClient.java:640)
at org.apache.atlas.hive.HiveITBase$1.evaluate(HiveITBase.java:168)
at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:205)
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.hook.HiveHookIT.assertProcessIsRegistered(HiveHookIT.java:1737)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:485)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:505)
at 
org.apache.atlas.hive.hook.HiveHookIT.testExportImportUnPartitionedTable(HiveHookIT.java:736)

testInsertIntoDFSDirPartitioned(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 7.193 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/somedfspath1-data-feam2puglh]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/somedfspath1-data-feam2puglh@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateOutputTables(HiveHookIT.java:253)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:498)
at 
org.apache.atlas.hive.hook.HiveHookIT.testInsertIntoDFSDirPartitioned(HiveHookIT.java:636)

testLoadDFSPathPartitioned(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 10.542 sec  <<< FAILURE!
java.lang.AssertionError: expected 

Re: Review Request 63502: ATLAS-2246 - Review request for the OMRS Connector API.

[Mandy Chessell]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63502/
---

(Updated Feb. 15, 2018, 7:03 p.m.)


Review request for atlas, David Radley and Madhan Neethiraj.


Repository: atlas


Description
---

This is a request for code review of the OMRS.  There are still parts of the 
code not written - the aim of the review is to make the connector interfaces 
available so they can be evaluated by teams buinding components against the 
APIs.

There is a patch connected to 
https://issues.apache.org/jira/projects/ATLAS/issues/ATLAS-2246 that has the 
code plus other code that is not ready for review.  The OMRS Connector API 
depends on the OCF - see https://issues.apache.org/jira/browse/ATLAS-1095.


Diffs
-

  om-fwk-ocf/src/main/java/org/apache/atlas/ocf/ConnectorBase.java cc2e430 
  om-fwk-ocf/src/main/java/org/apache/atlas/ocf/ConnectorProviderBase.java 
fafd20c 
  om-fwk-ocf/src/main/java/org/apache/atlas/ocf/properties/Connection.java 
d34e6f4 
  om-fwk-ocf/src/main/java/org/apache/atlas/ocf/properties/KeyPattern.java 
ce6dae1 
  omrs/README.md PRE-CREATION 
  omrs/pom.xml PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/eventmapper/AtlasOMRSRepositoryEventMapper.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/eventmapper/AtlasOMRSRepositoryEventMapperProvider.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSMetadataCollection.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSRepositoryConnector.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSRepositoryConnectorProvider.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/eventmapper/IGCOMRSRepositoryEventMapper.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/eventmapper/IGCOMRSRepositoryEventMapperProvider.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSMetadataCollection.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSRepositoryConnector.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSRepositoryConnectorProvider.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/eventmapper/IGCV2OMRSRepositoryEventMapper.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/eventmapper/IGCV2OMRSRepositoryEventMapperProvider.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSMetadataCollection.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSRepositoryConnector.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSRepositoryConnectorProvider.java
 PRE-CREATION 
  omrs/src/main/java/org/apache/atlas/omrs/admin/OMRSConfigurationFactory.java 
PRE-CREATION 
  omrs/src/main/java/org/apache/atlas/omrs/admin/OMRSOperationalServices.java 
PRE-CREATION 
  omrs/src/main/java/org/apache/atlas/omrs/admin/properties/CohortConfig.java 
PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/admin/properties/EnterpriseAccessConfig.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/admin/properties/LocalRepositoryConfig.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/admin/properties/OpenMetadataEventProtocolVersion.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/admin/properties/OpenMetadataExchangeRule.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/admin/properties/RepositoryServicesConfig.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/OMRSArchiveBuilder.java 
PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/OMRSArchiveManager.java 
PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/opentypes/OpenMetadataTypesArchive.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchive.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchiveInstanceStore.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchiveProperties.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchiveType.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchiveTypeStore.java
 PRE-CREATION 
  

[jira] [Created] (ATLAS-2450) HBase Atlas Hook: Wrong creating time of NameSpace if they are create before enabling HBase hook

[Ramesh Mani (JIRA)]

Ramesh Mani created ATLAS-2450:
--

 Summary: HBase Atlas Hook: Wrong creating time of NameSpace if 
they are create before enabling HBase hook
 Key: ATLAS-2450
 URL: https://issues.apache.org/jira/browse/ATLAS-2450
 Project: Atlas
  Issue Type: Bug
  Components: atlas-intg
Affects Versions: 0.8.2, trunk
Reporter: Ramesh Mani


HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
enabling HBase hook.

1) create namespace before enabling HBase Hook.

2) Enable HBase Hook

3) create the table on the same namespace.

In these steps, propagation of namespace happens only when a table is added to 
the namespace and during this time the create operation is create_table and not 
namespace and hence the namespace never gets updated resulting in this issue.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (ATLAS-2450) HBase Atlas Hook: Wrong creating time of NameSpace if they are create before enabling HBase hook

[Ramesh Mani (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ramesh Mani reassigned ATLAS-2450:
--

Assignee: Ramesh Mani

> HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
> enabling HBase hook
> 
>
> Key: ATLAS-2450
> URL: https://issues.apache.org/jira/browse/ATLAS-2450
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-intg
>Affects Versions: trunk, 0.8.2
>Reporter: Ramesh Mani
>Assignee: Ramesh Mani
>Priority: Major
>
> HBase Atlas Hook: Wrong creating time of NameSpace if they are create before 
> enabling HBase hook.
> 1) create namespace before enabling HBase Hook.
> 2) Enable HBase Hook
> 3) create the table on the same namespace.
> In these steps, propagation of namespace happens only when a table is added 
> to the namespace and during this time the create operation is create_table 
> and not namespace and hence the namespace never gets updated resulting in 
> this issue.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 63502: ATLAS-2246 - Review request for the OMRS Connector API.

[Jerry He]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63502/#review197628
---



Can we put the omrs module in the top level pom so that it builds the omrs 
module?

- Jerry He


On Feb. 15, 2018, 4:49 a.m., Mandy Chessell wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63502/
> ---
> 
> (Updated Feb. 15, 2018, 4:49 a.m.)
> 
> 
> Review request for atlas, David Radley and Madhan Neethiraj.
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This is a request for code review of the OMRS.  There are still parts of the 
> code not written - the aim of the review is to make the connector interfaces 
> available so they can be evaluated by teams buinding components against the 
> APIs.
> 
> There is a patch connected to 
> https://issues.apache.org/jira/projects/ATLAS/issues/ATLAS-2246 that has the 
> code plus other code that is not ready for review.  The OMRS Connector API 
> depends on the OCF - see https://issues.apache.org/jira/browse/ATLAS-1095.
> 
> 
> Diffs
> -
> 
>   om-fwk-ocf/src/main/java/org/apache/atlas/ocf/ConnectorBase.java cc2e430 
>   om-fwk-ocf/src/main/java/org/apache/atlas/ocf/ConnectorProviderBase.java 
> fafd20c 
>   om-fwk-ocf/src/main/java/org/apache/atlas/ocf/properties/Connection.java 
> d34e6f4 
>   om-fwk-ocf/src/main/java/org/apache/atlas/ocf/properties/KeyPattern.java 
> ce6dae1 
>   omrs/README.md PRE-CREATION 
>   omrs/pom.xml PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/eventmapper/AtlasOMRSRepositoryEventMapper.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/eventmapper/AtlasOMRSRepositoryEventMapperProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSMetadataCollection.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSRepositoryConnector.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSRepositoryConnectorProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/eventmapper/IGCOMRSRepositoryEventMapper.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/eventmapper/IGCOMRSRepositoryEventMapperProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSMetadataCollection.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSRepositoryConnector.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSRepositoryConnectorProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/eventmapper/IGCV2OMRSRepositoryEventMapper.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/eventmapper/IGCV2OMRSRepositoryEventMapperProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSMetadataCollection.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSRepositoryConnector.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSRepositoryConnectorProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/OMRSConfigurationFactory.java 
> PRE-CREATION 
>   omrs/src/main/java/org/apache/atlas/omrs/admin/OMRSOperationalServices.java 
> PRE-CREATION 
>   omrs/src/main/java/org/apache/atlas/omrs/admin/properties/CohortConfig.java 
> PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/properties/EnterpriseAccessConfig.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/properties/LocalRepositoryConfig.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/properties/OpenMetadataEventProtocolVersion.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/properties/OpenMetadataExchangeRule.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/properties/RepositoryServicesConfig.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/archivemanager/OMRSArchiveBuilder.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/archivemanager/OMRSArchiveManager.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/archivemanager/opentypes/OpenMetadataTypesArchive.java
>  PRE-CREATION 
>   
> 

Attempting to run Atlas with external HBase

[David Radley]

Hi Madhan,
Based on our meeting earlier this week, you suggested that we run with an 
external HBase rather than the embedded HBase, which you have found has 
delays around some transaction commits.
I am not very familiar with HBase and wondered if you could point me in 
the right direction. This is what I did:

1) I ran an embedded hbase build and found the solr and hbase tar.gz files
2) I then expanded these archives in a new runtime folder
3) I built Atlas without the embedded hbase option and then copied over 
the atlas tree into the runtime folder.
4)  I found https://atlas.apache.org/InstallationSteps.html .
- It indicates I should specify export ATLAS_SERVER_OPTS="-server 
-XX:SoftRefLRUPolicyMSPerMB=0 -XX:+CMSClassUnloadingEnabled 
-XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled 
-XX:+PrintTenuringDistribution -XX:+HeapDumpOnOutOfMemoryError 
-XX:HeapDumpPath=dumps/atlas_server.hprof -Xloggc:logs/gc-worker.log 
-verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 
-XX:GCLogFileSize=1m -XX:+PrintGCDetails -XX:+PrintHeapAtGC 
-XX:+PrintGCTimeStamps"
which I put in the atlas_env.sh
- As I am on a mac it suggests I specify  :
export ATLAS_SERVER_OPTS="-Djava.awt.headless=true 
-Djava.security.krb5.realm= -Djava.security.krb5.kdc="
 which I did.
- It says I should change the config to: 
"atlas.graph.storage.hbase.table=atlas
atlas.audit.hbase.tablename=apache_atlas_entity_audit
"
Is this correct - as the application.properties that has been generated is 
"atlas.graph.storage.hbase.table=apache_atlas_titan". 
- It says I should start solr with "$SOLR_HOME/bin/solr start -c -
z  -p 8983". I do not know what to put in for <
zookeeper_host:port>. Do I need to specify this if I am using the solr 
embedded zookeeper?
- It then says I should run
"  $SOLR_BIN/solr create -c vertex_index -d SOLR_CONF -shards #numShards 
-replicationFactor #replicationFactor
  $SOLR_BIN/solr create -c edge_index -d SOLR_CONF -shards #numShards 
-replicationFactor #replicationFactor
  $SOLR_BIN/solr create -c fulltext_index -d SOLR_CONF -shards #numShards 
-replicationFactor #replicationFactor"
It seems I need to specify numbers for numshards and 
replicationFactor, can I let these default, if not what do I specify here?
- It then says I need to specify 
"atlas.graph.index.search.backend=solr5
 atlas.graph.index.search.solr.mode=cloud
 atlas.graph.index.search.solr.zookeeper-url= eg: 10.1.6.4:2181,10.1.6.5:2181
 atlas.graph.index.search.solr.zookeeper-connect-timeout=. Default value is 6 ms
 atlas.graph.index.search.solr.zookeeper-session-timeout=. Default value is 6 ms"

I am not sure what to put for atlas.graph.index.search.solr.zookeeper-url. 
should we be using the solr embedded ZK - if do I need this line?

I updated HBASE_CONF_DIR to point to the conf folder of the hbase I had 
expanded. 

I start solr using $SOLR_HOME/bin/solr start -c -p 8983
I start hbase 
I start atlas.

Atlas says it successfully has started but the last line in the 
application.log says :

2018-02-15 17:25:23,755 INFO  - [main:] ~ Not running setup per 
configuration atlas.server.run.setup.on.start. 
(SetupSteps$SetupRequired:189)

The installation twiki talks of "If the setup failed due to HBase 
JanusGraph schema setup errors, it may be necessary to repair the HBase 
schema. If no
data has been stored, one can also disable and drop the HBase tables used 
by Atlas and run setup again." . It does not indicate what commands I need 
to run and how. 


many thanks , David. 






 


 
Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
741598. 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

Build failed in Jenkins: Atlas-master-IntegrationTests #532

[Apache Jenkins Server]

See 


--
[...truncated 629.85 KB...]
at org.apache.atlas.hive.HiveITBase$1.evaluate(HiveITBase.java:168)
at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:205)
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.HiveITBase.assertTableIsRegistered(HiveITBase.java:159)
at 
org.apache.atlas.hive.HiveITBase.assertTableIsRegistered(HiveITBase.java:153)
at 
org.apache.atlas.hive.hook.HiveHookIT.testDropView(HiveHookIT.java:1528)

testExportImportPartitionedTable(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 10.901 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/export-data-q6uzo57sut]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/export-data-q6uzo57sut@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateOutputTables(HiveHookIT.java:253)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:498)
at 
org.apache.atlas.hive.hook.HiveHookIT.testExportImportPartitionedTable(HiveHookIT.java:789)

testExportImportUnPartitionedTable(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 85.418 sec  <<< FAILURE!
java.lang.AssertionError: Assertions failed. Failing after waiting for timeout 
8 msecs
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithRetries(AtlasBaseClient.java:472)
at org.apache.atlas.AtlasClient.callAPIWithRetries(AtlasClient.java:931)
at org.apache.atlas.AtlasClient.getEntity(AtlasClient.java:640)
at org.apache.atlas.hive.HiveITBase$1.evaluate(HiveITBase.java:168)
at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:205)
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.hook.HiveHookIT.assertProcessIsRegistered(HiveHookIT.java:1737)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:485)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:505)
at 
org.apache.atlas.hive.hook.HiveHookIT.testExportImportUnPartitionedTable(HiveHookIT.java:736)

testInsertIntoDFSDirPartitioned(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 7.186 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/somedfspath1-data-izxnfrioyh]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/somedfspath1-data-izxnfrioyh@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateOutputTables(HiveHookIT.java:253)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:498)
at 
org.apache.atlas.hive.hook.HiveHookIT.testInsertIntoDFSDirPartitioned(HiveHookIT.java:636)

testLoadDFSPathPartitioned(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 10.535 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/loaddfsfile-data-oflrixjmda]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/loaddfsfile-data-oflrixjmda@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateInputTables(HiveHookIT.java:257)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:491)
at 
org.apache.atlas.hive.hook.HiveHookIT.testLoadDFSPathPartitioned(HiveHookIT.java:458)

Jenkins build is back to normal : Atlas-master-UnitTests #525

[Apache Jenkins Server]

See 

Re: Review Request 63502: ATLAS-2246 - Review request for the OMRS Connector API.

[David Radley]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63502/#review197619
---


Ship it!




Ship It!

- David Radley


On Feb. 15, 2018, 12:49 p.m., Mandy Chessell wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63502/
> ---
> 
> (Updated Feb. 15, 2018, 12:49 p.m.)
> 
> 
> Review request for atlas, David Radley and Madhan Neethiraj.
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This is a request for code review of the OMRS.  There are still parts of the 
> code not written - the aim of the review is to make the connector interfaces 
> available so they can be evaluated by teams buinding components against the 
> APIs.
> 
> There is a patch connected to 
> https://issues.apache.org/jira/projects/ATLAS/issues/ATLAS-2246 that has the 
> code plus other code that is not ready for review.  The OMRS Connector API 
> depends on the OCF - see https://issues.apache.org/jira/browse/ATLAS-1095.
> 
> 
> Diffs
> -
> 
>   om-fwk-ocf/src/main/java/org/apache/atlas/ocf/ConnectorBase.java cc2e430 
>   om-fwk-ocf/src/main/java/org/apache/atlas/ocf/ConnectorProviderBase.java 
> fafd20c 
>   om-fwk-ocf/src/main/java/org/apache/atlas/ocf/properties/Connection.java 
> d34e6f4 
>   om-fwk-ocf/src/main/java/org/apache/atlas/ocf/properties/KeyPattern.java 
> ce6dae1 
>   omrs/README.md PRE-CREATION 
>   omrs/pom.xml PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/eventmapper/AtlasOMRSRepositoryEventMapper.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/eventmapper/AtlasOMRSRepositoryEventMapperProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSMetadataCollection.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSRepositoryConnector.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSRepositoryConnectorProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/eventmapper/IGCOMRSRepositoryEventMapper.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/eventmapper/IGCOMRSRepositoryEventMapperProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSMetadataCollection.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSRepositoryConnector.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSRepositoryConnectorProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/eventmapper/IGCV2OMRSRepositoryEventMapper.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/eventmapper/IGCV2OMRSRepositoryEventMapperProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSMetadataCollection.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSRepositoryConnector.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSRepositoryConnectorProvider.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/OMRSConfigurationFactory.java 
> PRE-CREATION 
>   omrs/src/main/java/org/apache/atlas/omrs/admin/OMRSOperationalServices.java 
> PRE-CREATION 
>   omrs/src/main/java/org/apache/atlas/omrs/admin/properties/CohortConfig.java 
> PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/properties/EnterpriseAccessConfig.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/properties/LocalRepositoryConfig.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/properties/OpenMetadataEventProtocolVersion.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/properties/OpenMetadataExchangeRule.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/admin/properties/RepositoryServicesConfig.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/archivemanager/OMRSArchiveBuilder.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/archivemanager/OMRSArchiveManager.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/archivemanager/opentypes/OpenMetadataTypesArchive.java
>  PRE-CREATION 
>   
> omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchive.java
>  

[jira] [Created] (ATLAS-2449) Latest master atlas does not build cleanly with tests enabled locally on Mac

[David Radley (JIRA)]

David Radley created ATLAS-2449:
---

 Summary: Latest master atlas does not build cleanly with tests 
enabled locally on Mac
 Key: ATLAS-2449
 URL: https://issues.apache.org/jira/browse/ATLAS-2449
 Project: Atlas
  Issue Type: Bug
Reporter: David Radley


I run mvn clean install -Pdist,embedded-hbase-solr

And it fails with:

127.0.0.1 - - [15/Feb/2018:14:06:01 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/hive_table_v1 HTTP/1.1" 503 
372 "-" "Java/1.8.0_151"
127.0.0.1 - - [15/Feb/2018:14:06:06 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/hive_table_v1 HTTP/1.1" 503 
372 "-" "Java/1.8.0_151"
127.0.0.1 - - [15/Feb/2018:14:06:11 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 503 
374 "-" "Java/1.8.0_151"
127.0.0.1 - - [15/Feb/2018:14:06:16 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 503 
374 "-" "Java/1.8.0_151"
127.0.0.1 - - [15/Feb/2018:14:06:21 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 503 
374 "-" "Java/1.8.0_151"
127.0.0.1 - - [15/Feb/2018:14:06:26 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 503 
374 "-" "Java/1.8.0_151"
127.0.0.1 - - [15/Feb/2018:14:06:31 +] "POST 
//localhost:31000/api/atlas/types HTTP/1.1" 503 342 "-" "Java/1.8.0_151"
127.0.0.1 - - [15/Feb/2018:14:06:36 +] "POST 
//localhost:31000/api/atlas/types HTTP/1.1" 503 342 "-" "Java/1.8.0_151"
127.0.0.1 - - [15/Feb/2018:14:06:41 +] "POST 
//localhost:31000/api/atlas/types HTTP/1.1" 503 342 "-" "Java/1.8.0_151"
127.0.0.1 - - [15/Feb/2018:14:06:46 +] "POST 
//localhost:31000/api/atlas/types HTTP/1.1" 503 342 "-" "Java/1.8.0_151"
Tests run: 143, Failures: 11, Errors: 0, Skipped: 125, Time elapsed: 2,422.962 
sec <<< FAILURE! - in TestSuite
setUp(org.apache.atlas.web.integration.DataSetLineageJerseyResourceIT)  Time 
elapsed: 510.086 sec  <<< FAILURE!
org.apache.atlas.AtlasServiceException: Metadata service API 
org.apache.atlas.AtlasClient$API_V1@5161ae92 failed with status 503 (Service 
Unavailable) Response Body (


Error 503 


HTTP ERROR: 503
Problem accessing /api/atlas/types. Reason:
    Service Unavailable
http://eclipse.org/jetty;>Powered by Jetty:// 
9.3.14.v20161028


)
    at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
    at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
    at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:211)
    at org.apache.atlas.AtlasClient.callAPIWithBody(AtlasClient.java:906)
    at org.apache.atlas.AtlasClient.createType(AtlasClient.java:257)
    at org.apache.atlas.AtlasClient.createType(AtlasClient.java:275)
    at 
org.apache.atlas.web.integration.BaseResourceIT.createType(BaseResourceIT.java:213)
    at 
org.apache.atlas.web.integration.BaseResourceIT.createTypeDefinitionsV1(BaseResourceIT.java:360)
    at 
org.apache.atlas.web.integration.DataSetLineageJerseyResourceIT.setUp(DataSetLineageJerseyResourceIT.java:60)

setUp(org.apache.atlas.notification.NotificationHookConsumerIT)  Time elapsed: 
362.578 sec  <<< FAILURE!
org.apache.atlas.AtlasServiceException: Metadata service API 
org.apache.atlas.AtlasClient$API_V1@5161ae92 failed with status 503 (Service 
Unavailable) Response Body (


Error 503 


HTTP ERROR: 503
Problem accessing /api/atlas/types. Reason:
    Service Unavailable
http://eclipse.org/jetty;>Powered by Jetty:// 
9.3.14.v20161028


)
    at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
    at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
    at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:211)
    at org.apache.atlas.AtlasClient.callAPIWithBody(AtlasClient.java:906)
    at org.apache.atlas.AtlasClient.createType(AtlasClient.java:257)
    at org.apache.atlas.AtlasClient.createType(AtlasClient.java:275)
    at 
org.apache.atlas.web.integration.BaseResourceIT.createType(BaseResourceIT.java:213)
    at 
org.apache.atlas.web.integration.BaseResourceIT.createTypeDefinitionsV1(BaseResourceIT.java:360)
    at 
org.apache.atlas.notification.NotificationHookConsumerIT.setUp(NotificationHookConsumerIT.java:54)

testAccessforUnauthenticatedResource(org.apache.atlas.web.filters.AtlasAuthenticationSimpleFilterIT)
  Time elapsed: 0.003 sec  <<< FAILURE!
java.lang.AssertionError: expected [200] but found [503]
    at org.testng.Assert.fail(Assert.java:94)
    at org.testng.Assert.failNotEquals(Assert.java:496)
    at org.testng.Assert.assertEquals(Assert.java:125)
    at org.testng.Assert.assertEquals(Assert.java:372)
    at org.testng.Assert.assertEquals(Assert.java:382)
    at 

Build failed in Jenkins: Atlas-master-IntegrationTests #531

[Apache Jenkins Server]

See 


--
[...truncated 626.65 KB...]
at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:205)
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.HiveITBase.assertTableIsRegistered(HiveITBase.java:159)
at 
org.apache.atlas.hive.HiveITBase.assertTableIsRegistered(HiveITBase.java:153)
at 
org.apache.atlas.hive.hook.HiveHookIT.testDropView(HiveHookIT.java:1528)

testExportImportPartitionedTable(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 10.998 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/export-data-onmx9mtdu7]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/export-data-onmx9mtdu7@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateOutputTables(HiveHookIT.java:253)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:498)
at 
org.apache.atlas.hive.hook.HiveHookIT.testExportImportPartitionedTable(HiveHookIT.java:789)

testExportImportUnPartitionedTable(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 85.523 sec  <<< FAILURE!
java.lang.AssertionError: Assertions failed. Failing after waiting for timeout 
8 msecs
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithRetries(AtlasBaseClient.java:472)
at org.apache.atlas.AtlasClient.callAPIWithRetries(AtlasClient.java:931)
at org.apache.atlas.AtlasClient.getEntity(AtlasClient.java:640)
at org.apache.atlas.hive.HiveITBase$1.evaluate(HiveITBase.java:168)
at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:205)
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.hook.HiveHookIT.assertProcessIsRegistered(HiveHookIT.java:1737)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:485)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:505)
at 
org.apache.atlas.hive.hook.HiveHookIT.testExportImportUnPartitionedTable(HiveHookIT.java:736)

testInsertIntoDFSDirPartitioned(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 7.021 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/somedfspath1-data-eezasvly4k]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/somedfspath1-data-eezasvly4k@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateOutputTables(HiveHookIT.java:253)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:498)
at 
org.apache.atlas.hive.hook.HiveHookIT.testInsertIntoDFSDirPartitioned(HiveHookIT.java:636)

testLoadDFSPathPartitioned(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 10.691 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/loaddfsfile-data-nxgyrajyhl]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/loaddfsfile-data-nxgyrajyhl@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateInputTables(HiveHookIT.java:257)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:491)
at 
org.apache.atlas.hive.hook.HiveHookIT.testLoadDFSPathPartitioned(HiveHookIT.java:458)

testUpdateProcess(org.apache.atlas.hive.hook.HiveHookIT)  Time elapsed: 7.528 
sec  <<< FAILURE!

Re: Review Request 63502: ATLAS-2246 - Review request for the OMRS Connector API.

[Mandy Chessell]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63502/
---

(Updated Feb. 15, 2018, 12:49 p.m.)


Review request for atlas, David Radley and Madhan Neethiraj.


Changes
---

This should be the version we hope to commit to Atlas


Repository: atlas


Description
---

This is a request for code review of the OMRS.  There are still parts of the 
code not written - the aim of the review is to make the connector interfaces 
available so they can be evaluated by teams buinding components against the 
APIs.

There is a patch connected to 
https://issues.apache.org/jira/projects/ATLAS/issues/ATLAS-2246 that has the 
code plus other code that is not ready for review.  The OMRS Connector API 
depends on the OCF - see https://issues.apache.org/jira/browse/ATLAS-1095.


Diffs (updated)
-

  om-fwk-ocf/src/main/java/org/apache/atlas/ocf/ConnectorBase.java cc2e430 
  om-fwk-ocf/src/main/java/org/apache/atlas/ocf/ConnectorProviderBase.java 
fafd20c 
  om-fwk-ocf/src/main/java/org/apache/atlas/ocf/properties/Connection.java 
d34e6f4 
  om-fwk-ocf/src/main/java/org/apache/atlas/ocf/properties/KeyPattern.java 
ce6dae1 
  omrs/README.md PRE-CREATION 
  omrs/pom.xml PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/eventmapper/AtlasOMRSRepositoryEventMapper.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/eventmapper/AtlasOMRSRepositoryEventMapperProvider.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSMetadataCollection.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSRepositoryConnector.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/atlas/repositoryconnector/LocalAtlasOMRSRepositoryConnectorProvider.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/eventmapper/IGCOMRSRepositoryEventMapper.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/eventmapper/IGCOMRSRepositoryEventMapperProvider.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSMetadataCollection.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSRepositoryConnector.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v1/repositoryconnector/IGCOMRSRepositoryConnectorProvider.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/eventmapper/IGCV2OMRSRepositoryEventMapper.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/eventmapper/IGCV2OMRSRepositoryEventMapperProvider.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSMetadataCollection.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSRepositoryConnector.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/adapters/igc/v2/repositoryconnector/IGCV2OMRSRepositoryConnectorProvider.java
 PRE-CREATION 
  omrs/src/main/java/org/apache/atlas/omrs/admin/OMRSConfigurationFactory.java 
PRE-CREATION 
  omrs/src/main/java/org/apache/atlas/omrs/admin/OMRSOperationalServices.java 
PRE-CREATION 
  omrs/src/main/java/org/apache/atlas/omrs/admin/properties/CohortConfig.java 
PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/admin/properties/EnterpriseAccessConfig.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/admin/properties/LocalRepositoryConfig.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/admin/properties/OpenMetadataEventProtocolVersion.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/admin/properties/OpenMetadataExchangeRule.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/admin/properties/RepositoryServicesConfig.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/OMRSArchiveBuilder.java 
PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/OMRSArchiveManager.java 
PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/opentypes/OpenMetadataTypesArchive.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchive.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchiveInstanceStore.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchiveProperties.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchiveType.java
 PRE-CREATION 
  
omrs/src/main/java/org/apache/atlas/omrs/archivemanager/properties/OpenMetadataArchiveTypeStore.java
 

[jira] [Updated] (ATLAS-2246) Define OMRS Connector interface

[Mandy Chessell (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mandy Chessell updated ATLAS-2246:
--
Attachment: (was: 
0001-ATLAS-2246-OMRS-Connector-API-plus-REST-and-IGC-Conn.patch)

> Define OMRS Connector interface
> ---
>
> Key: ATLAS-2246
> URL: https://issues.apache.org/jira/browse/ATLAS-2246
> Project: Atlas
>  Issue Type: Sub-task
>  Components: atlas-intg
>Reporter: Mandy Chessell
>Assignee: Mandy Chessell
>Priority: Critical
> Attachments: 
> 0001-ATLAS-2246-OMRS-Connector-API-plus-REST-and-IGC-Conn.patch, OMRS 
> Javadoc.zip
>
>
> This task covers the creation of the OMRS Connector APIs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2246) Define OMRS Connector interface

[Mandy Chessell (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mandy Chessell updated ATLAS-2246:
--
Attachment: 0001-ATLAS-2246-OMRS-Connector-API-plus-REST-and-IGC-Conn.patch

> Define OMRS Connector interface
> ---
>
> Key: ATLAS-2246
> URL: https://issues.apache.org/jira/browse/ATLAS-2246
> Project: Atlas
>  Issue Type: Sub-task
>  Components: atlas-intg
>Reporter: Mandy Chessell
>Assignee: Mandy Chessell
>Priority: Critical
> Attachments: 
> 0001-ATLAS-2246-OMRS-Connector-API-plus-REST-and-IGC-Conn.patch, OMRS 
> Javadoc.zip
>
>
> This task covers the creation of the OMRS Connector APIs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: Atlas-master-UnitTests #524

[Apache Jenkins Server]

See 

--
[...truncated 2.39 KB...]
+ mvn -version
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=1024m; 
support was removed in 8.0
Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 
2017-04-03T19:39:06Z)
Maven home: /home/jenkins/tools/maven/latest
Java version: 1.8.0_144, vendor: Oracle Corporation
Java home: /usr/local/asfpackages/java/jdk1.8.0_144/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-89-generic", arch: "amd64", family: "unix"
+ java -version
java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)
+ env
BUILD_URL=https://builds.apache.org/job/Atlas-master-UnitTests/524/
XDG_SESSION_ID=217
ROOT_BUILD_CAUSE_TIMERTRIGGER=true
HUDSON_SERVER_COOKIE=f4ebd1e6b0d976e8
SHELL=/bin/bash
SSH_CLIENT=62.210.60.235 60244 22
BUILD_TAG=jenkins-Atlas-master-UnitTests-524
GIT_PREVIOUS_COMMIT=4152bc6d5247e6abf11d9e5d7b34e26f6da3511e
ROOT_BUILD_CAUSE=TIMERTRIGGER
WORKSPACE=
JOB_URL=https://builds.apache.org/job/Atlas-master-UnitTests/
RUN_CHANGES_DISPLAY_URL=https://builds.apache.org/job/Atlas-master-UnitTests/524/display/redirect?page=changes
USER=jenkins
GIT_AUTHOR_NAME=jenkins
GIT_COMMITTER_NAME=jenkins
MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat
GIT_COMMIT=4152bc6d5247e6abf11d9e5d7b34e26f6da3511e
JENKINS_HOME=/x1/jenkins/jenkins-home
MAIL=/var/mail/jenkins
PATH=/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/maven/latest/bin:/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
RUN_DISPLAY_URL=https://builds.apache.org/job/Atlas-master-UnitTests/524/display/redirect
GIT_COMMITTER_EMAIL=bui...@apache.org
PWD=
JAVA_HOME=/home/jenkins/tools/java/latest1.8
HUDSON_URL=https://builds.apache.org/
LANG=en_US
JOB_NAME=Atlas-master-UnitTests
XFILESEARCHPATH=/usr/dt/app-defaults/%L/Dt
BUILD_DISPLAY_NAME=#524
BUILD_CAUSE=TIMERTRIGGER
BUILD_ID=524
JENKINS_URL=https://builds.apache.org/
WIN_LABEL=Windows
JOB_BASE_NAME=Atlas-master-UnitTests
GIT_PREVIOUS_SUCCESSFUL_COMMIT=4152bc6d5247e6abf11d9e5d7b34e26f6da3511e
HOME=/home/jenkins
SHLVL=2
GIT_BRANCH=origin/master
EXECUTOR_NUMBER=1
JENKINS_SERVER_COOKIE=f4ebd1e6b0d976e8
GIT_URL=https://github.com/apache/atlas.git
NODE_LABELS=H18 Hadoop xenial
LOGNAME=jenkins
SSH_CONNECTION=62.210.60.235 60244 67.195.81.138 22
HUDSON_HOME=/x1/jenkins/jenkins-home
NODE_NAME=H18
BUILD_CAUSE_TIMERTRIGGER=true
NIX_LABEL=ubuntu
BUILD_NUMBER=524
JOB_DISPLAY_URL=https://builds.apache.org/job/Atlas-master-UnitTests/display/redirect
XDG_RUNTIME_DIR=/run/user/910
HUDSON_COOKIE=3687d977-b500-4562-b1d5-93e84442b607
GIT_AUTHOR_EMAIL=bui...@apache.org
_=/usr/bin/env
+ mvn clean package -DskipITs
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=1024m; 
support was removed in 8.0
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.atlas:atlas-graphdb-titan0:jar:1.0.0-SNAPSHOT
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must 
be unique: org.apache.solr:solr-solrj:jar -> version (?) vs ${solr.version} @ 
org.apache.atlas:atlas-graphdb-titan0:[unknown-version], 

 line 194, column 21
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must 
be unique: org.apache.solr:solr-core:jar -> version (?) vs ${solr.version} @ 
org.apache.atlas:atlas-graphdb-titan0:[unknown-version], 

 line 200, column 21
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.atlas:hive-bridge:jar:1.0.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found 
duplicate declaration of plugin org.apache.maven.plugins:maven-resources-plugin 
@ org.apache.atlas:hive-bridge:[unknown-version], 

 line 478, column 21
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.atlas:falcon-bridge:jar:1.0.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found 
duplicate declaration of plugin org.apache.maven.plugins:maven-resources-plugin 
@ org.apache.atlas:falcon-bridge:[unknown-version], 

 line 370, column 21
[WARNING] 
[WARNING] Some problems were encountered while 

Build failed in Jenkins: Atlas-master-IntegrationTests #529

[Apache Jenkins Server]

See 


Changes:

[nixon] ATLAS-2442:- Fix for read-only permission to allow read entity when http

[madhan] ATLAS-2448: added default values for JanusGraph cache configurations to

--
[...truncated 625.63 KB...]
at org.apache.atlas.hive.HiveITBase$1.evaluate(HiveITBase.java:168)
at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:205)
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.HiveITBase.assertTableIsRegistered(HiveITBase.java:159)
at 
org.apache.atlas.hive.HiveITBase.assertTableIsRegistered(HiveITBase.java:153)
at 
org.apache.atlas.hive.hook.HiveHookIT.testDropView(HiveHookIT.java:1528)

testExportImportPartitionedTable(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 10.824 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/export-data-fjxktxhh4r]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/export-data-fjxktxhh4r@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateOutputTables(HiveHookIT.java:253)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:498)
at 
org.apache.atlas.hive.hook.HiveHookIT.testExportImportPartitionedTable(HiveHookIT.java:789)

testExportImportUnPartitionedTable(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 85.55 sec  <<< FAILURE!
java.lang.AssertionError: Assertions failed. Failing after waiting for timeout 
8 msecs
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
at 
org.apache.atlas.AtlasBaseClient.callAPIWithRetries(AtlasBaseClient.java:472)
at org.apache.atlas.AtlasClient.callAPIWithRetries(AtlasClient.java:931)
at org.apache.atlas.AtlasClient.getEntity(AtlasClient.java:640)
at org.apache.atlas.hive.HiveITBase$1.evaluate(HiveITBase.java:168)
at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:205)
at 
org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:165)
at 
org.apache.atlas.hive.hook.HiveHookIT.assertProcessIsRegistered(HiveHookIT.java:1737)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:485)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:505)
at 
org.apache.atlas.hive.hook.HiveHookIT.testExportImportUnPartitionedTable(HiveHookIT.java:736)

testInsertIntoDFSDirPartitioned(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 7.479 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/somedfspath1-data-5hkuetybox]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/somedfspath1-data-5hkuetybox@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateOutputTables(HiveHookIT.java:253)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateProcess(HiveHookIT.java:498)
at 
org.apache.atlas.hive.hook.HiveHookIT.testInsertIntoDFSDirPartitioned(HiveHookIT.java:636)

testLoadDFSPathPartitioned(org.apache.atlas.hive.hook.HiveHookIT)  Time 
elapsed: 10.608 sec  <<< FAILURE!
java.lang.AssertionError: expected 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/loaddfsfile-data-0ctrnth1zr]
 but found 
[pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/loaddfsfile-data-0ctrnth1zr@primary]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:496)
at org.testng.Assert.assertEquals(Assert.java:125)
at org.testng.Assert.assertEquals(Assert.java:167)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateTables(HiveHookIT.java:270)
at 
org.apache.atlas.hive.hook.HiveHookIT.validateInputTables(HiveHookIT.java:257)
at