Re: Review Request 66053: ATLAS-2495: updated Kafka version to 1.0.0

[Apoorv Naik]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66053/#review199142
---


Ship it!




Ship It!

- Apoorv Naik


On March 14, 2018, 1:20 a.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/66053/
> ---
> 
> (Updated March 14, 2018, 1:20 a.m.)
> 
> 
> Review request for atlas.
> 
> 
> Bugs: ATLAS-2495
> https://issues.apache.org/jira/browse/ATLAS-2495
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Updated Kafka version to 1.0.0; updated Atlas for API changes in Kafka.
> 
> 
> Diffs
> -
> 
>   addons/falcon-bridge/src/test/resources/atlas-application.properties 
> d1c3f716 
>   addons/hbase-bridge/src/test/resources/atlas-application.properties 
> d1c3f716 
>   addons/hive-bridge/src/test/resources/atlas-application.properties d1c3f716 
>   addons/sqoop-bridge/src/test/resources/atlas-application.properties 
> d1c3f716 
>   addons/storm-bridge/src/test/resources/atlas-application.properties 
> 6e9042af 
>   authorization/src/test/resources/atlas-application.properties e1357b18 
>   graphdb/janus/src/test/resources/atlas-application.properties 5c9bd7a0 
>   graphdb/titan0/src/test/resources/atlas-application.properties c6ea4e02 
>   intg/src/test/resources/atlas-application.properties 9015f894 
>   notification/src/main/java/org/apache/atlas/kafka/EmbeddedKafkaServer.java 
> 33c8296c 
>   
> notification/src/test/java/org/apache/atlas/kafka/KafkaNotificationMockTest.java
>  78d2a909 
>   pom.xml 34e1ad04 
>   webapp/src/test/java/org/apache/atlas/web/integration/BaseResourceIT.java 
> 6a7aece2 
>   webapp/src/test/resources/atlas-application.properties 402d3628 
> 
> 
> Diff: https://reviews.apache.org/r/66053/diff/1/
> 
> 
> Testing
> ---
> 
> Verified that UTs and ITs pass successfully.
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>

Re: Atlas contributor permission

[Madhan Neethiraj]

Vineet,

Thanks for your interest in contributing to Apache Atlas. Can you please send 
your email-address/id registered in JIRA?

Regards,
Madhan




On 3/13/18, 11:30 AM, "Vineet Seth"  wrote:


Please add me as a contributor.

Regards,
Vineet Seth

Jenkins build is back to normal : PreCommit-ATLAS-Build-Test #172-master-ATLAS-2495-3.patch

[Apache Jenkins Server]

See 

[jira] [Updated] (ATLAS-2495) Update Kafka version to 1.0.0

[Madhan Neethiraj (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-2495:

Attachment: (was: ATLAS-2495.patch)

> Update Kafka version to 1.0.0
> -
>
> Key: ATLAS-2495
> URL: https://issues.apache.org/jira/browse/ATLAS-2495
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2495-3.patch
>
>
> Apache Kafka 1.0.0 was released few months back. This JIRA is to track 
> updates to move from Kafka version 0.10.0.0 to 1.0.0.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2495) Update Kafka version to 1.0.0

[Madhan Neethiraj (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-2495:

Attachment: ATLAS-2495-3.patch

> Update Kafka version to 1.0.0
> -
>
> Key: ATLAS-2495
> URL: https://issues.apache.org/jira/browse/ATLAS-2495
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2495-3.patch
>
>
> Apache Kafka 1.0.0 was released few months back. This JIRA is to track 
> updates to move from Kafka version 0.10.0.0 to 1.0.0.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Review Request 66053: ATLAS-2495: updated Kafka version to 1.0.0

[Madhan Neethiraj]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66053/
---

Review request for atlas.


Bugs: ATLAS-2495
https://issues.apache.org/jira/browse/ATLAS-2495


Repository: atlas


Description
---

Updated Kafka version to 1.0.0; updated Atlas for API changes in Kafka.


Diffs
-

  addons/falcon-bridge/src/test/resources/atlas-application.properties d1c3f716 
  addons/hbase-bridge/src/test/resources/atlas-application.properties d1c3f716 
  addons/hive-bridge/src/test/resources/atlas-application.properties d1c3f716 
  addons/sqoop-bridge/src/test/resources/atlas-application.properties d1c3f716 
  addons/storm-bridge/src/test/resources/atlas-application.properties 6e9042af 
  authorization/src/test/resources/atlas-application.properties e1357b18 
  graphdb/janus/src/test/resources/atlas-application.properties 5c9bd7a0 
  graphdb/titan0/src/test/resources/atlas-application.properties c6ea4e02 
  intg/src/test/resources/atlas-application.properties 9015f894 
  notification/src/main/java/org/apache/atlas/kafka/EmbeddedKafkaServer.java 
33c8296c 
  
notification/src/test/java/org/apache/atlas/kafka/KafkaNotificationMockTest.java
 78d2a909 
  pom.xml 34e1ad04 
  webapp/src/test/java/org/apache/atlas/web/integration/BaseResourceIT.java 
6a7aece2 
  webapp/src/test/resources/atlas-application.properties 402d3628 


Diff: https://reviews.apache.org/r/66053/diff/1/


Testing
---

Verified that UTs and ITs pass successfully.


Thanks,

Madhan Neethiraj

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #171-master-ATLAS-2495-3.patch

[Apache Jenkins Server]

See 


--
[...truncated 316.68 KB...]
[INFO] Exclude: **/.project
[INFO] Exclude: **/.settings/**
[INFO] Exclude: **/test-output/**
[INFO] Exclude: **/mock/**
[INFO] Exclude: **/data/**
[INFO] Exclude: **/maven-eclipse.xml
[INFO] Exclude: **/.externalToolBuilders/**
[INFO] Exclude: **/build.log
[INFO] Exclude: **/.bowerrc
[INFO] Exclude: *.json
[INFO] Exclude: **/overlays/**
[INFO] Exclude: dev-support/**
[INFO] Exclude: **/users-credentials.properties
[INFO] Exclude: **/public/css/animate.min.css
[INFO] Exclude: **/public/css/bootstrap-sidebar.css
[INFO] Exclude: **/public/js/external_lib/**
[INFO] Exclude: **/node_modules/**
[INFO] Exclude: **/public/js/libs/**
[INFO] Exclude: **/atlas.data/**
[INFO] Exclude: **/${sys:atlas.data}/**
[INFO] Exclude: **/policy-store.txt
[INFO] Exclude: **/*rebel*.xml
[INFO] Exclude: **/*rebel*.xml.bak
[INFO] Exclude: **/test/resources/**
[INFO] 126 resources included (use -debug for more details)
[INFO] Rat check: Summary over all files. Unapproved: 0, unknown: 0, generated: 
0, approved: 126 licenses.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 13 resources
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-solr-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9 resources
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ atlas-webapp 
---
[INFO] 
[INFO] --- keytool-maven-plugin:1.5:clean (clean) @ atlas-webapp ---
[WARNING] Keystore file 
'
 doesn't exist.
[INFO] 
[INFO] --- keytool-maven-plugin:1.5:generateKeyPair (generateKeyPair) @ 
atlas-webapp ---
[WARNING] 
[WARNING] Warning:
[WARNING] The JKS keystore uses a proprietary format. It is recommended to 
migrate to PKCS12 which is an industry standard format using "keytool 
-importkeystore -srckeystore 

 -destkeystore 

 -deststoretype pkcs12".
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 2 resources to META-INF
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ atlas-webapp 
---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 68 source files to 

[INFO] 
:
 Some input files use or override a deprecated API.
[INFO] 
:
 Recompile with -Xlint:deprecation for details.
[INFO] 
:
 Some input files use unchecked or unsafe operations.
[INFO] 
:
 Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @ 
atlas-webapp ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 50 source files to 

[INFO] 
:
 Some input files use or override a deprecated API.
[INFO] 
:
 Recompile with -Xlint:deprecation for details.
[INFO] 
:
 Some input files use unchecked or unsafe operations.
[INFO] 
:
 Recompile 

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #170-master-ATLAS-2495-3.patch

[Apache Jenkins Server]

See 


--
[...truncated 346.32 KB...]
[INFO] Exclude: **/*rebel*.xml
[INFO] Exclude: **/*rebel*.xml.bak
[INFO] Exclude: **/test/resources/**
[INFO] 126 resources included (use -debug for more details)
[INFO] Rat check: Summary over all files. Unapproved: 0, unknown: 0, generated: 
0, approved: 126 licenses.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 13 resources
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-solr-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9 resources
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ atlas-webapp 
---
[INFO] 
[INFO] --- keytool-maven-plugin:1.5:clean (clean) @ atlas-webapp ---
[WARNING] Keystore file 
'
 doesn't exist.
[INFO] 
[INFO] --- keytool-maven-plugin:1.5:generateKeyPair (generateKeyPair) @ 
atlas-webapp ---
[WARNING] 
[WARNING] Warning:
[WARNING] The JKS keystore uses a proprietary format. It is recommended to 
migrate to PKCS12 which is an industry standard format using "keytool 
-importkeystore -srckeystore 

 -destkeystore 

 -deststoretype pkcs12".
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 2 resources to META-INF
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ atlas-webapp 
---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 68 source files to 

[INFO] 
:
 Some input files use or override a deprecated API.
[INFO] 
:
 Recompile with -Xlint:deprecation for details.
[INFO] 
:
 Some input files use unchecked or unsafe operations.
[INFO] 
:
 Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ 
atlas-webapp ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @ 
atlas-webapp ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 50 source files to 

[INFO] 
:
 Some input files use or override a deprecated API.
[INFO] 
:
 Recompile with -Xlint:deprecation for details.
[INFO] 
:
 Some input files use unchecked or unsafe operations.
[INFO] 
:
 Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.18.1:test (default-test) @ atlas-webapp ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-surefire-plugin:2.18.1:test (unit-tests) @ atlas-webapp ---
[WARNING] The parameter forkMode is deprecated since version 2.14. Use 
forkCount and reuseForks instead.
[INFO] Surefire report directory: 

[INFO] Using configured provider org.apache.maven.surefire.testng.TestNGProvider

---
 T E S T S
---
Running org.apache.atlas.web.service.ActiveInstanceStateTest
Tests run: 

Build failed in Jenkins: Atlas-master-UnitTests #759

[Apache Jenkins Server]

See 

--
[...truncated 2.37 KB...]
+ mvn -version
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=1024m; 
support was removed in 8.0
Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 
2017-04-03T19:39:06Z)
Maven home: /home/jenkins/tools/maven/latest
Java version: 1.8.0_144, vendor: Oracle Corporation
Java home: /usr/local/asfpackages/java/jdk1.8.0_144/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-89-generic", arch: "amd64", family: "unix"
+ java -version
java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)
+ env
BUILD_URL=https://builds.apache.org/job/Atlas-master-UnitTests/759/
XDG_SESSION_ID=250
ROOT_BUILD_CAUSE_TIMERTRIGGER=true
HUDSON_SERVER_COOKIE=f4ebd1e6b0d976e8
SHELL=/bin/bash
SSH_CLIENT=62.210.60.235 53586 22
BUILD_TAG=jenkins-Atlas-master-UnitTests-759
GIT_PREVIOUS_COMMIT=ac2c1a779b24aca4c6cfacbb854cc35219013cbe
ROOT_BUILD_CAUSE=TIMERTRIGGER
WORKSPACE=
JOB_URL=https://builds.apache.org/job/Atlas-master-UnitTests/
RUN_CHANGES_DISPLAY_URL=https://builds.apache.org/job/Atlas-master-UnitTests/759/display/redirect?page=changes
USER=jenkins
GIT_AUTHOR_NAME=jenkins
GIT_COMMITTER_NAME=jenkins
MAVEN_OPTS=-Xmx4096m -XX:MaxPermSize=1024m -Dfile.encoding=UTF-8 -noverify
NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat
GIT_COMMIT=ac2c1a779b24aca4c6cfacbb854cc35219013cbe
JENKINS_HOME=/x1/jenkins/jenkins-home
MAIL=/var/mail/jenkins
PATH=/home/jenkins/tools/java/latest1.8/bin:/home/jenkins/tools/maven/latest/bin:/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
RUN_DISPLAY_URL=https://builds.apache.org/job/Atlas-master-UnitTests/759/display/redirect
GIT_COMMITTER_EMAIL=bui...@apache.org
PWD=
JAVA_HOME=/home/jenkins/tools/java/latest1.8
HUDSON_URL=https://builds.apache.org/
LANG=en_US
JOB_NAME=Atlas-master-UnitTests
XFILESEARCHPATH=/usr/dt/app-defaults/%L/Dt
BUILD_DISPLAY_NAME=#759
BUILD_CAUSE=TIMERTRIGGER
BUILD_ID=759
JENKINS_URL=https://builds.apache.org/
WIN_LABEL=Windows
JOB_BASE_NAME=Atlas-master-UnitTests
GIT_PREVIOUS_SUCCESSFUL_COMMIT=ac2c1a779b24aca4c6cfacbb854cc35219013cbe
HOME=/home/jenkins
SHLVL=2
GIT_BRANCH=origin/master
EXECUTOR_NUMBER=1
JENKINS_SERVER_COOKIE=f4ebd1e6b0d976e8
GIT_URL=https://github.com/apache/atlas.git
NODE_LABELS=H18 Hadoop xenial
LOGNAME=jenkins
SSH_CONNECTION=62.210.60.235 53586 67.195.81.138 22
HUDSON_HOME=/x1/jenkins/jenkins-home
NODE_NAME=H18
BUILD_CAUSE_TIMERTRIGGER=true
NIX_LABEL=ubuntu
BUILD_NUMBER=759
JOB_DISPLAY_URL=https://builds.apache.org/job/Atlas-master-UnitTests/display/redirect
XDG_RUNTIME_DIR=/run/user/910
HUDSON_COOKIE=4297ac13-c9ec-4f98-a97c-7a3383b2081d
GIT_AUTHOR_EMAIL=bui...@apache.org
_=/usr/bin/env
+ mvn clean package -DskipITs
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=1024m; 
support was removed in 8.0
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.atlas:atlas-graphdb-titan0:jar:1.0.0-SNAPSHOT
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must 
be unique: org.apache.solr:solr-solrj:jar -> version (?) vs ${solr.version} @ 
org.apache.atlas:atlas-graphdb-titan0:[unknown-version], 

 line 194, column 21
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must 
be unique: org.apache.solr:solr-core:jar -> version (?) vs ${solr.version} @ 
org.apache.atlas:atlas-graphdb-titan0:[unknown-version], 

 line 200, column 21
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.atlas:hive-bridge:jar:1.0.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found 
duplicate declaration of plugin org.apache.maven.plugins:maven-resources-plugin 
@ org.apache.atlas:hive-bridge:[unknown-version], 

 line 478, column 21
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.atlas:falcon-bridge:jar:1.0.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found 
duplicate declaration of plugin org.apache.maven.plugins:maven-resources-plugin 
@ org.apache.atlas:falcon-bridge:[unknown-version], 

 line 370, column 21
[WARNING] 
[WARNING] Some problems were encountered while 

Atlas contributor permission

[Vineet Seth]

Please add me as a contributor.

Regards,
Vineet Seth

[jira] [Updated] (ATLAS-2498) Soft and hard deletes, deleting a "DELETED" entity and cleanup of unused types

[Mark Kiami (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Kiami updated ATLAS-2498:
--
Summary: Soft and hard deletes, deleting a "DELETED" entity and cleanup of 
unused types  (was: Soft and hard deletes)

> Soft and hard deletes, deleting a "DELETED" entity and cleanup of unused types
> --
>
> Key: ATLAS-2498
> URL: https://issues.apache.org/jira/browse/ATLAS-2498
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 0.8-incubating
>Reporter: Mark Kiami
>Priority: Major
>
> Hello,
> Since the documentation on this feature not clear, could you please answer or 
> confirm the following:
>  # When an entity is deleted, its status goes to "DELETED", this is a soft 
> delete.
>  # Does Atlas version 0.8.0 support hard deletes (HDP 2.6.4 ships with 0.8.0)?
>  # Is the atlas.DeleteHandler.impl configuration key supported in this 
> version?
>  # Is it possible to delete a "DELETED" entity?
> I am asking this because I am stuck in the following scenario:
>  * Create a new ENTITY type named "custom_type"
>  * Create an entity of that type "entity_1_of_custom_type", its status is 
> "ACTIVE"
>  * Delete the entity "entity_1_of_custom_type", its status is "DELETED"
>  * Delete the ENTITY type named "custom_type"
>  * I get an error: \{"errorCode":"ATLAS-409-00-002","errorMessage":"Given 
> type custom_type has references"}
> How is it possible in this case to cleanup both the DELETED entity and the 
> unused type "custom_type"?
> Thanks!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2498) Soft and hard deletes

[Mark Kiami (JIRA)]

Mark Kiami created ATLAS-2498:
-

 Summary: Soft and hard deletes
 Key: ATLAS-2498
 URL: https://issues.apache.org/jira/browse/ATLAS-2498
 Project: Atlas
  Issue Type: Improvement
Affects Versions: 0.8-incubating
Reporter: Mark Kiami


Hello,

Since the documentation on this feature not clear, could you please answer or 
confirm the following:
 # When an entity is deleted, its status goes to "DELETED", this is a soft 
delete.
 # Does Atlas version 0.8.0 support hard deletes (HDP 2.6.4 ships with 0.8.0)?
 # Is the atlas.DeleteHandler.impl configuration key supported in this version?
 # Is it possible to delete a "DELETED" entity?

I am asking this because I am stuck in the following scenario:
 * Create a new ENTITY type named "custom_type"
 * Create an entity of that type "entity_1_of_custom_type", its status is 
"ACTIVE"
 * Delete the entity "entity_1_of_custom_type", its status is "DELETED"
 * Delete the ENTITY type named "custom_type"
 * I get an error: \{"errorCode":"ATLAS-409-00-002","errorMessage":"Given type 
custom_type has references"}

How is it possible in this case to cleanup both the DELETED entity and the 
unused type "custom_type"?

Thanks!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Issue Comment Deleted] (ATLAS-541) Soft deletes

[Mark Kiami (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Kiami updated ATLAS-541:
-
Comment: was deleted

(was: Could the following be confirmed please, as documentation on this feature 
is not clear:
 * Does Atlas version 0.8.0 support hard deletes (HDP 2.6.4 ships with 0.8.0)?
 * Is the atlas.DeleteHandler.impl configuration supported in this version?
 * Is it possible to delete a "DELETED" entity?

Thanks!)

> Soft deletes
> 
>
> Key: ATLAS-541
> URL: https://issues.apache.org/jira/browse/ATLAS-541
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Shwetha G S
>Assignee: Shwetha G S
>Priority: Major
> Fix For: 0.7-incubating
>
>
> We don't have graph versioning currently and hard deletes are not acceptable 
> for data governance. This jira tracks the proposal for soft deletes which can 
> mark an entity as deleted and by default search should return only active 
> entities. However, there should be an option to retrieve deleted entities



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (ATLAS-541) Soft deletes

[Mark Kiami (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397154#comment-16397154
 ] 

Mark Kiami commented on ATLAS-541:
--

Could the following be confirmed please, as documentation on this feature is 
not clear:
 * Does Atlas version 0.8.0 support hard deletes (HDP 2.6.4 ships with 0.8.0)?
 * Is the atlas.DeleteHandler.impl configuration supported in this version?
 * Is it possible to delete a "DELETED" entity?

Thanks!

> Soft deletes
> 
>
> Key: ATLAS-541
> URL: https://issues.apache.org/jira/browse/ATLAS-541
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Shwetha G S
>Assignee: Shwetha G S
>Priority: Major
> Fix For: 0.7-incubating
>
>
> We don't have graph versioning currently and hard deletes are not acceptable 
> for data governance. This jira tracks the proposal for soft deletes which can 
> mark an entity as deleted and by default search should return only active 
> entities. However, there should be an option to retrieve deleted entities



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 66040: Relationship UI improvements

[Madhan Neethiraj]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66040/#review199088
---


Ship it!




Ship It!

- Madhan Neethiraj


On March 13, 2018, 1:44 p.m., keval bhatt wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/66040/
> ---
> 
> (Updated March 13, 2018, 1:44 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2497
> https://issues.apache.org/jira/browse/ATLAS-2497
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This patch includes following changes to atlas UI.
> 
> * Zoom-In/Zoom-Out on relationship graph is available through mouse scroll 
> and buttons.
> * Move the circles for related objects. Moving to the anchor entity circle 
> can be used to move the entire graph.
> * Relationship details popup that lists the related objects:
> - it will be useful to number each item, instead of a bullet
> - ‘Search Entities’ search box should be hidden when there is only one 
> entity
> * From ‘CLASSIFICATION’ tab, clicking on a tag – like ‘PII’. On the result 
> page at the right-side, click on an entity to see its details :
>   - the left-side switches to ‘SEARCH’ tab (instead of remaining in 
> ‘CLASSIFICATION’ tab).
>   - If the user clicks on "back to result" button it should come back to 
> classification tab.
> 
> 
> Diffs
> -
> 
>   dashboardv2/public/css/scss/relationship.scss 91ad8f77 
>   dashboardv2/public/js/templates/graph/RelationshipLayoutView_tmpl.html 
> a0e5b976 
>   dashboardv2/public/js/templates/tag/TagAttributeDetailLayoutView_tmpl.html 
> 32fc7288 
>   dashboardv2/public/js/views/graph/RelationshipLayoutView.js a26a64ad 
>   dashboardv2/public/js/views/search/SearchResultLayoutView.js 28d11243 
>   dashboardv2/public/js/views/site/Header.js 8b75b1a9 
>   dashboardv2/public/js/views/site/SideNavLayoutView.js 76489071 
>   dashboardv2/public/js/views/tag/TagDetailLayoutView.js e5087c07 
> 
> 
> Diff: https://reviews.apache.org/r/66040/diff/1/
> 
> 
> Testing
> ---
> 
> Done one round of sanity testing
> 
> 
> Thanks,
> 
> keval bhatt
> 
>

Re: AtlasClient API v2

[Nigel Jones]

On 2018/03/13 14:08:31, David Radley  wrote: 
> Hi Nigel,
> I think you are saying this is a regression. 
> I notice "Add jackson.core dependency in intg module" has just been 
> committed. Could this make a difference?
> Does it work if you recompile? 
>all the best, David. 

I wonder if that was just one recent module that needed a change for Jackson.. 
I think the core change was a while ago? Not tried recompiling yet

However I am NOT saying this is a regression since it's my first time using the 
client API, 

Re: AtlasClient API v2

[David Radley]

Hi Nigel,
I think you are saying this is a regression. 
I notice "Add jackson.core dependency in intg module" has just been 
committed. Could this make a difference?
Does it work if you recompile? 
   all the best, David. 



From:   Nigel Jones 
To: 
Date:   13/03/2018 13:02
Subject:AtlasClient API v2



I'm trying to use the AtlasClientV2 api but hitting an exception when 
trying to create entities.

This is using code from master (client and server) built in the last few 
days.

I'm able to send REST APIs directly, also my type creation worked fine.

What do I need to look at to resolve this error? Is it an error I've made 
in my types? Could it be a Jackson version issue (I did try updating some 
dependencies for my client code to 2.x)

Creating sample entities:Â 
2018-03-13 12:43:12 INFO Â AtlasBaseClient:330 - 
--
2018-03-13 12:43:12 INFO  AtlasBaseClient:331 - Call         : POST 
api/atlas/v2/entity/
2018-03-13 12:43:12 INFO Â AtlasBaseClient:332 - Content-type : 
application/json; charset=UTF-8Â 
2018-03-13 12:43:12 INFO  AtlasBaseClient:333 - Accept       : 
application/json 
2018-03-13 12:43:12 INFO  AtlasBaseClient:335 - Request      : 
AtlasEntityWithExtInfo{entity=AtlasEntity{AtlasStruct{typeName='gaianSchema', 
attributes=[qualifiedName:GAIAN, name:GAIAN, comment:Gaian Database 
Schema]}guid='-24212680184574', status=null, createdBy='null', 
updatedBy='null', createTime=null, updateTime=null, version=0, 
relationshipAttributes=[], classifications=[], 
},AtlasEntityExtInfo{referredEntities={}}}
Exception in thread "main" java.lang.AbstractMethodError
    at 
org.codehaus.jackson.map.AnnotationIntrospector$Pair.findSerializer(AnnotationIntrospector.java:1153)
    at 
org.codehaus.jackson.map.ser.BasicSerializerFactory.findSerializerFromAnnotation(BasicSerializerFactory.java:366)
    at 
org.codehaus.jackson.map.ser.BeanSerializerFactory.createSerializer(BeanSerializerFactory.java:252)
    at 
org.codehaus.jackson.map.ser.StdSerializerProvider._createUntypedSerializer(StdSerializerProvider.java:782)
    at 
org.codehaus.jackson.map.ser.StdSerializerProvider._createAndCacheUntypedSerializer(StdSerializerProvider.java:735)
    at 
org.codehaus.jackson.map.ser.StdSerializerProvider.findValueSerializer(StdSerializerProvider.java:344)
    at 
org.codehaus.jackson.map.ser.StdSerializerProvider.findTypedValueSerializer(StdSerializerProvider.java:420)
    at 
org.codehaus.jackson.map.ser.StdSerializerProvider._serializeValue(StdSerializerProvider.java:601)
    at 
org.codehaus.jackson.map.ser.StdSerializerProvider.serializeValue(StdSerializerProvider.java:256)
    at 
org.codehaus.jackson.map.ObjectMapper.writeValue(ObjectMapper.java:1613)
    at 
org.codehaus.jackson.jaxrs.JacksonJsonProvider.writeTo(JacksonJsonProvider.java:559)
    at 
com.sun.jersey.json.impl.provider.entity.JacksonProviderProxy.writeTo(JacksonProviderProxy.java:160)
    at 
com.sun.jersey.api.client.RequestWriter.writeRequestEntity(RequestWriter.java:300)
    at 
com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:217)
    at 
com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153)
    at 
com.sun.jersey.api.client.filter.HTTPBasicAuthFilter.handle(HTTPBasicAuthFilter.java:105)
    at com.sun.jersey.api.client.Client.handle(Client.java:652)
    at 
com.sun.jersey.api.client.WebResource.handle(WebResource.java:682)
    at 
com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
    at 
com.sun.jersey.api.client.WebResource$Builder.method(WebResource.java:634)
    at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:350)
    at 
org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
    at 
org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:211)
    at 
org.apache.atlas.AtlasClientV2.createEntity(AtlasClientV2.java:285)
    at 
org.apache.atlas.gaian.GaianSampleData.createInstance(GaianSampleData.java:176)
    at 
org.apache.atlas.gaian.GaianSampleData.createSchema(GaianSampleData.java:198)
    at 
org.apache.atlas.gaian.GaianSampleData.createEntities(GaianSampleData.java:155)
    at 
org.apache.atlas.gaian.GaianSampleData.main(GaianSampleData.java:72)




Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
741598. 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

Re: Review Request 66040: Relationship UI improvements

[Nixon Rodrigues]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66040/#review199086
---


Ship it!




Ship It!

- Nixon Rodrigues


On March 13, 2018, 1:44 p.m., keval bhatt wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/66040/
> ---
> 
> (Updated March 13, 2018, 1:44 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2497
> https://issues.apache.org/jira/browse/ATLAS-2497
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This patch includes following changes to atlas UI.
> 
> * Zoom-In/Zoom-Out on relationship graph is available through mouse scroll 
> and buttons.
> * Move the circles for related objects. Moving to the anchor entity circle 
> can be used to move the entire graph.
> * Relationship details popup that lists the related objects:
> - it will be useful to number each item, instead of a bullet
> - ‘Search Entities’ search box should be hidden when there is only one 
> entity
> * From ‘CLASSIFICATION’ tab, clicking on a tag – like ‘PII’. On the result 
> page at the right-side, click on an entity to see its details :
>   - the left-side switches to ‘SEARCH’ tab (instead of remaining in 
> ‘CLASSIFICATION’ tab).
>   - If the user clicks on "back to result" button it should come back to 
> classification tab.
> 
> 
> Diffs
> -
> 
>   dashboardv2/public/css/scss/relationship.scss 91ad8f77 
>   dashboardv2/public/js/templates/graph/RelationshipLayoutView_tmpl.html 
> a0e5b976 
>   dashboardv2/public/js/templates/tag/TagAttributeDetailLayoutView_tmpl.html 
> 32fc7288 
>   dashboardv2/public/js/views/graph/RelationshipLayoutView.js a26a64ad 
>   dashboardv2/public/js/views/search/SearchResultLayoutView.js 28d11243 
>   dashboardv2/public/js/views/site/Header.js 8b75b1a9 
>   dashboardv2/public/js/views/site/SideNavLayoutView.js 76489071 
>   dashboardv2/public/js/views/tag/TagDetailLayoutView.js e5087c07 
> 
> 
> Diff: https://reviews.apache.org/r/66040/diff/1/
> 
> 
> Testing
> ---
> 
> Done one round of sanity testing
> 
> 
> Thanks,
> 
> keval bhatt
> 
>

[jira] [Updated] (ATLAS-2497) Relationship UI improvements

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2497:
---
Attachment: ATLAS-2497.patch

> Relationship UI improvements
> 
>
> Key: ATLAS-2497
> URL: https://issues.apache.org/jira/browse/ATLAS-2497
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2497.patch
>
>
> This patch includes following changes to atlas UI.
> * Zoom-In/Zoom-Out on relationship graph is available through mouse scroll 
> and buttons.
> * Move the circles for related objects. Moving to the anchor entity circle 
> can be used to move the entire graph.
> * Relationship details popup that lists the related objects:
> ** it will be useful to number each item, instead of a bullet
> ** ‘Search Entities’ search box should be hidden when there is only one 
> entity
> * From ‘CLASSIFICATION’ tab, clicking on a tag – like ‘PII’. On the result 
> page at the right-side, click on an entity to see its details :
>   ** The left-side switches to ‘SEARCH’ tab (instead of remaining in 
> ‘CLASSIFICATION’ tab).
>   ** If the user clicks on "back to result" button it should come back to 
> classification tab.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Review Request 66040: Relationship UI improvements

[keval bhatt]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66040/
---

Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
and Sarath Subramanian.


Bugs: ATLAS-2497
https://issues.apache.org/jira/browse/ATLAS-2497


Repository: atlas


Description
---

This patch includes following changes to atlas UI.

* Zoom-In/Zoom-Out on relationship graph is available through mouse scroll and 
buttons.
* Move the circles for related objects. Moving to the anchor entity circle can 
be used to move the entire graph.
* Relationship details popup that lists the related objects:
- it will be useful to number each item, instead of a bullet
- ‘Search Entities’ search box should be hidden when there is only one 
entity
* From ‘CLASSIFICATION’ tab, clicking on a tag – like ‘PII’. On the result page 
at the right-side, click on an entity to see its details :
  - the left-side switches to ‘SEARCH’ tab (instead of remaining in 
‘CLASSIFICATION’ tab).
  - If the user clicks on "back to result" button it should come back to 
classification tab.


Diffs
-

  dashboardv2/public/css/scss/relationship.scss 91ad8f77 
  dashboardv2/public/js/templates/graph/RelationshipLayoutView_tmpl.html 
a0e5b976 
  dashboardv2/public/js/templates/tag/TagAttributeDetailLayoutView_tmpl.html 
32fc7288 
  dashboardv2/public/js/views/graph/RelationshipLayoutView.js a26a64ad 
  dashboardv2/public/js/views/search/SearchResultLayoutView.js 28d11243 
  dashboardv2/public/js/views/site/Header.js 8b75b1a9 
  dashboardv2/public/js/views/site/SideNavLayoutView.js 76489071 
  dashboardv2/public/js/views/tag/TagDetailLayoutView.js e5087c07 


Diff: https://reviews.apache.org/r/66040/diff/1/


Testing
---

Done one round of sanity testing


Thanks,

keval bhatt

[jira] [Updated] (ATLAS-2497) Relationship UI improvements

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2497:
---
Description: 
This patch includes following changes to atlas UI.

* Zoom-In/Zoom-Out on relationship graph is available through mouse scroll and 
buttons.
* Move the circles for related objects. Moving to the anchor entity circle can 
be used to move the entire graph.
* Relationship details popup that lists the related objects:
** it will be useful to number each item, instead of a bullet
** ‘Search Entities’ search box should be hidden when there is only one 
entity
* From ‘CLASSIFICATION’ tab, clicking on a tag – like ‘PII’. On the result page 
at the right-side, click on an entity to see its details :
  ** The left-side switches to ‘SEARCH’ tab (instead of remaining in 
‘CLASSIFICATION’ tab).
  ** If the user clicks on "back to result" button it should come back to 
classification tab.

> Relationship UI improvements
> 
>
> Key: ATLAS-2497
> URL: https://issues.apache.org/jira/browse/ATLAS-2497
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 1.0.0
>
>
> This patch includes following changes to atlas UI.
> * Zoom-In/Zoom-Out on relationship graph is available through mouse scroll 
> and buttons.
> * Move the circles for related objects. Moving to the anchor entity circle 
> can be used to move the entire graph.
> * Relationship details popup that lists the related objects:
> ** it will be useful to number each item, instead of a bullet
> ** ‘Search Entities’ search box should be hidden when there is only one 
> entity
> * From ‘CLASSIFICATION’ tab, clicking on a tag – like ‘PII’. On the result 
> page at the right-side, click on an entity to see its details :
>   ** The left-side switches to ‘SEARCH’ tab (instead of remaining in 
> ‘CLASSIFICATION’ tab).
>   ** If the user clicks on "back to result" button it should come back to 
> classification tab.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : Atlas-master-IntegrationTests #762

[Apache Jenkins Server]

See 

[jira] [Updated] (ATLAS-2497) Relationship UI improvements

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2497:
---
Summary: Relationship UI improvements  (was: Relationship UI Improvements)

> Relationship UI improvements
> 
>
> Key: ATLAS-2497
> URL: https://issues.apache.org/jira/browse/ATLAS-2497
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 1.0.0
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2497) Relationship UI Improvements

[Keval Bhatt (JIRA)]

Keval Bhatt created ATLAS-2497:
--

 Summary: Relationship UI Improvements
 Key: ATLAS-2497
 URL: https://issues.apache.org/jira/browse/ATLAS-2497
 Project: Atlas
  Issue Type: Improvement
Reporter: Keval Bhatt
Assignee: Keval Bhatt
 Fix For: 1.0.0






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: Atlas-master-IntegrationTests #761

[Apache Jenkins Server]

See 


Changes:

[nixon] ATLAS-2494 :- Added jackson.core dependency in intg module.

--
[...truncated 609.82 KB...]
127.0.0.1 - - [13/Mar/2018:12:50:37 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_table=qualifiedName=default.tablepmhozdt6f5@primary
 HTTP/1.1" 404 116 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:42 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_table=qualifiedName=default.tablepmhozdt6f5@primary
 HTTP/1.1" 200 4971 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:42 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_table=qualifiedName=default.tablepmhozdt6f5@primary
 HTTP/1.1" 200 4971 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:43 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_process=qualifiedName=LOAD-%3E:default.tablepmhozdt6f5@primary:1520945437000
 HTTP/1.1" 404 139 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:48 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_process=qualifiedName=LOAD-%3E:default.tablepmhozdt6f5@primary:1520945437000
 HTTP/1.1" 200 1949 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:48 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_process=qualifiedName=LOAD-%3E:default.tablepmhozdt6f5@primary:1520945437000
 HTTP/1.1" 200 1949 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:48 +] "GET 
//localhost:31000/api/atlas/entities/e421d238-36ea-4174-b9fd-c21bfb5edf34 
HTTP/1.1" 200 1949 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:48 +] "GET 
//localhost:31000/api/atlas/entities/0a38faaf-6c87-49df-b08f-1e081db5c050 
HTTP/1.1" 200 1257 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:48 +] "GET 
//localhost:31000/api/atlas/entities/a422c8b9-95bc-4eba-95ad-aaeab2fa51c8 
HTTP/1.1" 200 4971 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:48 +] "GET 
//localhost:31000/api/atlas/entities?type=hdfs_path=qualifiedName=pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/loaddfsfile-data-i7jiyhyza6
 HTTP/1.1" 200 1257 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:48 +] "GET 
//localhost:31000/api/atlas/entities?type=hdfs_path=qualifiedName=pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/loaddfsfile-data-i7jiyhyza6
 HTTP/1.1" 200 1257 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:48 +] "GET 
//localhost:31000/api/atlas/entities/0a38faaf-6c87-49df-b08f-1e081db5c050 
HTTP/1.1" 200 1257 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:48 +] "GET 
//localhost:31000/api/atlas/entities/a422c8b9-95bc-4eba-95ad-aaeab2fa51c8 
HTTP/1.1" 200 4971 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:49 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_process=qualifiedName=LOAD-%3E:default.tablepmhozdt6f5@primary:1520945437000
 HTTP/1.1" 200 1949 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:54 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_process=qualifiedName=LOAD-%3E:default.tablepmhozdt6f5@primary:1520945437000
 HTTP/1.1" 200 2123 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:54 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_process=qualifiedName=LOAD-%3E:default.tablepmhozdt6f5@primary:1520945437000
 HTTP/1.1" 200 2123 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:54 +] "GET 
//localhost:31000/api/atlas/entities/e421d238-36ea-4174-b9fd-c21bfb5edf34 
HTTP/1.1" 200 2123 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:54 +] "GET 
//localhost:31000/api/atlas/entities/4b2e3dad-b5fd-4b5b-b7dd-19a490c90b58 
HTTP/1.1" 200 1260 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:54 +] "GET 
//localhost:31000/api/atlas/entities/0a38faaf-6c87-49df-b08f-1e081db5c050 
HTTP/1.1" 200 1257 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:54 +] "GET 
//localhost:31000/api/atlas/entities/a422c8b9-95bc-4eba-95ad-aaeab2fa51c8 
HTTP/1.1" 200 4971 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:54 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_process=qualifiedName=LOAD-%3E:default.tablehy0cy4w4xg@primary:1520945454000
 HTTP/1.1" 404 139 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:59 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_process=qualifiedName=LOAD-%3E:default.tablehy0cy4w4xg@primary:1520945454000
 HTTP/1.1" 200 1688 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:50:59 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_process=qualifiedName=LOAD-%3E:default.tablehy0cy4w4xg@primary:1520945454000
 HTTP/1.1" 200 1688 "-" "Java/1.8.0_152"
127.0.0.1 - - [13/Mar/2018:12:51:00 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_process=qualifiedName=LOAD-%3E:default.tableotdpwonjdh@primary:1520945459000
 HTTP/1.1" 404 139 "-" "Java/1.8.0_152"

[jira] [Commented] (ATLAS-2494) Add jackson.core dependency in intg module

[Nixon Rodrigues (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396855#comment-16396855
 ] 

Nixon Rodrigues commented on ATLAS-2494:


Thanks [~kevalbhatt] for review. Committed patch on master.

master -> http://git-wip-us.apache.org/repos/asf/atlas/commit/8120947b

> Add jackson.core dependency in intg module
> --
>
> Key: ATLAS-2494
> URL: https://issues.apache.org/jira/browse/ATLAS-2494
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-intg
>Affects Versions: 1.0.0-alpha
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2494.patch
>
>
> Seen this error on some UT's, need to add jackson-core dependency.
>  
> {noformat}
> java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonMerge
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   at 
> com.fasterxml.jackson.databind.introspect.JacksonAnnotationIntrospector.(JacksonAnnotationIntrospector.java:50)
>   at 
> com.fasterxml.jackson.databind.ObjectMapper.(ObjectMapper.java:291)
>   at org.apache.atlas.utils.AtlasJson.(AtlasJson.java:62)
>   at org.apache.atlas.type.AtlasType.toV1Json(AtlasType.java:143)
>   at 
> org.apache.atlas.notification.AbstractNotification.createNotificationMessages(AbstractNotification.java:149)
>   at 
> org.apache.atlas.notification.entity.EntityNotificationDeserializerTest.testDeserialize(EntityNotificationDeserializerTest.java:49
> {noformat}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-1831) Virtualiser to dynamically configure an information virtualization layer

[Yao Li (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yao Li updated ATLAS-1831:
--
Description: 
This component listens for events from the Information View OMAS event 
publisher built by ATLAS-1711 
(https://issues.apache.org/jira/browse/ATLAS-1711) to detect changes to 
relational data assets and configures an information virtualization tool (Gaian 
in the first instance) to create/maintain a view that maps to the physical data 
asset. It also populates Information View metadata (using the Information View 
OMAS API) for each of the views it creates.

RANGER-1485 (https://issues.apache.org/jira/browse/RANGER-1485) will also 
configure Gaian with enforcement logic to apply data protection rules to the 
data when queries are made to the views.

  was:
This component listens for events from the Information View OMAS event 
publisher built by ATLAS-1711 
(https://issues.apache.org/jira/browse/ATLAS-1711) to detect changes to 
relational data assets and configures an information virtualization tool 
(GaianDB in the first instance) to create/maintain a view that maps to the 
physical data asset.  It also populates Information View metadata (using the 
Information View OMAS API) for each of the views it creates.

RANGER-1485 (https://issues.apache.org/jira/browse/RANGER-1485) will also 
configure GaianDB with enforcement logic to apply data protection rules to the 
data when queries are made to the views.



> Virtualiser to dynamically configure an information virtualization layer
> 
>
> Key: ATLAS-1831
> URL: https://issues.apache.org/jira/browse/ATLAS-1831
> Project: Atlas
>  Issue Type: New Feature
>  Components: atlas-intg
>Affects Versions: 1.0.0
>Reporter: Mandy Chessell
>Assignee: Yao Li
>Priority: Major
>  Labels: VirtualDataConnector
>
> This component listens for events from the Information View OMAS event 
> publisher built by ATLAS-1711 
> (https://issues.apache.org/jira/browse/ATLAS-1711) to detect changes to 
> relational data assets and configures an information virtualization tool 
> (Gaian in the first instance) to create/maintain a view that maps to the 
> physical data asset. It also populates Information View metadata (using the 
> Information View OMAS API) for each of the views it creates.
> RANGER-1485 (https://issues.apache.org/jira/browse/RANGER-1485) will also 
> configure Gaian with enforcement logic to apply data protection rules to the 
> data when queries are made to the views.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (ATLAS-1831) Virtualiser to dynamically configure an information virtualization layer

[Yao Li (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yao Li reassigned ATLAS-1831:
-

Assignee: Yao Li

> Virtualiser to dynamically configure an information virtualization layer
> 
>
> Key: ATLAS-1831
> URL: https://issues.apache.org/jira/browse/ATLAS-1831
> Project: Atlas
>  Issue Type: New Feature
>  Components: atlas-intg
>Affects Versions: 1.0.0
>Reporter: Mandy Chessell
>Assignee: Yao Li
>Priority: Major
>  Labels: VirtualDataConnector
>
> This component listens for events from the Information View OMAS event 
> publisher built by ATLAS-1711 
> (https://issues.apache.org/jira/browse/ATLAS-1711) to detect changes to 
> relational data assets and configures an information virtualization tool 
> (GaianDB in the first instance) to create/maintain a view that maps to the 
> physical data asset.  It also populates Information View metadata (using the 
> Information View OMAS API) for each of the views it creates.
> RANGER-1485 (https://issues.apache.org/jira/browse/RANGER-1485) will also 
> configure GaianDB with enforcement logic to apply data protection rules to 
> the data when queries are made to the views.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)