[jira] [Commented] (ATLAS-3145) UI :Entity showing Active even if the relationshipStatus is Deleted

[Sarath Subramanian (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824822#comment-16824822
 ] 

Sarath Subramanian commented on ATLAS-3145:
---

+1 for patch - ATLAS-3145_3.patch

> UI :Entity showing Active even if the relationshipStatus is Deleted
> ---
>
> Key: ATLAS-3145
> URL: https://issues.apache.org/jira/browse/ATLAS-3145
> Project: Atlas
>  Issue Type: Bug
>Reporter: Binit Gutka
>Assignee: Binit Gutka
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: ATLAS-3145_3.patch, active_entity.png, 
> image-2019-04-17-15-37-49-735.png, relationship_deleted.png, response.png
>
>
> In the Relationship graph view, when an entity is deleted, the entity is 
> still shown as active.
> All the deleted entities should be shown as deleted.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-3145) UI :Entity showing Active even if the relationshipStatus is Deleted

[Binit Gutka (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Binit Gutka updated ATLAS-3145:
---
Attachment: (was: ATLAS-3145_2.patch)

> UI :Entity showing Active even if the relationshipStatus is Deleted
> ---
>
> Key: ATLAS-3145
> URL: https://issues.apache.org/jira/browse/ATLAS-3145
> Project: Atlas
>  Issue Type: Bug
>Reporter: Binit Gutka
>Assignee: Binit Gutka
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: ATLAS-3145_3.patch, active_entity.png, 
> image-2019-04-17-15-37-49-735.png, relationship_deleted.png, response.png
>
>
> In the Relationship graph view, when an entity is deleted, the entity is 
> still shown as active.
> All the deleted entities should be shown as deleted.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-3145) UI :Entity showing Active even if the relationshipStatus is Deleted

[Binit Gutka (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Binit Gutka updated ATLAS-3145:
---
Attachment: (was: ATLAS-3145_1.patch)

> UI :Entity showing Active even if the relationshipStatus is Deleted
> ---
>
> Key: ATLAS-3145
> URL: https://issues.apache.org/jira/browse/ATLAS-3145
> Project: Atlas
>  Issue Type: Bug
>Reporter: Binit Gutka
>Assignee: Binit Gutka
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: active_entity.png, image-2019-04-17-15-37-49-735.png, 
> relationship_deleted.png, response.png
>
>
> In the Relationship graph view, when an entity is deleted, the entity is 
> still shown as active.
> All the deleted entities should be shown as deleted.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Review Request 70536: ATLAS-3157: Add Integration tests for Hive metastore hook

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70536/
---

Review request for atlas, Ashutosh Mestry, Aadarsh Jajodia, keval bhatt, Le Ma, 
Madhan Neethiraj, Nikhil Bonte, and Nixon Rodrigues.


Bugs: ATLAS-3157
https://issues.apache.org/jira/browse/ATLAS-3157


Repository: atlas


Description
---

Add Integration tests for Hive metastore hook


Diffs
-

  addons/hive-bridge/src/test/java/org/apache/atlas/hive/HiveITBase.java 
c8c53c473 
  addons/hive-bridge/src/test/java/org/apache/atlas/hive/hook/HiveHookIT.java 
677043a01 
  
addons/hive-bridge/src/test/java/org/apache/atlas/hive/hook/HiveMetastoreHookIT.java
 PRE-CREATION 
  addons/hive-bridge/src/test/resources/hive-site.xml 4605ae322 


Diff: https://reviews.apache.org/r/70536/diff/1/


Testing
---

Precommit: 
https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1048/console


Thanks,

Sarath Subramanian

[jira] [Created] (ATLAS-3157) Add Integration tests for Hive metastore hook

[Sarath Subramanian (JIRA)]

Sarath Subramanian created ATLAS-3157:
-

 Summary: Add Integration tests for Hive metastore hook
 Key: ATLAS-3157
 URL: https://issues.apache.org/jira/browse/ATLAS-3157
 Project: Atlas
  Issue Type: Task
  Components:  atlas-core
Affects Versions: 2.0.0, trunk
Reporter: Sarath Subramanian
Assignee: Sarath Subramanian
 Fix For: 2.0.0


Add Integration tests for Hive metastore hook



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 70462: ATLAS-3133 : Adding support for Process Executions in Atlas

[Aadarsh Jajodia]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70462/
---

(Updated April 23, 2019, 9:37 p.m.)


Review request for atlas, Ashutosh Mestry, Sridhar K, Le Ma, Madhan Neethiraj, 
and Sarath Subramanian.


Changes
---

Tested these changes on a VM and it works now.


Bugs: ATLAS-3133
https://issues.apache.org/jira/browse/ATLAS-3133


Repository: atlas


Description
---

Adding support for Process Executions in Atlas


Diffs (updated)
-

  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/AtlasHiveHookContext.java
 52da7106282bc9ab0c8a99bccd47d7227867ec70 
  addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
6109297e30895f9329b82295e520f577aaa6954b 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java
 4127c611a271bf3cbfc747cf1ac23ecd120d8a50 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateHiveProcess.java
 019deb73c9c875033c1bc1117fb3188fd9749af2 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateTable.java
 b6ec5c330bed988e9f66298a68881f5fadb079f8 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/model/HiveDataTypes.java 
94010d0cb1a7a5c48b71f6d77c5e1a8f5cfcf013 
  addons/hive-bridge/src/test/java/org/apache/atlas/hive/HiveITBase.java 
c8c53c473db02bdb523b91f71d3c3d10ceb57c5a 
  addons/hive-bridge/src/test/java/org/apache/atlas/hive/hook/HiveHookIT.java 
677043a01bbebf0fe998feae49e6af6915685fad 
  addons/models/-Area0/0010-base_model.json 
8b41ee89f3a7288bb4cdad3df6887242b40b68d2 
  addons/models/1000-Hadoop/1030-hive_model.json 
e96443382a587411d1207d6e1157ea65350cbdba 
  webapp/src/main/java/org/apache/atlas/examples/QuickStartV2.java 
6fcea9ed43f7e3d93742c7de4bc4db4386ecdb2d 


Diff: https://reviews.apache.org/r/70462/diff/8/

Changes: https://reviews.apache.org/r/70462/diff/7-8/


Testing
---

We want to add support for Process Executions in Atlas. With the help of 
process executions attributes specific to each execution(like startTime, 
endTime, queryText) will be captured in the execution object. With the current 
model of Atlas this is lost since each execution overrides the previous one. To 
solve this problem. We are creating 2 new entity definitions and one relations 
definition. We create an entity definition called a process execution and 
another one called hive process execution. The hive process execution has all 
the attributes which are specific to each execution. We also create a 
relationship defintion between a hive process and a hive process execution as a 
many to one relation. The lineage does not get affected in this since the 
inputs and outputs are still attached to the hive process. Hive Process can now 
be thought of as a grouping of multiple executions. There is no lineage shown 
for a hive process execution. The criteria for grouping is based on the qualifie
 dName of a Hive Process. As long as the qualified Name of a hive process 
remains the same, each execution gets mapped to the same hive process.


Thanks,

Aadarsh Jajodia

[jira] [Assigned] (ATLAS-2901) Atlas tag doesn't support japanese characters

[Yu-Hsin Chang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yu-Hsin Chang reassigned ATLAS-2901:


Assignee: Yu-Hsin Chang

> Atlas tag doesn't support japanese characters
> -
>
> Key: ATLAS-2901
> URL: https://issues.apache.org/jira/browse/ATLAS-2901
> Project: Atlas
>  Issue Type: Bug
>Reporter: Changyao Ye
>Assignee: Yu-Hsin Chang
>Priority: Major
> Attachments: スクリーンショット 2018-09-28 10.39.24.png
>
>
> Hi there,
> I found that when I create a tag in Atlas using japanese characters, the 
> following error displayed.
> {color:#FF}"CLASSIFICATION. Names must consist of a letter followed by a 
> sequence of letter, number, or _ characters"{color}
> Is it possible to support japanese characters in tag's name?
>  
> !スクリーンショット 2018-09-28 10.39.24.png|width=617,height=293!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Update queries getting timed out

[Nallapati, Sreenivasulu]

Hi all,

We have a use case where we need to export all the meta data from existing 
system to Atlas. For us, it will a bootstrap job every day. Every day we will 
scan the existing system and update in the atlas. For this we are using the 
“v2/entity (createOrUpdate) post method.

Currently we are attaching the list of schema AtlasObjectIds to data scource, 
table AtlasObjectIds to schema, column AtlasObjectIds to table.
Rdbms model with Data source->schema->tables->columns. We have some of the data 
sources with below counts.
[cid:image001.png@01D4FA35.BEA17510]
When we try to update just the data source level attributes (say name and 
description), the “v2/entity (createOrUpdate) post method is taking numerous 
amount of time. While debugging the atlas code got to know that one of the 
method (mapAttributes) is trying to build the complete graph for all the 
entities involved from top to bottom (data source to column). As the process 
takes longer time our REST clients are getting socket/read timed out even after 
setting the time outs for 10 – 20 mins.

https://github.com/apache/atlas/blob/release-1.1.0-rc2/repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java#L386


And also curious to know about the getAndCache method, is this cache for a 
single thread?
https://github.com/apache/atlas/blob/d1f763ab2693911e564a91de29e5c4f2b5976ab7/repository/src/main/java/org/apache/atlas/repository/graph/FullTextMapperV2.java#L206


Please guide us to the right direction if we are doing something wrong..


---
Regards,
Sreeni

Re: [VOTE] Release Apache Atlas version 2.0.0 - rc0

[Madhan Neethiraj]

Sarath - thanks for putting this release together. Impressive set of 
enhancements. 250+ fixed JIRAs!

+1 for Apache Atlas 2.0.0 release

Performed the following:
- downloaded tar.gz and verified the signature
- built and installed Atlas for embedded HBase, Solr profile
- started Atlas with embedded HBase and Solr
- ran QuickStart successfully
- added/updated/deleted few 'Favorite Searches'
- performed number of searches - both basic and DSL
- created glossaries with number of terms, associated terms with entities
- verified classification propagations

Thanks,
Madhan


On 4/21/19, 11:02 PM, "Sarath Subramanian"  wrote:

Apache Atlas 2.0.0 release candidate #0 is now available for vote within
dev community.

Links to the release artifacts are given below. Please review and vote.

The vote will be open for at least 72 hours or until necessary votes are
reached.
  [ ] +1 Approve
  [ ] +0 No opinion
  [ ] -1 Disapprove (and reason why)

List of all issues addressed in this release:

https://issues.apache.org/jira/issues/?jql=project%20%3D%20ATLAS%20AND%20status%20%3D%20Resolved%20AND%20fixVersion%20%3D%202.0.0%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC

Git tag for the release:
https://github.com/apache/atlas/tree/release-2.0.0-rc0
Sources for the release:

https://dist.apache.org/repos/dist/dev/atlas/2.0.0-rc0/apache-atlas-2.0.0-sources.tar.gz

Source release verification:
PGP Signature:

https://dist.apache.org/repos/dist/dev/atlas/2.0.0-rc0/apache-atlas-2.0.0-sources.tar.gz.asc
SHA512 Hash:

https://dist.apache.org/repos/dist/dev/atlas/2.0.0-rc0/apache-atlas-2.0.0-sources.tar.gz.sha512
MD5 Hash:

https://dist.apache.org/repos/dist/dev/atlas/2.0.0-rc0/apache-atlas-2.0.0-sources.tar.gz.md5

Keys to verify the signature of the release artifacts are available at:
https://dist.apache.org/repos/dist/release/atlas/KEYS

New features/enhancements:
  - Update component versions to use Hadoop 3, HBase 2 and Solr 7
  - Update JanusGraph version to 0.3.1
  - Soft-reference attribute implementation.
  - Create patch framework to persist typedef patches applied to atlas
  - Handle data patches in patch framework
  - Export Process: Support for incremental export.
  - Atlas Import Transform handler implementation
  - Update authentication to support trusted proxy
  - Atlas Index Repair tool for JanusGraph
  - Update stats/metrics module to collect notification metrics
  - Add filter in lineage to hide Process entity.
  - Add service-type dropdown to filter entitydef type
  - Add notifications from RelationshipStore to ATLAS_ENTITITES kafka topic.
  - Added unique-attributes constraints at store-level
  - Performance enhancement to avoid unnecessary lookup when creating new
relationships
  - Updated notification processing to support batch-commits
  - Updated hook notification processing with option to ignore potentially
incorrect hive_column_lineage
  - Updated Hive hook to avoid duplicate column-lineage entities; also
updated Atlas server to skip duplicate column-lineage entities
  - Improved batch processing in notificaiton handler to avoid processing
of an entity multiple times
  - Add option to ignore/prune metadata for temporary/staging Hive tables
  - Update metrics query to use index query instead of graph query for
faster response
  - UI: Show counts besides the Type and Classification dropdown list in
search
  - UI: show lineage information for process entities
  - UI: Show entity specific icon for the lineage node
  - UI: Add relationship table inside relationships tab


Thanks,
Sarath

Add me as a Contributor for Atlas

[Rahul Kurup]

Hello,

I would like to be a contributor for Apache Atlas. My jira id is Rahul_FI .


--
Thanks and Regards,
/*Rahul Kurup
*/
/*Software  Tester*/
602, Synergy Business Park,
Sahakar Wadi,  Behind Virwani Indl Est,
Goregaon Mulund link road,
Goregaon (East), Mumbai-400063.
Tel: 02229272059 | Email: cont...@freestoneinfotech.com 



Web: www.freestoneinfotech.com 

[jira] [Assigned] (ATLAS-3129) Truststore reloader thread from AtlasBaseClient.

[Nixon Rodrigues (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nixon Rodrigues reassigned ATLAS-3129:
--

Assignee: Nixon Rodrigues

> Truststore reloader thread from AtlasBaseClient.
> 
>
> Key: ATLAS-3129
> URL: https://issues.apache.org/jira/browse/ATLAS-3129
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.1.0
>Reporter: Rajkumar Singh
>Assignee: Nixon Rodrigues
>Priority: Major
>
> AtlasBaseClient uses Hadoop's SSLFactory to create the 
> ReloadingX509TrustManager
> https://github.com/apache/atlas/blob/b919d3d0964efbe1eda40724545d5fa506100a02/client/common/src/main/java/org/apache/atlas/security/SecureClientUtils.java#L143
> currently, there is no way to stop/destroy method of the 
> ReloadingX509TrustManager, this creates  "Truststore reloader thread" leak in 
> hiveserver2 if the user is running any HOOK/UDF which uses the AtlasClient. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 70516: ATLAS-3129 Fix for Truststore reloader leak-from AtlasBaseClient

[Nixon Rodrigues]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70516/
---

(Updated April 23, 2019, 2:42 p.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
Subramanian.


Bugs: ATLAS-3129
https://issues.apache.org/jira/browse/ATLAS-3129


Repository: atlas


Description
---

AtlasBaseClient uses Hadoop's SSLFactory to create the ReloadingX509TrustManager

https://github.com/apache/atlas/blob/b919d3d0964efbe1eda40724545d5fa506100a02/client/common/src/main/java/org/apache/atlas/security/SecureClientUtils.java#L143

currently, there is no way to stop/destroy method of the 
ReloadingX509TrustManager, this creates "Truststore reloader thread" leak in 
hiveserver2 if the user is running any HOOK/UDF which uses the AtlasClient.

Solution:- Refactoring of code and added destroy method to destroy SSLFactory 
instance.


Diffs
-

  
addons/hbase-bridge/src/main/java/org/apache/atlas/hbase/bridge/HBaseBridge.java
 17d617d19 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
 21ceda200 
  
addons/kafka-bridge/src/main/java/org/apache/atlas/kafka/bridge/KafkaBridge.java
 214dd2512 
  client/common/src/main/java/org/apache/atlas/AtlasBaseClient.java cb7340fb6 
  client/common/src/main/java/org/apache/atlas/security/SecureClientUtils.java 
aeae300a6 
  webapp/src/main/java/org/apache/atlas/examples/QuickStart.java c043b65eb 


Diff: https://reviews.apache.org/r/70516/diff/2/


Testing
---

In progress


Thanks,

Nixon Rodrigues

[jira] [Updated] (ATLAS-3155) UI - IE-11 - Name entry not clickable

[Rahul Kurup (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rahul Kurup updated ATLAS-3155:
---
Attachment: ie11_name_issue.jpg

> UI - IE-11 - Name entry not clickable
> -
>
> Key: ATLAS-3155
> URL: https://issues.apache.org/jira/browse/ATLAS-3155
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Rahul Kurup
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: ie11_name_issue.jpg
>
>
> In the search results page, when we try to click the 'Name' column value of 
> any entry, nothing happens.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-3156) No loading animation while creating or deleting a Classification

[Rahul Kurup (JIRA)]

Rahul Kurup created ATLAS-3156:
--

 Summary: No loading animation while creating or deleting a 
Classification
 Key: ATLAS-3156
 URL: https://issues.apache.org/jira/browse/ATLAS-3156
 Project: Atlas
  Issue Type: Improvement
Reporter: Rahul Kurup


While creating a Classification, there is no loading animation or any 
indication to the user that the creation process is underway. The user only 
gets a notification that the creation process is complete. If for some reason 
the creation process takes a long while, then this lack of indication might 
confuse the user into thinking that nothing is happening on clicking the 
'Create' button.

 

This same issue exists when trying to delete a classification.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-3155) UI - IE-11 - Name entry not clickable

[Rahul Kurup (JIRA)]

Rahul Kurup created ATLAS-3155:
--

 Summary: UI - IE-11 - Name entry not clickable
 Key: ATLAS-3155
 URL: https://issues.apache.org/jira/browse/ATLAS-3155
 Project: Atlas
  Issue Type: Sub-task
Reporter: Rahul Kurup
 Fix For: 2.0.0


In the search results page, when we try to click the 'Name' column value of any 
entry, nothing happens.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-3154) UI - Lineage PNG export not working on Firefox

[Rahul Kurup (JIRA)]

Rahul Kurup created ATLAS-3154:
--

 Summary: UI - Lineage PNG export not working on Firefox
 Key: ATLAS-3154
 URL: https://issues.apache.org/jira/browse/ATLAS-3154
 Project: Atlas
  Issue Type: Sub-task
Reporter: Rahul Kurup
 Fix For: 2.0.0


When we click the PNG export button in Firefox (66.0.3), the message prompt 
"Lineage will be downloaded in a moment." appears but nothing happens.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)