[jira] [Updated] (ATLAS-4564) Can kafka metadata be automatically retrieved

2022-03-01 Thread fox (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-4564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

fox updated ATLAS-4564:
---
Issue Type: Test  (was: Wish)

> Can kafka metadata be automatically retrieved
> -
>
> Key: ATLAS-4564
> URL: https://issues.apache.org/jira/browse/ATLAS-4564
> Project: Atlas
>  Issue Type: Test
>  Components: kafka-integration
>Affects Versions: 2.1.0
>Reporter: fox
>Priority: Minor
>
> Configuration kafka hook, execute 'import-kafka.sh' successful.But can't Get 
> metadata in real time. Can I get the case documents?
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (ATLAS-4564) Can kafka metadata be automatically retrieved

2022-03-01 Thread fox (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-4564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

fox updated ATLAS-4564:
---
Issue Type: Wish  (was: Test)

> Can kafka metadata be automatically retrieved
> -
>
> Key: ATLAS-4564
> URL: https://issues.apache.org/jira/browse/ATLAS-4564
> Project: Atlas
>  Issue Type: Wish
>  Components: kafka-integration
>Affects Versions: 2.1.0
>Reporter: fox
>Priority: Minor
>
> Configuration kafka hook, execute 'import-kafka.sh' successful.But can't Get 
> metadata in real time. Can I get the case documents?
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (ATLAS-4556) Add Ozone "ofs" scheme support for external tables created through hive.

2022-03-01 Thread Mandar Ambawane (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mandar Ambawane updated ATLAS-4556:
---
Issue Type: Bug  (was: Improvement)

> Add Ozone "ofs" scheme support for external tables created through hive.
> 
>
> Key: ATLAS-4556
> URL: https://issues.apache.org/jira/browse/ATLAS-4556
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Mandar Ambawane
>Assignee: Mandar Ambawane
>Priority: Major
>
> When we provide ozone key as a path for an external table in hive,
> corresponding Ozone entities of type "Ozone_Volume", "Ozone_Bucket", 
> "Ozone_Key" etc. get created.
> Currently in Atlas, code supports the above in "o3fs" ozone scheme.
> Need to provide improved support in "ofs" scheme, same as that of "o3fs".



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Created] (ATLAS-4564) Can kafka metadata be automatically retrieved

2022-03-01 Thread fox (Jira) 
fox created ATLAS-4564:
--

 Summary: Can kafka metadata be automatically retrieved
 Key: ATLAS-4564
 URL: https://issues.apache.org/jira/browse/ATLAS-4564
 Project: Atlas
  Issue Type: Test
  Components: kafka-integration
Affects Versions: 2.1.0
Reporter: fox


Configuration kafka hook, execute 'import-kafka.sh' successful.But can't Get 
metadata in real time. Can I get the case documents?

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Re: Review Request 73731: ATLAS-4495 Glossary section takes longer time to load when Glossaries have large number of Categories and Terms associated with them

2022-03-01 Thread Radhika Kundam 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73731/#review224106
---




repository/src/main/java/org/apache/atlas/glossary/GlossaryService.java
Line 128 (original), 133 (patched)


Can we use atlasGlossaryDTO.from(glossaryEntity) and update "from" method 
to set the displayText instead of implementing new methods to avaoid duplicate 
code.



repository/src/main/java/org/apache/atlas/glossary/GlossaryService.java
Lines 1335 (patched)



categoryObjectId.getRelationshipAttributes().getAttribute("parentCategoryGuid") 
can be used instead of getting all attributes and null check.



repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
Lines 1554 (patched)


ret.getRelationshipAttributes().setAttribute("parentCategoryGuid", 
parentCategoryGuid) can be used which will handle to create attributes map if 
none present.


- Radhika Kundam


On Feb. 9, 2022, 8:54 p.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73731/
> ---
> 
> (Updated Feb. 9, 2022, 8:54 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Jayendra Parab, Radhika Kundam, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-4495
> https://issues.apache.org/jira/browse/ATLAS-4495
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> It is observed that, due to existing framework Glossary GET api takes longer 
> time.
> 
> This patch avoids the unnecessary db calls and improve the performance when 
> there is large number of data associated with the Glossary (say 10K terms or 
> categories)
> 
> 
> Diffs
> -
> 
>   repository/src/main/java/org/apache/atlas/glossary/GlossaryService.java 
> f81b53854 
>   repository/src/main/java/org/apache/atlas/repository/ogm/DataAccess.java 
> f902b2afb 
>   
> repository/src/main/java/org/apache/atlas/repository/ogm/glossary/AtlasGlossaryDTO.java
>  c525bdb99 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
>  794847555 
> 
> 
> Diff: https://reviews.apache.org/r/73731/diff/2/
> 
> 
> Testing
> ---
> 
> Manual testing is done.
> 
> PreCommit: 
> https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/1009/consoleFull
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>

[jira] [Commented] (ATLAS-3671) Maven Package Failure

2022-03-01 Thread Gary J. (Jira) 


[ 
https://issues.apache.org/jira/browse/ATLAS-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499715#comment-17499715
 ] 

Gary J.  commented on ATLAS-3671:
-

[~a1tair6] - which pom file did you edit to fix the {*}{*}Storm bridge shim 
failure?

> Maven Package Failure
> -
>
> Key: ATLAS-3671
> URL: https://issues.apache.org/jira/browse/ATLAS-3671
> Project: Atlas
>  Issue Type: Bug
>Reporter: ygo
>Priority: Blocker
> Attachments: image-2020-03-20-12-23-10-166.png, 
> image-2020-03-20-12-23-26-760.png, image-2020-03-20-12-25-19-822.png, 
> image-2020-03-20-12-26-08-408.png
>
>
> mvn clean -DskipTests package -Pdist,embedded-hbase-solr
>  
> i try mvn package, but failed.
> mvn version : 3.6.1
>  
>  
> *first*. JanusGraph DB Impl 2.0.0 build failure.
> "com.sleepycat:je:pom:7.4.5" in "http://repo1.maven.org/maven2";
> !image-2020-03-20-12-23-10-166.png|width=833,height=68!       
> !image-2020-03-20-12-23-26-760.png|width=1344,height=45!
>  * i modified the pom.xml file
>  ** 
>    oracleReleases
>    Oracle Released Java Packages
>    [http://download.oracle.com/maven]
>    default
>  
>  
> *second.* Storm bridge shim 2.0.0 build failure.
> !image-2020-03-20-12-25-19-822.png|width=589,height=236!
> !image-2020-03-20-12-26-08-408.png|width=1217,height=40!
>  
>  * i modified the pom.xml file
>  ** 
>   atlassian-public
>   https://maven.atlassian.com/repository/public
>   
>     true
>     never
>     warn
>   
>   
>     true
>     warn
>   
>  
>  
> *result. build succeed*
>  
> Did I do something wrong? Otherwise, please modify the source.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (ATLAS-4561) Suggestions feature for elasticsearch backend

2022-03-01 Thread Nithin Kumara Narayanaswamy Teekaramanaa (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nithin Kumara Narayanaswamy Teekaramanaa updated ATLAS-4561:

Component/s:  atlas-core

> Suggestions feature for elasticsearch backend
> -
>
> Key: ATLAS-4561
> URL: https://issues.apache.org/jira/browse/ATLAS-4561
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Reporter: Nithin Kumara Narayanaswamy Teekaramanaa
>Priority: Major
> Fix For: 2.3.0
>
>
> Hello, 
> Currently the suggestion feature only works for solr indexing backend but not 
> for other backends like elasticsearch.
> {code:java}
> if (solrClient == null) {
>  LOG.warn("The indexing system is not solr based. Suggestions feature 
> will not be 
>available.");
>  return;
> }
> {code}
> It would be a nice to have feature.
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (ATLAS-4561) Suggestions feature for elasticsearch backend

2022-03-01 Thread Nithin Kumara Narayanaswamy Teekaramanaa (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nithin Kumara Narayanaswamy Teekaramanaa updated ATLAS-4561:

Labels:   (was: 2.2.o)

> Suggestions feature for elasticsearch backend
> -
>
> Key: ATLAS-4561
> URL: https://issues.apache.org/jira/browse/ATLAS-4561
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Nithin Kumara Narayanaswamy Teekaramanaa
>Priority: Major
>
> Hello, 
> Currently the suggestion feature only works for solr indexing backend but not 
> for other backends like elasticsearch.
> {code:java}
> if (solrClient == null) {
>  LOG.warn("The indexing system is not solr based. Suggestions feature 
> will not be 
>available.");
>  return;
> }
> {code}
> It would be a nice to have feature.
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (ATLAS-4561) Suggestions feature for elasticsearch backend

2022-03-01 Thread Nithin Kumara Narayanaswamy Teekaramanaa (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nithin Kumara Narayanaswamy Teekaramanaa updated ATLAS-4561:

Fix Version/s: 2.3.0

> Suggestions feature for elasticsearch backend
> -
>
> Key: ATLAS-4561
> URL: https://issues.apache.org/jira/browse/ATLAS-4561
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Nithin Kumara Narayanaswamy Teekaramanaa
>Priority: Major
> Fix For: 2.3.0
>
>
> Hello, 
> Currently the suggestion feature only works for solr indexing backend but not 
> for other backends like elasticsearch.
> {code:java}
> if (solrClient == null) {
>  LOG.warn("The indexing system is not solr based. Suggestions feature 
> will not be 
>available.");
>  return;
> }
> {code}
> It would be a nice to have feature.
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (ATLAS-4561) Suggestions feature for elasticsearch backend

2022-03-01 Thread Nithin Kumara Narayanaswamy Teekaramanaa (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nithin Kumara Narayanaswamy Teekaramanaa updated ATLAS-4561:

Issue Type: New Feature  (was: Wish)

> Suggestions feature for elasticsearch backend
> -
>
> Key: ATLAS-4561
> URL: https://issues.apache.org/jira/browse/ATLAS-4561
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Nithin Kumara Narayanaswamy Teekaramanaa
>Priority: Major
>  Labels: 2.2.0
>
> Hello, 
> Currently the suggestion feature only works for solr indexing backend but not 
> for other backends like elasticsearch.
> {code:java}
> if (solrClient == null) {
>  LOG.warn("The indexing system is not solr based. Suggestions feature 
> will not be 
>available.");
>  return;
> }
> {code}
> It would be a nice to have feature.
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (ATLAS-4561) Suggestions feature for elasticsearch backend

2022-03-01 Thread Nithin Kumara Narayanaswamy Teekaramanaa (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nithin Kumara Narayanaswamy Teekaramanaa updated ATLAS-4561:

Labels: 2.2.o  (was: 2.2.0)

> Suggestions feature for elasticsearch backend
> -
>
> Key: ATLAS-4561
> URL: https://issues.apache.org/jira/browse/ATLAS-4561
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Nithin Kumara Narayanaswamy Teekaramanaa
>Priority: Major
>  Labels: 2.2.o
>
> Hello, 
> Currently the suggestion feature only works for solr indexing backend but not 
> for other backends like elasticsearch.
> {code:java}
> if (solrClient == null) {
>  LOG.warn("The indexing system is not solr based. Suggestions feature 
> will not be 
>available.");
>  return;
> }
> {code}
> It would be a nice to have feature.
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Commented] (ATLAS-4213) Atlas UI is taking lot of time to load.

2022-03-01 Thread Nithin Kumara Narayanaswamy Teekaramanaa (Jira) 


[ 
https://issues.apache.org/jira/browse/ATLAS-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499641#comment-17499641
 ] 

Nithin Kumara Narayanaswamy Teekaramanaa commented on ATLAS-4213:
-

Hi [~prasadpp13], Sure I have attached  [^localhost.har] 

> Atlas UI is taking lot of time to load.
> ---
>
> Key: ATLAS-4213
> URL: https://issues.apache.org/jira/browse/ATLAS-4213
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-webui
>Affects Versions: 3.0.0
>Reporter: Prasad P. Pawar
>Assignee: Prasad P. Pawar
>Priority: Major
> Fix For: 2.2.0
>
> Attachments: 
> 0001-ATLAS-4213-Atlas-UI-is-taking-lot-of-time-to-load.fi.patch, 
> 0001-ATLAS-4213-V1-UIAtlas-UI-is-taking-lot-of-time-to-lo.patch, 
> 0001-ATLAS-4213-V2-Atlas-UI-is-taking-lot-of-time-to-load.patch, localhost.har
>
>
> Description-
> Atlas UI is taking a lot of time to load, after metadata creation part of 
> scale testing, a large number of classifications & entities.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (ATLAS-4213) Atlas UI is taking lot of time to load.

2022-03-01 Thread Nithin Kumara Narayanaswamy Teekaramanaa (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nithin Kumara Narayanaswamy Teekaramanaa updated ATLAS-4213:

Attachment: localhost.har

> Atlas UI is taking lot of time to load.
> ---
>
> Key: ATLAS-4213
> URL: https://issues.apache.org/jira/browse/ATLAS-4213
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-webui
>Affects Versions: 3.0.0
>Reporter: Prasad P. Pawar
>Assignee: Prasad P. Pawar
>Priority: Major
> Fix For: 2.2.0
>
> Attachments: 
> 0001-ATLAS-4213-Atlas-UI-is-taking-lot-of-time-to-load.fi.patch, 
> 0001-ATLAS-4213-V1-UIAtlas-UI-is-taking-lot-of-time-to-lo.patch, 
> 0001-ATLAS-4213-V2-Atlas-UI-is-taking-lot-of-time-to-load.patch, localhost.har
>
>
> Description-
> Atlas UI is taking a lot of time to load, after metadata creation part of 
> scale testing, a large number of classifications & entities.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Created] (ATLAS-4563) Failed to execute goal org.apache.maven.plugins:maven-war-plugin:3.3.2:war (default-war) on project atlas-webapp: Execution default-war of goal org.apache.maven.plugins:m

2022-03-01 Thread pongpanot samarkkarn (Jira) 
pongpanot samarkkarn created ATLAS-4563:
---

 Summary: Failed to execute goal 
org.apache.maven.plugins:maven-war-plugin:3.3.2:war (default-war) on project 
atlas-webapp: Execution default-war of goal 
org.apache.maven.plugins:maven-war-plugin:3.3.2:war failed: Negative time 
 Key: ATLAS-4563
 URL: https://issues.apache.org/jira/browse/ATLAS-4563
 Project: Atlas
  Issue Type: Bug
Reporter: pongpanot samarkkarn
 Attachments: atlas.png

i got stuck for a quizBuild



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Created] (ATLAS-4562) Failed to execute goal org.apache.maven.plugins:maven-war-plugin:2.6:war (default-war) on project atlas-dashboardv2

2022-03-01 Thread pongpanot samarkkarn (Jira) 
pongpanot samarkkarn created ATLAS-4562:
---

 Summary: Failed to execute goal 
org.apache.maven.plugins:maven-war-plugin:2.6:war (default-war) on project 
atlas-dashboardv2
 Key: ATLAS-4562
 URL: https://issues.apache.org/jira/browse/ATLAS-4562
 Project: Atlas
  Issue Type: Bug
Reporter: pongpanot samarkkarn
 Attachments: apache.png

Failed to execute goal org.apache.maven.plugins:maven-war-plugin:2.6:war 
(default-war) on project atlas-dashboardv2: Execution default-war of goal 
org.apache.maven.plugins:maven-war-plugin:2.6:war failed: Unable to load the 
mojo 'war' in the plugin 'org.apache.maven.plugins:maven-war-plugin:2.6' due to 
an API incompatibility: 
org.codehaus.plexus.component.repository.exception.ComponentLookupException: 
null



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Using apache atlas as data catalog for snowflake

2022-03-01 Thread Great Info 
I have snowflake as a data warehouse and want to use Apache atlas as a data
catalog and lineage tool. I went through the details but am not sure if it
can be used with snowflake. Is it possible to connect with snowflake?