[jira] [Updated] (ATLAS-4451) UI: Chart representation of Metrics data on Statistics dialog box

2021-11-29 Thread Prasad P. Pawar (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasad P. Pawar updated ATLAS-4451:
---
Attachment: 0001-ATLAS-4451-UI-2-Chart-representation-of-Metrics-data.patch

> UI: Chart representation of Metrics data on Statistics dialog box 
> --
>
> Key: ATLAS-4451
> URL: https://issues.apache.org/jira/browse/ATLAS-4451
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.2.0
>Reporter: Prasad P. Pawar
>Assignee: Prasad P. Pawar
>Priority: Major
>  Labels: Atlas-UI
> Attachments: 
> 0001-ATLAS-4451-UI-1-Chart-representation-of-Metrics-data.patch, 
> 0001-ATLAS-4451-UI-2-Chart-representation-of-Metrics-data.patch
>
>
> Below mentioned points need to be added on the Statistics dialog box.
> 1) Dropdown List
>  A Dropdown list will be shown at the upper right corner of the Entities 
> panel.
> When the dropdown list is selected, the GetAll() API will be called, and a 
> list of readable timestamps (Date & Time) of the MetricsStatMin will be shown.
> When a specific timestamp (Date & Time) is selected, the GetMetrics() API 
> will be called, and return one MetricsStat with detailed information matching 
> the selected timestamp, this data should be shown on the Statistics dialog 
> box.
> 2) Trending Chart inside Entity (Stacked Area Chart) [Stacked Area Chart 
> Link|https://nvd3.org/examples/stackedArea.html]
>  For users, the specific typeName is selectable. It has a green shade in the 
> UI, to indicate this typeName is selected. Its default value is “hive_table”. 
>  The chart shows “hive_table” by default. Users can select the other 
> typeName, then the panel and the chart will be refreshed.
> The past period of time frame is selectable (1 day, 7 days, 14 days, 30 
> days). Its default value is 7 days. The endTime is Now. 
> Currently, there are 3 categories of counting information: Active, Deleted, 
> Shell. Their trending counts are different.  This data can be represented on 
> the Stacked Area Chart.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


Large number of CVE's (vulnerabilities) when building 2.2.0 from source

2021-11-29 Thread BOOZ 樂
Atlas 2.2.0 when built from source seems to have a large number of jar
packages that suffer from known exploits / vulnerabilities. I've performed
an Anchore and a Twistlock scan of the compiled application and here's the
list of the High and Critical vulnerabilities found:

https://pastebin.com/raw/t59rcyH8

I am attempting to put together a public docker image of Atlas compiled
from source. You can see my build process here to see how I arrived at the
compiled build that I performed the scans on:

https://github.com/589290/docker-apache-atlas-ubi8/blob/main/Dockerfile

I'm not a Java developer, but I would imagine that perhaps a different
version of Maven (I'm using 3.6.3) or an updated pom.xml that has more
current (vulnerability free) versions of packages may help remedy my
findings.

Best Regards,
Greg


Review Request 73731: ATLAS-4495 Glossary section takes longer time to load when Glossaries have large number of Categories and Terms associated with them

2021-11-29 Thread Mandar Ambawane

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73731/
---

Review request for atlas, Ashutosh Mestry, Jayendra Parab, and Sarath 
Subramanian.


Bugs: ATLAS-4495
https://issues.apache.org/jira/browse/ATLAS-4495


Repository: atlas


Description
---

It is observed that, due to existing framework Glossary GET api takes longer 
time.

This patch avoids the unnecessary db calls and improve the performance when 
there is large number of data associated with the Glossary (say 10K terms or 
categories)


Diffs
-

  repository/src/main/java/org/apache/atlas/glossary/GlossaryService.java 
9c8459874 
  repository/src/main/java/org/apache/atlas/repository/ogm/DataAccess.java 
f902b2afb 
  
repository/src/main/java/org/apache/atlas/repository/ogm/glossary/AtlasGlossaryDTO.java
 c525bdb99 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
 794847555 


Diff: https://reviews.apache.org/r/73731/diff/1/


Testing
---

Manual testing is done.


Thanks,

Mandar Ambawane



[jira] [Assigned] (ATLAS-4495) Glossary section takes longer time to load when Glossaries have large number of Categories and Terms associated with them

2021-11-29 Thread Mandar Ambawane (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mandar Ambawane reassigned ATLAS-4495:
--

Assignee: Mandar Ambawane

> Glossary section takes longer time to load when Glossaries have large number 
> of Categories and Terms associated with them
> -
>
> Key: ATLAS-4495
> URL: https://issues.apache.org/jira/browse/ATLAS-4495
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Mandar Ambawane
>Assignee: Mandar Ambawane
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Created] (ATLAS-4495) Glossary section takes longer time to load when Glossaries have large number of Categories and Terms associated with them

2021-11-29 Thread Mandar Ambawane (Jira)
Mandar Ambawane created ATLAS-4495:
--

 Summary: Glossary section takes longer time to load when 
Glossaries have large number of Categories and Terms associated with them
 Key: ATLAS-4495
 URL: https://issues.apache.org/jira/browse/ATLAS-4495
 Project: Atlas
  Issue Type: Improvement
Reporter: Mandar Ambawane






--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Commented] (ATLAS-3820) run import-kafka.sh throws Expection

2021-11-29 Thread Axel COUTY (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450326#comment-17450326
 ] 

Axel COUTY commented on ATLAS-3820:
---

Just encountered this issue.

It seems that *NestableRuntimeExceptionException* is not present in recent 
releases of apache commons lang.

 

This commit: 
[https://github.com/apache/atlas/commit/27fb8eebc33e40dc60c1b331c69225aaa9207290]
 changed the dependency version from 2.4 to 3.4. Which in the end brake the 
kafka-hook.

 

Adding back this dependency to java command which starts the hook does the 
trick !

 

 

 

> run import-kafka.sh throws Expection
> 
>
> Key: ATLAS-3820
> URL: https://issues.apache.org/jira/browse/ATLAS-3820
> Project: Atlas
>  Issue Type: Bug
>  Components: kafka-integration
>Affects Versions: 1.0.0
> Environment: Kafka version: 1.1.0
>Reporter: fa
>Priority: Major
>
> maven build command: mvn clean -DskipTests package -Pdist,embedded-hbase-solr
> I run `bin/atlas_stat.py`, and I can see the web-ui.
> Then I run 
> apache-atlas-1.0.0-kafka-hook/apache-atlas-kafka-hook-1.0.0/hook-bin/import-kafka.sh.
> stack trace
> Exception in thread "main" java.lang.NoClassDefFoundError: 
> org/apache/commons/lang/exception/NestableRuntimeExceptionException in thread 
> "main" java.lang.NoClassDefFoundError: 
> org/apache/commons/lang/exception/NestableRuntimeException at 
> java.lang.ClassLoader.defineClass1(Native Method) at 
> java.lang.ClassLoader.defineClass(ClassLoader.java:763) at 
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at 
> java.net.URLClassLoader.defineClass(URLClassLoader.java:468) at 
> java.net.URLClassLoader.access$100(URLClassLoader.java:74) at 
> java.net.URLClassLoader$1.run(URLClassLoader.java:369) at 
> java.net.URLClassLoader$1.run(URLClassLoader.java:363) at 
> java.security.AccessController.doPrivileged(Native Method) at 
> java.net.URLClassLoader.findClass(URLClassLoader.java:362) at 
> java.lang.ClassLoader.loadClass(ClassLoader.java:424) at 
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at 
> java.lang.ClassLoader.loadClass(ClassLoader.java:357) at 
> java.lang.ClassLoader.defineClass1(Native Method) at 
> java.lang.ClassLoader.defineClass(ClassLoader.java:763) at 
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at 
> java.net.URLClassLoader.defineClass(URLClassLoader.java:468) at 
> java.net.URLClassLoader.access$100(URLClassLoader.java:74) at 
> java.net.URLClassLoader$1.run(URLClassLoader.java:369) at 
> java.net.URLClassLoader$1.run(URLClassLoader.java:363) at 
> java.security.AccessController.doPrivileged(Native Method) at 
> java.net.URLClassLoader.findClass(URLClassLoader.java:362) at 
> java.lang.ClassLoader.loadClass(ClassLoader.java:424) at 
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at 
> java.lang.ClassLoader.loadClass(ClassLoader.java:357) at 
> org.apache.atlas.kafka.bridge.KafkaBridge.main(KafkaBridge.java:100)Caused 
> by: java.lang.ClassNotFoundException: 
> org.apache.commons.lang.exception.NestableRuntimeException at 
> java.net.URLClassLoader.findClass(URLClassLoader.java:382) at 
> java.lang.ClassLoader.loadClass(ClassLoader.java:424) at 
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at 
> java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 25 more



--
This message was sent by Atlassian Jira
(v8.20.1#820001)