[jira] [Commented] (ATLAS-3468) Exclude JTS topology suite library from being packaged
[ https://issues.apache.org/jira/browse/ATLAS-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952492#comment-16952492 ] Ashutosh Mestry commented on ATLAS-3468: +1 for patch. Thanks [~sarath]! > Exclude JTS topology suite library from being packaged > -- > > Key: ATLAS-3468 > URL: https://issues.apache.org/jira/browse/ATLAS-3468 > Project: Atlas > Issue Type: Task > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 2.1.0 > > Attachments: ATLAS-3468.001.patch > > > Exclude JTS topology suite library from being packaged -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3468) Exclude JTS topology suite library from being packaged
[ https://issues.apache.org/jira/browse/ATLAS-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sarath Subramanian updated ATLAS-3468: -- Attachment: ATLAS-3468.001.patch > Exclude JTS topology suite library from being packaged > -- > > Key: ATLAS-3468 > URL: https://issues.apache.org/jira/browse/ATLAS-3468 > Project: Atlas > Issue Type: Task > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 2.1.0 > > Attachments: ATLAS-3468.001.patch > > > Exclude JTS topology suite library from being packaged -- This message was sent by Atlassian Jira (v8.3.4#803005)
Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71620/ --- Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath Subramanian. Bugs: ATLAS-3461 https://issues.apache.org/jira/browse/ATLAS-3461 Repository: atlas Description --- Now even if the Impala queries contains comment/ extra spaces, Atlas will create the impala process approproately. Even "create external table" will create Impala process at Atlas and user can see lineage. Diffs - addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java b9dd894f8 addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java dc4d1333e addons/impala-bridge/src/test/resources/WALimpala.wal PRE-CREATION addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json PRE-CREATION addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json PRE-CREATION addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json PRE-CREATION Diff: https://reviews.apache.org/r/71620/diff/1/ Testing --- 1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. Now after the fix it works. 2. Validated manually by running below mentioned query from Impala:JDBC: create table testMon4 as select * from t1; creAte external table /*test*/ testMo3 aS -- temp fff /* temp */ -- sdfrnfkjef select select * from t1; Create /*dd*/ table testMon4 aS select * from t1; creAte external table /*test*/ testMon10 aS -- temp fff /* temp */ -- sdfrnfkjef select select * from t1; alter view testMonView2 as select * from t1; create view testMonView4 as select * from t1; alter view testMonView4 as select * from t1; CREATE EXTERNAL TABLE IF NOT EXISTS mondaysecond1 LIKE t1 LOCATION '/warehouse/tablespace/external/hive/db1.db/mondaysecond1'; Thanks, Sidharth Mishra
[jira] [Created] (ATLAS-3469) Missing information on Atlas web page
Raymond C created ATLAS-3469: Summary: Missing information on Atlas web page Key: ATLAS-3469 URL: https://issues.apache.org/jira/browse/ATLAS-3469 Project: Atlas Issue Type: Improvement Reporter: Raymond C I found that there are missing information on the Atlas webpage [https://atlas.apache.org/#/Architecture.|https://atlas.apache.org/#/Architecture] 1 Not all the hooks on the figure of High Level Architecture: missing Kafka. 2 One the same page, Metadata sources section missed Falcon. 3 Some project provides the integration of Spark to Atlas ([https://github.com/hortonworks-spark/spark-atlas-connector]), please consider to add it to the webpage. I am happy to help update the Atlas webpage if you need any assistance. Regards, Raymond -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ATLAS-3468) Exclude JTS topology suite library from being packaged
Sarath Subramanian created ATLAS-3468: - Summary: Exclude JTS topology suite library from being packaged Key: ATLAS-3468 URL: https://issues.apache.org/jira/browse/ATLAS-3468 Project: Atlas Issue Type: Task Components: atlas-core Affects Versions: 2.0.0 Reporter: Sarath Subramanian Assignee: Sarath Subramanian Fix For: 2.1.0 Exclude JTS topology suite library from being packaged -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3463) UI : Show JVM resources stats on statistics modal
[
https://issues.apache.org/jira/browse/ATLAS-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952377#comment-16952377
]
ASF subversion and git services commented on ATLAS-3463:
Commit 0b51871daa1d147556da5331e63219f2f6172c0f in atlas's branch
refs/heads/branch-2.0 from sameer79
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=0b51871 ]
ATLAS-3463 UI : Show JVM resources stats on statistics modal
Signed-off-by: Sarath Subramanian
(cherry picked from commit c3da6d5ff3519f3f39cd34d578b91341a417d402)
> UI : Show JVM resources stats on statistics modal
> -
>
> Key: ATLAS-3463
> URL: https://issues.apache.org/jira/browse/ATLAS-3463
> Project: Atlas
> Issue Type: Sub-task
>Reporter: Nikhil Bonte
>Assignee: Sameer Shaikh
>Priority: Major
> Attachments:
> ATLAS-3463-UI-Show-JVM-resources-stats-on-statistics.patch, ATLAS-3463.patch
>
>
> Add system details returned in metric API to the statistics modal.
> {code:java}
> JSON structure:
> {
> "data": {
> "general": {
> ...
> },
> "system": {
> "memory": {
> "heapCommitted": "687865856",
> "heapInit": "262144000",
> "heapMax": "954728448",
> "heapUsed": "398610416",
> "memory_pool_usages": {
> "PS Eden Space": {
> "committed": 217579520,
> "init": 66060288,
> "max": 302514176,
> "used": 171862912
> },
> "PS Old Gen": {
> "committed": 449314816,
> "init": 175112192,
> "max": 716177408,
> "used": 205808048
> },
> "PS Survivor Space": {
> "committed": 20971520,
> "init": 10485760,
> "max": 20971520,
> "used": 20939456
> }
> },
> "nonHeapCommitted": "172163072",
> "nonHeapInit": "2555904",
> "nonHeapMax": "-1",
> "nonHeapUsed": "168581552"
> },
> "os": {
> "os.spec": "Linux, amd64, 4.15.0-51-generic",
> "os.vcpus": "4"
> },
> "runtime": {
> "name": "OpenJDK 64-Bit Server VM",
> "version": "1.8.0_212"
> }
> }
> }
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ATLAS-3463) UI : Show JVM resources stats on statistics modal
[
https://issues.apache.org/jira/browse/ATLAS-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952376#comment-16952376
]
ASF subversion and git services commented on ATLAS-3463:
Commit c3da6d5ff3519f3f39cd34d578b91341a417d402 in atlas's branch
refs/heads/master from sameer79
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=c3da6d5 ]
ATLAS-3463 UI : Show JVM resources stats on statistics modal
Signed-off-by: Sarath Subramanian
> UI : Show JVM resources stats on statistics modal
> -
>
> Key: ATLAS-3463
> URL: https://issues.apache.org/jira/browse/ATLAS-3463
> Project: Atlas
> Issue Type: Sub-task
>Reporter: Nikhil Bonte
>Assignee: Sameer Shaikh
>Priority: Major
> Attachments:
> ATLAS-3463-UI-Show-JVM-resources-stats-on-statistics.patch, ATLAS-3463.patch
>
>
> Add system details returned in metric API to the statistics modal.
> {code:java}
> JSON structure:
> {
> "data": {
> "general": {
> ...
> },
> "system": {
> "memory": {
> "heapCommitted": "687865856",
> "heapInit": "262144000",
> "heapMax": "954728448",
> "heapUsed": "398610416",
> "memory_pool_usages": {
> "PS Eden Space": {
> "committed": 217579520,
> "init": 66060288,
> "max": 302514176,
> "used": 171862912
> },
> "PS Old Gen": {
> "committed": 449314816,
> "init": 175112192,
> "max": 716177408,
> "used": 205808048
> },
> "PS Survivor Space": {
> "committed": 20971520,
> "init": 10485760,
> "max": 20971520,
> "used": 20939456
> }
> },
> "nonHeapCommitted": "172163072",
> "nonHeapInit": "2555904",
> "nonHeapMax": "-1",
> "nonHeapUsed": "168581552"
> },
> "os": {
> "os.spec": "Linux, amd64, 4.15.0-51-generic",
> "os.vcpus": "4"
> },
> "runtime": {
> "name": "OpenJDK 64-Bit Server VM",
> "version": "1.8.0_212"
> }
> }
> }
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ATLAS-3463) UI : Show JVM resources stats on statistics modal
[
https://issues.apache.org/jira/browse/ATLAS-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952374#comment-16952374
]
Sarath Subramanian commented on ATLAS-3463:
---
Thanks for the patch [~sameer.shaikh]. +1
> UI : Show JVM resources stats on statistics modal
> -
>
> Key: ATLAS-3463
> URL: https://issues.apache.org/jira/browse/ATLAS-3463
> Project: Atlas
> Issue Type: Sub-task
>Reporter: Nikhil Bonte
>Assignee: Sameer Shaikh
>Priority: Major
> Attachments:
> ATLAS-3463-UI-Show-JVM-resources-stats-on-statistics.patch, ATLAS-3463.patch
>
>
> Add system details returned in metric API to the statistics modal.
> {code:java}
> JSON structure:
> {
> "data": {
> "general": {
> ...
> },
> "system": {
> "memory": {
> "heapCommitted": "687865856",
> "heapInit": "262144000",
> "heapMax": "954728448",
> "heapUsed": "398610416",
> "memory_pool_usages": {
> "PS Eden Space": {
> "committed": 217579520,
> "init": 66060288,
> "max": 302514176,
> "used": 171862912
> },
> "PS Old Gen": {
> "committed": 449314816,
> "init": 175112192,
> "max": 716177408,
> "used": 205808048
> },
> "PS Survivor Space": {
> "committed": 20971520,
> "init": 10485760,
> "max": 20971520,
> "used": 20939456
> }
> },
> "nonHeapCommitted": "172163072",
> "nonHeapInit": "2555904",
> "nonHeapMax": "-1",
> "nonHeapUsed": "168581552"
> },
> "os": {
> "os.spec": "Linux, amd64, 4.15.0-51-generic",
> "os.vcpus": "4"
> },
> "runtime": {
> "name": "OpenJDK 64-Bit Server VM",
> "version": "1.8.0_212"
> }
> }
> }
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Re: Review Request 71619: ATLAS-3464: Define Entities stored in Atlas for ML Governance
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71619/ --- (Updated Oct. 15, 2019, 9:47 p.m.) Review request for atlas, Ashutosh Mestry, Sridhar K, Madhan Neethiraj, and Sarath Subramanian. Bugs: atlas-3464 https://issues.apache.org/jira/browse/atlas-3464 Repository: atlas Description --- Define entities used for Machine Learning Governance Diffs - addons/models/1000-Hadoop/-ml_model.json PRE-CREATION Diff: https://reviews.apache.org/r/71619/diff/1/ Testing --- verified it is valid json file Thanks, Na Li
Review Request 71619: ATLAS-3464: Define Entities stored in Atlas for ML Governance
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71619/ --- Review request for atlas, Ashutosh Mestry, Sridhar K, Madhan Neethiraj, and Sarath Subramanian. Repository: atlas Description --- Define entities used for Machine Learning Governance Diffs - addons/models/1000-Hadoop/-ml_model.json PRE-CREATION Diff: https://reviews.apache.org/r/71619/diff/1/ Testing --- verified it is valid json file Thanks, Na Li
[jira] [Created] (ATLAS-3467) Regression : Tag filters (begins_with , ends_with , contains) and space fetches incorrect results
Le Ma created ATLAS-3467: Summary: Regression : Tag filters (begins_with , ends_with , contains) and space fetches incorrect results Key: ATLAS-3467 URL: https://issues.apache.org/jira/browse/ATLAS-3467 Project: Atlas Issue Type: Bug Reporter: Le Ma Assignee: Le Ma 1. Create a tag `tag1` with attribute `attr1`. 2. Associate `tag1` to an entity with value `value1` for `attr1` 3. Fire basic search for tag1 with filters: "attr1" contains "new comment" Entity is returned , though "value1" is not related to "new comment" at all. Happens with contains/begins_with/ends_with filters and not with =/!= Happens with filters with space (ex : new comment and not with newcomment or new_comment) Happens only with tag filters and not with entity filters. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ATLAS-3466) Implement ML Hook API for Atlas
Na Li created ATLAS-3466: Summary: Implement ML Hook API for Atlas Key: ATLAS-3466 URL: https://issues.apache.org/jira/browse/ATLAS-3466 Project: Atlas Issue Type: Task Components: atlas-core Affects Versions: 3.0.0 Reporter: Na Li Assignee: Na Li The implementation of the ML Hook API will transform the ML metadata into entities defined for ML integration with Atlas. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ATLAS-3465) Define the ML Hook API that an Atlas addon will implement
Na Li created ATLAS-3465: Summary: Define the ML Hook API that an Atlas addon will implement Key: ATLAS-3465 URL: https://issues.apache.org/jira/browse/ATLAS-3465 Project: Atlas Issue Type: Task Components: atlas-core Affects Versions: 3.0.0 Reporter: Na Li Assignee: Na Li A ML model should call the Hook API to pass in metadata updates. ML integration as part of Atlas code base will implement this Hook API to transform the metadata into entities stored in Atlas. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ATLAS-3464) Define Entities stored in Atlas for ML Governance
Na Li created ATLAS-3464: Summary: Define Entities stored in Atlas for ML Governance Key: ATLAS-3464 URL: https://issues.apache.org/jira/browse/ATLAS-3464 Project: Atlas Issue Type: Task Components: atlas-core Affects Versions: 3.0.0 Reporter: Na Li Assignee: Na Li Need to define the entities to store ML governance metadata. The definitions include: Entities and their relationship * Project create process * Project * Model training process * Model build * Model deployment process * Model deployment * User -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3463) UI : Show JVM resources stats on statistics modal
[
https://issues.apache.org/jira/browse/ATLAS-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sameer Shaikh updated ATLAS-3463:
-
Attachment: ATLAS-3463.patch
> UI : Show JVM resources stats on statistics modal
> -
>
> Key: ATLAS-3463
> URL: https://issues.apache.org/jira/browse/ATLAS-3463
> Project: Atlas
> Issue Type: Sub-task
>Reporter: Nikhil Bonte
>Assignee: Sameer Shaikh
>Priority: Major
> Attachments: ATLAS-3463.patch
>
>
> Add system details returned in metric API to the statistics modal.
> {code:java}
> JSON structure:
> {
> "data": {
> "general": {
> ...
> },
> "system": {
> "memory": {
> "heapCommitted": "687865856",
> "heapInit": "262144000",
> "heapMax": "954728448",
> "heapUsed": "398610416",
> "memory_pool_usages": {
> "PS Eden Space": {
> "committed": 217579520,
> "init": 66060288,
> "max": 302514176,
> "used": 171862912
> },
> "PS Old Gen": {
> "committed": 449314816,
> "init": 175112192,
> "max": 716177408,
> "used": 205808048
> },
> "PS Survivor Space": {
> "committed": 20971520,
> "init": 10485760,
> "max": 20971520,
> "used": 20939456
> }
> },
> "nonHeapCommitted": "172163072",
> "nonHeapInit": "2555904",
> "nonHeapMax": "-1",
> "nonHeapUsed": "168581552"
> },
> "os": {
> "os.spec": "Linux, amd64, 4.15.0-51-generic",
> "os.vcpus": "4"
> },
> "runtime": {
> "name": "OpenJDK 64-Bit Server VM",
> "version": "1.8.0_212"
> }
> }
> }
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (ATLAS-3463) UI : Show JVM resources stats on statistics modal
[
https://issues.apache.org/jira/browse/ATLAS-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nikhil Bonte reassigned ATLAS-3463:
---
Assignee: Nikhil Bonte
> UI : Show JVM resources stats on statistics modal
> -
>
> Key: ATLAS-3463
> URL: https://issues.apache.org/jira/browse/ATLAS-3463
> Project: Atlas
> Issue Type: Sub-task
>Reporter: Nikhil Bonte
>Assignee: Nikhil Bonte
>Priority: Major
>
> Add system details returned in metric API to the statistics modal.
> {code:java}
> JSON structure:
> {
> "data": {
> "general": {
> ...
> },
> "system": {
> "memory": {
> "heapCommitted": "687865856",
> "heapInit": "262144000",
> "heapMax": "954728448",
> "heapUsed": "398610416",
> "memory_pool_usages": {
> "PS Eden Space": {
> "committed": 217579520,
> "init": 66060288,
> "max": 302514176,
> "used": 171862912
> },
> "PS Old Gen": {
> "committed": 449314816,
> "init": 175112192,
> "max": 716177408,
> "used": 205808048
> },
> "PS Survivor Space": {
> "committed": 20971520,
> "init": 10485760,
> "max": 20971520,
> "used": 20939456
> }
> },
> "nonHeapCommitted": "172163072",
> "nonHeapInit": "2555904",
> "nonHeapMax": "-1",
> "nonHeapUsed": "168581552"
> },
> "os": {
> "os.spec": "Linux, amd64, 4.15.0-51-generic",
> "os.vcpus": "4"
> },
> "runtime": {
> "name": "OpenJDK 64-Bit Server VM",
> "version": "1.8.0_212"
> }
> }
> }
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (ATLAS-3463) UI : Show JVM resources stats on statistics modal
[
https://issues.apache.org/jira/browse/ATLAS-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nikhil Bonte reassigned ATLAS-3463:
---
Assignee: Sameer Shaikh (was: Nikhil Bonte)
> UI : Show JVM resources stats on statistics modal
> -
>
> Key: ATLAS-3463
> URL: https://issues.apache.org/jira/browse/ATLAS-3463
> Project: Atlas
> Issue Type: Sub-task
>Reporter: Nikhil Bonte
>Assignee: Sameer Shaikh
>Priority: Major
>
> Add system details returned in metric API to the statistics modal.
> {code:java}
> JSON structure:
> {
> "data": {
> "general": {
> ...
> },
> "system": {
> "memory": {
> "heapCommitted": "687865856",
> "heapInit": "262144000",
> "heapMax": "954728448",
> "heapUsed": "398610416",
> "memory_pool_usages": {
> "PS Eden Space": {
> "committed": 217579520,
> "init": 66060288,
> "max": 302514176,
> "used": 171862912
> },
> "PS Old Gen": {
> "committed": 449314816,
> "init": 175112192,
> "max": 716177408,
> "used": 205808048
> },
> "PS Survivor Space": {
> "committed": 20971520,
> "init": 10485760,
> "max": 20971520,
> "used": 20939456
> }
> },
> "nonHeapCommitted": "172163072",
> "nonHeapInit": "2555904",
> "nonHeapMax": "-1",
> "nonHeapUsed": "168581552"
> },
> "os": {
> "os.spec": "Linux, amd64, 4.15.0-51-generic",
> "os.vcpus": "4"
> },
> "runtime": {
> "name": "OpenJDK 64-Bit Server VM",
> "version": "1.8.0_212"
> }
> }
> }
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
