[jira] [Created] (ATLAS-4407) INTG: Remove Dependency on shared curator JAR
Ashutosh Mestry created ATLAS-4407: -- Summary: INTG: Remove Dependency on shared curator JAR Key: ATLAS-4407 URL: https://issues.apache.org/jira/browse/ATLAS-4407 Project: Atlas Issue Type: Improvement Components: atlas-intg Affects Versions: trunk Reporter: Ashutosh Mestry Assignee: Ashutosh Mestry There are couple of places in INTG where curator shaded jar is used. This can be removed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: Review Request 73552: ATLAS-4406: Ignore configs:- A hive table DDL entity is created for ignored hive tables
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/73552/#review223411 --- Can you please add to description: * ignore patter you used for hive_table. * ignore patter you used for hive_db. Did you verify the change with hive_db_ddl? - Ashutosh Mestry On Aug. 27, 2021, 2:15 a.m., Disha Talreja wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/73552/ > --- > > (Updated Aug. 27, 2021, 2:15 a.m.) > > > Review request for atlas, Ashutosh Mestry, Radhika Kundam, Sarath > Subramanian, and Sidharth Mishra. > > > Bugs: ATLAS-4406 > https://issues.apache.org/jira/browse/ATLAS-4406 > > > Repository: atlas > > > Description > --- > > When hive tables are ignored, a hive table DDL entity is created in Atlas for > the same. A shell entity is also created for the hive table associated with > the DDL operation. > > A DDL entity should not be created for ignored tables and this patch avoids > the creation of a DDL entity for ignored tables. > > > Diffs > - > > > webapp/src/main/java/org/apache/atlas/notification/preprocessor/HivePreprocessor.java > bf6a623fe > > > Diff: https://reviews.apache.org/r/73552/diff/1/ > > > Testing > --- > > mvn clean -DskipTests install > mvn clean -DskipTests package -Pdist,embedded-hbase-solr > Atlas server running. > > > Thanks, > > Disha Talreja > >
Review Request 73552: ATLAS-4406: Ignore configs:- A hive table DDL entity is created for ignored hive tables
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/73552/ --- Review request for atlas, Ashutosh Mestry, Radhika Kundam, Sarath Subramanian, and Sidharth Mishra. Bugs: ATLAS-4406 https://issues.apache.org/jira/browse/ATLAS-4406 Repository: atlas Description --- When hive tables are ignored, a hive table DDL entity is created in Atlas for the same. A shell entity is also created for the hive table associated with the DDL operation. A DDL entity should not be created for ignored tables and this patch avoids the creation of a DDL entity for ignored tables. Diffs - webapp/src/main/java/org/apache/atlas/notification/preprocessor/HivePreprocessor.java bf6a623fe Diff: https://reviews.apache.org/r/73552/diff/1/ Testing --- mvn clean -DskipTests install mvn clean -DskipTests package -Pdist,embedded-hbase-solr Atlas server running. Thanks, Disha Talreja
[jira] [Created] (ATLAS-4406) Ignore configs: A hive table DDL entity is created for ignored hive tables
Disha Talreja created ATLAS-4406: Summary: Ignore configs: A hive table DDL entity is created for ignored hive tables Key: ATLAS-4406 URL: https://issues.apache.org/jira/browse/ATLAS-4406 Project: Atlas Issue Type: Bug Components: atlas-core Reporter: Disha Talreja Assignee: Disha Talreja Attachments: Ignore configs - Atlas server.png, Ignored Hive Table-DDL entity.png -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-4406) Ignore configs: A hive table DDL entity is created for ignored hive tables
[ https://issues.apache.org/jira/browse/ATLAS-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Disha Talreja updated ATLAS-4406: - Description: When hive tables are ignored, a hive table DDL entity is created in Atlas for the same. A shell entity is also created for the hive table associated with the DDL operation. A DDL entity should not be created for ignored tables. > Ignore configs: A hive table DDL entity is created for ignored hive tables > -- > > Key: ATLAS-4406 > URL: https://issues.apache.org/jira/browse/ATLAS-4406 > Project: Atlas > Issue Type: Bug > Components: atlas-core >Reporter: Disha Talreja >Assignee: Disha Talreja >Priority: Critical > Attachments: Ignore configs - Atlas server.png, Ignored Hive > Table-DDL entity.png > > > When hive tables are ignored, a hive table DDL entity is created in Atlas for > the same. A shell entity is also created for the hive table associated with > the DDL operation. > A DDL entity should not be created for ignored tables. -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: Review Request 73544: ATLAS-4400: Lower version of aws_s3_v2_directory (1.2) of Atlas is is compatible with new Hooks
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/73544/ --- (Updated Aug. 26, 2021, 11:39 p.m.) Review request for atlas, Ashutosh Mestry, Disha Talreja, Radhika Kundam, and Sarath Subramanian. Bugs: ATLAS-4400 https://issues.apache.org/jira/browse/ATLAS-4400 Repository: atlas Description --- ATLAS-4400: Fixed Hook and Atlas Preprocessor to handle S3 V2 directory objectPrefix Issue with Atlas Server and Hook versions mismatch Diffs (updated) - common/src/main/java/org/apache/atlas/utils/AtlasPathExtractorUtil.java a9f2e5092 common/src/test/java/org/apache/atlas/utils/AtlasPathExtractorUtilTest.java 6bf5d5779 webapp/src/main/java/org/apache/atlas/notification/NotificationHookConsumer.java 5643af95c webapp/src/main/java/org/apache/atlas/notification/preprocessor/AWSS3V2Preprocessor.java PRE-CREATION webapp/src/main/java/org/apache/atlas/notification/preprocessor/EntityPreprocessor.java 7f0cafe86 webapp/src/main/java/org/apache/atlas/notification/preprocessor/PreprocessorContext.java 59f6440d5 webapp/src/test/java/org/apache/atlas/notification/preprocessor/AWSS3V2PreprocessorTest.java PRE-CREATION Diff: https://reviews.apache.org/r/73544/diff/3/ Changes: https://reviews.apache.org/r/73544/diff/2-3/ Testing --- Manually tested the Newer Atlas with old Hook and vice versa. Precommit - https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/824/ Thanks, Sidharth Mishra
Re: Review Request 73549: ATLAS-4403: Improve find entity by unique attributes logic - when multiple unique attributes exist for entity type
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/73549/ --- (Updated Aug. 26, 2021, 1:32 p.m.) Review request for atlas, Ashutosh Mestry, Disha Talreja, Jayendra Parab, Madhan Neethiraj, Nikhil Bonte, Nixon Rodrigues, Radhika Kundam, and Sidharth Mishra. Changes --- addressed review comments. Bugs: ATLAS-4403 https://issues.apache.org/jira/browse/ATLAS-4403 Repository: atlas Description --- When a entity type has multiple unique attributes defined: unique_attr1 unique_attr2 During creation of entity, we check if entity with unique attributes is already present and return/update them. The current logic check if entity is present - one unique attribute at a time, if present will return immediately. We should improve the lookup logic to look for entity with all unique attributes specified and not just return on the first unique attribute value. Diffs (updated) - repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasGraphUtilsV2.java e73f084b8 Diff: https://reviews.apache.org/r/73549/diff/4/ Changes: https://reviews.apache.org/r/73549/diff/3-4/ Testing --- Pre-commit: https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/822/consoleFull (SUCCESS) Thanks, Sarath Subramanian
[jira] [Commented] (ATLAS-4398) Add additional path types to Hive DDL filter
[ https://issues.apache.org/jira/browse/ATLAS-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405362#comment-17405362 ] ASF subversion and git services commented on ATLAS-4398: Commit b612a9458004ee6601a6ad58d7ec88f8b322a49e in atlas's branch refs/heads/master from Radhika Kundam [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=b612a94 ] ATLAS-4398: Add additional path types to Hive DDL filter Signed-off-by: Sarath Subramanian > Add additional path types to Hive DDL filter > > > Key: ATLAS-4398 > URL: https://issues.apache.org/jira/browse/ATLAS-4398 > Project: Atlas > Issue Type: Bug >Affects Versions: 2.2.0 >Reporter: Radhika Kundam >Assignee: Radhika Kundam >Priority: Major > > Below path entities are getting filtered at Hive DDL filter.We need to allow > those path entities without filtering. > aws_s3_v2_bucket, adls_gen2_account, adls_gen2_container -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-4398) Add additional path types to Hive DDL filter
[ https://issues.apache.org/jira/browse/ATLAS-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405363#comment-17405363 ] ASF subversion and git services commented on ATLAS-4398: Commit 51485ece56cc45d78862de77ad09a52aa72d2d0c in atlas's branch refs/heads/branch-2.0 from Radhika Kundam [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=51485ec ] ATLAS-4398: Add additional path types to Hive DDL filter Signed-off-by: Sarath Subramanian (cherry picked from commit b612a9458004ee6601a6ad58d7ec88f8b322a49e) > Add additional path types to Hive DDL filter > > > Key: ATLAS-4398 > URL: https://issues.apache.org/jira/browse/ATLAS-4398 > Project: Atlas > Issue Type: Bug >Affects Versions: 2.2.0 >Reporter: Radhika Kundam >Assignee: Radhika Kundam >Priority: Major > > Below path entities are getting filtered at Hive DDL filter.We need to allow > those path entities without filtering. > aws_s3_v2_bucket, adls_gen2_account, adls_gen2_container -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-4398) Add additional path types to Hive DDL filter
[ https://issues.apache.org/jira/browse/ATLAS-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radhika Kundam updated ATLAS-4398: -- Affects Version/s: 2.2.0 > Add additional path types to Hive DDL filter > > > Key: ATLAS-4398 > URL: https://issues.apache.org/jira/browse/ATLAS-4398 > Project: Atlas > Issue Type: Bug >Affects Versions: 2.2.0 >Reporter: Radhika Kundam >Assignee: Radhika Kundam >Priority: Major > > Below path entities are getting filtered at Hive DDL filter.We need to allow > those path entities without filtering. > aws_s3_v2_bucket, adls_gen2_account, adls_gen2_container -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-4378) UI - Implement session timeout on Atlas UI
[ https://issues.apache.org/jira/browse/ATLAS-4378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasad P. Pawar updated ATLAS-4378: --- Attachment: 0001-ATLAS-4378-3-UI-Implement-session-timeout-on-Atlas-U.patch > UI - Implement session timeout on Atlas UI > -- > > Key: ATLAS-4378 > URL: https://issues.apache.org/jira/browse/ATLAS-4378 > Project: Atlas > Issue Type: New Feature >Reporter: Nixon Rodrigues >Assignee: Prasad P. Pawar >Priority: Major > Attachments: > 0001-ATLAS-4378-1-UI-Implement-session-timeout-on-Atlas-U.patch, > 0001-ATLAS-4378-2-UI-Implement-session-timeout-on-Atlas-U.patch, > 0001-ATLAS-4378-3-UI-Implement-session-timeout-on-Atlas-U.patch > > > If Atlas UI is inactive for N minutes, alert the user about the inactivity, > ask user if he wants to stay on page or logout the user session UI for after > X seconds -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [atlas] Shantanu-atlan closed pull request #144: Feat/local setup
Shantanu-atlan closed pull request #144: URL: https://github.com/apache/atlas/pull/144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@atlas.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [atlas] Shantanu-atlan opened a new pull request #144: Feat/local setup
Shantanu-atlan opened a new pull request #144: URL: https://github.com/apache/atlas/pull/144 PR to main Atlas repo -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@atlas.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (ATLAS-4405) UI: Filter Type of DSL search is not consistent while switching between New-UI and Old-UI.
Prasad P. Pawar created ATLAS-4405: -- Summary: UI: Filter Type of DSL search is not consistent while switching between New-UI and Old-UI. Key: ATLAS-4405 URL: https://issues.apache.org/jira/browse/ATLAS-4405 Project: Atlas Issue Type: Bug Reporter: Prasad P. Pawar Assignee: Prasad P. Pawar Attachments: typeFilter_bug.png Steps to reproduce: 1) Perform DSL search using type filter of DSL. 2) Switch the UI. 3) DSL Type filter is not consistent. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-4404) UI: Left side Panel doesn't toggled to Advanced Search after Switching from New-UI to Old-UI
[ https://issues.apache.org/jira/browse/ATLAS-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasad P. Pawar updated ATLAS-4404: --- Summary: UI: Left side Panel doesn't toggled to Advanced Search after Switching from New-UI to Old-UI (was: UI: Left side Panel doesn't toggle to Advanced Search after Switching from New-UI to Old-UI) > UI: Left side Panel doesn't toggled to Advanced Search after Switching from > New-UI to Old-UI > > > Key: ATLAS-4404 > URL: https://issues.apache.org/jira/browse/ATLAS-4404 > Project: Atlas > Issue Type: Bug >Reporter: Prasad P. Pawar >Assignee: Prasad P. Pawar >Priority: Minor > > Steps to reproduce: > 1) Perform DSL search (advanced search) on New-UI. > 2) Switch to Old-UI. > 3) Left side panel doesn't get toggled to Advance search. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ATLAS-4404) UI: Left side Panel doesn't toggle to Advanced Search after Switching from New-UI to Old-UI
Prasad P. Pawar created ATLAS-4404: -- Summary: UI: Left side Panel doesn't toggle to Advanced Search after Switching from New-UI to Old-UI Key: ATLAS-4404 URL: https://issues.apache.org/jira/browse/ATLAS-4404 Project: Atlas Issue Type: Bug Reporter: Prasad P. Pawar Assignee: Prasad P. Pawar Steps to reproduce: 1) Perform DSL search (advanced search) on New-UI. 2) Switch to Old-UI. 3) Left side panel doesn't get toggled to Advance search. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3930) Atlas server distribution contains 180+ CVEs
[ https://issues.apache.org/jira/browse/ATLAS-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405115#comment-17405115 ] Syed Atif Akhtar commented on ATLAS-3930: - Any updates on this - i think it would be good to have a CI job that checks for vulnerabilities if we don't already have one and have some sort of tolerance threshold, this is a major issue that stops Atlas from larger enterprise adoption. > Atlas server distribution contains 180+ CVEs > > > Key: ATLAS-3930 > URL: https://issues.apache.org/jira/browse/ATLAS-3930 > Project: Atlas > Issue Type: Bug > Components: atlas-core, atlas-intg, atlas-webui >Affects Versions: 2.1.0 >Reporter: Gaurav Saini >Priority: Blocker > Attachments: dependency-check-report.csv, dependency-check-report.html > > > we are working on apache atlas code and started deploying over > *[https://github.com/apache/atlas/tree/release-2.1.0-rc3]* > Upon scanning using twistlock, we found *180+* vulnerability. > > Out of these, Jackson-databind and netty_netty-all are the most occurring > ones. > So, we tried upgrading the versions, but integration tests in atlas-webapp > started failing saying *"org.eclise.jetty, utils: Multi exception".* > The same thing is happening while upgrading versions of any other > dependencies in the atlas module. The application breaks for any other > dependency which we are trying to upgrade. for example, Hadoop_hdfs uses > Jackson-databind as a transitive dependency, hence I am unable to update > version. > _PFA of dependency check for the project._ > *I do not see any open issue on the Github channel too.* > *Have you experienced any such scenario while upgrading earlier?* > *Is there a way for me to move ahead to remove vulnerabilities in the > current version?* > > *The atlas server distribution should be using the latest version of the > dependencies having no or fewer CVEs.* -- This message was sent by Atlassian Jira (v8.3.4#803005)
