[jira] [Assigned] (ATLAS-3500) Implement S3 Bulk Extraction
[ https://issues.apache.org/jira/browse/ATLAS-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharth Kumar Mishra reassigned ATLAS-3500: Assignee: Sidharth Kumar Mishra (was: Sridhar) > Implement S3 Bulk Extraction > > > Key: ATLAS-3500 > URL: https://issues.apache.org/jira/browse/ATLAS-3500 > Project: Atlas > Issue Type: Improvement >Reporter: Sridhar >Assignee: Sidharth Kumar Mishra >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3590) Hive hook should ignore capturing lineage for temporary tables in CTAS queries
[ https://issues.apache.org/jira/browse/ATLAS-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020357#comment-17020357 ] ASF subversion and git services commented on ATLAS-3590: Commit 1d3bef6319b76b804774452fd1ee8c6521c5b54e in atlas's branch refs/heads/branch-2.0 from Sarath Subramanian [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=1d3bef6 ] ATLAS-3590: Hive hook should ignore capturing lineage for temporary tables in CTAS queries (cherry picked from commit 47f2e77bf798547e652e16cf10adaa818ded1e3e) > Hive hook should ignore capturing lineage for temporary tables in CTAS queries > -- > > Key: ATLAS-3590 > URL: https://issues.apache.org/jira/browse/ATLAS-3590 > Project: Atlas > Issue Type: Task > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 2.1.0 > > Attachments: ATLAS-3590.001.patch > > > Atlas hive hook ignores capturing metadata for temporary tables in CREATE > queries. Similarly it should ignore capturing lineage for temporary tables in > CTAS queries -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3590) Hive hook should ignore capturing lineage for temporary tables in CTAS queries
[ https://issues.apache.org/jira/browse/ATLAS-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020356#comment-17020356 ] ASF subversion and git services commented on ATLAS-3590: Commit 47f2e77bf798547e652e16cf10adaa818ded1e3e in atlas's branch refs/heads/master from Sarath Subramanian [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=47f2e77 ] ATLAS-3590: Hive hook should ignore capturing lineage for temporary tables in CTAS queries > Hive hook should ignore capturing lineage for temporary tables in CTAS queries > -- > > Key: ATLAS-3590 > URL: https://issues.apache.org/jira/browse/ATLAS-3590 > Project: Atlas > Issue Type: Task > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 2.1.0 > > Attachments: ATLAS-3590.001.patch > > > Atlas hive hook ignores capturing metadata for temporary tables in CREATE > queries. Similarly it should ignore capturing lineage for temporary tables in > CTAS queries -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3568) Performance improvements in writing audit logs
[ https://issues.apache.org/jira/browse/ATLAS-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020353#comment-17020353 ] ASF subversion and git services commented on ATLAS-3568: Commit 25f7475e242ac08034c61334b19bde89cf9a5136 in atlas's branch refs/heads/branch-2.0 from Sarath Subramanian [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=25f7475 ] ATLAS-3568: Hive hook should set startTime and endTime for hive_process entities to System.currentTimeMillis() (cherry picked from commit 0ac9534915e55f21bb44e7a4da2439055d0620a8) > Performance improvements in writing audit logs > -- > > Key: ATLAS-3568 > URL: https://issues.apache.org/jira/browse/ATLAS-3568 > Project: Atlas > Issue Type: Improvement > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Saqeeb Shaikh >Assignee: Saqeeb Shaikh >Priority: Major > Attachments: ATLAS-3568.001.patch > > > Atlas server generates audit logs on changes to entities - like add/remove > classifications, entity attribute updates, etc. Add/remove of classifications > to an entity can result in multiple entities to be updated due to > tag-propagation. In such cases, the time taken to create audit logs can be > reduced by writing audits for all updated entities in one call to the audit > store, instead of current implementation that writes audit logs for one > entity at a time. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3568) Performance improvements in writing audit logs
[ https://issues.apache.org/jira/browse/ATLAS-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020352#comment-17020352 ] ASF subversion and git services commented on ATLAS-3568: Commit 0ac9534915e55f21bb44e7a4da2439055d0620a8 in atlas's branch refs/heads/master from Sarath Subramanian [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=0ac9534 ] ATLAS-3568: Hive hook should set startTime and endTime for hive_process entities to System.currentTimeMillis() > Performance improvements in writing audit logs > -- > > Key: ATLAS-3568 > URL: https://issues.apache.org/jira/browse/ATLAS-3568 > Project: Atlas > Issue Type: Improvement > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Saqeeb Shaikh >Assignee: Saqeeb Shaikh >Priority: Major > Attachments: ATLAS-3568.001.patch > > > Atlas server generates audit logs on changes to entities - like add/remove > classifications, entity attribute updates, etc. Add/remove of classifications > to an entity can result in multiple entities to be updated due to > tag-propagation. In such cases, the time taken to create audit logs can be > reduced by writing audits for all updated entities in one call to the audit > store, instead of current implementation that writes audit logs for one > entity at a time. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [atlas] mwiewior opened a new pull request #82: Feature/solr index properties
mwiewior opened a new pull request #82: Feature/solr index properties URL: https://github.com/apache/atlas/pull/82 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
Call for presentations for ApacheCon North America 2020 now open
Dear Apache enthusiast, (You’re receiving this message because you are subscribed to one or more project mailing lists at the Apache Software Foundation.) The call for presentations for ApacheCon North America 2020 is now open at https://apachecon.com/acna2020/cfp ApacheCon will be held at the Sheraton, New Orleans, September 28th through October 2nd, 2020. As in past years, ApacheCon will feature tracks focusing on the various technologies within the Apache ecosystem, and so the call for presentations will ask you to select one of those tracks, or “General” if the content falls outside of one of our already-organized tracks. These tracks are: Karaf Internet of Things Fineract Community Content Delivery Solr/Lucene (Search) Gobblin/Big Data Integration Ignite Observability Cloudstack Geospatial Graph Camel/Integration Flagon Tomcat Cassandra Groovy Web/httpd General/Other The CFP will close Friday, May 1, 2020 8:00 AM (America/New_York time). Submit early, submit often, at https://apachecon.com/acna2020/cfp Rich, for the ApacheCon Planners
Re: Review Request 72021: ATLAS-3590: Hive hook should ignore capturing lineage for temporary tables in CTAS queries
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72021/#review219340 --- Ship it! Ship It! - Madhan Neethiraj On Jan. 17, 2020, 12:54 a.m., Sarath Subramanian wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72021/ > --- > > (Updated Jan. 17, 2020, 12:54 a.m.) > > > Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Mandar Ambawane, > mayank jain, Nixon Rodrigues, and Sidharth Mishra. > > > Bugs: ATLAS-3590 > https://issues.apache.org/jira/browse/ATLAS-3590 > > > Repository: atlas > > > Description > --- > > Atlas hive hook ignores capturing metadata for temporary tables in CREATE > queries. Similarly it should ignore capturing lineage for temporary tables in > CTAS queries > > > Diffs > - > > addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java > 5b1f61b63 > > addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java > 425be5952 > > addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateHiveProcess.java > 82df57650 > > > Diff: https://reviews.apache.org/r/72021/diff/1/ > > > Testing > --- > > validated manually hive hook is not sending lineage for temporary table. > > Precommit: > https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1606/console > > > Thanks, > > Sarath Subramanian > >
[jira] [Commented] (ATLAS-3586) Hive hook should set startTime and endTime for hive_process entities to System.currentTimeMillis()
[ https://issues.apache.org/jira/browse/ATLAS-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020113#comment-17020113 ] Madhan Neethiraj commented on ATLAS-3586: - +1 for the patch. Thanks [~sarath]! > Hive hook should set startTime and endTime for hive_process entities to > System.currentTimeMillis() > -- > > Key: ATLAS-3586 > URL: https://issues.apache.org/jira/browse/ATLAS-3586 > Project: Atlas > Issue Type: Task > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 2.1.0 > > Attachments: ATLAS-3568.001.patch > > > Hive hook should set startTime and endTime for hive_process entities to > System.currentTimeMillis() > > The server side (ATLAS-3565) sets startTime and endTime to > System.currentTimeMillis() if it is empty or null, to be consistent we may > need to update the hook. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ATLAS-3589) Unable to search typeDefs of category "Namespace"
[ https://issues.apache.org/jira/browse/ATLAS-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nixon Rodrigues resolved ATLAS-3589. Fix Version/s: 3.0.0 2.1.0 Resolution: Fixed > Unable to search typeDefs of category "Namespace" > - > > Key: ATLAS-3589 > URL: https://issues.apache.org/jira/browse/ATLAS-3589 > Project: Atlas > Issue Type: Bug >Reporter: Mandar Ambawane >Assignee: Mandar Ambawane >Priority: Major > Fix For: 2.1.0, 3.0.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3589) Unable to search typeDefs of category "Namespace"
[ https://issues.apache.org/jira/browse/ATLAS-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020053#comment-17020053 ] ASF subversion and git services commented on ATLAS-3589: Commit 248058bba440aab7e008f85f729713fc8c917e43 in atlas's branch refs/heads/branch-2.0 from Mandar Ambawane [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=248058b ] ATLAS-3589 Unable to search typeDefs of category 'Namespace' Signed-off-by: nixonrodrigues > Unable to search typeDefs of category "Namespace" > - > > Key: ATLAS-3589 > URL: https://issues.apache.org/jira/browse/ATLAS-3589 > Project: Atlas > Issue Type: Bug >Reporter: Mandar Ambawane >Assignee: Mandar Ambawane >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3589) Unable to search typeDefs of category "Namespace"
[ https://issues.apache.org/jira/browse/ATLAS-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020051#comment-17020051 ] ASF subversion and git services commented on ATLAS-3589: Commit cb0fe79e3f41e1b7bf9a52202f71b23fe1326800 in atlas's branch refs/heads/master from Mandar Ambawane [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=cb0fe79 ] ATLAS-3589 Unable to search typeDefs of category 'Namespace' Signed-off-by: nixonrodrigues > Unable to search typeDefs of category "Namespace" > - > > Key: ATLAS-3589 > URL: https://issues.apache.org/jira/browse/ATLAS-3589 > Project: Atlas > Issue Type: Bug >Reporter: Mandar Ambawane >Assignee: Mandar Ambawane >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
