Re: Review Request 72893: ATLAS-3427: Hook Enhancements for Improved Resiliency

2020-10-14 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72893/#review222012 ------- On Oct. 6, 2020, 5:47 p.m., Ashutosh Mestry wrote: > > --

[jira] [Updated] (ATLAS-3977) Migration Script: Deleted entities in Atlas1.0 miss few attributes after migrated to Atlas2.0

2020-10-13 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3977: --- Attachment: ATLAS-3977-Deleted-entity-behavior-fix-during-migrat-Part-2.patch > Migrat

[jira] [Updated] (ATLAS-3989) Behavior change in Atlas API to get Atlas Server object during metadata replication

2020-10-09 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3989: --- Attachment: ATLAS-3989-Updated-Export-Import-Audits-Writer-to-us.patch > Behavior cha

[jira] [Updated] (ATLAS-3989) Behavior change in Atlas API to get Atlas Server object during metadata replication

2020-10-09 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3989: --- Attachment: (was: ATLAS-3989-Updated-Export-Import-Audits-Writer-to-us.patch

[jira] [Updated] (ATLAS-3989) Behavior change in Atlas API to get Atlas Server object during metadata replication

2020-10-09 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3989: --- Description: There is a change being noticed in the Atlas server API used during atlas

[jira] [Updated] (ATLAS-3989) Behavior change in Atlas API to get Atlas Server object during metadata replication

2020-10-09 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3989: --- Attachment: ATLAS-3989-Updated-Export-Import-Audits-Writer-to-us.patch > Behavior cha

[jira] [Created] (ATLAS-3989) Behavior change in Atlas API to get Atlas Server object during metadata replication

2020-10-09 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3989: -- Summary: Behavior change in Atlas API to get Atlas Server object during metadata replication Key: ATLAS-3989 URL: https://issues.apache.org/jira/browse/ATLAS-3989

Re: Review Request 72937: ATLAS-3971 :- Move authorization check for Business Metadata def before type exist check

2020-10-06 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72937/#review221998 --- Ship it! Ship It! - Ashutosh Mestry On Oct. 7, 2020, 5:15

[jira] [Comment Edited] (ATLAS-3977) Migration Script: Deleted entities in Atlas1.0 miss few attributes after migrated to Atlas2.0

2020-10-06 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208482#comment-17208482 ] Ashutosh Mestry edited comment on ATLAS-3977 at 10/6/20, 9:41 PM

[jira] [Commented] (ATLAS-3977) Migration Script: Deleted entities in Atlas1.0 miss few attributes after migrated to Atlas2.0

2020-10-05 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208482#comment-17208482 ] Ashutosh Mestry commented on ATLAS-3977: [~sarath] / [~nixon] / [~nikhilbonte] Can you please

[jira] [Assigned] (ATLAS-3977) Migration Script: Deleted entities in Atlas1.0 miss few attributes after migrated to Atlas2.0

2020-10-05 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry reassigned ATLAS-3977: -- Attachment: ATLAS-3977-Addressed-patch-processing-for.patch Assignee: Ashutosh

Re: Review Request 72932: ATLAS-3964: Fix for regression caused by earlier patch

2020-10-05 Thread Ashutosh Mestry via Review Board
all these re-usable methods are kept. Right now there is duplication of code. - Ashutosh Mestry On Oct. 6, 2020, 2:05 a.m., Deep Singh wrote: > > --- > This is an automatically generated e-mail. To reply, visit

Re: Review Request 72920: ATLAS-3965:Relationships with null values are missing in entity relationshipAttributes

2020-10-01 Thread Ashutosh Mestry via Review Board
; if (aClass instanceof MyClass) { assertTrue(true); } - Ashutosh Mestry On Sept. 30, 2020, 10:53 p.m., Deep Singh wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://review

[jira] [Resolved] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-10-01 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry resolved ATLAS-3953. Resolution: Fixed > JSON Files from Export API with "?" char for string with

[jira] [Commented] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-09-29 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204390#comment-17204390 ] Ashutosh Mestry commented on ATLAS-3953: Pre-commit build: [https://ci-builds.apache.org/job

[jira] [Commented] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-09-29 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204389#comment-17204389 ] Ashutosh Mestry commented on ATLAS-3953: [~carlosrochacardoso] That is great news! I will proceed

[jira] [Commented] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-09-24 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201698#comment-17201698 ] Ashutosh Mestry commented on ATLAS-3953: Thanks for your interest. Please take a look at: [http

[jira] [Updated] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-09-23 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3953: --- Attachment: ATLAS-3953-Export-ZipSink-Specify-character-endcodin.patch > JSON Files f

[jira] [Commented] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-09-23 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201000#comment-17201000 ] Ashutosh Mestry commented on ATLAS-3953: I have attached couple of things: * _path.zip_

[jira] [Updated] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-09-23 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3953: --- Attachment: path.zip > JSON Files from Export API with "?" char for string

[jira] [Updated] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-09-23 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3953: --- Attachment: a5c148bf-5ab6-4c49-853e-855842102128.json > JSON Files from Export

[jira] [Commented] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-09-23 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200984#comment-17200984 ] Ashutosh Mestry commented on ATLAS-3953: [~carlosrochacardoso] Thanks for filing this JIRA

[jira] [Updated] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-09-23 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3953: --- Priority: Major (was: Minor) > JSON Files from Export API with "?" ch

[jira] [Assigned] (ATLAS-3953) JSON Files from Export API with "?" char for string with special chars

2020-09-23 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry reassigned ATLAS-3953: -- Assignee: Ashutosh Mestry > JSON Files from Export API with "?" ch

[jira] [Updated] (ATLAS-3427) Atlas hooks enhancements for better fault-tolerance i.e. Kafka unavailability

2020-09-21 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3427: --- Description: *Background* Existing implementation for sending messages from the hooks

[jira] [Updated] (ATLAS-3427) Atlas hooks enhancements for better fault-tolerance i.e. Kafka unavailability

2020-09-21 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3427: --- Description: *Background* Existing implementation for sending messages from the hooks

[jira] [Assigned] (ATLAS-3427) Atlas hooks enhancements for better fault-tolerance i.e. Kafka unavailability

2020-09-21 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry reassigned ATLAS-3427: -- Assignee: Ashutosh Mestry (was: Nixon Rodrigues) > Atlas hooks enhanceme

[jira] [Updated] (ATLAS-3948) Entity Creation: Index Consistency: Java Patch Handler: Provide Option to Disable

2020-09-17 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3948: --- Attachment: ATLAS-3948-index-consistency-conditional.patch > Entity Creation: In

[jira] [Created] (ATLAS-3948) Entity Creation: Index Consistency: Java Patch Handler: Provide Option to Disable

2020-09-17 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3948: -- Summary: Entity Creation: Index Consistency: Java Patch Handler: Provide Option to Disable Key: ATLAS-3948 URL: https://issues.apache.org/jira/browse/ATLAS-3948

[jira] [Updated] (ATLAS-3941) NotificationHookConsumer: Reduce Retry Pause Interval

2020-09-14 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3941: --- Attachment: ATLAS-3941-NotificationHookConsumer-Reduce-wait-time.patch

[jira] [Updated] (ATLAS-3941) NotificationHookConsumer: Reduce Retry Pause Interval

2020-09-14 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3941: --- Attachment: (was: ATLAS-3941-NotificationHookConsumer-Reduce-wait-time.patch

[jira] [Updated] (ATLAS-3941) NotificationHookConsumer: Reduce Retry Pause Interval

2020-09-14 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3941: --- Attachment: ATLAS-3941-NotificationHookConsumer-Reduce-wait-time.patch

[jira] [Created] (ATLAS-3941) NotificationHookConsumer: Reduce Retry Pause Interval

2020-09-14 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3941: -- Summary: NotificationHookConsumer: Reduce Retry Pause Interval Key: ATLAS-3941 URL: https://issues.apache.org/jira/browse/ATLAS-3941 Project: Atlas

[jira] [Assigned] (ATLAS-2932) Update DSL to use Java Traversal API

2020-08-27 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry reassigned ATLAS-2932: -- Assignee: Ashutosh Mestry (was: Apoorv Naik) > Update DSL to use Java Traversal

[jira] [Updated] (ATLAS-3082) /var/log/atlas/application.log has unclear message

2020-08-17 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3082: --- Priority: Major (was: Minor) > /var/log/atlas/application.log has unclear mess

[jira] [Assigned] (ATLAS-3082) /var/log/atlas/application.log has unclear message

2020-08-17 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry reassigned ATLAS-3082: -- Assignee: Ashutosh Mestry (was: Xinran Tinney) > /var/log/atlas/application.log

Re: Review Request 72636: NotificationHookConsumer: Concurrent Message Processing

2020-08-03 Thread Ashutosh Mestry via Review Board
**Volume test** Medium-size Kafka dump added. *Setup* Add same kafka dump to multiple topics. This will result in contention for almost every message. **Pre-commit Build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2003/ Thanks, Ashutosh Mestry

[jira] [Updated] (ATLAS-3874) NotificationHookConsumer: Shell Entity Resolution When Multiple Consumers Process Same Entity

2020-08-03 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3874: --- Attachment: (was: ATLAS-3874-Notification-hook-processing-concurrent-e.patch

[jira] [Resolved] (ATLAS-3878) Notifications: Improve Memory Usage in Scale Enviroment

2020-08-03 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry resolved ATLAS-3878. Resolution: Fixed > Notifications: Improve Memory Usage in Scale Envirom

[jira] [Assigned] (ATLAS-3398) Duplicates for unique attributes

2020-07-31 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry reassigned ATLAS-3398: -- Assignee: Ashutosh Mestry > Duplicates for unique attribu

[jira] [Commented] (ATLAS-3398) Duplicates for unique attributes

2020-07-31 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17168967#comment-17168967 ] Ashutosh Mestry commented on ATLAS-3398: [~dwarszawski] I am not able to assign this issue to you

[jira] [Resolved] (ATLAS-3398) Duplicates for unique attributes

2020-07-31 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry resolved ATLAS-3398. Resolution: Fixed > Duplicates for unique attribu

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-31 Thread Ashutosh Mestry via Review Board
/ https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2067/ https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2076/ Thanks, Ashutosh Mestry

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-31 Thread Ashutosh Mestry via Review Board
iew221431 --- On July 30, 2020, 10:58 p.m., Ashutosh Mestry wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://revie

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-30 Thread Ashutosh Mestry via Review Board
://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2067/ Thanks, Ashutosh Mestry

Re: Review Request 72722: Index Consistency: Java Patch Handler Implementation

2020-07-30 Thread Ashutosh Mestry via Review Board
eded. File Attachments entity payload https://reviews.apache.org/media/uploaded/files/2020/07/30/62c25f8c-87cb-458d-a49e-ce41a96855de__t.json Thanks, Ashutosh Mestry

Re: Review Request 72722: Index Consistency: Java Patch Handler Implementation

2020-07-30 Thread Ashutosh Mestry via Review Board
File Attachments entity payload https://reviews.apache.org/media/uploaded/files/2020/07/30/62c25f8c-87cb-458d-a49e-ce41a96855de__t.json Thanks, Ashutosh Mestry

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-30 Thread Ashutosh Mestry via Review Board
** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/ https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2067/ Thanks, Ashutosh Mestry

Re: Review Request 72722: Index Consistency: Java Patch Handler Implementation

2020-07-30 Thread Ashutosh Mestry via Review Board
2074/ File Attachments entity payload https://reviews.apache.org/media/uploaded/files/2020/07/30/62c25f8c-87cb-458d-a49e-ce41a96855de__t.json Thanks, Ashutosh Mestry

Review Request 72722: Index Consistency: Java Patch Handler Implementation

2020-07-30 Thread Ashutosh Mestry via Review Board
edia/uploaded/files/2020/07/30/62c25f8c-87cb-458d-a49e-ce41a96855de__t.json Thanks, Ashutosh Mestry

[jira] [Created] (ATLAS-3907) Entity Creation: Index Consistency: Java Patch Handler

2020-07-30 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3907: -- Summary: Entity Creation: Index Consistency: Java Patch Handler Key: ATLAS-3907 URL: https://issues.apache.org/jira/browse/ATLAS-3907 Project: Atlas

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-29 Thread Ashutosh Mestry via Review Board
ally generated e-mail. To reply, visit: https://reviews.apache.org/r/72666/#review221337 --- On July 29, 2020, 6:23 p.m., Ashutosh Mestry wrote: > > --- > This is an au

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-29 Thread Ashutosh Mestry via Review Board
> > EntityNotificationV2 instances in list buffer - which will cause the > > notification objects stored in EntityNotificationSender.send() be updated > > as well. This will result in incorrect notification to be sent. Please > > review this carefully and update. I addresse

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-29 Thread Ashutosh Mestry via Review Board
** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/ https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2067/ Thanks, Ashutosh Mestry

Re: Review Request 72695: Optional configuration to support locks on JanusGraph to ensure data consitency.

2020-07-24 Thread Ashutosh Mestry via Review Board
> On July 23, 2020, 9:28 p.m., Ashutosh Mestry wrote: > > repository/src/main/java/org/apache/atlas/repository/patches/ConcurrentPatchProcessor.java > > Line 39 (original), 39 (patched) > > <https://reviews.apache.org/r/72695/diff/1/?file=2236038#file2236038line39&g

Re: Review Request 72695: Optional configuration to support locks on JanusGraph to ensure data consitency.

2020-07-24 Thread Ashutosh Mestry via Review Board
> On July 23, 2020, 4:52 a.m., Ashutosh Mestry wrote: > > repository/src/main/java/org/apache/atlas/repository/patches/ConcurrentPatchProcessor.java > > Lines 44 (patched) > > <https://reviews.apache.org/r/72695/diff/1/?file=2236038#file2236038line44> > > > &g

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-23 Thread Ashutosh Mestry via Review Board
/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/ https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2067/ Thanks, Ashutosh Mestry

Re: Review Request 72695: Optional configuration to support locks on JanusGraph to ensure data consitency.

2020-07-23 Thread Ashutosh Mestry via Review Board
/ConcurrentPatchProcessor.java Line 39 (original), 39 (patched) <https://reviews.apache.org/r/72695/#comment310232> We will need to add another *JavaPatch* to update existing data. - Ashutosh Mestry On July 20, 2020, 9:48 p.m., Damian Warszawski

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-23 Thread Ashutosh Mestry via Review Board
of memory error. **Pre-commit** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/ Thanks, Ashutosh Mestry

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-23 Thread Ashutosh Mestry via Review Board
//reviews.apache.org/r/72666/#review221322 --- On July 22, 2020, 4:16 p.m., Ashutosh Mestry wrote: > > --- > This is an automatically generated e-mail. To

Review Request 72703: Import Service: UpdateVertexGuid Now Makes Updates to AtlasEntityWithExtInfo

2020-07-23 Thread Ashutosh Mestry via Review Board
s-1.zip Stocks-2 https://reviews.apache.org/media/uploaded/files/2020/07/23/b0813b02-e44f-40a8-b52c-2dd620d067d9__stocks-2.zip Thanks, Ashutosh Mestry

[jira] [Updated] (ATLAS-3902) Import Service: Importing Data With Differing GUIDs for Same Unique Attributes Causes Errors in Certain Cases

2020-07-23 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3902: --- Summary: Import Service: Importing Data With Differing GUIDs for Same Unique Attributes

[jira] [Updated] (ATLAS-3902) Import Service: Importing Data With Differing GUIDs for Same Unique Attributes Causes Errors

2020-07-23 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3902: --- Description: *Background* Consider the scenario where 2 clusters containing Atlas are setup

[jira] [Created] (ATLAS-3902) Import Service: Importing Data With Differing GUIDs for Same Unique Attributes Causes Errors

2020-07-23 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3902: -- Summary: Import Service: Importing Data With Differing GUIDs for Same Unique Attributes Causes Errors Key: ATLAS-3902 URL: https://issues.apache.org/jira/browse/ATLAS-3902

Re: Review Request 72695: Optional configuration to support locks on JanusGraph to ensure data consitency.

2020-07-22 Thread Ashutosh Mestry via Review Board
/ConcurrentPatchProcessor.java Lines 44 (patched) <https://reviews.apache.org/r/72695/#comment310207> I suggest use AtlasConfiguration for this. Also, I think this should be true by default. - Ashutosh Mestry On July 20, 2020, 9:48 p.m., Damian Warszawski

Re: Review Request 72695: Optional configuration to support locks on JanusGraph to ensure data consitency.

2020-07-22 Thread Ashutosh Mestry via Review Board
> On July 21, 2020, 8:38 p.m., Ashutosh Mestry wrote: > > Here's what I have tried so far: > > - Concurrent entity creation using my own test rig. This creates entities > > concurrently but it does not allow for entity with same qualifiedName to be > > c

Re: Review Request 72695: Optional configuration to support locks on JanusGraph to ensure data consitency.

2020-07-22 Thread Ashutosh Mestry via Review Board
> On July 22, 2020, 4:30 p.m., Ashutosh Mestry wrote: > > I attempted to create same entity (entity with same qualifiedName) from > > multiple requests. > > > > I did this experiment: > > - Created an entity payload. > > - Used bulk enti

Re: Review Request 72695: Optional configuration to support locks on JanusGraph to ensure data consitency.

2020-07-22 Thread Ashutosh Mestry via Review Board
was created. My thinking is that we will see real value of this if we have a Java patch handler that fixes existing data. - Ashutosh Mestry On July 20, 2020, 9:48 p.m., Damian Warszawski wrote: > > --- > This is an automatically ge

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-22 Thread Ashutosh Mestry via Review Board
and audit write time). - Throughput: ~1.2 M entities per hour. Without out of memory error. **Pre-commit** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/ Thanks, Ashutosh Mestry

Re: Review Request 72646: ATLAS-3876 : Relationship Search API not showing correct approximateCount

2020-07-22 Thread Ashutosh Mestry via Review Board
> On July 20, 2020, 10:54 p.m., Ashutosh Mestry wrote: > > repository/src/main/java/org/apache/atlas/discovery/EntityDiscoveryService.java > > Line 649 (original), 662 (patched) > > <https://reviews.apache.org/r/72646/diff/2/?file=2235580#file2235580line664> >

Re: Review Request 72695: Optional configuration to support locks on JanusGraph to ensure data consitency.

2020-07-21 Thread Ashutosh Mestry via Review Board
performance or impact on accuracy. Yet to try: - Migration from 0.8 to latest. - Migration import using ZipDirect format. - Ashutosh Mestry On July 20, 2020, 9:48 p.m., Damian Warszawski wrote: > > --- > This is an automatically generat

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-20 Thread Ashutosh Mestry via Review Board
time and audit write time). - Throughput: ~1.2 M entities per hour. Without out of memory error. **Pre-commit** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/ Thanks, Ashutosh Mestry

Re: Review Request 72646: ATLAS-3876 : Relationship Search API not showing correct approximateCount

2020-07-20 Thread Ashutosh Mestry via Review Board
What is the volume of data you have tested this with? - Ashutosh Mestry On July 6, 2020, 9:14 a.m., Pinal Shah wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > http

Re: Review Request 72636: NotificationHookConsumer: Concurrent Message Processing

2020-07-20 Thread Ashutosh Mestry via Review Board
w/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2003/ Thanks, Ashutosh Mestry

[jira] [Commented] (ATLAS-3398) Duplicates for unique attributes

2020-07-20 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161588#comment-17161588 ] Ashutosh Mestry commented on ATLAS-3398: I suppose the way to duplicate would be to attempt

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-13 Thread Ashutosh Mestry via Review Board
at, with value > 0 > > // incrCapacity can be initialized in constructor as well > > int incrCapacity = (int) (this.capacity * incrementByFactor) + 1.0F; > > > > int newCapacity = this.capacity; > > > > for (; newCapacity < requestedSize; newCapacity += incrCapacity); > > > >

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-13 Thread Ashutosh Mestry via Review Board
** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/ Thanks, Ashutosh Mestry

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-10 Thread Ashutosh Mestry via Review Board
). - Throughput: ~1.2 M entities per hour. **Pre-commit** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/ Thanks, Ashutosh Mestry

Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-09 Thread Ashutosh Mestry via Review Board
://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/ Thanks, Ashutosh Mestry

[jira] [Updated] (ATLAS-3878) Notifications: Improve Memory Usage in Scale Enviroment

2020-07-08 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3878: --- Attachment: (was: notifications-memory-fix-v3.patch) > Notifications: Improve Mem

[jira] [Updated] (ATLAS-3878) Notifications: Improve Memory Usage in Scale Enviroment

2020-07-08 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3878: --- Attachment: ATLAS-3878-Notifications-Improve-Memory-Usage-in-Sca-v2.patch > Notificati

Review Request 72666: Notification: Solution to Memory Build-up

2020-07-08 Thread Ashutosh Mestry via Review Board
custom script ingesting 100M entities. Memory usage stayed between 0 and 5% during the 24 hr period. **Pre-commit** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/ Thanks, Ashutosh Mestry

[jira] [Updated] (ATLAS-3878) Notifications: Improve Memory Usage in Scale Enviroment

2020-07-08 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3878: --- Attachment: notifications-memory-fix-v3.patch > Notifications: Improve Memory Usage in Sc

[jira] [Updated] (ATLAS-3878) Notifications: Improve Memory Usage in Scale Enviroment

2020-07-08 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3878: --- Description: *Background* As part of entity creation, Atlas sends notifications

[jira] [Created] (ATLAS-3878) Notifications: Improve Memory Usage in Scale Enviroment

2020-07-06 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3878: -- Summary: Notifications: Improve Memory Usage in Scale Enviroment Key: ATLAS-3878 URL: https://issues.apache.org/jira/browse/ATLAS-3878 Project: Atlas

Re: Review Request 72638: ATLAS-3875: Enhancing AtlasClient by adding missing API endpoints

2020-07-06 Thread Ashutosh Mestry via Review Board
/#comment309931> Can you investigate loading JSONs instead of hand coding entities. - Ashutosh Mestry On July 6, 2020, 5:53 p.m., Jyoti Singh wrote: > > --- > This is an automatica

Re: Review Request 72636: NotificationHookConsumer: Concurrent Message Processing

2020-07-06 Thread Ashutosh Mestry via Review Board
size Kafka dump added. *Setup* Add same kafka dump to multiple topics. This will result in contention for almost every message. **Pre-commit Build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2003/ Thanks, Ashutosh Mestry

Review Request 72636: NotificationHookConsumer: Concurrent Message Processing

2020-07-01 Thread Ashutosh Mestry via Review Board
4676, t2_1381104676 where col1=col2").write.saveAsTable("t3_1381104676") ``` **Volume test** Medium-size Kafka dump added. **Pre-commit Build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2003/ Thanks, Ashutosh Mestry

[jira] [Updated] (ATLAS-3874) NotificationHookConsumer: Shell Entity Resolution When Multiple Consumers Process Same Entity

2020-07-01 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3874: --- Attachment: ATLAS-3874-Notification-hook-processing-concurrent-e.patch

[jira] [Created] (ATLAS-3874) NotificationHookConsumer: Shell Entity Resolution When Multiple Consumers Process Same Entity

2020-07-01 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3874: -- Summary: NotificationHookConsumer: Shell Entity Resolution When Multiple Consumers Process Same Entity Key: ATLAS-3874 URL: https://issues.apache.org/jira/browse/ATLAS-3874

[jira] [Updated] (ATLAS-3801) NotificationHookConsumer: Introduce Retry Logic for PermanentLockingException

2020-06-30 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3801: --- Attachment: ATLAS-3801-Notification-hook-processing-concurrent-e.patch

Re: Review Request 72619: ATLAS-3863: Avoid re-evaluating tag propagation when deleting relationship (edge)

2020-06-24 Thread Ashutosh Mestry via Review Board
ent309884> Consider using hasEdges. - Ashutosh Mestry On June 24, 2020, 8:03 p.m., Sarath Subramanian wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: [DRAFT] Board report for Apache Atlas: June 2020

2020-06-10 Thread Ashutosh Mestry
+1 for the report. Thanks for taking the time and effort for getting this together. I will leave it to your discretion to include: - Efforts on Beta UI. ~ ashutosh On 6/10/20, 11:34 AM, "Madhan Neethiraj" wrote: Atlas team, Please review the draft board report below and send your

Re: Review Request 72527: Refactoring Kafka JAAS Configuration

2020-05-19 Thread Ashutosh Mestry via Review Board
ation/src/main/java/org/apache/atlas/kafka/KafkaNotification.java Lines 512 (patched) <https://reviews.apache.org/r/72527/#comment309541> Refactor: Promote to const field. - Ashutosh Mestry On May 19, 20

[jira] [Updated] (ATLAS-3801) NotificationHookConsumer: Introduce Retry Logic for PermanentLockingException

2020-05-18 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3801: --- Attachment: (was: ATLAS-3801-NotificationHookConsumer-Introduce-rollba.patch

[jira] [Updated] (ATLAS-3801) NotificationHookConsumer: Introduce Retry Logic for PermanentLockingException

2020-05-17 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3801: --- Attachment: ATLAS-3801-NotificationHookConsumer-Introduce-rollba.patch

[jira] [Resolved] (ATLAS-3796) Migration Import Display: StatusReporter Does not Remove Processed Items

2020-05-17 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry resolved ATLAS-3796. Resolution: Fixed > Migration Import Display: StatusReporter Does not Remove Proces

[jira] [Resolved] (ATLAS-3797) Entity Creation: Refactoring: Improve Edge Creation

2020-05-17 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry resolved ATLAS-3797. Resolution: Fixed > Entity Creation: Refactoring: Improve Edge Creat

[jira] [Created] (ATLAS-3801) NotificationHookConsumer: Introduce Retry Logic for PermanentLockingException

2020-05-15 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3801: -- Summary: NotificationHookConsumer: Introduce Retry Logic for PermanentLockingException Key: ATLAS-3801 URL: https://issues.apache.org/jira/browse/ATLAS-3801

[jira] [Updated] (ATLAS-3797) Entity Creation: Refactoring: Improve Edge Creation

2020-05-15 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3797: --- Attachment: (was: ATLAS-3797-Refactoring-Improve-Edge-Creation.patch) > Entity Creat

  1   2   3   4   5   6   7   8   9   10   >