Re: Atlas Glossary and Communicator

2019-09-29 Thread Ashutosh Mestry
Hi Thanks for reaching out and the contributions. For now this email alias is best for communication. Let me take a look at the changes and get back to you. Ashutosh On Fri, Sep 27, 2019, 3:47 PM Nathaniel Vala wrote: > Hi All, > > I have started using Atlas to try and manage/utilise

[jira] [Commented] (ATLAS-3396) ZipSource: Usage of In-memory Maps Limits the Size of Imports Performed

2019-09-10 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926904#comment-16926904 ] Ashutosh Mestry commented on ATLAS-3396: Master PC build:  [https://builds.apache.org/view/A/view

[jira] [Updated] (ATLAS-3396) ZipSource: Usage of In-memory Maps Limits the Size of Imports Performed

2019-09-10 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3396: --- Attachment: ATLAS-3396-ZipSourceWithBackingDirectory-Implementat-master.patch > ZipSou

[jira] [Comment Edited] (ATLAS-3396) ZipSource: Usage of In-memory Maps Limits the Size of Imports Performed

2019-09-10 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926904#comment-16926904 ] Ashutosh Mestry edited comment on ATLAS-3396 at 9/10/19 9:28 PM: - Cherry

[jira] [Commented] (ATLAS-3408) Index Repair Tool: improve time required for graph initialization

2019-09-10 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926754#comment-16926754 ] Ashutosh Mestry commented on ATLAS-3408: +1 for the update. > Index Repair Tool: improve t

Re: Review Request 71426: Import Service: Support for Backing Directory for Large Imports

2019-09-09 Thread Ashutosh Mestry via Review Board
s preformed on small size data. **Pre-commit Build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1380/ Thanks, Ashutosh Mestry

Re: Review Request 71426: Import Service: Support for Backing Directory for Large Imports

2019-09-09 Thread Ashutosh Mestry via Review Board
TLAS-Build-Test/1380/ Thanks, Ashutosh Mestry

Re: Review Request 71426: Import Service: Support for Backing Directory for Large Imports

2019-09-09 Thread Ashutosh Mestry via Review Board
ours. Memory and CPU stayed in normal range during this operation. **Functional tests** Accuracy tests preformed on small size data. **Pre-commit Build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1380/ Thanks, Ashutosh Mestry

Re: Review Request 71426: Import Service: Support for Backing Directory for Large Imports

2019-09-08 Thread Ashutosh Mestry via Review Board
ion. **Volume tests** Imported 4GB ZIP file that took 26 hours. Memory and CPU stayed in normal range during this operation. **Functional tests** Accuracy tests preformed on small size data. **Pre-commit Build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1380/

Re: Review Request 71426: Import Service: Support for Backing Directory for Large Imports

2019-09-08 Thread Ashutosh Mestry via Review Board
h its implementation: > > f.exists() && f.isDirectory() && f.canWrite() Dropping since permissionChecks is more explanatory. - Ashutosh --- This is an automatically generated e-mail. To reply, vi

Re: Review Request 71278: Set log level to warn for relationships without relationship definition

2019-09-05 Thread Ashutosh Mestry via Review Board
others who are not interested will continue with same experience as before. - Ashutosh Mestry On Aug. 21, 2019, 7:42 p.m., Bolke de Bruin wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://

Re: Review Request 71278: Set log level to warn for relationships without relationship definition

2019-09-05 Thread Ashutosh Mestry via Review Board
/v2/EntityGraphMapper.java Line 907 (original), 907 (patched) <https://reviews.apache.org/r/71278/#comment304869> Are you OK with this warning being under debug log level? - Ashutosh Mestry On Aug. 21, 2019, 7:42 p.m., Bolke de Bruin

Re: Review Request 71439: Qualified name of term not being updated when term name is updated.

2019-09-05 Thread Ashutosh Mestry via Review Board
repository/src/main/java/org/apache/atlas/glossary/GlossaryService.java Line 413 (original), 413 (patched) <https://reviews.apache.org/r/71439/#comment304865> Remove commented code. - Ashutosh Mestry On Sept. 5, 2019, 12:36 p.m., S

Re: Review Request 71344: Use fulltext indices for dsl search

2019-09-04 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71344/#review217571 --- Ship it! Ship It! - Ashutosh Mestry On Aug. 31, 2019, 8:21

Re: Review Request 71426: Import Service: Support for Backing Directory for Large Imports

2019-09-04 Thread Ashutosh Mestry via Review Board
s** Imported 4GB ZIP file that took 26 hours. Memory and CPU stayed in normal range during this operation. **Functional tests** Accuracy tests preformed on small size data. **Pre-commit Build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1380/ Thanks, Ashutosh Mestry

Re: Review Request 71426: Import Service: Support for Backing Directory for Large Imports

2019-09-04 Thread Ashutosh Mestry via Review Board
size data. **Pre-commit Build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1379/console Thanks, Ashutosh Mestry

Re: Review Request 71426: Import Service: Support for Backing Directory for Large Imports

2019-09-04 Thread Ashutosh Mestry via Review Board
ourceTestUtils.java > a2a5f58dc > webapp/src/main/java/org/apache/atlas/web/resources/AdminResource.java > 8417e7eb0 > > > Diff: https://reviews.apache.org/r/71426/diff/2/ > > > Testing > --- > > **Unit tests** > Updated to exercise the new implementation. > > **Volume tests** > Imported 4GB ZIP file that took 26 hours. Memory and CPU stayed in normal > range during this operation. > > **Functional tests** > Accuracy tests preformed on small size data. > > **Pre-commit Build** > https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1379/console > > > Thanks, > > Ashutosh Mestry > >

Re: Review Request 71426: Import Service: Support for Backing Directory for Large Imports

2019-09-03 Thread Ashutosh Mestry via Review Board
sts** Updated to exercise the new implementation. **Volume tests** Imported 4GB ZIP file that took 26 hours. Memory and CPU stayed in normal range during this operation. **Functional tests** Accuracy tests preformed on small size data. **Pre-commit Build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1379/console Thanks, Ashutosh Mestry

[jira] [Updated] (ATLAS-3396) ZipSource: Usage of In-memory Maps Limits the Size of Imports Performed

2019-09-03 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3396: --- Attachment: ATLAS-3396-ZipSource-Memory-usage-improvement-for-la-branch-0.8.patch

Review Request 71426: Import Service: Support for Backing Directory for Large Imports

2019-09-03 Thread Ashutosh Mestry via Review Board
that took 26 hours. Memory and CPU stayed in normal range during this operation. **Functional tests** Accuracy tests preformed on small size data. Thanks, Ashutosh Mestry

[jira] [Updated] (ATLAS-3396) ZipSource: Usage of In-memory Maps Limits the Size of Imports Performed

2019-09-03 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3396: --- Attachment: (was: ATLAS-3396-ZipSource-Memory-usage-improvement-for-la.patch

[jira] [Updated] (ATLAS-3396) ZipSource: Usage of In-memory Maps Limits the Size of Imports Performed

2019-09-02 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3396: --- Component/s: atlas-core Fix Version/s: 0.8.4 trunk

[jira] [Created] (ATLAS-3396) ZipSource: Usage of In-memory Maps Limits the Size of Imports Performed

2019-09-02 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3396: -- Summary: ZipSource: Usage of In-memory Maps Limits the Size of Imports Performed Key: ATLAS-3396 URL: https://issues.apache.org/jira/browse/ATLAS-3396 Project

Re: Review requests pending

2019-08-26 Thread Ashutosh Mestry
Hi I have reviewed the patch related to DSL search. I looked at the other 2 patches as well. The changes seem low risk. Sridhar: Can you please look at https://reviews.apache.org/r/71282/ Best regards, ~ ashutosh ... No hurry, no pause. – Tim Ferriss, Life Hacker, Author On 8/26/19,

Re: Review Request 71344: Use fulltext indices for dsl search

2019-08-26 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71344/#review217446 --- Ship it! Ship It! - Ashutosh Mestry On Aug. 22, 2019, 3:52

[jira] [Reopened] (ATLAS-3381) Atlas Patch Handler: Patch Handlers Not Committing Changes

2019-08-21 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry reopened ATLAS-3381: Condition to check for vertex having classification is updated. > Atlas Patch Handler: Pa

[jira] [Updated] (ATLAS-3381) Atlas Patch Handler: Patch Handlers Not Committing Changes

2019-08-21 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3381: --- Attachment: ATLAS-3381-ClassificationTextPatch.-Improved-conditi.patch > Atlas Patch Hand

[jira] [Comment Edited] (ATLAS-3381) Atlas Patch Handler: Patch Handlers Not Committing Changes

2019-08-20 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911580#comment-16911580 ] Ashutosh Mestry edited comment on ATLAS-3381 at 8/20/19 9:50 PM

[jira] [Commented] (ATLAS-3381) Atlas Patch Handler: Patch Handlers Not Committing Changes

2019-08-20 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911580#comment-16911580 ] Ashutosh Mestry commented on ATLAS-3381: Addresses:  * Commit problem

[jira] [Updated] (ATLAS-3381) Atlas Patch Handler: Patch Handlers Not Committing Changes

2019-08-20 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3381: --- Attachment: ATLAS-3381-Addressed-ConcurrentPatchProcessor-not-ca.patch > Atlas Patch Hand

[jira] [Updated] (ATLAS-3381) Atlas Patch Handler: Patch Handlers Not Committing Changes

2019-08-20 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3381: --- Attachment: (was: ATLAS-3381-Addressed-ConcurrentPatchProcessor-not-ca.patch) > At

[jira] [Updated] (ATLAS-3381) Atlas Patch Handler: Patch Handlers Not Committing Changes

2019-08-20 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3381: --- Description: ***Background* Atlas patch handler is a framework that applies changes made

[jira] [Updated] (ATLAS-3381) Atlas Patch Handler: Patch Handlers Not Committing Changes

2019-08-20 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3381: --- Attachment: ATLAS-3381-Addressed-ConcurrentPatchProcessor-not-ca.patch > Atlas Patch Hand

[jira] [Created] (ATLAS-3381) Atlas Patch Handler: Patch Handlers Not Committing Changes

2019-08-20 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3381: -- Summary: Atlas Patch Handler: Patch Handlers Not Committing Changes Key: ATLAS-3381 URL: https://issues.apache.org/jira/browse/ATLAS-3381 Project: Atlas

Re: Review Request 71319: ATLAS-3380: Regression: After moving a table to a different database , db attribute in the table entity still points to the old db.

2019-08-19 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71319/#review217302 --- Ship it! Ship It! - Ashutosh Mestry On Aug. 19, 2019, 9:58

[jira] [Resolved] (ATLAS-3379) Relationship API: Fetch using Relationship GUID Fails with 'Internal Server Error'

2019-08-19 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry resolved ATLAS-3379. Resolution: Fixed > Relationship API: Fetch using Relationship GUID Fails with 'Inter

[jira] [Updated] (ATLAS-3379) Relationship API: Fetch using Relationship GUID Fails with 'Internal Server Error'

2019-08-19 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3379: --- Attachment: ATLAS-3379-Relationship-API-inadvertently-uses-getQu.patch > Relationship

[jira] [Commented] (ATLAS-3379) Relationship API: Fetch using Relationship GUID Fails with 'Internal Server Error'

2019-08-19 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910676#comment-16910676 ] Ashutosh Mestry commented on ATLAS-3379: Analysis: Recent change that uses _Asset.name_ to store

[jira] [Updated] (ATLAS-3379) Relationship API: Fetch using Relationship GUID Fails with 'Internal Server Error'

2019-08-19 Thread Ashutosh Mestry (Jira)
[ https://issues.apache.org/jira/browse/ATLAS-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3379: --- Description: *Steps to Duplicate* * Create entities via Hive hook. * Search

[jira] [Created] (ATLAS-3379) Relationship API: Fetch using Relationship GUID Fails with 'Internal Server Error'

2019-08-19 Thread Ashutosh Mestry (Jira)
Ashutosh Mestry created ATLAS-3379: -- Summary: Relationship API: Fetch using Relationship GUID Fails with 'Internal Server Error' Key: ATLAS-3379 URL: https://issues.apache.org/jira/browse/ATLAS-3379

Re: Review Request 71304: ATLAS-3377: Update AtlasPatchRegistry to use graph query instead of index query

2019-08-16 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71304/#review217252 --- - Ashutosh Mestry On Aug. 17, 2019, 12:47 a.m., Sarath

Re: Review Request 71295: ATLAS-3370: Aggregation Metrics with Quick Search Do Not Result in Correct Counts

2019-08-16 Thread Ashutosh Mestry via Review Board
** DSLQueriesTest: 246 (multiplied by 2). GremlinQueryComposerTest: 39 tests. **Integration tests** Existing set. **Pre-commit build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1357/ Thanks, Ashutosh Mestry

Re: Review Request 71295: ATLAS-3370: Aggregation Metrics with Quick Search Do Not Result in Correct Counts

2019-08-16 Thread Ashutosh Mestry via Review Board
** DSLQueriesTest: 246 (multiplied by 2). GremlinQueryComposerTest: 39 tests. **Integration tests** Existing set. **Pre-commit build** https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1357/ Thanks, Ashutosh Mestry

Re: Help needed with Production Configurations

2019-08-15 Thread Ashutosh Mestry
: Verdan Mahmood Date: Wednesday, August 14, 2019 at 10:39 AM To: "dev@atlas.apache.org" , Ashutosh Mestry Cc: "u...@atlas.apache.org" Subject: Re: Help needed with Production Configurations We are using Atlas 2.0 We do have following relations: Table(DataSet): hive_ta

Review Request 71295: ATLAS-3370: Aggregation Metrics with Quick Search Do Not Result in Correct Counts

2019-08-15 Thread Ashutosh Mestry via Review Board
). GremlinQueryComposerTest: 39 tests. **Integration tests** Existing set. Thanks, Ashutosh Mestry

Re: Review Request 71294: ATLAS-3374: fix for incorrect basic/quick search results

2019-08-15 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71294/#review217218 --- Ship it! Ship It! - Ashutosh Mestry On Aug. 15, 2019, 9:48

Re: Help needed with Production Configurations

2019-08-14 Thread Ashutosh Mestry
What version are you using? DSL queries mostly not use indexes, hence having good configuration of Solr may not be of much value. The pre-1.0 version of DSL is not very efficient in terms of performance. What kind of queries do you have? Can you post some examples? Few things you could try: -

Review Request 71270: Table-level Export & Import: Preserving REPL Additional Info

2019-08-10 Thread Ashutosh Mestry via Review Board
. Thanks, Ashutosh Mestry

[jira] [Updated] (ATLAS-3362) Import Service: Table-level Imports: Updating Replication Info Improvements

2019-08-09 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3362: --- Attachment: ATLAS-3362-Updated-logic-for-storing-repl-key-for-ta.patch > Import Serv

[jira] [Updated] (ATLAS-3362) Import Service: Table-level Imports: Updating Replication Info Improvements

2019-08-09 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3362: --- Attachment: (was: ATLAS-3362-Using-different-scheme-for-storing-repl-d.patch) > Imp

Re: Atlas import taking huge amount of time

2019-08-08 Thread Ashutosh Mestry
Right now this implementation is only for Import. ~ ashutosh Ashutosh Mestry <mailto:ames...@cloudera.com> . Software Engineer . Cloudera, Inc. . +1-310-988 0670 ... No hurry, no pause. – Tim Ferriss, Life Hacker, Author On 8/8/19, 12:04 PM, "Bolke de Br

[jira] [Updated] (ATLAS-3362) Import Service: Table-level Imports: Updating Replication Info Improvements

2019-08-08 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3362: --- Attachment: ATLAS-3362-Using-different-scheme-for-storing-repl-d.patch > Import Serv

[jira] [Created] (ATLAS-3362) Import Service: Table-level Imports: Updating Replication Info Improvements

2019-08-08 Thread Ashutosh Mestry (JIRA)
Ashutosh Mestry created ATLAS-3362: -- Summary: Import Service: Table-level Imports: Updating Replication Info Improvements Key: ATLAS-3362 URL: https://issues.apache.org/jira/browse/ATLAS-3362

Re: Review Request 71253: [ATLAS-3360]-Duplicate audits in atlas when HMS and hive hook is enabled.

2019-08-08 Thread Ashutosh Mestry via Review Board
be better to store entitiesToSkip in a map of guids. server-api/src/main/java/org/apache/atlas/RequestContext.java Lines 347 (patched) <https://reviews.apache.org/r/71253/#comment304385> What is the purpose of this method? - Ashutosh Mestry On Aug. 8, 2019, 1:51 p

Re: Review Request 71127: ATLAS-3343: Ordering of dynAttr evaluation

2019-08-05 Thread Ashutosh Mestry via Review Board
osed on current entity creation flow with this change? - Ashutosh Mestry On Aug. 5, 2019, 4:35 p.m., Merryle Wang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https:/

[jira] [Commented] (ATLAS-3050) OGM DataAccess: Error Condition Change

2019-08-05 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900216#comment-16900216 ] Ashutosh Mestry commented on ATLAS-3050: [~nixonrodrigues] Thanks for taking care of this. +1

[jira] [Updated] (ATLAS-3357) DataSetLineageJerseyResourceIT: Failure Due to Data Type Mismatch

2019-08-02 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3357: --- Attachment: ATLAS-3357-DataSetLineageJerseyResourceIT-updated-da.patch

[jira] [Updated] (ATLAS-3357) DataSetLineageJerseyResourceIT: Failure Due to Data Type Mismatch

2019-08-02 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3357: --- Attachment: (was: ATLAS-3357-DataSetLineageJerseyResourceIT-updated-da.patch

[jira] [Created] (ATLAS-3357) DataSetLineageJerseyResourceIT: Failure Due to Data Type Mismatch

2019-08-02 Thread Ashutosh Mestry (JIRA)
Ashutosh Mestry created ATLAS-3357: -- Summary: DataSetLineageJerseyResourceIT: Failure Due to Data Type Mismatch Key: ATLAS-3357 URL: https://issues.apache.org/jira/browse/ATLAS-3357 Project: Atlas

[jira] [Created] (ATLAS-3355) DSLQueriesTest: Failure Due to Data Type Mismatch

2019-08-01 Thread Ashutosh Mestry (JIRA)
Ashutosh Mestry created ATLAS-3355: -- Summary: DSLQueriesTest: Failure Due to Data Type Mismatch Key: ATLAS-3355 URL: https://issues.apache.org/jira/browse/ATLAS-3355 Project: Atlas Issue

[jira] [Updated] (ATLAS-3232) Relationships, Export & Import : Updates to relationshipDef are not honored during import

2019-07-31 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3232: --- Fix Version/s: 2.1.0 > Relationships, Export & Import : Updates to relation

Re: Review Request 71202: ImportTypeDefProcessor: Now includes processing AtlasRelationships

2019-07-31 Thread Ashutosh Mestry via Review Board
. **Functional tests** Export and import tests with steps from bug. Thanks, Ashutosh Mestry

[jira] [Updated] (ATLAS-3354) Export Service: ChangeMarker Does not Change

2019-07-31 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3354: --- Attachment: AtlasTypeDefStoreInitializer-RequestContext-Clearnin.patch > Export Serv

[jira] [Created] (ATLAS-3354) Export Service: ChangeMarker Does not Change

2019-07-31 Thread Ashutosh Mestry (JIRA)
Ashutosh Mestry created ATLAS-3354: -- Summary: Export Service: ChangeMarker Does not Change Key: ATLAS-3354 URL: https://issues.apache.org/jira/browse/ATLAS-3354 Project: Atlas Issue Type

[jira] [Updated] (ATLAS-3351) Atlas Entity: Support Storing Arbitrary Name-Value Pairs

2019-07-30 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3351: --- Summary: Atlas Entity: Support Storing Arbitrary Name-Value Pairs (was: Support Name-Value

[jira] [Updated] (ATLAS-3351) Support Name-Value Pair within Atlas Entities

2019-07-30 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3351: --- Description: *Background* There are cases where it is required to store additional

[jira] [Assigned] (ATLAS-3351) Support Name-Value Pair within Atlas Entities

2019-07-30 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry reassigned ATLAS-3351: -- Assignee: (was: Ashutosh Mestry) > Support Name-Value Pair within Atlas Entit

[jira] [Updated] (ATLAS-3351) Support Name-Value Pair within Atlas Entities

2019-07-30 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3351: --- Attachment: (was: ATLAS-3351-Referenceable-to-have-customProperties-at.patch) > Supp

[jira] [Updated] (ATLAS-3351) Support Name-Value Pair within Atlas Entities

2019-07-30 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3351: --- Summary: Support Name-Value Pair within Atlas Entities (was: Referencable: New Attribute

Re: Review Request 71202: ImportTypeDefProcessor: Now includes processing AtlasRelationships

2019-07-30 Thread Ashutosh Mestry via Review Board
/TypeAttributeDifference.java e3d86c862 Diff: https://reviews.apache.org/r/71202/diff/1/ Testing --- **Unit tests** Existing tests. **Functional tests** Export and import tests with steps from bug. Thanks, Ashutosh Mestry

Review Request 71202: ImportTypeDefProcessor: Now includes processing AtlasRelationships

2019-07-30 Thread Ashutosh Mestry via Review Board
, Ashutosh Mestry

[jira] [Assigned] (ATLAS-3232) Relationships, Export & Import : Updates to relationshipDef are not honored during import

2019-07-30 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry reassigned ATLAS-3232: -- Assignee: Ashutosh Mestry > Relationships, Export & Import :

[jira] [Updated] (ATLAS-3232) Relationships, Export & Import : Updates to relationshipDef are not honored during import

2019-07-30 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3232: --- Description: # In source cluster , updated relationshipDef "hive_table_db" pro

[jira] [Updated] (ATLAS-3351) Referencable: New Attribute Custom Properties

2019-07-26 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3351: --- Attachment: ATLAS-3351-Referenceable-to-have-customProperties-at.patch > Referencable:

[jira] [Updated] (ATLAS-3351) Referencable: New Attribute Custom Properties

2019-07-26 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3351: --- Attachment: (was: ATLAS-3351-Referenceable-has-customProperties.patch) > Referenca

[jira] [Updated] (ATLAS-3351) Referencable: New Attribute Custom Properties

2019-07-26 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3351: --- Attachment: ATLAS-3351-Referenceable-has-customProperties.patch > Referencable:

[jira] [Created] (ATLAS-3351) Referencable: New Attribute Custom Properties

2019-07-26 Thread Ashutosh Mestry (JIRA)
Ashutosh Mestry created ATLAS-3351: -- Summary: Referencable: New Attribute Custom Properties Key: ATLAS-3351 URL: https://issues.apache.org/jira/browse/ATLAS-3351 Project: Atlas Issue Type

Re: Atlas import taking huge amount of time

2019-07-24 Thread Ashutosh Mestry
i Ashutosh, Thanks for your reply. Currently we are using Atlas 2.0.0 and I am not able to apply this patch. It has lot of compilation errors. Do you have a patch for 2.0.0? --- Regards, Sreeni On 23/07/19, 11:36 PM, "Ashutosh

Re: Review Request 71025: Import Service: Support Concurrent Ingest

2019-07-24 Thread Ashutosh Mestry via Review Board
---+--++ | largedb |3 hrs | 10 mins | Shards: 4, Threads: 16 | | (40 MB) | | || +--+--+------+----+ Thanks, Ashutosh Mestry

Re: Review Request 71025: Import Service: Support Concurrent Ingest

2019-07-24 Thread Ashutosh Mestry via Review Board
----+------+----+ Thanks, Ashutosh Mestry

Re: Review Request 71025: Import Service: Support Concurrent Ingest

2019-07-23 Thread Ashutosh Mestry via Review Board
hrs | 20 mins | Shards: 4, Threads: 16 | | (40 MB) | | || +--+--+------+----+ Thanks, Ashutosh Mestry

Re: Atlas import taking huge amount of time

2019-07-23 Thread Ashutosh Mestry
Hi Existing import processes 1 entity at a time. Thus time taken is linear. There is a JIRA that improves the situation. It is being tested right now. Please take a look at: JIRA: https://issues.apache.org/jira/browse/ATLAS-3320 Review: https://reviews.apache.org/r/71025/ (latest patch is

Re: Review Request 71046: ATLAS-3324 Export API - incremental export with hive_table

2019-07-12 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71046/#review216554 --- Ship it! Ship It! - Ashutosh Mestry On July 10, 2019, 2:14

Re: Review Request 71046: ATLAS-3324 Export API - incremental export with hive_table

2019-07-11 Thread Ashutosh Mestry via Review Board
/ExportService.java Lines 388 (patched) <https://reviews.apache.org/r/71046/#comment303760> Check for array bounds. - Ashutosh Mestry On July 10, 2019, 2:14 p.m., Nikhil Bonte wrote: > > --- > This is an automatically g

Re: Review Request 71058: ATLAS-3329 :- Update usage of Servlets.getUserName method to AtlasAuthorizationUtils.getCurrentUserName()

2019-07-11 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71058/#review216525 --- Ship it! Ship It! - Ashutosh Mestry On July 11, 2019, 2:14

Re: Review Request 71042: ATLAS-3321: Introduce atlas metadata namespace

2019-07-09 Thread Ashutosh Mestry via Review Board
for getMetadataNamespace. - Ashutosh Mestry On July 9, 2019, 11:53 p.m., Sarath Subramanian wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache

Re: Review Request 71042: ATLAS-3321: Introduce atlas metadata namespace

2019-07-09 Thread Ashutosh Mestry via Review Board
a/org/apache/atlas/kafka/bridge/KafkaBridge.java Lines 176 (patched) <https://reviews.apache.org/r/71042/#comment303708> Duplicate code. - Ashutosh Mestry On July 9, 2019, 11:53 p.m., Sarath Subramanian wrote: > > --- > T

[jira] [Updated] (ATLAS-3315) AtlasGraphProvider: Allow for Creation of JanusGraph DB Connection Initialized with Batch Loading Enabled

2019-07-08 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3315: --- Attachment: ATLAS-3315-Database-initialization-exception-handlin.patch > AtlasGraphProvi

Review Request 71025: Import Service: Support Concurrent Ingest

2019-07-08 Thread Ashutosh Mestry via Review Board
) | | || +--+--+--++ Thanks, Ashutosh Mestry

[jira] [Created] (ATLAS-3320) Import Service: Support Concurrent Ingest

2019-07-08 Thread Ashutosh Mestry (JIRA)
Ashutosh Mestry created ATLAS-3320: -- Summary: Import Service: Support Concurrent Ingest Key: ATLAS-3320 URL: https://issues.apache.org/jira/browse/ATLAS-3320 Project: Atlas Issue Type: Bug

[jira] [Updated] (ATLAS-3315) AtlasGraphProvider: Allow for Creation of JanusGraph DB Connection Initialized with Batch Loading Enabled

2019-07-03 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3315: --- Attachment: ATLAS-3315-Error-during-AtlasGraphDatabase-initializ.patch > AtlasGraphProvi

[jira] [Updated] (ATLAS-3315) AtlasGraphProvider: Allow for Creation of JanusGraph DB Connection Initialized with Batch Loading Enabled

2019-07-03 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3315: --- Attachment: (was: AltasJanusGraph-Init-exception-fix.patch) > AtlasGraphProvider: Al

[jira] [Updated] (ATLAS-3315) AtlasGraphProvider: Allow for Creation of JanusGraph DB Connection Initialized with Batch Loading Enabled

2019-07-03 Thread Ashutosh Mestry (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Mestry updated ATLAS-3315: --- Attachment: AltasJanusGraph-Init-exception-fix.patch > AtlasGraphProvider: Al

Re: Review Request 71006: [ATLAS-3313] Enhance Atlas server to process notifications from multiple Kafka topics

2019-07-03 Thread Ashutosh Mestry via Review Board
ent303527> Please add test for this. - Ashutosh Mestry On July 3, 2019, 2:52 p.m., Saqeeb Shaikh wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: Review Request 71006: [ATLAS-3313] Enhance Atlas server to process notifications from multiple Kafka topics

2019-07-03 Thread Ashutosh Mestry via Review Board
this scenario. Overall impelemnetation looks simple enough. We are still little away for scaling Atlas. I was expecting that the NotificationHookConsumer will consume a particular topic. But I suppose that will need another set of changes. - Ashutosh Mestry On July 3, 2019, 2:52 p.m., Saqeeb

Re: Review Request 70913: ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes

2019-07-02 Thread Ashutosh Mestry via Review Board
> On July 2, 2019, 3:50 p.m., Ashutosh Mestry wrote: > > This an edge case: When temporary tables are created, their qualifiedName > > gets suffixed with GUID, how will this scheme handle that? > > Aadarsh Jajodia wrote: > Hi Ashutosh, Thats a good point you menti

Re: Review Request 70913: ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes

2019-07-02 Thread Ashutosh Mestry via Review Board
, their qualifiedName gets suffixed with GUID, how will this scheme handle that? - Ashutosh Mestry On July 1, 2019, 6:10 p.m., Merryle Wang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.

Re: Review Request 70913: ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes

2019-06-24 Thread Ashutosh Mestry via Review Board
method, say resolveDynamicAttribute(AtlasAttribute attr); - Ashutosh Mestry On June 22, 2019, 12:40 a.m., Merryle Wang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: Review Request 70930: ATLAS-3297: cache added/update entities in request-context, for use in entity-change listeners

2019-06-24 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70930/#review216093 --- Ship it! Ship It! - Ashutosh Mestry On June 22, 2019, 6:57

Re: Review Request 70880: ATLAS-3290: Impala Hook should get database name and table name from vertex metadata

2019-06-18 Thread Ashutosh Mestry via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70880/#review215957 --- Ship it! Ship It! - Ashutosh Mestry On June 18, 2019, 10:38

<    3   4   5   6   7   8   9   10   11   12   >