Re: [VOTE] Release Apache Atlas version 2.0.0 - rc0

2019-04-24 Thread Kapildeo Nayak 
+1 Release Apache Atlas version 2.0.0 - rc0 release

- Built successfully from the source tar file
- Verified PGP signature
- Tested Atlas UI
- Ran quick start and validated basic functionality

  Verified following features:
- Export Process: Support for incremental export.
- Atlas Import Transform handler implementation

Thanks,
Kapildeo.

On Wed, Apr 24, 2019 at 7:03 PM Nikhil Bonte <
nikhil.bo...@freestoneinfotech.com> wrote:

> +1 Release Apache Atlas 2.0.0 - rc0 release
>
> - Built successfully from the source tar file
> - Verified PGP signature
> - Ran quick start and validated basic functionality.
> - Verified following features:
> - Atlas Index Repair tool for JanusGraph
> - Update stats/metrics module to collect notification metrics
> - Add notifications from RelationshipStore to ATLAS_ENTITITES kafka topic
>
> Thanks
> Nikhil P. Bonte
>
> On Mon, Apr 22, 2019 at 11:32 AM Sarath Subramanian 
> wrote:
>
> > Apache Atlas 2.0.0 release candidate #0 is now available for vote within
> > dev community.
> >
> > Links to the release artifacts are given below. Please review and vote.
> >
> > The vote will be open for at least 72 hours or until necessary votes are
> > reached.
> >   [ ] +1 Approve
> >   [ ] +0 No opinion
> >   [ ] -1 Disapprove (and reason why)
> >
> > List of all issues addressed in this release:
> >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ATLAS%20AND%20status%20%3D%20Resolved%20AND%20fixVersion%20%3D%202.0.0%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC
> >
> > Git tag for the release:
> > https://github.com/apache/atlas/tree/release-2.0.0-rc0
> > Sources for the release:
> >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.0.0-rc0/apache-atlas-2.0.0-sources.tar.gz
> >
> > Source release verification:
> > PGP Signature:
> >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.0.0-rc0/apache-atlas-2.0.0-sources.tar.gz.asc
> > SHA512
> > <
> https://dist.apache.org/repos/dist/dev/atlas/2.0.0-rc0/apache-atlas-2.0.0-sources.tar.gz.ascSHA512
> >
> > Hash:
> >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.0.0-rc0/apache-atlas-2.0.0-sources.tar.gz.sha512
> > MD5
> > <
> https://dist.apache.org/repos/dist/dev/atlas/2.0.0-rc0/apache-atlas-2.0.0-sources.tar.gz.sha512MD5
> >
> > Hash:
> >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.0.0-rc0/apache-atlas-2.0.0-sources.tar.gz.md5
> >
> > Keys to verify the signature of the release artifacts are available at:
> > https://dist.apache.org/repos/dist/release/atlas/KEYS
> >
> > New features/enhancements:
> >   - Update component versions to use Hadoop 3, HBase 2 and Solr 7
> >   - Update JanusGraph version to 0.3.1
> >   - Soft-reference attribute implementation.
> >   - Create patch framework to persist typedef patches applied to atlas
> >   - Handle data patches in patch framework
> >   - Export Process: Support for incremental export.
> >   - Atlas Import Transform handler implementation
> >   - Update authentication to support trusted proxy
> >   - Atlas Index Repair tool for JanusGraph
> >   - Update stats/metrics module to collect notification metrics
> >   - Add filter in lineage to hide Process entity.
> >   - Add service-type dropdown to filter entitydef type
> >   - Add notifications from RelationshipStore to ATLAS_ENTITITES kafka
> > topic.
> >   - Added unique-attributes constraints at store-level
> >   - Performance enhancement to avoid unnecessary lookup when creating new
> > relationships
> >   - Updated notification processing to support batch-commits
> >   - Updated hook notification processing with option to ignore
> potentially
> > incorrect hive_column_lineage
> >   - Updated Hive hook to avoid duplicate column-lineage entities; also
> > updated Atlas server to skip duplicate column-lineage entities
> >   - Improved batch processing in notificaiton handler to avoid processing
> > of an entity multiple times
> >   - Add option to ignore/prune metadata for temporary/staging Hive tables
> >   - Update metrics query to use index query instead of graph query for
> > faster response
> >   - UI: Show counts besides the Type and Classification dropdown list in
> > search
> >   - UI: show lineage information for process entities
> >   - UI: Show entity specific icon for the lineage node
> >   - UI: Add relationship table inside relationships tab
> >
> >
> > Thanks,
> > Sarath
> > 
> >
>
>
> --
> Regards
> Nikhil P. Bonte
>

[jira] [Updated] (ATLAS-2458) RelationshipApi Delete doesnt remove relationshipAttributes from entity

2019-03-20 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-2458:
--
Attachment: ATLAS-2458.patch

> RelationshipApi Delete doesnt remove relationshipAttributes from entity
> ---
>
> Key: ATLAS-2458
> URL: https://issues.apache.org/jira/browse/ATLAS-2458
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 1.0.0
>Reporter: Brandon Kirchner
>    Assignee: Kapildeo Nayak
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2458.patch
>
>
> When I create a Process and DataSet entity, and create a 
> process_dataset_outputs relationship between the two, when I delete the 
> relationship, the relationshipAttributes are not removed from the Process or 
> DataSet entities. full reproduction steps and output are below --
>  
> step 1 -- create dataset and process (through UI)
> step 2 -- create relationship
> http post http://localhost:21000/api/atlas/v2/relationship
> PAYLOAD
> {
>  "end1" : {
>  "guid" : "d456dc93-8832-4a36-8ae0-071946c653fc"
>  },
>  "end2" : {
>  "guid" : "247bc2d1-de27-4c50-a35b-b62350dc7979"
>  },
>  "typeName":"process_dataset_outputs"
> }
> RESPONSE
> {
>  "createTime": 1519335073389,
>  "createdBy": "admin",
>  "end1": {
>  "guid": "d456dc93-8832-4a36-8ae0-071946c653fc",
>  "typeName": "Process"
>  },
>  "end2": {
>  "guid": "247bc2d1-de27-4c50-a35b-b62350dc7979",
>  "typeName": "DataSet"
>  },
>  "guid": "bb9dfa43-c193-4cbb-9472-6b9421f43701",
>  "label": "__Process.outputs",
>  "propagateTags": "ONE_TO_TWO",
>  "status": "ACTIVE",
>  "typeName": "process_dataset_outputs",
>  "updateTime": 1519335073389,
>  "updatedBy": "admin",
>  "version": 0
> }
> step 3 -- verify relationship on entities
> http get 
> http://localhost:21000/api/atlas/v2/entity/guid/247bc2d1-de27-4c50-a35b-b62350dc7979
> HTTP/1.1 200 OK
> {
>  "entity": {
>  "attributes": {
>  "description": null,
>  "name": "dataset",
>  "owner": null,
>  "qualifiedName": "dataset"
>  },
>  "classifications": [],
>  "createTime": 1519334042139,
>  "createdBy": "admin",
>  "guid": "247bc2d1-de27-4c50-a35b-b62350dc7979",
>  "relationshipAttributes": {
>  "sinkFromProcesses": [
>  {
>  "displayText": "process",
>  "guid": "d456dc93-8832-4a36-8ae0-071946c653fc",
>  "relationshipAttributes": {
>  "typeName": "process_dataset_outputs"
>  },
>  "relationshipGuid": "bb9dfa43-c193-4cbb-9472-6b9421f43701",
>  "typeName": "Process"
>  }
>  ],
>  "sourceToProcesses": []
>  },
>  "status": "ACTIVE",
>  "typeName": "DataSet",
>  "updateTime": 1519334042139,
>  "updatedBy": "admin",
>  "version": 0
>  },
>  "referredEntities": {}
> }
> http get 
> http://localhost:21000/api/atlas/v2/entity/guid/247bc2d1-de27-4c50-a35b-b62350dc7979
> HTTP/1.1 200 OK
> {
>  "entity": {
>  "attributes": {
>  "description": null,
>  "name": "dataset",
>  "owner": null,
>  "qualifiedName": "dataset"
>  },
>  "classifications": [],
>  "createTime": 1519334042139,
>  "createdBy": "admin",
>  "guid": "247bc2d1-de27-4c50-a35b-b62350dc7979",
>  "relationshipAttributes": {
>  "sinkFromProcesses": [
>  {
>  "displayText": "process",
>  "guid": "d456dc93-8832-4a36-8ae0-071946c653fc",
>  "relationshipAttributes": {
>  "typeName": "process_dataset_outputs"
>  },
>  "relationshipGuid": "bb9dfa43-c193-4cbb-9472-6b9421f43701",
>  "typeName": "Process"
>  }
>  ],
>  "sourceToProcesses": []
>  },
>  "status": &qu

[jira] [Assigned] (ATLAS-2458) RelationshipApi Delete doesnt remove relationshipAttributes from entity

2019-03-20 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak reassigned ATLAS-2458:
-

Assignee: Kapildeo Nayak

> RelationshipApi Delete doesnt remove relationshipAttributes from entity
> ---
>
> Key: ATLAS-2458
> URL: https://issues.apache.org/jira/browse/ATLAS-2458
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 1.0.0
>Reporter: Brandon Kirchner
>    Assignee: Kapildeo Nayak
>Priority: Major
> Fix For: 1.0.0
>
>
> When I create a Process and DataSet entity, and create a 
> process_dataset_outputs relationship between the two, when I delete the 
> relationship, the relationshipAttributes are not removed from the Process or 
> DataSet entities. full reproduction steps and output are below --
>  
> step 1 -- create dataset and process (through UI)
> step 2 -- create relationship
> http post http://localhost:21000/api/atlas/v2/relationship
> PAYLOAD
> {
>  "end1" : {
>  "guid" : "d456dc93-8832-4a36-8ae0-071946c653fc"
>  },
>  "end2" : {
>  "guid" : "247bc2d1-de27-4c50-a35b-b62350dc7979"
>  },
>  "typeName":"process_dataset_outputs"
> }
> RESPONSE
> {
>  "createTime": 1519335073389,
>  "createdBy": "admin",
>  "end1": {
>  "guid": "d456dc93-8832-4a36-8ae0-071946c653fc",
>  "typeName": "Process"
>  },
>  "end2": {
>  "guid": "247bc2d1-de27-4c50-a35b-b62350dc7979",
>  "typeName": "DataSet"
>  },
>  "guid": "bb9dfa43-c193-4cbb-9472-6b9421f43701",
>  "label": "__Process.outputs",
>  "propagateTags": "ONE_TO_TWO",
>  "status": "ACTIVE",
>  "typeName": "process_dataset_outputs",
>  "updateTime": 1519335073389,
>  "updatedBy": "admin",
>  "version": 0
> }
> step 3 -- verify relationship on entities
> http get 
> http://localhost:21000/api/atlas/v2/entity/guid/247bc2d1-de27-4c50-a35b-b62350dc7979
> HTTP/1.1 200 OK
> {
>  "entity": {
>  "attributes": {
>  "description": null,
>  "name": "dataset",
>  "owner": null,
>  "qualifiedName": "dataset"
>  },
>  "classifications": [],
>  "createTime": 1519334042139,
>  "createdBy": "admin",
>  "guid": "247bc2d1-de27-4c50-a35b-b62350dc7979",
>  "relationshipAttributes": {
>  "sinkFromProcesses": [
>  {
>  "displayText": "process",
>  "guid": "d456dc93-8832-4a36-8ae0-071946c653fc",
>  "relationshipAttributes": {
>  "typeName": "process_dataset_outputs"
>  },
>  "relationshipGuid": "bb9dfa43-c193-4cbb-9472-6b9421f43701",
>  "typeName": "Process"
>  }
>  ],
>  "sourceToProcesses": []
>  },
>  "status": "ACTIVE",
>  "typeName": "DataSet",
>  "updateTime": 1519334042139,
>  "updatedBy": "admin",
>  "version": 0
>  },
>  "referredEntities": {}
> }
> http get 
> http://localhost:21000/api/atlas/v2/entity/guid/247bc2d1-de27-4c50-a35b-b62350dc7979
> HTTP/1.1 200 OK
> {
>  "entity": {
>  "attributes": {
>  "description": null,
>  "name": "dataset",
>  "owner": null,
>  "qualifiedName": "dataset"
>  },
>  "classifications": [],
>  "createTime": 1519334042139,
>  "createdBy": "admin",
>  "guid": "247bc2d1-de27-4c50-a35b-b62350dc7979",
>  "relationshipAttributes": {
>  "sinkFromProcesses": [
>  {
>  "displayText": "process",
>  "guid": "d456dc93-8832-4a36-8ae0-071946c653fc",
>  "relationshipAttributes": {
>  "typeName": "process_dataset_outputs"
>  },
>  "relationshipGuid": "bb9dfa43-c193-4cbb-9472-6b9421f43701",
>  "typeName": "Process"
>  }
>  ],
>  "sourceToProcesses": []
>  },
>  "status": "ACTIVE",
>  "typeName": &

Re: Review Request 69744: ATLAS-3032 Importing an entity with tag attribute of type float data type fails with an BigDecimal Exception

2019-02-27 Thread Kapildeo Nayak 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69744/
---

(Updated Feb. 27, 2019, 1:19 p.m.)


Review request for atlas, Ashutosh Mestry, Nixon Rodrigues, and Sarath 
Subramanian.


Changes
---

Added unit test


Bugs: ATLAS-3032
https://issues.apache.org/jira/browse/ATLAS-3032


Repository: atlas


Description
---

1. In source cluster , created a tag with float attribute.
2. Created an hive_db and associated the tag to the hive_db with value 
"-3.4028235E+38"
3. On importing the exported hive_db entity, exception is seen and import fails.


Diffs (updated)
-

  intg/src/test/java/org/apache/atlas/TestUtilsV2.java 093105b52 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasGraphUtilsV2.java
 25770a334 
  
repository/src/test/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityStoreV2BigDecimalTest.java
 PRE-CREATION 


Diff: https://reviews.apache.org/r/69744/diff/2/

Changes: https://reviews.apache.org/r/69744/diff/1-2/


Testing
---

Tested in import-export with transformers options.


Thanks,

Kapildeo Nayak

Re: Review Request 69682: ATLAS-3024 On hive_db rename few attributes are still not renamed after successful import

2019-02-11 Thread Kapildeo Nayak 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69682/
---

(Updated Feb. 11, 2019, 11:27 a.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
and Sarath Subramanian.


Changes
---

Added Test Cases


Bugs: ATLAS-3024
https://issues.apache.org/jira/browse/ATLAS-3024


Repository: atlas


Description
---

1) Created a database db9 with a table and external table and exported it.
2) On Importing , renamed it to db11 using : 
{\"conditions\": {\"hive_db.name\":\"EQUALS: 
db9\"},\"action\":{\"hive_db.name\":\"SET: db11\"}}]"

3. Attributes related to hive_db location, hive_storagedesc location and 
attributes of hive_process and hdfs_path are not renamed and still have db9 
reference.


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/entitytransform/BaseEntityHandler.java 
975e4ddd6 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveDatabaseEntityHandler.java
 b8032aa09 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveProcessEntityHandler.java
 PRE-CREATION 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveStorageDescriptorEntityHandler.java
 38de206d1 
  
intg/src/main/java/org/apache/atlas/entitytransform/TransformationConstants.java
 247de7320 
  
intg/src/test/java/org/apache/atlas/entitytransform/TransformationHandlerTest.java
 d6b0ede2b 


Diff: https://reviews.apache.org/r/69682/diff/5/

Changes: https://reviews.apache.org/r/69682/diff/4-5/


Testing
---

Tested in import-export with transformers options.


Thanks,

Kapildeo Nayak

Re: Review Request 69682: ATLAS-3024 On hive_db rename few attributes are still not renamed after successful import

2019-01-17 Thread Kapildeo Nayak 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69682/
---

(Updated Jan. 18, 2019, 7:35 a.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
and Sarath Subramanian.


Changes
---

tested for more test cases.


Bugs: ATLAS-3024
https://issues.apache.org/jira/browse/ATLAS-3024


Repository: atlas


Description
---

1) Created a database db9 with a table and external table and exported it.
2) On Importing , renamed it to db11 using : 
{\"conditions\": {\"hive_db.name\":\"EQUALS: 
db9\"},\"action\":{\"hive_db.name\":\"SET: db11\"}}]"

3. Attributes related to hive_db location, hive_storagedesc location and 
attributes of hive_process and hdfs_path are not renamed and still have db9 
reference.


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/entitytransform/BaseEntityHandler.java 
975e4ddd6 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveDatabaseEntityHandler.java
 b8032aa09 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveProcessEntityHandler.java
 PRE-CREATION 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveStorageDescriptorEntityHandler.java
 38de206d1 
  
intg/src/main/java/org/apache/atlas/entitytransform/TransformationConstants.java
 247de7320 


Diff: https://reviews.apache.org/r/69682/diff/4/

Changes: https://reviews.apache.org/r/69682/diff/3-4/


Testing
---

Tested in import-export with transformers options.


Thanks,

Kapildeo Nayak

Re: Review Request 69682: ATLAS-3024 On hive_db rename few attributes are still not renamed after successful import

2019-01-17 Thread Kapildeo Nayak 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69682/
---

(Updated Jan. 17, 2019, 2:44 p.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
and Sarath Subramanian.


Changes
---

Handled review comment for QualifiedName


Bugs: ATLAS-3024
https://issues.apache.org/jira/browse/ATLAS-3024


Repository: atlas


Description
---

1) Created a database db9 with a table and external table and exported it.
2) On Importing , renamed it to db11 using : 
{\"conditions\": {\"hive_db.name\":\"EQUALS: 
db9\"},\"action\":{\"hive_db.name\":\"SET: db11\"}}]"

3. Attributes related to hive_db location, hive_storagedesc location and 
attributes of hive_process and hdfs_path are not renamed and still have db9 
reference.


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/entitytransform/BaseEntityHandler.java 
975e4ddd6 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveDatabaseEntityHandler.java
 b8032aa09 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveProcessEntityHandler.java
 PRE-CREATION 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveStorageDescriptorEntityHandler.java
 38de206d1 
  
intg/src/main/java/org/apache/atlas/entitytransform/TransformationConstants.java
 247de7320 


Diff: https://reviews.apache.org/r/69682/diff/3/

Changes: https://reviews.apache.org/r/69682/diff/2-3/


Testing
---

Tested in import-export with transformers options.


Thanks,

Kapildeo Nayak

[jira] [Updated] (ATLAS-3032) Importing an entity with tag attribute of type float data type fails with an BigDecimal Exception

2019-01-14 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-3032:
--
Attachment: ATLAS-3032.patch

> Importing an entity with tag attribute of type float data type fails with an 
> BigDecimal Exception
> -
>
> Key: ATLAS-3032
> URL: https://issues.apache.org/jira/browse/ATLAS-3032
> Project: Atlas
>  Issue Type: Bug
>        Reporter: Kapildeo Nayak
>Priority: Critical
> Attachments: ATLAS-3032.patch
>
>
> 1. In source cluster , created a tag with float attribute.
> 2. Created an hive_db and associated the tag to the hive_db with value 
> "-3.4028235E+38"
> 3. On importing the exported hive_db entity, exception is seen and import 
> fails.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Review Request 69744: ATLAS-3032 Importing an entity with tag attribute of type float data type fails with an BigDecimal Exception

2019-01-14 Thread Kapildeo Nayak 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69744/
---

Review request for atlas, Ashutosh Mestry, Nixon Rodrigues, and Sarath 
Subramanian.


Bugs: ATLAS-3032
https://issues.apache.org/jira/browse/ATLAS-3032


Repository: atlas


Description
---

1. In source cluster , created a tag with float attribute.
2. Created an hive_db and associated the tag to the hive_db with value 
"-3.4028235E+38"
3. On importing the exported hive_db entity, exception is seen and import fails.


Diffs
-

  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasGraphUtilsV2.java
 69d3f63f9 


Diff: https://reviews.apache.org/r/69744/diff/1/


Testing
---

Tested in import-export with transformers options.


Thanks,

Kapildeo Nayak

[jira] [Created] (ATLAS-3032) Importing an entity with tag attribute of type float data type fails with an BigDecimal Exception

2019-01-14 Thread Kapildeo Nayak (JIRA) 
Kapildeo Nayak created ATLAS-3032:
-

 Summary: Importing an entity with tag attribute of type float data 
type fails with an BigDecimal Exception
 Key: ATLAS-3032
 URL: https://issues.apache.org/jira/browse/ATLAS-3032
 Project: Atlas
  Issue Type: Bug
Reporter: Kapildeo Nayak


1. In source cluster , created a tag with float attribute.
2. Created an hive_db and associated the tag to the hive_db with value 
"-3.4028235E+38"
3. On importing the exported hive_db entity, exception is seen and import fails.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-3024) On hive_db rename few attributes are still not renamed after successful import

2019-01-07 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-3024:
--
Attachment: ATLAS-3024.patch

> On hive_db rename few attributes are still not renamed after successful import
> --
>
> Key: ATLAS-3024
> URL: https://issues.apache.org/jira/browse/ATLAS-3024
> Project: Atlas
>  Issue Type: Bug
>    Reporter: Kapildeo Nayak
>Priority: Major
> Attachments: ATLAS-3024.patch
>
>
> # Created a database db9 with a table and external table and exported it.
>  # On Importing , renamed it to db11 using : 
> {\"conditions\":{\"hive_db.name\":\"EQUALS: 
> db9\"},\"action\":{\"hive_db.name\":\"SET: db11\"}}]"
>       3. Attributes related to hive_db location, hive_storagedesc location 
> and attributes of hive_process and hdfs_path are not renamed and have db9 
> reference still.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-3024) On hive_db rename few attributes are still not renamed after successful import

2019-01-07 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-3024:
--
Attachment: (was: 
0001-BUG-111658-hive_db-rename-few-attributes-are-still-n.patch)

> On hive_db rename few attributes are still not renamed after successful import
> --
>
> Key: ATLAS-3024
> URL: https://issues.apache.org/jira/browse/ATLAS-3024
> Project: Atlas
>  Issue Type: Bug
>    Reporter: Kapildeo Nayak
>Priority: Major
> Attachments: ATLAS-3024.patch
>
>
> # Created a database db9 with a table and external table and exported it.
>  # On Importing , renamed it to db11 using : 
> {\"conditions\":{\"hive_db.name\":\"EQUALS: 
> db9\"},\"action\":{\"hive_db.name\":\"SET: db11\"}}]"
>       3. Attributes related to hive_db location, hive_storagedesc location 
> and attributes of hive_process and hdfs_path are not renamed and have db9 
> reference still.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 69682: ATLAS-3024 On hive_db rename few attributes are still not renamed after successful import

2019-01-07 Thread Kapildeo Nayak 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69682/
---

(Updated Jan. 7, 2019, 2:06 p.m.)


Review request for atlas, Ashutosh Mestry, Nixon Rodrigues, and Sarath 
Subramanian.


Bugs: ATLAS-3024
https://issues.apache.org/jira/browse/ATLAS-3024


Repository: atlas


Description
---

1) Created a database db9 with a table and external table and exported it.
2) On Importing , renamed it to db11 using : 
{\"conditions\": {\"hive_db.name\":\"EQUALS: 
db9\"},\"action\":{\"hive_db.name\":\"SET: db11\"}}]"

3. Attributes related to hive_db location, hive_storagedesc location and 
attributes of hive_process and hdfs_path are not renamed and still have db9 
reference.


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/entitytransform/BaseEntityHandler.java 
975e4ddd6 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveDatabaseEntityHandler.java
 b8032aa09 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveProcessEntityHandler.java
 PRE-CREATION 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveStorageDescriptorEntityHandler.java
 38de206d1 
  
intg/src/main/java/org/apache/atlas/entitytransform/TransformationConstants.java
 247de7320 


Diff: https://reviews.apache.org/r/69682/diff/2/

Changes: https://reviews.apache.org/r/69682/diff/1-2/


Testing
---

Tested in import-export with transformers options.


Thanks,

Kapildeo Nayak

Review Request 69682: ATLAS-3024 On hive_db rename few attributes are still not renamed after successful import

2019-01-07 Thread Kapildeo Nayak 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69682/
---

Review request for atlas, Ashutosh Mestry, Nixon Rodrigues, and Sarath 
Subramanian.


Bugs: ATLAS-3024
https://issues.apache.org/jira/browse/ATLAS-3024


Repository: atlas


Description
---

1) Created a database db9 with a table and external table and exported it.
2) On Importing , renamed it to db11 using : 
{\"conditions\": {\"hive_db.name\":\"EQUALS: 
db9\"},\"action\":{\"hive_db.name\":\"SET: db11\"}}]"

3. Attributes related to hive_db location, hive_storagedesc location and 
attributes of hive_process and hdfs_path are not renamed and still have db9 
reference.


Diffs
-

  intg/src/main/java/org/apache/atlas/entitytransform/BaseEntityHandler.java 
975e4ddd6 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveDatabaseEntityHandler.java
 b8032aa09 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveProcessEntityHandler.java
 PRE-CREATION 
  
intg/src/main/java/org/apache/atlas/entitytransform/HiveStorageDescriptorEntityHandler.java
 38de206d1 
  
intg/src/main/java/org/apache/atlas/entitytransform/TransformationConstants.java
 247de7320 


Diff: https://reviews.apache.org/r/69682/diff/1/


Testing
---

Tested in import-export with transformers options.


Thanks,

Kapildeo Nayak

[jira] [Updated] (ATLAS-3024) On hive_db rename few attributes are still not renamed after successful import

2019-01-07 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-3024:
--
Attachment: 0001-BUG-111658-hive_db-rename-few-attributes-are-still-n.patch

> On hive_db rename few attributes are still not renamed after successful import
> --
>
> Key: ATLAS-3024
> URL: https://issues.apache.org/jira/browse/ATLAS-3024
> Project: Atlas
>  Issue Type: Bug
>    Reporter: Kapildeo Nayak
>Priority: Major
> Attachments: 
> 0001-BUG-111658-hive_db-rename-few-attributes-are-still-n.patch
>
>
> # Created a database db9 with a table and external table and exported it.
>  # On Importing , renamed it to db11 using : 
> {\"conditions\":{\"hive_db.name\":\"EQUALS: 
> db9\"},\"action\":{\"hive_db.name\":\"SET: db11\"}}]"
>       3. Attributes related to hive_db location, hive_storagedesc location 
> and attributes of hive_process and hdfs_path are not renamed and have db9 
> reference still.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-3024) On hive_db rename few attributes are still not renamed after successful import

2019-01-07 Thread Kapildeo Nayak (JIRA) 
Kapildeo Nayak created ATLAS-3024:
-

 Summary: On hive_db rename few attributes are still not renamed 
after successful import
 Key: ATLAS-3024
 URL: https://issues.apache.org/jira/browse/ATLAS-3024
 Project: Atlas
  Issue Type: Bug
Reporter: Kapildeo Nayak


# Created a database db9 with a table and external table and exported it.
 # On Importing , renamed it to db11 using : 
{\"conditions\":{\"hive_db.name\":\"EQUALS: 
db9\"},\"action\":{\"hive_db.name\":\"SET: db11\"}}]"

      3. Attributes related to hive_db location, hive_storagedesc location and 
attributes of hive_process and hdfs_path are not renamed and have db9 reference 
still.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-3019) Handle NPE while transform and replicatedTo in import-export

2019-01-03 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-3019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-3019:
--
Attachment: 0001-ATLAS-3019-Handle-NPE-while-transform-and-replicated.patch

> Handle NPE while transform and replicatedTo in import-export
> 
>
> Key: ATLAS-3019
> URL: https://issues.apache.org/jira/browse/ATLAS-3019
> Project: Atlas
>  Issue Type: Bug
>    Reporter: Kapildeo Nayak
>        Assignee: Kapildeo Nayak
>Priority: Minor
> Attachments: 
> 0001-ATLAS-3019-Handle-NPE-while-transform-and-replicated.patch
>
>
> 1) Export fails on setting replicatedTo value to null in export JSON
> 2) Using transforms (replace) with both supertype and subtype fails with NPE 
> during import



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Review Request 69660: ATLAS-3019 Handle NPE while transform and replicatedTo in import-export

2019-01-03 Thread Kapildeo Nayak 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69660/
---

Review request for atlas, Ashutosh Mestry, Nixon Rodrigues, and Sarath 
Subramanian.


Repository: atlas


Description
---

This patch handles
1) Export fails on setting replicatedTo value to null in export JSON

2) Using transforms (replace) with both supertype and subtype fails with NPE 
during import


Diffs
-

  intg/src/main/java/org/apache/atlas/model/impexp/AtlasExportRequest.java 
0e93744f1 
  
repository/src/main/java/org/apache/atlas/repository/impexp/ImportTransforms.java
 72b684b01 


Diff: https://reviews.apache.org/r/69660/diff/1/


Testing
---

Tested in import-export with transforms options.


Thanks,

Kapildeo Nayak

[jira] [Assigned] (ATLAS-3019) Handle NPE while transform and replicatedTo in import-export

2019-01-03 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-3019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak reassigned ATLAS-3019:
-

Assignee: Kapildeo Nayak

> Handle NPE while transform and replicatedTo in import-export
> 
>
> Key: ATLAS-3019
> URL: https://issues.apache.org/jira/browse/ATLAS-3019
> Project: Atlas
>  Issue Type: Bug
>    Reporter: Kapildeo Nayak
>        Assignee: Kapildeo Nayak
>Priority: Minor
>
> 1) Export fails on setting replicatedTo value to null in export JSON
> 2) Using transforms (replace) with both supertype and subtype fails with NPE 
> during import



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-3019) Handle NPE while transform and replicatedTo in import-export

2019-01-03 Thread Kapildeo Nayak (JIRA) 
Kapildeo Nayak created ATLAS-3019:
-

 Summary: Handle NPE while transform and replicatedTo in 
import-export
 Key: ATLAS-3019
 URL: https://issues.apache.org/jira/browse/ATLAS-3019
 Project: Atlas
  Issue Type: Bug
Reporter: Kapildeo Nayak


1) Export fails on setting replicatedTo value to null in export JSON

2) Using transforms (replace) with both supertype and subtype fails with NPE 
during import



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2968) Update model files to include service-type for each entityDef

2018-11-19 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-2968:
--
Attachment: (was: 
0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch)

> Update model files to include service-type for each entityDef
> -
>
> Key: ATLAS-2968
> URL: https://issues.apache.org/jira/browse/ATLAS-2968
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: trunk
>        Reporter: Kapildeo Nayak
>    Assignee: Kapildeo Nayak
>Priority: Major
> Fix For: trunk
>
> Attachments: 
> 0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch
>
>
> Adding the service-type value to each typedef’s options param.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2968) Update model files to include service-type for each entityDef

2018-11-19 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-2968:
--
Attachment: 0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch

> Update model files to include service-type for each entityDef
> -
>
> Key: ATLAS-2968
> URL: https://issues.apache.org/jira/browse/ATLAS-2968
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: trunk
>        Reporter: Kapildeo Nayak
>    Assignee: Kapildeo Nayak
>Priority: Major
> Fix For: trunk
>
> Attachments: 
> 0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch, 
> 0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch
>
>
> Adding the service-type value to each typedef’s options param.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (ATLAS-2968) Update model files to include service-type for each entityDef

2018-11-16 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak reassigned ATLAS-2968:
-

Assignee: Kapildeo Nayak

> Update model files to include service-type for each entityDef
> -
>
> Key: ATLAS-2968
> URL: https://issues.apache.org/jira/browse/ATLAS-2968
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: trunk
>        Reporter: Kapildeo Nayak
>    Assignee: Kapildeo Nayak
>Priority: Major
> Fix For: trunk
>
> Attachments: 
> 0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch
>
>
> Adding the service-type value to each typedef’s options param.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2968) Update model files to include service-type for each entityDef

2018-11-16 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-2968:
--
Attachment: (was: 
0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch)

> Update model files to include service-type for each entityDef
> -
>
> Key: ATLAS-2968
> URL: https://issues.apache.org/jira/browse/ATLAS-2968
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: trunk
>        Reporter: Kapildeo Nayak
>Priority: Major
> Fix For: trunk
>
> Attachments: 
> 0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch
>
>
> Adding the service-type value to each typedef’s options param.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2968) Update model files to include service-type for each entityDef

2018-11-16 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-2968:
--
Attachment: 0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch

> Update model files to include service-type for each entityDef
> -
>
> Key: ATLAS-2968
> URL: https://issues.apache.org/jira/browse/ATLAS-2968
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: trunk
>        Reporter: Kapildeo Nayak
>Priority: Major
> Fix For: trunk
>
> Attachments: 
> 0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch
>
>
> Adding the service-type value to each typedef’s options param.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2968) Update model files to include service-type for each entityDef

2018-11-15 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-2968:
--
Attachment: 0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch

> Update model files to include service-type for each entityDef
> -
>
> Key: ATLAS-2968
> URL: https://issues.apache.org/jira/browse/ATLAS-2968
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: trunk
>        Reporter: Kapildeo Nayak
>Priority: Major
> Fix For: trunk
>
> Attachments: 
> 0001-ATLAS-2968-Update-model-files-to-include-service-typ.patch
>
>
> Adding the service-type value to each typedef’s options param.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2968) Update model files to include service-type for each entityDef

2018-11-15 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-2968:
--
Description: Adding the service-type value to each typedef’s options param. 
 (was: Adding the service-type value to each typedef’s options ** param.)

> Update model files to include service-type for each entityDef
> -
>
> Key: ATLAS-2968
> URL: https://issues.apache.org/jira/browse/ATLAS-2968
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: trunk
>        Reporter: Kapildeo Nayak
>Priority: Major
> Fix For: trunk
>
>
> Adding the service-type value to each typedef’s options param.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2968) Update model files to include service-type for each entityDef

2018-11-14 Thread Kapildeo Nayak (JIRA) 
Kapildeo Nayak created ATLAS-2968:
-

 Summary: Update model files to include service-type for each 
entityDef
 Key: ATLAS-2968
 URL: https://issues.apache.org/jira/browse/ATLAS-2968
 Project: Atlas
  Issue Type: Improvement
Affects Versions: trunk
Reporter: Kapildeo Nayak
 Fix For: trunk


Adding the service-type value to each typedef’s options ** param.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2964) Unit TestCases for Exporting multiple hdfs_path

2018-11-12 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-2964:
--
Description: Modified: HdfsPathEntityHandler.java returned path instead of 
name in toPath() method.

> Unit TestCases for Exporting multiple hdfs_path
> ---
>
> Key: ATLAS-2964
> URL: https://issues.apache.org/jira/browse/ATLAS-2964
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 2.0.0
>        Reporter: Kapildeo Nayak
>    Assignee: Kapildeo Nayak
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: 
> 0001-ATLAS-2964-Unit-TestCases-for-Exporting-multiple-hdf.patch
>
>
> Modified: HdfsPathEntityHandler.java returned path instead of name in 
> toPath() method.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2964) Unit TestCases for Exporting multiple hdfs_path

2018-11-12 Thread Kapildeo Nayak (JIRA) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kapildeo Nayak updated ATLAS-2964:
--
Attachment: 0001-ATLAS-2964-Unit-TestCases-for-Exporting-multiple-hdf.patch

> Unit TestCases for Exporting multiple hdfs_path
> ---
>
> Key: ATLAS-2964
> URL: https://issues.apache.org/jira/browse/ATLAS-2964
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 2.0.0
>        Reporter: Kapildeo Nayak
>    Assignee: Kapildeo Nayak
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: 
> 0001-ATLAS-2964-Unit-TestCases-for-Exporting-multiple-hdf.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2964) Unit TestCases for Exporting multiple hdfs_path

2018-11-12 Thread Kapildeo Nayak (JIRA) 
Kapildeo Nayak created ATLAS-2964:
-

 Summary: Unit TestCases for Exporting multiple hdfs_path
 Key: ATLAS-2964
 URL: https://issues.apache.org/jira/browse/ATLAS-2964
 Project: Atlas
  Issue Type: Bug
Affects Versions: 2.0.0
Reporter: Kapildeo Nayak
Assignee: Kapildeo Nayak
 Fix For: 2.0.0






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 69177: Export & Import: New Features Documentation

2018-11-02 Thread Kapildeo Nayak 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69177/#review210274
---


Ship it!




Ship It!

- Kapildeo Nayak


On Oct. 31, 2018, 12:36 a.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69177/
> ---
> 
> (Updated Oct. 31, 2018, 12:36 a.m.)
> 
> 
> Review request for atlas, Madhan Neethiraj, Nixon Rodrigues, and Sarath 
> Subramanian.
> 
> 
> Bugs: ATLAS-2839
> https://issues.apache.org/jira/browse/ATLAS-2839
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> **Approach**
> 
> Augmented existing documentation.
> 
> Additional documentation uses markdown.
> 
> 
> Diffs
> -
> 
>   docs/pom.xml 19e916918 
>   docs/src/site/markdown/AtlasServer.md PRE-CREATION 
>   docs/src/site/markdown/ExportImportAudits.md PRE-CREATION 
>   docs/src/site/markdown/ImportEntityTransforms.md PRE-CREATION 
>   docs/src/site/markdown/Incremental-Export.md PRE-CREATION 
>   docs/src/site/markdown/ReplicatedToFromAttributes.md PRE-CREATION 
>   docs/src/site/markdown/SoftReference.md PRE-CREATION 
>   docs/src/site/resources/images/markdown/atlas-server-exp-imp-audits.png 
> PRE-CREATION 
>   docs/src/site/resources/images/markdown/atlas-server-properties.png 
> PRE-CREATION 
>   docs/src/site/twiki/Export-API.twiki 207499985 
>   docs/src/site/twiki/Export-HDFS-API.twiki 6c2006035 
>   docs/src/site/twiki/Import-Export-API.twiki 6b07b64ac 
> 
> 
> Diff: https://reviews.apache.org/r/69177/diff/3/
> 
> 
> Testing
> ---
> 
> **Tests**
> 
> Used mvn site:run to verify rendering.
> 
> 
> Thanks,
> 
> Ashutosh Mestry
> 
>

[jira] [Commented] (ATLAS-2257) hive_column type definition changes for position and table attributes when updated

2018-08-07 Thread Kapildeo Nayak (JIRA) 


[ 
https://issues.apache.org/jira/browse/ATLAS-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571361#comment-16571361
 ] 

Kapildeo Nayak commented on ATLAS-2257:
---

In class AtlasStructDefStoreV1 the method[ toJsonFromAttribute](AtlasAttribute 
attribute)

The value of lower and upper variable are set according to Cardinality used
 for e.g. if Cardinality is SINGLE 
 and isOptional attribute is true than lower = 0 , and upper is set = 1 by 
default.
 if isOptional attribute is false than lower = 1 , and upper is set = 1 by 
default.
 and than value of lower and upper is set for attribute multiplicity with lower 
and upper
 after this in method() toAttributeDefFromJson()
 the value of lower and upper is set for variable valuesMinCount and 
valuesMaxCount accordingly.

 

https://github.com/apache/atlas/blob/branch-0.8/repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java#L469

 

If isUnique is false and Cardinality is other than SINGLE than the Cardinality 
is set to LIST and 
 if isUnique is true and Cardinality is other than SINGLE than the Cardinality 
is set to SET.
 and if Cardinality is non SINGLE and isOptional attribute is false and 
valuesMinCount < 1 than lower = 1 else lower is userdefined value , 
 and if Cardinality is non SINGLE and valuesMinCount < 2 than upper = 
Integer.MAX_VALUE else upper is userdefined value, 
 and than value of lower and upper is set for attribute multiplicity with lower 
and upper

after this in method() toAttributeDefFromJson()
 the value of lower and upper is set for variable valuesMinCount and 
valuesMaxCount accordingly.

[https://github.com/apache/atlas/blob/branch-0.8/repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java#L516]

 

Its not a issue.

> hive_column type definition changes for position and table attributes when 
> updated
> --
>
> Key: ATLAS-2257
> URL: https://issues.apache.org/jira/browse/ATLAS-2257
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Sharmadha Sainath
>Priority: Major
>
> On a fresh instance of Atlas , following is the type definition of 
> hive_column :
> {code}
> {  
>category:"ENTITY",
>guid:"076ceac2-5c0d-400f-8f89-ab455125191d",
>createdBy:"atlas",
>updatedBy:"atlas",
>createTime:1510294855527,
>updateTime:1510294855527,
>version:1,
>name:"hive_column",
>description:"hive_column",
>typeVersion:"1.3",
>options:{  
>   schemaAttributes:"["  name",
>   "description",
>   "owner",
>   "type",
>   "comment",
>   "position"
>]   " 
> }, 
> attributeDefs: [ 
> { 
> name: "   type",
>typeName:"string",
>isOptional:false,
>cardinality:"SINGLE",
>valuesMinCount:1,
>valuesMaxCount:1,
>isUnique:false,
>isIndexable:true
> },
> {  
>name:"comment",
>typeName:"string",
>isOptional:true,
>cardinality:"SINGLE",
>valuesMinCount:0,
>valuesMaxCount:1,
>isUnique:false,
>isIndexable:false
> },
> {  
>name:"position",
>typeName:"int",
>isOptional:true,
>cardinality:"SINGLE",
>valuesMinCount:-1,
>valuesMaxCount:-1,
>isUnique:false,
>isIndexable:false
> },
> {  
>name:"table",
>typeName:"hive_table",
>isOptional:true,
>cardinality:"SINGLE",
>valuesMinCount:-1,
>valuesMaxCount:-1,
>isUnique:false,
>isIndexable:false
> }
> ],
> superTypes:[  
> "DataSet"
> ]
> }
> {code}
> fired an update PUT request to update the hive_column type definition without 
> changing the definition . Update is successful. After update , following is 
> the type definition of hive_column :
> {code}
> {  
>category:"ENTITY",
>guid:"076ceac2-5c0d-400f-8f89-ab455125191d",
>createdBy:"atlas",
>updatedBy:"admin",
>createTime:1510294855527,
>updateTime:1510294918066,
>version:5,
>name:"hive_column",
>description:"hive_column",
>typeVersion:"1.3",
>options:{  
>   schemaAttributes:"["  name",
>   "description",
>   &

[jira] [Commented] (ATLAS-1645) Tag is not associated when value for optional attributes are not provided for byte ,date, double,float,short,int.

2018-07-30 Thread Kapildeo Nayak (JIRA) 


[ 
https://issues.apache.org/jira/browse/ATLAS-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561906#comment-16561906
 ] 

Kapildeo Nayak commented on ATLAS-1645:
---

[~ssainath],could not reproduce this bug on master and branch-0.8

> Tag is not associated when value for optional attributes are not provided for 
> byte ,date, double,float,short,int.
> -
>
> Key: ATLAS-1645
> URL: https://issues.apache.org/jira/browse/ATLAS-1645
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 0.8-incubating
>Reporter: Sharmadha Sainath
>Priority: Major
> Attachments: Empty value for tag attributes exception.txt
>
>
> 1. Created 8 tags. 
> 2. Each tag with one attribute of types byte,date, double,float,short,int, 
> string,boolean. 
> 3. Associated all the tags to an entity one by one without providing any 
> value for the tag attribute. 
> 4.Only tags with string and boolean as types got associated. Rest of the tag 
> association threw 500 internal server error as empty values are treated as 
> string and are validated against the datatype.
> Trait attribute values are optional ,so empty values should be handled.
> Following types expect value :
> - byte
> - date
> - double
> - float
> - short
> - int 
> Attached exception stack trace when associating an entity, a PII tag with 
> attribute id of type int ,with no value for id.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Please add me as contributor in Apache Atlas Project

2018-07-26 Thread Kapildeo Nayak 
Hi Dev,

Please add me as contributor in Apache Atlas Project.
My Jira username is *kapildeo*

Thanks,
Kapildeo Nayak