[jira] [Updated] (ATLAS-4095) DSL Search : __isIncomplete System Attribute returns incorrect results or throws error

2021-07-26 Thread Pinal (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pinal updated ATLAS-4095:
-
Fix Version/s: 2.2.0
   3.0.0

> DSL Search : __isIncomplete System Attribute returns incorrect results or 
> throws error
> --
>
> Key: ATLAS-4095
> URL: https://issues.apache.org/jira/browse/ATLAS-4095
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.1.0
>Reporter: Pinal
>Assignee: Pinal
>Priority: Major
>  Labels: DSL
> Fix For: 3.0.0, 2.2.0
>
>
> With DSL search having __isIncomplete System attribute in where clause, it 
> returns empty results.
> Ex: Table where __isIncomplete = false
> Workaround: Need to map boolean value to integer value before querying. Also 
> need to handle check for the presence of attribute.  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4088) Quick Search: Unable to get Aggregation Metric when query text is empty

2021-07-26 Thread Pinal (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pinal updated ATLAS-4088:
-
Fix Version/s: 2.2.0
   3.0.0

> Quick Search: Unable to get Aggregation Metric when query text is empty
> ---
>
> Key: ATLAS-4088
> URL: https://issues.apache.org/jira/browse/ATLAS-4088
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.1.0
>Reporter: Pinal
>Assignee: Pinal
>Priority: Major
>  Labels: quicksearch
> Fix For: 3.0.0, 2.2.0
>
>
> In case the query text is passed as empty string ,
> [/api/atlas/v2/search/quick?typeName=hive_table&query=|http://localhost:21000/api/atlas/v2/search/quick?typeName=hive_table&query=]
>  the aggregation metrics in the response does not contain any information 
> like owners, state of the asset, etc.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4057) DSL Search : Support glossary terms and relationships

2021-07-26 Thread Pinal (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pinal updated ATLAS-4057:
-
Fix Version/s: 2.2.0
   3.0.0

> DSL Search : Support glossary terms and relationships
> -
>
> Key: ATLAS-4057
> URL: https://issues.apache.org/jira/browse/ATLAS-4057
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Reporter: Pinal
>Assignee: Pinal
>Priority: Major
>  Labels: DSL
> Fix For: 3.0.0, 2.2.0
>
>
> Supporting glossary term in advanced search, will allow user to search the 
> entities which are assigned to particular term.
>  
> 'hasTerm' keyword is added to support glossary term.
> User needs to add fully qualifiedName of glossary term.
>  
> Example queries to search with glossary terms:
> hive_table hasTerm "modernTrade@salesGlossary",
> hive_table hasTerm "modernTrade@salesGlossary" and hive_table isA Dimension
>  
> Example queries to search with relationship:
> hive_table where db.name = "sales"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4332) DSL Query : query with like operator and "/" in search text throws 500

2021-07-26 Thread Pinal (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pinal updated ATLAS-4332:
-
Fix Version/s: (was: 2.1.0)
   2.2.0

> DSL Query : query with like operator and "/" in search text throws 500
> --
>
> Key: ATLAS-4332
> URL: https://issues.apache.org/jira/browse/ATLAS-4332
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Pinal Shah
>Assignee: Pinal
>Priority: Major
>  Labels: AdvancedSearch
> Fix For: 3.0.0, 2.2.0
>
>
> hdfs_path name="/warehouse/tablespace/external/hive/db_fdchj.db" returns 
> right entity.
> hdfs_path name like "/warehouse/*" throws following exception: 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4254) Basic Search : Optimize pagination

2021-07-26 Thread Pinal (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pinal updated ATLAS-4254:
-
Fix Version/s: 2.2.0
   3.0.0

> Basic Search : Optimize pagination
> --
>
> Key: ATLAS-4254
> URL: https://issues.apache.org/jira/browse/ATLAS-4254
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Reporter: Pinal
>Assignee: Pinal
>Priority: Major
>  Labels: BasicSearch
> Fix For: 3.0.0, 2.2.0
>
>
> *Current Working of Pagination*
>  * When user specifies page information i.e offset and limit in the request, 
> except some condition, offset is reset to 0
>  * Query is then executed from 0 offset and limit
>  * Filter out the results obtained from query
>  * Generate result set by skipping the results from 0 to the given offset
> *New Working Structure*
>  * New Parameter 'marker' (String) has been introduced in SearchParameters 
> which will have encrypted string as value.
>  * The marker should be  set as '*' for the start of the page
>  * The response of above request (AtlasSearchResult) will have 'nextMarker' 
> field which will have encrypted String which is to be passed as value of 
> 'marker' in the subsequent request
>  * if marker is set then offset should not be greater than 0
> *Improvement*
>  * It will increase performance of the basic search 
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4373) Statistical information error

2021-07-26 Thread ighack (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ighack updated ATLAS-4373:
--
Description: 
when I drop database;

Statistical information is error

!20210727133053114.png!

  was:
when I drop database;

Statistical information error

!20210727133053114.png!


> Statistical information error
> -
>
> Key: ATLAS-4373
> URL: https://issues.apache.org/jira/browse/ATLAS-4373
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Major
> Attachments: 20210727133053114.png
>
>
> when I drop database;
> Statistical information is error
> !20210727133053114.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4373) Statistical information error

2021-07-26 Thread ighack (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ighack updated ATLAS-4373:
--
Description: 
when I drop database;

Statistical information error

!20210727133053114.png!

  was:
Statistical information error

!20210727133053114.png!


> Statistical information error
> -
>
> Key: ATLAS-4373
> URL: https://issues.apache.org/jira/browse/ATLAS-4373
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Major
> Attachments: 20210727133053114.png
>
>
> when I drop database;
> Statistical information error
> !20210727133053114.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4373) Statistical information error

2021-07-26 Thread ighack (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ighack updated ATLAS-4373:
--
Description: 
Statistical information error

!20210727133053114.png!

  was:Statistical information error


> Statistical information error
> -
>
> Key: ATLAS-4373
> URL: https://issues.apache.org/jira/browse/ATLAS-4373
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Major
> Attachments: 20210727133053114.png
>
>
> Statistical information error
> !20210727133053114.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4373) Statistical information error

2021-07-26 Thread ighack (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ighack updated ATLAS-4373:
--
Attachment: 20210727133053114.png

> Statistical information error
> -
>
> Key: ATLAS-4373
> URL: https://issues.apache.org/jira/browse/ATLAS-4373
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Major
> Attachments: 20210727133053114.png
>
>
> Statistical information error



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ATLAS-4373) Statistical information error

2021-07-26 Thread ighack (Jira)
ighack created ATLAS-4373:
-

 Summary: Statistical information error
 Key: ATLAS-4373
 URL: https://issues.apache.org/jira/browse/ATLAS-4373
 Project: Atlas
  Issue Type: Bug
  Components: hive-integration
Affects Versions: 2.1.0
Reporter: ighack


Statistical information error



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (ATLAS-3625) Add Test cases for Namespace type creation and Namespace-Entity association

2021-07-26 Thread Mandar Ambawane (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mandar Ambawane resolved ATLAS-3625.

Resolution: Fixed

> Add Test cases for Namespace type creation and Namespace-Entity association
> ---
>
> Key: ATLAS-3625
> URL: https://issues.apache.org/jira/browse/ATLAS-3625
> Project: Atlas
>  Issue Type: Bug
>Reporter: Mandar Ambawane
>Assignee: Mandar Ambawane
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Review Request 73488: ATLAS-4352 Migrate to the next version of Python `requests` when released

2021-07-26 Thread Shraddha Pardeshi

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73488/
---

Review request for atlas, Jayendra Parab and Nixon Rodrigues.


Bugs: ATLAS-4352
https://issues.apache.org/jira/browse/ATLAS-4352


Repository: atlas


Description
---

To install requests version-
  "python3 -m pip install requests"
   current requests version for python3 is 2.25.1
For version update-
  "pip install --upgrade requests"
   now requests version - 2.26.0 with default charset-normalizer - 2.0.0


Diffs
-

  intg/src/main/python/requirements.txt 3b87e26da 
  intg/src/main/python/setup.py 35d79fed2 


Diff: https://reviews.apache.org/r/73488/diff/1/


Testing
---

PC - 
https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/766/console


Thanks,

Shraddha Pardeshi



[jira] [Resolved] (ATLAS-4105) table details are set to null for a dropped hbase_column_family

2021-07-26 Thread Mandar Ambawane (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mandar Ambawane resolved ATLAS-4105.

Resolution: Not A Bug

> table details are set to null for a dropped hbase_column_family
> ---
>
> Key: ATLAS-4105
> URL: https://issues.apache.org/jira/browse/ATLAS-4105
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Umesh Padashetty
>Assignee: Mandar Ambawane
>Priority: Minor
> Attachments: Screenshot 2021-01-20 at 12.19.22 AM.png, Screenshot 
> 2021-01-20 at 12.21.50 AM.png, Screenshot 2021-01-20 at 12.22.01 AM.png
>
>
> Table hbase_table_endlu has 2 column families, col_fam_kpgfu_2 is ACTIVE 
> whereas col_fam_kpgfu_1 is DELETED.
> On clicking the entities, it can be seen that for col_fam_kpgfu_2 which is 
> ACTIVE, the table info is set to hbase_table_endlu
> whereas for col_fam_kpgfu_1 which is DELETED, it is set to N/A (UI displays 
> null values as N/A)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ATLAS-4372) Upgrade nimbus-jose-jwt to 9.8.1

2021-07-26 Thread Disha Talreja (Jira)
Disha Talreja created ATLAS-4372:


 Summary: Upgrade nimbus-jose-jwt to 9.8.1
 Key: ATLAS-4372
 URL: https://issues.apache.org/jira/browse/ATLAS-4372
 Project: Atlas
  Issue Type: Task
Reporter: Disha Talreja


Atlas is currently pulling in nimbus-jose-jwt 5.4. Upgrate it to 9.8.1 or later.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Review Request 73461: ATLAS-4362 : Basic Search : Support filtering with multiple entity/classification type with its corresponding attributes

2021-07-26 Thread Pinal Shah

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73461/
---

(Updated July 26, 2021, 4:26 p.m.)


Review request for atlas, Ashutosh Mestry, Jayendra Parab, Madhan Neethiraj, 
Nixon Rodrigues, and Sarath Subramanian.


Bugs: ATLAS-4362
https://issues.apache.org/jira/browse/ATLAS-4362


Repository: atlas


Description
---

**Problem**

- Searching with multiple entity/classification type like hive_table, 
hive_column is possible in basic search.
- Searching with multiple entity/classification type like hive_table, 
hive_column with common attributes like system Attributes or attribute to be 
search present in both the type is possible.
- But searching with multiple entity/classification type like hive_table, 
hive_column with its respective attributes like hive_table.tableType is not 
possible

**Changes**

- Field typeName (String) is added in SearchParameters.FilterCriteria
- Example: 
  "entityFilters": {
   "condition": "AND",
   "criterion": [{
 "attributeName": "tableType",
 "operator": "eq",
 "attributeValue": "Managed",
 "typeName": "hive_table"
   }]
   }

**Appraoch**

- If 'typeName' is added under filterCriteria, extra filter of *type* is added 
with *AND* condition to *attribute* filter
- Example:
("typeName": hive_table AND "hive_table.tableType": (Managed))
- To get the correct results, it is preferable to set typeName as 
'ALL_ENTITY_TYPES' 
- Classification is also handled same way


Diffs
-

  intg/src/main/java/org/apache/atlas/model/discovery/SearchParameters.java 
78fb4a48f 
  repository/src/main/java/org/apache/atlas/discovery/SearchContext.java 
01954d07e 
  repository/src/main/java/org/apache/atlas/discovery/SearchProcessor.java 
f69dc4215 
  repository/src/test/java/org/apache/atlas/BasicTestSetup.java a1d7b62a5 
  
repository/src/test/java/org/apache/atlas/discovery/AtlasDiscoveryServiceTest.java
 a9fbd435a 
  
repository/src/test/java/org/apache/atlas/discovery/ClassificationSearchProcessorTest.java
 121dca9f5 
  
repository/src/test/java/org/apache/atlas/discovery/EntitySearchProcessorTest.java
 764568915 


Diff: https://reviews.apache.org/r/73461/diff/2/


Testing
---

added test cases


Thanks,

Pinal Shah