Re: Review Request 62491: ATLAS-2151: Surrounding brace fix for multiple filters on same attribute

2017-09-21 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62491/#review185942
---




repository/src/main/java/org/apache/atlas/discovery/SearchProcessor.java
Line 353 (original), 354 (patched)


For outer most level, braces are not needed when conditon is AND. Consider 
updating this line to:

boolean needSurroundingBraces = level != 0 || (condition == Condition.OR && 
criteria.getCriterion().size() > 0);


- Madhan Neethiraj


On Sept. 22, 2017, 4:35 a.m., Apoorv Naik wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62491/
> ---
> 
> (Updated Sept. 22, 2017, 4:35 a.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
> Subramanian.
> 
> 
> Bugs: ATLAS-2151
> https://issues.apache.org/jira/browse/ATLAS-2151
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> While fixing the bugs surronding the index query generation, the case where 
> multiple filters on a single entity attribute are specified was not being 
> handled correctly. This would cause the index to return wrong results or a 
> smaller dataset. 
> 
> level == 0 check in the constructIndexQuery led to this problem.
> 
> The fix is to encapsulate the entity filters index clauses within braces if 
> there are more than one attribute filters.
> 
> 
> Diffs
> -
> 
>   repository/src/main/java/org/apache/atlas/discovery/SearchProcessor.java 
> d5e39236 
> 
> 
> Diff: https://reviews.apache.org/r/62491/diff/1/
> 
> 
> Testing
> ---
> 
> mvn clean package -Pberkeley-elasticsearch works fine
> 
> Tested the REST call with following search parameters
> 
> ```javascript
> 
> {
>   "typeName": "hive_table",
>   "excludeDeletedEntities": true,
>   "classification" : "",
>   "query": "",
>   "limit": 10,
>   "offset": 0,
>   "entityFilters": {
>   "condition": "AND",
>   "criterion": [
>   {
>   "attributeName": "createTime",
>   "operator": "neq",
>   "attributeValue": "1491248917103"
>   },
>   {
> "attributeName": "name",
> "operator": "eq",
> "attributeValue": "testtable_0"
> }
>   ]
>   },
>   "tagFilters": null,
>   "attributes": ["createTime"]
> }
> 
> {
>   "typeName": "hive_table",
>   "excludeDeletedEntities": true,
>   "classification" : "",
>   "query": "",
>   "limit": 10,
>   "offset": 0,
>   "entityFilters": {
>   "condition": "OR",
>   "criterion": [
>   {
>   "attributeName": "name",
>   "operator": "eq",
>   "attributeValue": "testtable_1"
>   },
>   {
> "attributeName": "name",
> "operator": "eq",
> "attributeValue": "testtable_0"
> }
>   ]
>   },
>   "tagFilters": null,
>   "attributes": ["createTime"]
> }
> 
> {
>   "typeName": "hive_table",
>   "excludeDeletedEntities": true,
>   "classification" : "",
>   "query": "",
>   "limit": 10,
>   "offset": 0,
>   "entityFilters": {
>   "attributeName": "createTime",
>   "operator": "neq",
>   "attributeValue": "1491248917103"
>   },  
>   "tagFilters": null,
>   "attributes": ["createTime"]
> }
> ```
> 
> Verified from logs that the index query is enclosed within braces for 
> multi-filter attribute query and not when there's only one attribute (single) 
> filter
> 
> Verified the results from REST calls (as UI doesn't support this use case)
> 
> 
> Thanks,
> 
> Apoorv Naik
> 
>



[jira] [Updated] (ATLAS-2154) UI save-search : No data message showing even after adding favorite search.

2017-09-21 Thread Keval Bhatt (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2154:
---
Attachment: bug.webm

> UI save-search : No data message showing even after adding favorite search.
> ---
>
> Key: ATLAS-2154
> URL: https://issues.apache.org/jira/browse/ATLAS-2154
> Project: Atlas
>  Issue Type: Bug
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
> Attachments: bug.webm
>
>
>  showing "You don't have any favorite search." message even after adding 
> favorite search.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2162) Add hyperlink for URI formatted attribute value on property table

2017-09-21 Thread pratik pandey (JIRA)
pratik pandey created ATLAS-2162:


 Summary: Add hyperlink for URI formatted attribute value on 
property table
 Key: ATLAS-2162
 URL: https://issues.apache.org/jira/browse/ATLAS-2162
 Project: Atlas
  Issue Type: Improvement
Reporter: pratik pandey
Assignee: pratik pandey
 Fix For: 0.9-incubating






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ATLAS-2156) UI save-search : allow user to edit name

2017-09-21 Thread Keval Bhatt (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2156:
---
Summary: UI save-search : allow user to edit name  (was: UI : save-search : 
allow user to edit name)

> UI save-search : allow user to edit name
> 
>
> Key: ATLAS-2156
> URL: https://issues.apache.org/jira/browse/ATLAS-2156
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ATLAS-2156) UI : save-search :allow user to edit name

2017-09-21 Thread Keval Bhatt (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2156:
---
Summary: UI : save-search :allow user to edit name  (was: UI : save search 
allow user to edit name)

> UI : save-search :allow user to edit name
> -
>
> Key: ATLAS-2156
> URL: https://issues.apache.org/jira/browse/ATLAS-2156
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ATLAS-2156) UI : save-search : allow user to edit name

2017-09-21 Thread Keval Bhatt (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2156:
---
Summary: UI : save-search : allow user to edit name  (was: UI : save-search 
:allow user to edit name)

> UI : save-search : allow user to edit name
> --
>
> Key: ATLAS-2156
> URL: https://issues.apache.org/jira/browse/ATLAS-2156
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2161) UI : Save Search Query: Search button is not enabled when a saved search has only "Query" without typename / classification

2017-09-21 Thread Sharmadha Sainath (JIRA)
Sharmadha Sainath created ATLAS-2161:


 Summary: UI : Save Search Query: Search button is not enabled when 
a saved search has only "Query" without typename / classification
 Key: ATLAS-2161
 URL: https://issues.apache.org/jira/browse/ATLAS-2161
 Project: Atlas
  Issue Type: Bug
  Components: atlas-webui
Affects Versions: 0.9.1
Reporter: Sharmadha Sainath
Priority: Minor


1.Fired a basic search :
query = table1 (without typename and classification name). Now Search button 
was enabled.
2.Saved the search as hive_table_search.
3.Cleared the search.
4.Clicked on the saved search - hive_table_search.
5.table1 was populated in the query text box. But Search button was not enabled.
6.But on clicking the "..." on the hive_table_search and selecting "Search" 
option fired the search and fetched the entity.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (ATLAS-1905) Search UI is confusing to user

2017-09-21 Thread Keval Bhatt (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt reassigned ATLAS-1905:
--

Assignee: pratik pandey  (was: Keval Bhatt)

> Search UI is confusing to user
> --
>
> Key: ATLAS-1905
> URL: https://issues.apache.org/jira/browse/ATLAS-1905
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-webui
>Affects Versions: 0.8-incubating
>Reporter: Laura Ngo
>Assignee: pratik pandey
>
> As a business user it has taken me days to understand why my UI search 
> queries were 'unstable' - it turns out the UI is unclear!
> The search interface must be clear to business users. What we actually have 
> is:
> Basic search
> * Search By Type
> * Search By Tag
> * Search By Query
> Advanced search
> * Search By Type
> * Search By Query
> So it looks as if the Advanced search has fewer options than the basic!
> ...but worse, the two aren't analogous despite having the same lables. 
> A 'Search By Query' in Basic return many results, but 'Search By Query' in 
> Advanced returns 1 for hive_table where 
> qualifiedName='db_name.table_name@clauster_name'.
> Only by reading JIRA tickets here did I realise that Basic was a full text 
> search whereas Advanced as DSL.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Review Request 62491: ATLAS-2151: Surrounding brace fix for multiple filters on same attribute

2017-09-21 Thread Apoorv Naik

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62491/
---

Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
Subramanian.


Bugs: ATLAS-2151
https://issues.apache.org/jira/browse/ATLAS-2151


Repository: atlas


Description
---

While fixing the bugs surronding the index query generation, the case where 
multiple filters on a single entity attribute are specified was not being 
handled correctly. This would cause the index to return wrong results or a 
smaller dataset. 

level == 0 check in the constructIndexQuery led to this problem.

The fix is to encapsulate the entity filters index clauses within braces if 
there are more than one attribute filters.


Diffs
-

  repository/src/main/java/org/apache/atlas/discovery/SearchProcessor.java 
d5e39236 


Diff: https://reviews.apache.org/r/62491/diff/1/


Testing
---

mvn clean package -Pberkeley-elasticsearch works fine

Tested the REST call with following search parameters

```javascript

{
"typeName": "hive_table",
"excludeDeletedEntities": true,
"classification" : "",
"query": "",
"limit": 10,
"offset": 0,
"entityFilters": {
"condition": "AND",
"criterion": [
{
"attributeName": "createTime",
"operator": "neq",
"attributeValue": "1491248917103"
},
{
"attributeName": "name",
"operator": "eq",
"attributeValue": "testtable_0"
}
]
},
"tagFilters": null,
"attributes": ["createTime"]
}

{
"typeName": "hive_table",
"excludeDeletedEntities": true,
"classification" : "",
"query": "",
"limit": 10,
"offset": 0,
"entityFilters": {
"condition": "OR",
"criterion": [
{
"attributeName": "name",
"operator": "eq",
"attributeValue": "testtable_1"
},
{
"attributeName": "name",
"operator": "eq",
"attributeValue": "testtable_0"
}
]
},
"tagFilters": null,
"attributes": ["createTime"]
}

{
"typeName": "hive_table",
"excludeDeletedEntities": true,
"classification" : "",
"query": "",
"limit": 10,
"offset": 0,
"entityFilters": {
"attributeName": "createTime",
"operator": "neq",
"attributeValue": "1491248917103"
},  
"tagFilters": null,
"attributes": ["createTime"]
}
```

Verified from logs that the index query is enclosed within braces for 
multi-filter attribute query and not when there's only one attribute (single) 
filter

Verified the results from REST calls (as UI doesn't support this use case)


Thanks,

Apoorv Naik



[jira] [Assigned] (ATLAS-2151) Search using entity and trait attributes - OR condition considers only the first criterion in the list

2017-09-21 Thread Apoorv Naik (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apoorv Naik reassigned ATLAS-2151:
--

Assignee: Apoorv Naik

> Search using entity and trait attributes - OR condition considers only the 
> first criterion in the list 
> ---
>
> Key: ATLAS-2151
> URL: https://issues.apache.org/jira/browse/ATLAS-2151
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 0.9-incubating, 0.9.1
>Reporter: Sharmadha Sainath
>Assignee: Apoorv Naik
>Priority: Critical
>
> 1.Created 2 hive_table entities by name : table1 and table2.
> 2. Fired basic search query with following POST body :
> {code}
> {  
>"entityFilters":{  
>   "condition":"OR",
>   "criterion":[ 
>  {  
> "attributeName":"name",
> "operator":"=",
> "attributeValue":"table1"
>  },
>  {  
> "attributeName":"name",
> "operator":"=",
> "attributeValue":"table2"
>  }
>   ]
>},
>"tagFilters":null,
>"attributes":[  
>],
>"query":null,
>"limit":25,
>"offset":0,
>"typeName":"hive_table",
>"classification":null,
>"excludeDeletedEntities": false
> }
> {code}
> 2. Expected the response would return both table1 and table2.
> 3. Only table1 (first filter) is returned. Any filter other than "!=" in the 
> second condition doesn't fetch expected results.
> 4. Also when "excludeDeletedEntities" is set to true , though table1 and 
> table2 are ACTIVE , no entity is returned.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Re: Review Request 62455: ATLAS-2092: Upfront edgelabel creation to avoid concurrency issues

2017-09-21 Thread Apoorv Naik

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62455/
---

(Updated Sept. 22, 2017, 3:04 a.m.)


Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2092
https://issues.apache.org/jira/browse/ATLAS-2092


Repository: atlas


Description
---

See ATLAS-2092 for the discussion


Diffs (updated)
-

  
graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraphManagement.java
 0db46d46 
  
graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0GraphManagement.java
 ec4d6c45 
  
graphdb/titan1/src/main/java/org/apache/atlas/repository/graphdb/titan1/Titan1GraphManagement.java
 61dc2980 
  
repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
 be6a0a06 
  
repository/src/test/java/org/apache/atlas/service/DefaultMetadataServiceTest.java
 d8d8d91b 


Diff: https://reviews.apache.org/r/62455/diff/2/

Changes: https://reviews.apache.org/r/62455/diff/1-2/


Testing
---

mvn clean package -Dberkeley-elasticsearch went through fine
Build was done 3-4 times to ensure that the concurrency tests passed every time


Thanks,

Apoorv Naik



Build failed in Jenkins: Atlas-0.8-IntegrationTests #75

2017-09-21 Thread Apache Jenkins Server
See 


--
[...truncated 491.10 KB...]
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/finance HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/FactvX7d3q1pUd HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/ETLNdBRIhPXcE HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/DimensionIjsa2Hv4z3 HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/MetricBoUh1WCBP0 HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/hive_db_v1 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/hive_column_v1 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/hive_table_v1 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/Fact HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/ETL HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/Dimension HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "GET 
/api/atlas/v2/types/typedef/name/Metric HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:49 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:50 +] "POST /api/atlas/entities HTTP/1.1" 
201 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:50 +] "GET 
/api/atlas/lineage/hive/table/sales_fact_monthly_mvCwxzXeMa99/inputs/graph 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:52 +] "GET 
/api/atlas/entities?type=hive_table_v1=qualifiedName=sales_factoANClFkTnf
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:52 +] "GET 
/api/atlas/lineage/acd65721-a1fd-48da-b893-6c6d481c431d/outputs/graph HTTP/1.1" 
200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:53 +] "GET 
/api/atlas/lineage/hive/table/blah/schema HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:53 +] "GET 
/api/atlas/lineage/hive/table/sales_factoANClFkTnf/outputs/graph HTTP/1.1" 200 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:55 +] "GET 
/api/atlas/entities?type=hive_table_v1=qualifiedName=sales_fact_monthly_mvCwxzXeMa99
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:55 +] "GET 
/api/atlas/lineage/86e23948-0323-4645-94fe-16cef9990b28/inputs/graph HTTP/1.1" 
200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:56 +] "GET 
/api/atlas/lineage/hive/table/Salesl4RIqVXnnx/schema HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:56 +] "GET 
/api/atlas/entities?type=hive_table_v1=qualifiedName=sales_factoANClFkTnf
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:56 +] "GET 
/api/atlas/lineage/acd65721-a1fd-48da-b893-6c6d481c431d/schema HTTP/1.1" 200 - 
"-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:57 +] "GET 
/api/atlas/lineage/hive/table/sales_factoANClFkTnf/schema HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:58 +] "GET 
/api/atlas/v2/types/typedef/name/tableType HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:58 +] "GET 
/api/atlas/v2/types/typedef/name/serdeType HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:02:49:58 +] "GET 
/api/atlas/v2/types/typedef/name/classification HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - 

Build failed in Jenkins: Atlas-0.8-IntegrationTests #74

2017-09-21 Thread Apache Jenkins Server
See 


Changes:

[ssubramanian] ATLAS-2159: Incorrect createTime retrieved for entity attributes 
in

--
[...truncated 63.25 MB...]
at 
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
[INFO] 
[INFO] --- maven-source-plugin:2.4:jar-no-fork (attach-sources) @ hive-bridge 
---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.4:test-jar-no-fork (attach-sources) @ 
hive-bridge ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-failsafe-plugin:2.19.1:verify (verify) @ hive-bridge ---
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Atlas Server Build Tools  SUCCESS [  1.091 s]
[INFO] apache-atlas ... SUCCESS [  7.069 s]
[INFO] Apache Atlas Integration ... SUCCESS [ 26.885 s]
[INFO] Apache Atlas Common  SUCCESS [ 16.304 s]
[INFO] Apache Atlas Typesystem  SUCCESS [01:09 min]
[INFO] Apache Atlas Client  SUCCESS [ 18.953 s]
[INFO] Apache Atlas Server API  SUCCESS [ 10.872 s]
[INFO] Apache Atlas Notification .. SUCCESS [ 16.948 s]
[INFO] Apache Atlas Graph Database Projects ... SUCCESS [  0.600 s]
[INFO] Apache Atlas Graph Database API  SUCCESS [  7.883 s]
[INFO] Graph Database Common Code . SUCCESS [  8.883 s]
[INFO] Apache Atlas Titan 1.0.0 GraphDB Impl .. SUCCESS [ 34.140 s]
[INFO] Shaded version of Apache hbase client .. SUCCESS [  8.734 s]
[INFO] Apache Atlas Titan 0.5.4 Graph DB Impl . SUCCESS [ 46.044 s]
[INFO] Apache Atlas Graph Database Implementation Dependencies SUCCESS [  0.685 
s]
[INFO] Shaded version of Apache hbase server .. SUCCESS [ 24.364 s]
[INFO] Apache Atlas Repository  SUCCESS [01:46 min]
[INFO] Apache Atlas Authorization . SUCCESS [ 11.027 s]
[INFO] Apache Atlas Business Catalog .. SUCCESS [ 15.820 s]
[INFO] Apache Atlas UI  SUCCESS [01:35 min]
[INFO] Apache Atlas Web Application ... SUCCESS [05:26 min]
[INFO] Apache Atlas Documentation . SUCCESS [  6.123 s]
[INFO] Apache Atlas FileSystem Model .. SUCCESS [  1.771 s]
[INFO] Apache Atlas Plugin Classloader  SUCCESS [  9.417 s]
[INFO] Apache Atlas Hive Bridge Shim .. SUCCESS [  7.484 s]
[INFO] Apache Atlas Hive Bridge ... FAILURE [07:05 min]
[INFO] Apache Atlas Falcon Bridge Shim  SKIPPED
[INFO] Apache Atlas Falcon Bridge . SKIPPED
[INFO] Apache Atlas Sqoop Bridge Shim . SKIPPED
[INFO] Apache Atlas Sqoop Bridge .. SKIPPED
[INFO] Apache Atlas Storm Bridge Shim . SKIPPED
[INFO] Apache Atlas Storm Bridge .. SKIPPED
[INFO] Apache Atlas Distribution .. SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 21:48 min
[INFO] Finished at: 2017-09-22T01:01:08Z
[INFO] Final Memory: 584M/1917M
[INFO] 
2017-09-22 01:01:10,431 DEBUG - [main-SendThread(localhost:19026):] ~ ==> 
InMemoryJAASConfiguration.getAppConfigurationEntry(Client) 
(InMemoryJAASConfiguration:208)
2017-09-22 01:01:10,431 DEBUG - [main-SendThread(localhost:19026):] ~ <== 
InMemoryJAASConfiguration.getAppConfigurationEntry(Client): {} 
(InMemoryJAASConfiguration:238)
2017-09-22 01:01:10,432 DEBUG - [main-SendThread(localhost:19026):] ~ ==> 
InMemoryJAASConfiguration.getAppConfigurationEntry(Client) 
(InMemoryJAASConfiguration:208)
2017-09-22 01:01:10,432 WARN  - [main-SendThread(localhost:19026):] ~ Session 
0x15ea714a6960001 for server null, unexpected error, closing socket connection 
and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at 

Build failed in Jenkins: Atlas-master-IntegrationTests #114

2017-09-21 Thread Apache Jenkins Server
See 


Changes:

[ssubramanian] ATLAS-2159: Incorrect createTime retrieved for entity attributes 
in

--
[...truncated 450.39 KB...]
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/pci HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/sox HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/sec HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/finance HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/FactDiRoTGOTDT HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/ETLpvzEuNl76a HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/Dimensionsv5OaVLUdr HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/MetricYdjVgsd8XT HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/hive_db_v1 HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/hive_column_v1 HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/hive_table_v1 HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "POST /api/atlas/types HTTP/1.1" 400 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "POST /api/atlas/v2/types/typedefs/ 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "POST /api/atlas/v2/types/typedefs/ 
HTTP/1.1" 409 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/enumdef/name/blah HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/enumdef/guid/blah HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/structdef/name/blah HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/structdef/guid/blah HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/classificationdef/name/blah HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/classificationdef/guid/blah HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/entitydef/name/blah HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/entitydef/guid/blah HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "POST /api/atlas/v2/types/typedefs/ 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedefs/?supertype=AKTorRIAiCM=CLASS HTTP/1.1" 200 - 
"-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "GET 
/api/atlas/v2/types/typedefs/?notsupertype=BJN2ylEclZR=AKTorRIAiCM=CLASS
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:35 +] "POST /api/atlas/v2/types/typedefs/ 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "PUT /api/atlas/v2/types/typedefs/ 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "GET 
/api/atlas/v2/types/typedefs/?type=ENTITY HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "POST /api/atlas/types HTTP/1.1" 409 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "GET /api/atlas/types/blah HTTP/1.1" 
404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "GET 
/api/atlas/v2/types/typedef/name/class_trait HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "GET 
/api/atlas/v2/types/typedef/name/secure_trait HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "GET 
/api/atlas/v2/types/typedef/name/pii_trait HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [22/Sep/2017:00:43:36 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - 

Build failed in Jenkins: Atlas-master-UnitTests #91

2017-09-21 Thread Apache Jenkins Server
See 


Changes:

[ssubramanian] ATLAS-2159: Incorrect createTime retrieved for entity attributes 
in

--
[...truncated 187.89 KB...]
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.1:findbugs (findbugs) @ 
atlas-hbase-client-shaded ---
[INFO] 
[INFO] <<< findbugs-maven-plugin:3.0.1:check (findbugs-check) < :findbugs @ 
atlas-hbase-client-shaded <<<
[INFO] 
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.1:check (findbugs-check) @ 
atlas-hbase-client-shaded ---
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ 
atlas-hbase-client-shaded ---
[INFO] Installing 

 to 
/home/jenkins/.m2/repository/org/apache/atlas/atlas-hbase-client-shaded/0.9-SNAPSHOT/atlas-hbase-client-shaded-0.9-SNAPSHOT.jar
[INFO] Installing 

 to 
/home/jenkins/.m2/repository/org/apache/atlas/atlas-hbase-client-shaded/0.9-SNAPSHOT/atlas-hbase-client-shaded-0.9-SNAPSHOT.pom
[INFO] Installing 

 to 
/home/jenkins/.m2/repository/org/apache/atlas/atlas-hbase-client-shaded/0.9-SNAPSHOT/atlas-hbase-client-shaded-0.9-SNAPSHOT-sources.jar
[INFO] Installing 

 to 
/home/jenkins/.m2/repository/org/apache/atlas/atlas-hbase-client-shaded/0.9-SNAPSHOT/atlas-hbase-client-shaded-0.9-SNAPSHOT-test-sources.jar
[INFO] 
[INFO] 
[INFO] Building Apache Atlas Titan 0.5.4 Graph DB Impl 0.9-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ atlas-graphdb-titan0 
---
[INFO] Deleting 
 
(includes = [**/*.pyc], excludes = [])
[INFO] 
[INFO] --- buildnumber-maven-plugin:1.4:create (default) @ atlas-graphdb-titan0 
---
[INFO] Executing: /bin/sh -c cd 
' && 
'git' 'rev-parse' '--verify' 'HEAD'
[INFO] Working directory: 

[INFO] Storing buildNumber: 9d01689d326f938443de715a090afe26f6df1300 at 
timestamp: 1506040225649
[WARNING] Cannot get the branch information from the git repository: 
Detecting the current branch failed: fatal: ref HEAD is not a symbolic ref

[INFO] Executing: /bin/sh -c cd 
' && 
'git' 'rev-parse' '--verify' 'HEAD'
[INFO] Working directory: 

[INFO] Storing buildScmBranch: UNKNOWN
[INFO] 
[INFO] --- apache-rat-plugin:0.7:check (rat-check) @ atlas-graphdb-titan0 ---
[INFO] Exclude: **/dependency-reduced-pom.xml
[INFO] Exclude: **/javax.script.ScriptEngineFactory
[INFO] Exclude: .reviewboardrc
[INFO] Exclude: 3party-licenses/**
[INFO] Exclude: **/.cache
[INFO] Exclude: **/.cache-main
[INFO] Exclude: **/.cache-tests
[INFO] Exclude: **/.checkstyle
[INFO] Exclude: *.txt
[INFO] Exclude: **/*.json
[INFO] Exclude: .pc/**
[INFO] Exclude: debian/**
[INFO] Exclude: .svn/**
[INFO] Exclude: .git/**
[INFO] Exclude: .gitignore
[INFO] Exclude: **/.idea/**
[INFO] Exclude: **/*.twiki
[INFO] Exclude: **/*.iml
[INFO] Exclude: **/*.json
[INFO] Exclude: **/*.log
[INFO] Exclude: **/target/**
[INFO] Exclude: **/target*/**
[INFO] Exclude: **/build/**
[INFO] Exclude: **/*.patch
[INFO] Exclude: derby.log
[INFO] Exclude: **/logs/**
[INFO] Exclude: **/.classpath
[INFO] Exclude: **/.project
[INFO] Exclude: **/.settings/**
[INFO] Exclude: **/test-output/**
[INFO] Exclude: **/mock/**
[INFO] Exclude: **/data/**
[INFO] Exclude: **/maven-eclipse.xml
[INFO] Exclude: **/.externalToolBuilders/**
[INFO] Exclude: **/build.log
[INFO] Exclude: **/.bowerrc
[INFO] Exclude: *.json
[INFO] Exclude: **/overlays/**
[INFO] Exclude: dev-support/**
[INFO] Exclude: **/users-credentials.properties
[INFO] Exclude: **/public/css/animate.min.css
[INFO] Exclude: **/public/css/bootstrap-sidebar.css
[INFO] Exclude: **/public/js/external_lib/**
[INFO] Exclude: **/node_modules/**
[INFO] Exclude: **/public/js/libs/**
[INFO] Exclude: **/atlas.data/**
[INFO] Exclude: **/${sys:atlas.data}/**
[INFO] Exclude: **/policy-store.txt
[INFO] Exclude: **/*rebel*.xml
[INFO] Exclude: **/*rebel*.xml.bak
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
atlas-graphdb-titan0 ---
[INFO] 
[INFO] --- 

[jira] [Updated] (ATLAS-2158) ZipFileResourceTestUtils: Need Improvement to Handle Case for Failure in Loading

2017-09-21 Thread Ashutosh Mestry (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Mestry updated ATLAS-2158:
---
Attachment: ATLAS-2158-Master-ZipFileResourceTestUtils.patch

> ZipFileResourceTestUtils: Need Improvement to Handle Case for Failure in 
> Loading
> 
>
> Key: ATLAS-2158
> URL: https://issues.apache.org/jira/browse/ATLAS-2158
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: trunk, 0.8-incubating
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Trivial
> Fix For: trunk
>
> Attachments: ATLAS-2158-Master-ZipFileResourceTestUtils.patch, 
> ATLAS-2158-ZipFileResourceTestUtils.patch
>
>
> _ZipFileResourceTestUtils_ should handle case where model file loading fails. 
> A NULL check and/or exception thrown should be sufficient.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Review Request 62484: ATLAS-2160: Execute Saved Searches

2017-09-21 Thread Ashutosh Mestry

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62484/
---

Review request for atlas, keval bhatt and Madhan Neethiraj.


Bugs: ATLAS-2160
https://issues.apache.org/jira/browse/ATLAS-2160


Repository: atlas


Description
---

**Implementation**

There are 2 additional APIs:
* Saved Search using _type_ and _name_.
* Saved search using _guid_.

Once _AtlasUserSavedSearch_ is executed, execute _basic_ or _advanced_ search 
using the _searchType_. The results are returned in _AtlasSearchResult_ form.

**CURL**

Search results using saved search using search name and search type:
```javascript
curl -g -X GET -u admin:admin -H "Content-Type: application/json" -H 
"Cache-Control: no-cache"  
"http://localhost:21000/api/atlas/v2/search/saved/execute/BASIC/Tax%20Tables;
```

Search results using saved search GUID:
```javascript
curl -g -X GET -u admin:admin -H "Content-Type: application/json" -H 
"Cache-Control: no-cache"  
"http://localhost:21000/api/atlas/v2/search/saved/execute/18a21a1b-af61-47c6-a50a-34e8ae81dad3;
```


Diffs
-

  webapp/src/main/java/org/apache/atlas/web/rest/DiscoveryREST.java aed82ae0 


Diff: https://reviews.apache.org/r/62484/diff/1/


Testing
---

**Unit tests**
None

**Functional tests**
Executed APIs using CURL calls.


Thanks,

Ashutosh Mestry



[jira] [Updated] (ATLAS-2160) Saved Search: Introduce REST API to Execute Saved Search

2017-09-21 Thread Ashutosh Mestry (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Mestry updated ATLAS-2160:
---
Attachment: ATLAS-2160-SearchWithSavedSearch.patch

> Saved Search: Introduce REST API to Execute Saved Search
> 
>
> Key: ATLAS-2160
> URL: https://issues.apache.org/jira/browse/ATLAS-2160
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Affects Versions: 0.8-incubating
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Minor
> Fix For: trunk
>
> Attachments: ATLAS-2160-SearchWithSavedSearch.patch
>
>
> The existing APIs for Saved Search provide rich functionality for management 
> of saved searches.
> It will be a worthwhile addition if an API that takes saved search name and 
> executes the corresponding search and returns the search results.
> Inputs should include:
> * Saved search using name.
> * Saved Search using guid.
> Should support BASIC and ADVANCED search.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2160) Saved Search: Introduce REST API to Execute Saved Search

2017-09-21 Thread Ashutosh Mestry (JIRA)
Ashutosh Mestry created ATLAS-2160:
--

 Summary: Saved Search: Introduce REST API to Execute Saved Search
 Key: ATLAS-2160
 URL: https://issues.apache.org/jira/browse/ATLAS-2160
 Project: Atlas
  Issue Type: Improvement
  Components:  atlas-core
Affects Versions: 0.8-incubating
Reporter: Ashutosh Mestry
Assignee: Ashutosh Mestry
Priority: Minor
 Fix For: trunk


The existing APIs for Saved Search provide rich functionality for management of 
saved searches.

It will be a worthwhile addition if an API that takes saved search name and 
executes the corresponding search and returns the search results.

Inputs should include:
* Saved search using name.
* Saved Search using guid.

Should support BASIC and ADVANCED search.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Build failed in Jenkins: Atlas-0.8-IntegrationTests #73

2017-09-21 Thread Apache Jenkins Server
See 


Changes:

[madhan] ATLAS-2158: good coding practices

--
[...truncated 67.72 MB...]
at 
com.thinkaurelius.titan.graphdb.transaction.StandardTitanTx.commit(StandardTitanTx.java:1337)
... 14 more
Caused by: com.thinkaurelius.titan.diskstorage.PermanentBackendException: 
Permanent failure in storage backend
at 
com.thinkaurelius.titan.diskstorage.berkeleyje.BerkeleyJEKeyValueStore.insert(BerkeleyJEKeyValueStore.java:206)
at 
com.thinkaurelius.titan.diskstorage.berkeleyje.BerkeleyJEKeyValueStore.insert(BerkeleyJEKeyValueStore.java:183)
at 
com.thinkaurelius.titan.diskstorage.berkeleyje.BerkeleyJEStoreManager.mutateMany(BerkeleyJEStoreManager.java:193)
at 
com.thinkaurelius.titan.diskstorage.keycolumnvalue.keyvalue.OrderedKeyValueStoreManagerAdapter.mutateMany(OrderedKeyValueStoreManagerAdapter.java:100)
at 
com.thinkaurelius.titan.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:89)
at 
com.thinkaurelius.titan.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:86)
at 
com.thinkaurelius.titan.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:56)
at 
com.thinkaurelius.titan.diskstorage.util.BackendOperation.execute(BackendOperation.java:42)
... 20 more
Caused by: com.sleepycat.je.LockTimeoutException: (JE 5.0.73) Lock expired. 
Locker 1879945298 13384_NotificationHookConsumer thread-0_Txn: waited for lock 
on database=edgestore LockAddr:397064299 LSN=0x0/0x5a106e type=WRITE 
grant=WAIT_PROMOTION timeoutMillis=500 startTime=1506034803989 
endTime=1506034804489
Owners: [, , ]
Waiters: []
Transaction 1879945298 13384_NotificationHookConsumer thread-0_Txn owns 
LockAddr:397064299 
Transaction 1879945298 13384_NotificationHookConsumer thread-0_Txn waits for 
LockAddr:397064299

at 
com.sleepycat.je.txn.LockManager.newLockTimeoutException(LockManager.java:664)
at 
com.sleepycat.je.txn.LockManager.makeTimeoutMsgInternal(LockManager.java:623)
at 
com.sleepycat.je.txn.SyncedLockManager.makeTimeoutMsg(SyncedLockManager.java:97)
at com.sleepycat.je.txn.LockManager.lockInternal(LockManager.java:390)
at com.sleepycat.je.txn.LockManager.lock(LockManager.java:276)
at com.sleepycat.je.txn.Txn.lockInternal(Txn.java:498)
at com.sleepycat.je.txn.Locker.lock(Locker.java:443)
at com.sleepycat.je.dbi.CursorImpl.lockLN(CursorImpl.java:2621)
at 
com.sleepycat.je.dbi.CursorImpl.getSlotReuseInfo(CursorImpl.java:1091)
at com.sleepycat.je.dbi.CursorImpl.putInternal(CursorImpl.java:880)
at com.sleepycat.je.dbi.CursorImpl.put(CursorImpl.java:811)
at com.sleepycat.je.Cursor.putAllowPhantoms(Cursor.java:2243)
at com.sleepycat.je.Cursor.putNoNotify(Cursor.java:2200)
at com.sleepycat.je.Cursor.putNotify(Cursor.java:2117)
at com.sleepycat.je.Cursor.putNoDups(Cursor.java:2052)
at com.sleepycat.je.Cursor.putInternal(Cursor.java:2020)
at com.sleepycat.je.Database.putInternal(Database.java:1302)
at com.sleepycat.je.Database.put(Database.java:1172)
at 
com.thinkaurelius.titan.diskstorage.berkeleyje.BerkeleyJEKeyValueStore.insert(BerkeleyJEKeyValueStore.java:194)
... 27 more
2017-09-21 23:00:04,499 INFO  - [NotificationHookConsumer thread-0:] ~ Sleeping 
for 500 ms before retry (NotificationHookConsumer$HookConsumer:421)
[INFO] Closing Spring root WebApplicationContext
2017-09-21 23:00:04,870 INFO  - [ShutdownMonitor:] ~ Stopping service 
org.apache.atlas.web.service.ActiveInstanceElectorService (Services:65)
2017-09-21 23:00:04,871 INFO  - [ShutdownMonitor:] ~ HA is not enabled, no need 
to stop leader election service (ActiveInstanceElectorService:124)
2017-09-21 23:00:04,871 INFO  - [ShutdownMonitor:] ~ Stopping service 
org.apache.atlas.kafka.KafkaNotification (Services:65)
2017-09-21 23:00:05,000 WARN  - [NotificationHookConsumer thread-0:] ~ Max 
retries exceeded for message [{Id='(type: hive_db, id: )', 
traits=[], values={clusterName=primary, 
location=
 description=Default Hive database, qualifiedName=default@primary, ownerType=2, 
name=default, owner=public, parameters={}}}, {Id='(type: hive_table, id: 
)', traits=[], values={db={Id='(type: hive_db, id: )', 
traits=[], values={clusterName=primary, 
location=
 description=Default Hive database, qualifiedName=default@primary, ownerType=2, 
name=default, owner=public, parameters={}}}, 
createTime=2017-09-21T22:59:40.000Z, lastAccessTime=2017-09-21T22:59:40.000Z, 
qualifiedName=default.table7n17aewdwv@primary, sd={Id='(type: hive_storagedesc, 
id: )', traits=[], 

[jira] [Commented] (ATLAS-2159) Incorrect createTime retrieved for entity attributes in related entities search

2017-09-21 Thread Madhan Neethiraj (JIRA)

[ 
https://issues.apache.org/jira/browse/ATLAS-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175594#comment-16175594
 ] 

Madhan Neethiraj commented on ATLAS-2159:
-

+1 for the patch.

> Incorrect createTime retrieved for entity attributes in related entities 
> search
> ---
>
> Key: ATLAS-2159
> URL: https://issues.apache.org/jira/browse/ATLAS-2159
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 0.9-incubating, 0.8.1-incubating
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
> Fix For: 0.9-incubating, 0.8.1-incubating
>
> Attachments: ATLAS-2159.1.patch
>
>
> While fetching the tables of a database , 
> entities[“attributes”][“createTime”] of a table  has value of 
> response[“entity”][“createTime”] instead of 
> response[“entity”][“attributes”][“createTime”]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Build failed in Jenkins: Atlas-0.8-IntegrationTests #72

2017-09-21 Thread Apache Jenkins Server
See 


Changes:

[madhan] ATLAS-2157: HiveHook fix to handle getTable() error for temproray 
tables

--
[...truncated 61.29 MB...]
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
[INFO] 
[INFO] --- maven-source-plugin:2.4:jar-no-fork (attach-sources) @ hive-bridge 
---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.4:test-jar-no-fork (attach-sources) @ 
hive-bridge ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-failsafe-plugin:2.19.1:verify (verify) @ hive-bridge ---
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Atlas Server Build Tools  SUCCESS [  1.082 s]
[INFO] apache-atlas ... SUCCESS [  5.295 s]
[INFO] Apache Atlas Integration ... SUCCESS [ 28.621 s]
[INFO] Apache Atlas Common  SUCCESS [ 18.046 s]
[INFO] Apache Atlas Typesystem  SUCCESS [01:07 min]
[INFO] Apache Atlas Client  SUCCESS [ 17.312 s]
[INFO] Apache Atlas Server API  SUCCESS [  9.602 s]
[INFO] Apache Atlas Notification .. SUCCESS [ 15.913 s]
[INFO] Apache Atlas Graph Database Projects ... SUCCESS [  0.654 s]
[INFO] Apache Atlas Graph Database API  SUCCESS [  8.124 s]
[INFO] Graph Database Common Code . SUCCESS [  8.286 s]
[INFO] Apache Atlas Titan 1.0.0 GraphDB Impl .. SUCCESS [ 31.802 s]
[INFO] Shaded version of Apache hbase client .. SUCCESS [  8.442 s]
[INFO] Apache Atlas Titan 0.5.4 Graph DB Impl . SUCCESS [ 45.062 s]
[INFO] Apache Atlas Graph Database Implementation Dependencies SUCCESS [  0.771 
s]
[INFO] Shaded version of Apache hbase server .. SUCCESS [ 23.873 s]
[INFO] Apache Atlas Repository  SUCCESS [01:51 min]
[INFO] Apache Atlas Authorization . SUCCESS [ 13.347 s]
[INFO] Apache Atlas Business Catalog .. SUCCESS [ 16.033 s]
[INFO] Apache Atlas UI  SUCCESS [01:49 min]
[INFO] Apache Atlas Web Application ... SUCCESS [05:36 min]
[INFO] Apache Atlas Documentation . SUCCESS [  7.325 s]
[INFO] Apache Atlas FileSystem Model .. SUCCESS [  2.130 s]
[INFO] Apache Atlas Plugin Classloader  SUCCESS [ 10.449 s]
[INFO] Apache Atlas Hive Bridge Shim .. SUCCESS [  9.218 s]
[INFO] Apache Atlas Hive Bridge ... FAILURE [06:54 min]
[INFO] Apache Atlas Falcon Bridge Shim  SKIPPED
[INFO] Apache Atlas Falcon Bridge . SKIPPED
[INFO] Apache Atlas Sqoop Bridge Shim . SKIPPED
[INFO] Apache Atlas Sqoop Bridge .. SKIPPED
[INFO] Apache Atlas Storm Bridge Shim . SKIPPED
[INFO] Apache Atlas Storm Bridge .. SKIPPED
[INFO] Apache Atlas Distribution .. SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 22:02 min
[INFO] Finished at: 2017-09-21T22:06:49Z
[INFO] Final Memory: 590M/2209M
[INFO] 
2017-09-21 22:06:51,085 DEBUG - [main-SendThread(localhost:19026):] ~ ==> 
InMemoryJAASConfiguration.getAppConfigurationEntry(Client) 
(InMemoryJAASConfiguration:208)
2017-09-21 22:06:51,085 DEBUG - [main-SendThread(localhost:19026):] ~ <== 
InMemoryJAASConfiguration.getAppConfigurationEntry(Client): {} 
(InMemoryJAASConfiguration:238)
2017-09-21 22:06:51,086 WARN  - [main-SendThread(localhost:19026):] ~ Session 
0x15ea67559410001 for server null, unexpected error, closing socket connection 
and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
   

Build failed in Jenkins: Atlas-master-IntegrationTests #113

2017-09-21 Thread Apache Jenkins Server
See 


Changes:

[madhan] ATLAS-2157: HiveHook fix to handle getTable() error for temproray 
tables

--
[...truncated 449.59 KB...]
127.0.0.1 - - [21/Sep/2017:21:51:26 +] "GET 
/api/atlas/v2/types/entitydef/name/blah HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:26 +] "GET 
/api/atlas/v2/types/entitydef/guid/blah HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:26 +] "POST /api/atlas/v2/types/typedefs/ 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:27 +] "GET 
/api/atlas/v2/types/typedefs/?supertype=AWfxwc70Zf6=CLASS HTTP/1.1" 200 - 
"-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:27 +] "GET 
/api/atlas/v2/types/typedefs/?notsupertype=BBsK9jwQc4U=AWfxwc70Zf6=CLASS
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:27 +] "POST /api/atlas/v2/types/typedefs/ 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:27 +] "PUT /api/atlas/v2/types/typedefs/ 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:27 +] "GET 
/api/atlas/v2/types/typedefs/?type=ENTITY HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:27 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:27 +] "POST /api/atlas/types HTTP/1.1" 409 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:27 +] "GET 
/api/atlas/v2/types/typedef/name/AcffcJsXOjq HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:27 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "GET 
/api/atlas/v2/types/typedef/name/A1MWNkjG6QzU HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "GET 
/api/atlas/v2/types/typedef/name/Bai35yIyQx1 HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "GET 
/api/atlas/v2/types/typedef/name/CDme6LpMsen HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "GET 
/api/atlas/types?type=CLASS=AcffcJsXOjq=Bai35yIyQx1 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "GET 
/api/atlas/v2/types/typedef/name/class_trait HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "GET 
/api/atlas/v2/types/typedef/name/secure_trait HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "GET 
/api/atlas/v2/types/typedef/name/pii_trait HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:28 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "GET 
/api/atlas/v2/types/typedef/name/ssn_trait HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "GET 
/api/atlas/v2/types/typedef/name/salary_trait HTTP/1.1" 404 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "GET 
/api/atlas/v2/types/typedef/name/sox_trait HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "GET /api/atlas/types?type=TRAIT 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "POST /api/atlas/types HTTP/1.1" 201 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "PUT /api/atlas/types HTTP/1.1" 200 
- "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "GET /api/atlas/types/tzkLRRhgxF 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:29 +] "GET /api/atlas/types/blah HTTP/1.1" 
404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [21/Sep/2017:21:51:34 +] "GET /api/atlas/admin/version 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
Tests run: 143, Failures: 16, Errors: 0, Skipped: 100, Time elapsed: 19.686 sec 
<<< FAILURE! - in TestSuite
setUp(org.apache.atlas.web.integration.EntityDiscoveryJerseyResourceIT)  Time 
elapsed: 4.428 sec  <<< FAILURE!
org.apache.atlas.AtlasServiceException: Metadata service API 
org.apache.atlas.AtlasBaseClient$APIInfo@442591e7 failed with status 400 (Bad 
Request) Response 

Build failed in Jenkins: Atlas-master-UnitTests #90

2017-09-21 Thread Apache Jenkins Server
See 


Changes:

[madhan] ATLAS-2157: HiveHook fix to handle getTable() error for temproray 
tables

--
[...truncated 261.61 KB...]
Running org.apache.atlas.lineage.EntityLineageServiceTest
Running org.apache.atlas.util.CompiledQueryCacheKeyTest
Running org.apache.atlas.TestModules
Running org.apache.atlas.repository.store.graph.v1.AtlasRelationshipStoreV1Test
Running 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1BulkImportPercentTest
Running org.apache.atlas.service.StoreBackedTypeCacheMetadataServiceTest
Running org.apache.atlas.discovery.GraphBackedDiscoveryServiceTest
Running 
org.apache.atlas.repository.store.graph.v1.AtlasRelationshipStoreSoftDeleteV1Test
Running org.apache.atlas.RepositoryServiceLoadingTest
Running org.apache.atlas.query.ExpressionTest
Running org.apache.atlas.services.MetricsServiceTest
Running 
org.apache.atlas.repository.store.graph.v1.InverseReferenceUpdateSoftDeleteV1Test
Running 
org.apache.atlas.repository.store.graph.v1.InverseReferenceUpdateHardDeleteV1Test
Running 
org.apache.atlas.repository.store.graph.v1.AtlasRelationshipDefStoreV1Test
Running org.apache.atlas.repository.store.graph.v1.AtlasDeleteHandlerV1Test
Running 
org.apache.atlas.repository.store.graph.v1.AtlasRelationshipStoreHardDeleteV1Test
Running org.apache.atlas.repository.store.graph.v1.SoftDeleteHandlerV1Test
Running org.apache.atlas.repository.store.graph.v1.AtlasEntityDefStoreV1Test
Running org.apache.atlas.repository.store.graph.v1.InverseReferenceUpdateV1Test
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.457 sec - in 
org.apache.atlas.query.BaseGremlinTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.682 sec - in 
org.apache.atlas.BaseRepositoryTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.276 sec - in 
org.apache.atlas.util.CompiledQueryCacheKeyTest
Running org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStoreTest
Running org.apache.atlas.repository.typestore.GraphBackedTypeStoreTest
Running org.apache.atlas.repository.typestore.StoreBackedTypeCacheTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.807 sec - in 
org.apache.atlas.repository.store.graph.v1.AtlasDeleteHandlerV1Test
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.639 sec - 
in org.apache.atlas.query.ExpressionTest
Running org.apache.atlas.repository.graph.AbstractGremlinQueryOptimizerTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.689 sec - in 
org.apache.atlas.utils.ObjectUpdateSynchronizerTest
Running org.apache.atlas.repository.graph.Gremlin2QueryOptimizerTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.459 sec - in 
org.apache.atlas.repository.store.graph.v1.InverseReferenceUpdateV1Test
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.739 sec - in 
org.apache.atlas.query.QueryProcessorTest
Running org.apache.atlas.repository.graph.TestIntSequence
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.797 sec - in 
org.apache.atlas.repository.store.graph.v1.AtlasRelationshipStoreV1Test
Running org.apache.atlas.repository.graph.GraphBackedSearchIndexerTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.052 sec - in 
org.apache.atlas.TestModules
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.182 sec - in 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1BulkImportPercentTest
Running org.apache.atlas.repository.graph.ReverseReferenceUpdateHardDeleteTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.016 sec - 
in org.apache.atlas.query.ParserTest
Running org.apache.atlas.repository.graph.GraphRepoMapperScaleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.235 sec - in 
org.apache.atlas.query.LexerTest
Running org.apache.atlas.repository.graph.GraphHelperTest
Running org.apache.atlas.repository.graph.Gremlin3QueryOptimizerTest
Running org.apache.atlas.repository.graph.GraphBackedRepositoryHardDeleteTest
Running org.apache.atlas.repository.graph.ReverseReferenceUpdateSoftDeleteTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.22 sec - in 
org.apache.atlas.RepositoryServiceLoadingTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.024 sec - in 
org.apache.atlas.discovery.EntityDiscoveryServiceTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.608 sec - in 
org.apache.atlas.discovery.DataSetLineageServiceTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.635 sec - in 
org.apache.atlas.services.MetricsServiceTest
Running org.apache.atlas.repository.graph.GraphBackedSearchIndexerMockTest
Running org.apache.atlas.repository.graph.GraphBackedRepositorySoftDeleteTest
Running org.apache.atlas.repository.graph.GraphHelperMockTest
Running 

Re: Review Request 62457: ATLAS-2157: HiveHook error while processing temporary tables

2017-09-21 Thread Sarath Subramanian

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62457/#review185921
---


Ship it!




Ship It!

- Sarath Subramanian


On Sept. 21, 2017, 12:47 p.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62457/
> ---
> 
> (Updated Sept. 21, 2017, 12:47 p.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Ashutosh Mestry, Sarath Subramanian, 
> and Suma Shivaprasad.
> 
> 
> Bugs: ATLAS-2157
> https://issues.apache.org/jira/browse/ATLAS-2157
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> As reported in user list, executing Hive SQL that use temprorary tables (for 
> example insert statement) causes Atlas hook to report the following failure. 
> The fix is to ignore this error, as it doesn't result in loss of 
> functionality.
> 
> 
> 17/09/20 09:36:42 [Atlas Logger 1]: ERROR metadata.Hive: Table 
> values__tmp__table__1 not found: default.values__tmp__table__1 table not found
> 17/09/20 09:36:43 [Atlas Logger 1]: ERROR hook.HiveHook: Atlas hook failed 
> due to error
> java.lang.reflect.UndeclaredThrowableException
>         at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1884)
>         at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:195)
>         at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.registerProcess() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:701)
>         at org.apache.atlas.hive.hook.HiveHook.collect(HiveHook.java:268)
>         at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:83)
>         at org.apache.atlas.hive.hook.HiveHook$2$1.run(HiveHook.java:198)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:422)
>         at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
>         ... 6 more
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.processHiveEntity() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:731)
>         at 
> org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:668)
>         ... 12 more
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.createOrUpdateEntities() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:597)
>         at 
> org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:711)
>         ... 13 more
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.createOrUpdateEntities() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:589)
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:595)
>         ... 14 more
> Caused by: org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table 
> not found values__tmp__table__1
>         at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1216)
>         at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1186)
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:568)
>         ... 15 more
> 
> 
> Diffs
> -
> 
>   addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
> 7dc2e2f1 
> 
> 
> Diff: https://reviews.apache.org/r/62457/diff/2/
> 
> 
> Testing
> ---
> 
> Verified that the error is not reported in the following cases:
> - CREATE TEMPORARY TABLE tmp1(c1 string);
> - insert into tmp1 values('1');
> 
> Also verified that lineage details are recorded correctly - for both table 
> and column level lineages:
> - CREATE TABLE t1(c1 STRING, c2 STRING);
> - CREATE TABLE s1(c1 STRING, c2 STRING);
> - CREATE VIEW v_t1_s1 AS SELECT (t.c1 + s.c1) c1, (t.c2 + s.c2) c2 FROM t1 t, 
> s1 s;
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>



Re: Review Request 62457: ATLAS-2157: HiveHook error while processing temporary tables

2017-09-21 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62457/
---

(Updated Sept. 21, 2017, 7:47 p.m.)


Review request for atlas, Apoorv Naik, Ashutosh Mestry, Sarath Subramanian, and 
Suma Shivaprasad.


Changes
---

Addressed review comments.


Bugs: ATLAS-2157
https://issues.apache.org/jira/browse/ATLAS-2157


Repository: atlas


Description
---

As reported in user list, executing Hive SQL that use temprorary tables (for 
example insert statement) causes Atlas hook to report the following failure. 
The fix is to ignore this error, as it doesn't result in loss of functionality.


17/09/20 09:36:42 [Atlas Logger 1]: ERROR metadata.Hive: Table 
values__tmp__table__1 not found: default.values__tmp__table__1 table not found
17/09/20 09:36:43 [Atlas Logger 1]: ERROR hook.HiveHook: Atlas hook failed due 
to error
java.lang.reflect.UndeclaredThrowableException
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1884)
        at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:195)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.atlas.hook.AtlasHookException: HiveHook.registerProcess() 
failed.
        at 
org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:701)
        at org.apache.atlas.hive.hook.HiveHook.collect(HiveHook.java:268)
        at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:83)
        at org.apache.atlas.hive.hook.HiveHook$2$1.run(HiveHook.java:198)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
        ... 6 more
Caused by: org.apache.atlas.hook.AtlasHookException: 
HiveHook.processHiveEntity() failed.
        at 
org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:731)
        at 
org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:668)
        ... 12 more
Caused by: org.apache.atlas.hook.AtlasHookException: 
HiveHook.createOrUpdateEntities() failed.
        at 
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:597)
        at 
org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:711)
        ... 13 more
Caused by: org.apache.atlas.hook.AtlasHookException: 
HiveHook.createOrUpdateEntities() failed.
        at 
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:589)
        at 
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:595)
        ... 14 more
Caused by: org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not 
found values__tmp__table__1
        at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1216)
        at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1186)
        at 
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:568)
        ... 15 more


Diffs (updated)
-

  addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
7dc2e2f1 


Diff: https://reviews.apache.org/r/62457/diff/2/

Changes: https://reviews.apache.org/r/62457/diff/1-2/


Testing
---

Verified that the error is not reported in the following cases:
- CREATE TEMPORARY TABLE tmp1(c1 string);
- insert into tmp1 values('1');

Also verified that lineage details are recorded correctly - for both table and 
column level lineages:
- CREATE TABLE t1(c1 STRING, c2 STRING);
- CREATE TABLE s1(c1 STRING, c2 STRING);
- CREATE VIEW v_t1_s1 AS SELECT (t.c1 + s.c1) c1, (t.c2 + s.c2) c2 FROM t1 t, 
s1 s;


Thanks,

Madhan Neethiraj



Re: Review Request 62457: ATLAS-2157: HiveHook error while processing temporary tables

2017-09-21 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62457/#review185918
---




addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java
Line 552 (original), 550 (patched)


This seems to be necessary only for 'case DATABASE' above. I will move this 
block to line #533.


- Madhan Neethiraj


On Sept. 21, 2017, 5:39 p.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62457/
> ---
> 
> (Updated Sept. 21, 2017, 5:39 p.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Ashutosh Mestry, Sarath Subramanian, 
> and Suma Shivaprasad.
> 
> 
> Bugs: ATLAS-2157
> https://issues.apache.org/jira/browse/ATLAS-2157
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> As reported in user list, executing Hive SQL that use temprorary tables (for 
> example insert statement) causes Atlas hook to report the following failure. 
> The fix is to ignore this error, as it doesn't result in loss of 
> functionality.
> 
> 
> 17/09/20 09:36:42 [Atlas Logger 1]: ERROR metadata.Hive: Table 
> values__tmp__table__1 not found: default.values__tmp__table__1 table not found
> 17/09/20 09:36:43 [Atlas Logger 1]: ERROR hook.HiveHook: Atlas hook failed 
> due to error
> java.lang.reflect.UndeclaredThrowableException
>         at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1884)
>         at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:195)
>         at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.registerProcess() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:701)
>         at org.apache.atlas.hive.hook.HiveHook.collect(HiveHook.java:268)
>         at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:83)
>         at org.apache.atlas.hive.hook.HiveHook$2$1.run(HiveHook.java:198)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:422)
>         at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
>         ... 6 more
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.processHiveEntity() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:731)
>         at 
> org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:668)
>         ... 12 more
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.createOrUpdateEntities() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:597)
>         at 
> org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:711)
>         ... 13 more
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.createOrUpdateEntities() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:589)
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:595)
>         ... 14 more
> Caused by: org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table 
> not found values__tmp__table__1
>         at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1216)
>         at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1186)
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:568)
>         ... 15 more
> 
> 
> Diffs
> -
> 
>   addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
> 7dc2e2f1 
> 
> 
> Diff: https://reviews.apache.org/r/62457/diff/1/
> 
> 
> Testing
> ---
> 
> Verified that the error is not reported in the following cases:
> - CREATE TEMPORARY TABLE tmp1(c1 string);
> - insert into tmp1 values('1');
> 
> Also verified that lineage details are recorded correctly - for both table 
> and column level lineages:
> - CREATE TABLE t1(c1 STRING, c2 STRING);
> - CREATE TABLE s1(c1 STRING, c2 STRING);
> - CREATE VIEW v_t1_s1 AS SELECT (t.c1 + s.c1) c1, (t.c2 + s.c2) c2 FROM t1 t, 
> s1 s;
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>



[jira] [Updated] (ATLAS-2159) Incorrect createTime retrieved for entity attributes in related entities search

2017-09-21 Thread Sarath Subramanian (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-2159:
--
Attachment: ATLAS-2159.1.patch

> Incorrect createTime retrieved for entity attributes in related entities 
> search
> ---
>
> Key: ATLAS-2159
> URL: https://issues.apache.org/jira/browse/ATLAS-2159
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 0.9-incubating, 0.8.1-incubating
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
> Fix For: 0.9-incubating, 0.8.1-incubating
>
> Attachments: ATLAS-2159.1.patch
>
>
> While fetching the tables of a database , 
> entities[“attributes”][“createTime”] of a table  has value of 
> response[“entity”][“createTime”] instead of 
> response[“entity”][“attributes”][“createTime”]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2159) Incorrect createTime retrieved for entity attributes in related entities search

2017-09-21 Thread Sarath Subramanian (JIRA)
Sarath Subramanian created ATLAS-2159:
-

 Summary: Incorrect createTime retrieved for entity attributes in 
related entities search
 Key: ATLAS-2159
 URL: https://issues.apache.org/jira/browse/ATLAS-2159
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 0.9-incubating, 0.8.1-incubating
Reporter: Sarath Subramanian
Assignee: Sarath Subramanian
 Fix For: 0.9-incubating, 0.8.1-incubating


While fetching the tables of a database , entities[“attributes”][“createTime”] 
of a table  has value of response[“entity”][“createTime”] instead of 
response[“entity”][“attributes”][“createTime”]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Re: Review Request 62457: ATLAS-2157: HiveHook error while processing temporary tables

2017-09-21 Thread Sarath Subramanian

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62457/#review185910
---


Fix it, then Ship it!





addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java
Line 552 (original), 550 (patched)


do we need this additional get on db? doesn't db have a valid value 
assigned from switch statement above?


- Sarath Subramanian


On Sept. 21, 2017, 10:39 a.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62457/
> ---
> 
> (Updated Sept. 21, 2017, 10:39 a.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Ashutosh Mestry, Sarath Subramanian, 
> and Suma Shivaprasad.
> 
> 
> Bugs: ATLAS-2157
> https://issues.apache.org/jira/browse/ATLAS-2157
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> As reported in user list, executing Hive SQL that use temprorary tables (for 
> example insert statement) causes Atlas hook to report the following failure. 
> The fix is to ignore this error, as it doesn't result in loss of 
> functionality.
> 
> 
> 17/09/20 09:36:42 [Atlas Logger 1]: ERROR metadata.Hive: Table 
> values__tmp__table__1 not found: default.values__tmp__table__1 table not found
> 17/09/20 09:36:43 [Atlas Logger 1]: ERROR hook.HiveHook: Atlas hook failed 
> due to error
> java.lang.reflect.UndeclaredThrowableException
>         at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1884)
>         at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:195)
>         at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.registerProcess() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:701)
>         at org.apache.atlas.hive.hook.HiveHook.collect(HiveHook.java:268)
>         at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:83)
>         at org.apache.atlas.hive.hook.HiveHook$2$1.run(HiveHook.java:198)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:422)
>         at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
>         ... 6 more
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.processHiveEntity() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:731)
>         at 
> org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:668)
>         ... 12 more
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.createOrUpdateEntities() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:597)
>         at 
> org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:711)
>         ... 13 more
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.createOrUpdateEntities() failed.
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:589)
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:595)
>         ... 14 more
> Caused by: org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table 
> not found values__tmp__table__1
>         at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1216)
>         at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1186)
>         at 
> org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:568)
>         ... 15 more
> 
> 
> Diffs
> -
> 
>   addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
> 7dc2e2f1 
> 
> 
> Diff: https://reviews.apache.org/r/62457/diff/1/
> 
> 
> Testing
> ---
> 
> Verified that the error is not reported in the following cases:
> - CREATE TEMPORARY TABLE tmp1(c1 string);
> - insert into tmp1 values('1');
> 
> Also verified that lineage details are recorded correctly - for both table 
> and column level lineages:
> - CREATE TABLE t1(c1 STRING, c2 STRING);
> - CREATE TABLE s1(c1 STRING, c2 STRING);
> - CREATE VIEW v_t1_s1 AS SELECT (t.c1 + s.c1) c1, (t.c2 + s.c2) c2 FROM t1 t, 
> s1 s;
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>



[jira] [Assigned] (ATLAS-2157) Atlas Hive hook runs into unhandled exceptions from beeline if there are temp tables involved

2017-09-21 Thread Madhan Neethiraj (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj reassigned ATLAS-2157:
---

Assignee: Madhan Neethiraj

> Atlas Hive hook runs into unhandled exceptions from beeline if there are temp 
> tables involved
> -
>
> Key: ATLAS-2157
> URL: https://issues.apache.org/jira/browse/ATLAS-2157
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-intg
>Affects Versions: 0.8-incubating, 0.7.1-incubating
> Environment: HDP 2.6.2
>Reporter: Sailaja Navvluru
>Assignee: Madhan Neethiraj
>
> Opening JIRA as requested by [~madhan.neethiraj] in the mailing list
> *Repro steps:*
> Insert into a Hive table from beeline, insert goes through fine but Atlas 
> Hive hook throws errors.
> *Detailed description pasted from mailing list*:
> created a table from both Hive CLI and beeline and inserted a row with
> Atlas Hive hook enabled. From Hive CLI the insert goes through fine without 
> any errors but
> from beeline I see errors for a temp table not found although insert itself 
> succeeds and temp
> table shows up in table listing. Do I need to do anything extra for 
> beeline/HS2 connections
> when Atlas is enabled ? 
>  
> hive> create table test1(c1 int, c2 string);
> OK
> Time taken: 2.108 seconds
> hive> insert into test1 values(1,'v');
> Query ID = hive_20170920092542_d8ec0a4b-b88d-4d87-b59d-790f2eae6792
> Total jobs = 1
> Launching Job 1 out of 1
> Status: Running (Executing on YARN cluster with App id 
> application_1505852425742_0004)
>  
> 
> VERTICES  STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  
> KILLED
> 
> Map 1 ..   SUCCEEDED  1  100   0  
>  0
> 
> VERTICES: 01/01  [==>>] 100%  ELAPSED TIME: 4.68 s
> 
> Loading data to table default.test1
> Table default.test1 stats: [numFiles=1, numRows=1, totalSize=4, rawDataSize=3]
> OK
> Time taken: 6.7 seconds
> hive> select * from test1;
> OK
> 1   v
> Time taken: 0.112 seconds, Fetched: 1 row(s)
> hive>
>  
> Beeline version 1.2.1000.2.6.2.0-133 by Apache Hive
> 0: jdbc:hive2://> create table s1(c1 int,c2 string);
> OK
> No rows affected (2.345 seconds)
>  
> 0: jdbc:hive2://> insert into s1 values(1,'v');
> 17/09/20 09:28:24 [main]: ERROR hdfs.KeyProviderCache: Could not find uri 
> with key [dfs.encryption.key.provider.uri]
> to create a keyProvider !!
> Query ID = hive_20170920092824_14bfdec4-dfe8-4b97-b5be-0af74de055ce
> Total jobs = 1
> Launching Job 1 out of 1
> Status: Running (Executing on YARN cluster with App id 
> application_1505852425742_0005)
>  
> Loading data to table default.s1
> Table default.s1 stats: [numFiles=1, numRows=1, totalSize=4, rawDataSize=3]
> OK
> No rows affected (498.295 seconds)
> 0: jdbc:hive2://>
> 0: jdbc:hive2://> 17/09/20 09:36:42 [Atlas Logger 1]: ERROR metadata.Hive: 
> Table values__tmp__table__1
> not found: default.values__tmp__table__1 table not found
> 17/09/20 09:36:43 [Atlas Logger 1]: ERROR hook.HiveHook: Atlas hook failed 
> due to error
> java.lang.reflect.UndeclaredThrowableException
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1884)
> at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:195)
> at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.registerProcess() failed.
> at 
> org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:701)
> at org.apache.atlas.hive.hook.HiveHook.collect(HiveHook.java:268)
> at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:83)
> at org.apache.atlas.hive.hook.HiveHook$2$1.run(HiveHook.java:198)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
> ... 6 more
> Caused by: org.apache.atlas.hook.AtlasHookException: 
> HiveHook.processHiveEntity() failed.

Re: Review Request 62457: ATLAS-2157: HiveHook error while processing temporary tables

2017-09-21 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62457/
---

(Updated Sept. 21, 2017, 5:39 p.m.)


Review request for atlas, Apoorv Naik, Ashutosh Mestry, Sarath Subramanian, and 
Suma Shivaprasad.


Summary (updated)
-

ATLAS-2157: HiveHook error while processing temporary tables 


Bugs: ATLAS-2157
https://issues.apache.org/jira/browse/ATLAS-2157


Repository: atlas


Description
---

As reported in user list, executing Hive SQL that use temprorary tables (for 
example insert statement) causes Atlas hook to report the following failure. 
The fix is to ignore this error, as it doesn't result in loss of functionality.


17/09/20 09:36:42 [Atlas Logger 1]: ERROR metadata.Hive: Table 
values__tmp__table__1 not found: default.values__tmp__table__1 table not found
17/09/20 09:36:43 [Atlas Logger 1]: ERROR hook.HiveHook: Atlas hook failed due 
to error
java.lang.reflect.UndeclaredThrowableException
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1884)
        at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:195)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.atlas.hook.AtlasHookException: HiveHook.registerProcess() 
failed.
        at 
org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:701)
        at org.apache.atlas.hive.hook.HiveHook.collect(HiveHook.java:268)
        at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:83)
        at org.apache.atlas.hive.hook.HiveHook$2$1.run(HiveHook.java:198)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
        ... 6 more
Caused by: org.apache.atlas.hook.AtlasHookException: 
HiveHook.processHiveEntity() failed.
        at 
org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:731)
        at 
org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:668)
        ... 12 more
Caused by: org.apache.atlas.hook.AtlasHookException: 
HiveHook.createOrUpdateEntities() failed.
        at 
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:597)
        at 
org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:711)
        ... 13 more
Caused by: org.apache.atlas.hook.AtlasHookException: 
HiveHook.createOrUpdateEntities() failed.
        at 
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:589)
        at 
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:595)
        ... 14 more
Caused by: org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not 
found values__tmp__table__1
        at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1216)
        at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1186)
        at 
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:568)
        ... 15 more


Diffs
-

  addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
7dc2e2f1 


Diff: https://reviews.apache.org/r/62457/diff/1/


Testing
---

Verified that the error is not reported in the following cases:
- CREATE TEMPORARY TABLE tmp1(c1 string);
- insert into tmp1 values('1');

Also verified that lineage details are recorded correctly - for both table and 
column level lineages:
- CREATE TABLE t1(c1 STRING, c2 STRING);
- CREATE TABLE s1(c1 STRING, c2 STRING);
- CREATE VIEW v_t1_s1 AS SELECT (t.c1 + s.c1) c1, (t.c2 + s.c2) c2 FROM t1 t, 
s1 s;


Thanks,

Madhan Neethiraj



[jira] [Updated] (ATLAS-2158) ZipFileResourceTestUtils: Need Improvement to Handle Case for Failure in Loading

2017-09-21 Thread Ashutosh Mestry (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Mestry updated ATLAS-2158:
---
Attachment: ATLAS-2158-ZipFileResourceTestUtils.patch

> ZipFileResourceTestUtils: Need Improvement to Handle Case for Failure in 
> Loading
> 
>
> Key: ATLAS-2158
> URL: https://issues.apache.org/jira/browse/ATLAS-2158
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: trunk, 0.8-incubating
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Trivial
> Fix For: trunk
>
> Attachments: ATLAS-2158-ZipFileResourceTestUtils.patch
>
>
> _ZipFileResourceTestUtils_ should handle case where model file loading fails. 
> A NULL check and/or exception thrown should be sufficient.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2158) ZipFileResourceTestUtils: Need Improvement to Handle Case for Failure in Loading

2017-09-21 Thread Ashutosh Mestry (JIRA)
Ashutosh Mestry created ATLAS-2158:
--

 Summary: ZipFileResourceTestUtils: Need Improvement to Handle Case 
for Failure in Loading
 Key: ATLAS-2158
 URL: https://issues.apache.org/jira/browse/ATLAS-2158
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 0.8-incubating, trunk
Reporter: Ashutosh Mestry
Assignee: Ashutosh Mestry
Priority: Trivial
 Fix For: trunk


_ZipFileResourceTestUtils_ should handle case where model file loading fails. 

A NULL check and/or exception thrown should be sufficient.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2157) Atlas Hive hook runs into unhandled exceptions from beeline if there are temp tables involved

2017-09-21 Thread Sailaja Navvluru (JIRA)
Sailaja Navvluru created ATLAS-2157:
---

 Summary: Atlas Hive hook runs into unhandled exceptions from 
beeline if there are temp tables involved
 Key: ATLAS-2157
 URL: https://issues.apache.org/jira/browse/ATLAS-2157
 Project: Atlas
  Issue Type: Bug
  Components: atlas-intg
Affects Versions: 0.7.1-incubating, 0.8-incubating
 Environment: HDP 2.6.2
Reporter: Sailaja Navvluru


Opening JIRA as requested by [~madhan.neethiraj] in the mailing list
*Repro steps:*
Insert into a Hive table from beeline, insert goes through fine but Atlas Hive 
hook throws errors.

*Detailed description pasted from mailing list*:
created a table from both Hive CLI and beeline and inserted a row with
Atlas Hive hook enabled. From Hive CLI the insert goes through fine without any 
errors but
from beeline I see errors for a temp table not found although insert itself 
succeeds and temp
table shows up in table listing. Do I need to do anything extra for beeline/HS2 
connections
when Atlas is enabled ? 

 

hive> create table test1(c1 int, c2 string);

OK

Time taken: 2.108 seconds

hive> insert into test1 values(1,'v');

Query ID = hive_20170920092542_d8ec0a4b-b88d-4d87-b59d-790f2eae6792

Total jobs = 1

Launching Job 1 out of 1

Status: Running (Executing on YARN cluster with App id 
application_1505852425742_0004)

 



VERTICES  STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED



Map 1 ..   SUCCEEDED  1  100   0   0



VERTICES: 01/01  [==>>] 100%  ELAPSED TIME: 4.68 s



Loading data to table default.test1

Table default.test1 stats: [numFiles=1, numRows=1, totalSize=4, rawDataSize=3]

OK

Time taken: 6.7 seconds

hive> select * from test1;

OK

1   v

Time taken: 0.112 seconds, Fetched: 1 row(s)

hive>

 

Beeline version 1.2.1000.2.6.2.0-133 by Apache Hive

0: jdbc:hive2://> create table s1(c1 int,c2 string);

OK

No rows affected (2.345 seconds)

 

0: jdbc:hive2://> insert into s1 values(1,'v');

17/09/20 09:28:24 [main]: ERROR hdfs.KeyProviderCache: Could not find uri with 
key [dfs.encryption.key.provider.uri]
to create a keyProvider !!

Query ID = hive_20170920092824_14bfdec4-dfe8-4b97-b5be-0af74de055ce

Total jobs = 1

Launching Job 1 out of 1

Status: Running (Executing on YARN cluster with App id 
application_1505852425742_0005)

 

Loading data to table default.s1

Table default.s1 stats: [numFiles=1, numRows=1, totalSize=4, rawDataSize=3]

OK

No rows affected (498.295 seconds)

0: jdbc:hive2://>

0: jdbc:hive2://> 17/09/20 09:36:42 [Atlas Logger 1]: ERROR metadata.Hive: 
Table values__tmp__table__1
not found: default.values__tmp__table__1 table not found

17/09/20 09:36:43 [Atlas Logger 1]: ERROR hook.HiveHook: Atlas hook failed due 
to error

java.lang.reflect.UndeclaredThrowableException

at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1884)

at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:195)

at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.atlas.hook.AtlasHookException: HiveHook.registerProcess() 
failed.

at 
org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:701)

at org.apache.atlas.hive.hook.HiveHook.collect(HiveHook.java:268)

at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:83)

at org.apache.atlas.hive.hook.HiveHook$2$1.run(HiveHook.java:198)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:422)

at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)

... 6 more

Caused by: org.apache.atlas.hook.AtlasHookException: 
HiveHook.processHiveEntity() failed.

at 
org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:731)

at 
org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:668)

... 12 more

Caused by: org.apache.atlas.hook.AtlasHookException: 
HiveHook.createOrUpdateEntities() failed.

at 
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:597)

at 

[jira] [Updated] (ATLAS-2156) UI : save search allow user to edit name

2017-09-21 Thread Keval Bhatt (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2156:
---
Summary: UI : save search allow user to edit name  (was: UI : save search 
Allow user to edit name)

> UI : save search allow user to edit name
> 
>
> Key: ATLAS-2156
> URL: https://issues.apache.org/jira/browse/ATLAS-2156
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2156) UI : save search Allow user to edit name

2017-09-21 Thread Keval Bhatt (JIRA)
Keval Bhatt created ATLAS-2156:
--

 Summary: UI : save search Allow user to edit name
 Key: ATLAS-2156
 URL: https://issues.apache.org/jira/browse/ATLAS-2156
 Project: Atlas
  Issue Type: Improvement
Reporter: Keval Bhatt
Assignee: Keval Bhatt






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2155) Attributes with null values are not filtered using search parameters

2017-09-21 Thread Ayub Pathan (JIRA)
Ayub Pathan created ATLAS-2155:
--

 Summary: Attributes with null values are not filtered using search 
parameters
 Key: ATLAS-2155
 URL: https://issues.apache.org/jira/browse/ATLAS-2155
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 0.9.1
Reporter: Ayub Pathan
 Fix For: 0.9.1


For example: Below example shows attrbutes like "Description" has nullvalues
{noformat}
apathan@Ayub-sys-101:~/Hortonworks > curl 
'http://localhost:21000/api/atlas/v2/search/basic' -H 'Origin: 
http://localhost:21000' -H 'Accept-Encoding: gzip, deflate, br' -H 
'X-XSRF-HEADER: ""' -H 'Authorization: Basic YWRtaW46YWRtaW4=' -H 
'Accept-Language: en-US,en;q=0.8' -H 'Cookie: 
ATLASSESSIONID=9hm04vl07k7f1vmcmeq9q6kg9' -H 'Connection: keep-alive' -H 
'Pragma: no-cache' -H 'X-Requested-With: XMLHttpRequest' -H 'User-Agent: 
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like 
Gecko) Chrome/60.0.3112.113 Safari/537.36' -H 'Content-Type: application/json' 
-H 'Accept: application/json, text/javascript, */*; q=0.01' -H 'Cache-Control: 
no-cache' -H 'Referer: http://localhost:21000/index.html' --data-binary 
'{"excludeDeletedEntities":true,"entityFilters":{"condition":"AND","criterion":[{"attributeName":"owner","operator":"eq","attributeValue":"apathan"}]},"tagFilters":null,"attributes":["qualifiedName"],"query":null,"limit":25,"offset":0,"typeName":"hive_table","classification":null}'
 --compressed | python -m json.tool
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
100  11050   825  100   280  13953   4735 --:--:-- --:--:-- --:--:-- 14224
{
"entities": [
{
"attributes": {
"createTime": 1505475604641,
"description": null,
"name": "h5",
"owner": "apathan",
"qualifiedName": "default.h5@primary"
},
"classificationNames": [],
"displayText": "h5",
"guid": "7a8955bf-7395-454f-9d67-ea3ba01529bf",
"status": "ACTIVE",
"typeName": "hive_table"
},
{
"attributes": {
"createTime": 1505475721717,
"description": null,
"name": "h7",
"owner": "apathan",
"qualifiedName": "default.h7@primary"
},
"classificationNames": [
"abc",
"dsfads",
"sdf"
],
"displayText": "h7",
"guid": "82d6de4e-d808-4c88-8207-be5a58fbbb4e",
"status": "ACTIVE",
"typeName": "hive_table"
}
],
"queryType": "BASIC",
"searchParameters": {
"attributes": [
"qualifiedName"
],
"entityFilters": {
"condition": "AND",
"criterion": [
{
"attributeName": "owner",
"attributeValue": "apathan",
"operator": "eq"
}
]
},
"excludeDeletedEntities": true,
"limit": 25,
"offset": 0,
"typeName": "hive_table"
}
}
{noformat}

*Filtering those attributes using any operand will not take effect and it will 
always result empty response*
example:
{noformat}
apathan@Ayub-sys-101:~/Hortonworks > curl 
'http://localhost:21000/api/atlas/v2/search/basic' -H 'Origin: 
http://localhost:21000' -H 'Accept-Encoding: gzip, deflate, br' -H 
'X-XSRF-HEADER: ""' -H 'Authorization: Basic YWRtaW46YWRtaW4=' -H 
'Accept-Language: en-US,en;q=0.8' -H 'Cookie: 
ATLASSESSIONID=9hm04vl07k7f1vmcmeq9q6kg9' -H 'Connection: keep-alive' -H 
'Pragma: no-cache' -H 'X-Requested-With: XMLHttpRequest' -H 'User-Agent: 
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like 
Gecko) Chrome/60.0.3112.113 Safari/537.36' -H 'Content-Type: application/json' 
-H 'Accept: application/json, text/javascript, */*; q=0.01' -H 'Cache-Control: 
no-cache' -H 'Referer: http://localhost:21000/index.html' --data-binary 
'{"excludeDeletedEntities":true,"entityFilters":{"condition":"AND","criterion":[{"attributeName":"description","operator":"neq","attributeValue":"ac"}]},"tagFilters":null,"attributes":["qualifiedName"],"query":null,"limit":25,"offset":0,"typeName":"hive_table","classification":null}'
 --compressed | python -m json.tool
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
100   5520   270  100   282   4562   4765 --:--:-- --:--:-- --:--:--  4862
{
"queryType": "BASIC",
"searchParameters": {
"attributes": [
"qualifiedName"
],
"entityFilters": {

[jira] [Created] (ATLAS-2154) UI save-search : No data message showing even after adding favorite search.

2017-09-21 Thread Keval Bhatt (JIRA)
Keval Bhatt created ATLAS-2154:
--

 Summary: UI save-search : No data message showing even after 
adding favorite search.
 Key: ATLAS-2154
 URL: https://issues.apache.org/jira/browse/ATLAS-2154
 Project: Atlas
  Issue Type: Bug
Reporter: Keval Bhatt
Assignee: Keval Bhatt


 showing "You don't have any favorite search." message even after adding 
favorite search.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ATLAS-2152) Saved Search: UI: Atlas UI not able to load the saved search

2017-09-21 Thread Ayub Pathan (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ayub Pathan updated ATLAS-2152:
---
Attachment: SavedSearchSample.json

Attaching the sample savedsearch.json

[~kevalbhatt] [~madhan.neethiraj]

> Saved Search: UI: Atlas UI not able to load the saved search
> 
>
> Key: ATLAS-2152
> URL: https://issues.apache.org/jira/browse/ATLAS-2152
> Project: Atlas
>  Issue Type: Bug
>  Components: atlas-webui
>Affects Versions: 0.9.1
>Reporter: Ayub Pathan
>Priority: Critical
> Fix For: 0.9.1
>
> Attachments: SavedSearchSample.json
>
>
> After saving the search query, Atlas UI unable to load the saved search. 
> Below exception is observed on the browser console
> {noformat}
> CommonViewFunction.js:487 Uncaught TypeError: Cannot read property 'toJSON' 
> of undefined
> at CommonViewFunction.js:487
> at Function.s.each.s.forEach (underscore-min.js:5)
> at Object.g.generateUrlFromSaveSearchObject (CommonViewFunction.js:476)
> at L.d.applyValue (SearchLayoutView.js:155)
> at L.d.stateChange (SaveSearchItemView.js:60)
> at HTMLLIElement.dispatch (jquery.min.js:3)
> at HTMLLIElement.q.handle (jquery.min.js:3)
> {noformat}
> Tested on master.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2153) UI : Adding more columns to the search table masks the "Remove tag" button

2017-09-21 Thread Sharmadha Sainath (JIRA)
Sharmadha Sainath created ATLAS-2153:


 Summary: UI : Adding more columns to the search table masks the 
"Remove tag" button 
 Key: ATLAS-2153
 URL: https://issues.apache.org/jira/browse/ATLAS-2153
 Project: Atlas
  Issue Type: Bug
  Components: atlas-webui
Affects Versions: 0.9-incubating, 0.9.1
Reporter: Sharmadha Sainath
Priority: Minor


For basic search typename = hive_table , 20 attributes can be added in the 
columns filter. When more attributes are added , "Remove Tag" (Cross button) on 
the Tag under Tags column  is masked. This happens when the screen size is less 
and more columns are added. When columns are removed , Remove button shows up 
again.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2152) Saved Search: UI: Atlas UI not able to load the saved search

2017-09-21 Thread Ayub Pathan (JIRA)
Ayub Pathan created ATLAS-2152:
--

 Summary: Saved Search: UI: Atlas UI not able to load the saved 
search
 Key: ATLAS-2152
 URL: https://issues.apache.org/jira/browse/ATLAS-2152
 Project: Atlas
  Issue Type: Bug
  Components: atlas-webui
Affects Versions: 0.9.1
Reporter: Ayub Pathan
Priority: Critical
 Fix For: 0.9.1


After saving the search query, Atlas UI unable to load the saved search. 

Below exception is observed on the browser console
{noformat}
CommonViewFunction.js:487 Uncaught TypeError: Cannot read property 'toJSON' of 
undefined
at CommonViewFunction.js:487
at Function.s.each.s.forEach (underscore-min.js:5)
at Object.g.generateUrlFromSaveSearchObject (CommonViewFunction.js:476)
at L.d.applyValue (SearchLayoutView.js:155)
at L.d.stateChange (SaveSearchItemView.js:60)
at HTMLLIElement.dispatch (jquery.min.js:3)
at HTMLLIElement.q.handle (jquery.min.js:3)
{noformat}

Tested on master.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ATLAS-2151) Search using entity and trait attributes - OR condition considers only the first criterion in the list

2017-09-21 Thread Sharmadha Sainath (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sharmadha Sainath updated ATLAS-2151:
-
Summary: Search using entity and trait attributes - OR condition considers 
only the first criterion in the list   (was: Search using entity and trait 
attributes - OR condition takes only the first parameter)

> Search using entity and trait attributes - OR condition considers only the 
> first criterion in the list 
> ---
>
> Key: ATLAS-2151
> URL: https://issues.apache.org/jira/browse/ATLAS-2151
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 0.9-incubating, 0.9.1
>Reporter: Sharmadha Sainath
>Priority: Critical
>
> 1.Created 2 hive_table entities by name : table1 and table2.
> 2. Fired basic search query with following POST body :
> {code}
> {  
>"entityFilters":{  
>   "condition":"OR",
>   "criterion":[ 
>  {  
> "attributeName":"name",
> "operator":"=",
> "attributeValue":"table1"
>  },
>  {  
> "attributeName":"name",
> "operator":"=",
> "attributeValue":"table2"
>  }
>   ]
>},
>"tagFilters":null,
>"attributes":[  
>],
>"query":null,
>"limit":25,
>"offset":0,
>"typeName":"hive_table",
>"classification":null,
>"excludeDeletedEntities": false
> }
> {code}
> 2. Expected the response would return both table1 and table2.
> 3. Only table1 (first filter) is returned. Any filter other than "!=" in the 
> second condition doesn't fetch expected results.
> 4. Also when "excludeDeletedEntities" is set to true , though table1 and 
> table2 are ACTIVE , no entity is returned.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ATLAS-2151) Search using entity and trait attributes - OR condition takes only the first parameter

2017-09-21 Thread Sharmadha Sainath (JIRA)
Sharmadha Sainath created ATLAS-2151:


 Summary: Search using entity and trait attributes - OR condition 
takes only the first parameter
 Key: ATLAS-2151
 URL: https://issues.apache.org/jira/browse/ATLAS-2151
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 0.9-incubating, 0.9.1
Reporter: Sharmadha Sainath
Priority: Critical


1.Created 2 hive_table entities by name : table1 and table2.
2. Fired basic search query with following POST body :
{code}
{  
   "entityFilters":{  
  "condition":"OR",
  "criterion":[ 
 {  
"attributeName":"name",
"operator":"=",
"attributeValue":"table1"
 },
 {  
"attributeName":"name",
"operator":"=",
"attributeValue":"table2"
 }
  ]
   },
   "tagFilters":null,
   "attributes":[  
   ],
   "query":null,
   "limit":25,
   "offset":0,
   "typeName":"hive_table",
   "classification":null,
   "excludeDeletedEntities": false
}
{code}

2. Expected the response would return both table1 and table2.
3. Only table1 (first filter) is returned. Any filter other than "!=" in the 
second condition doesn't fetch expected results.
4. Also when "excludeDeletedEntities" is set to true , though table1 and table2 
are ACTIVE , no entity is returned.






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ATLAS-2031) Allow EntityDef deletion

2017-09-21 Thread David Radley (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Radley updated ATLAS-2031:

Attachment: ATLAS2031-1.patch

> Allow EntityDef deletion
> 
>
> Key: ATLAS-2031
> URL: https://issues.apache.org/jira/browse/ATLAS-2031
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: David Radley
>Assignee: David Radley
> Attachments: ATLAS2031-1.patch, ATLAS2031.patch
>
>
> Allow entityTypes to be removed from classificationDef so that is is possible 
> to delete the entityDef. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Re: Review Request 62405: ATLAS2031 Allow AtlasClassificationDef entitytypes removal

2017-09-21 Thread David Radley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62405/
---

(Updated Sept. 21, 2017, 8:45 a.m.)


Review request for atlas and Madhan Neethiraj.


Repository: atlas


Description
---

ATLAS2031 Allow AtlasClassificationDef entitytypes removal


Diffs (updated)
-

  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasTypeDefGraphStoreV1.java
 603516d49f1e6ce2acd8cb1b45bd89d51cff7e94 


Diff: https://reviews.apache.org/r/62405/diff/2/

Changes: https://reviews.apache.org/r/62405/diff/1-2/


Testing
---

1) create a classificationDef with 2 valid entityTypes EntityA and EntityB
2) update classification def to remove EntityTypeB
3) create an instance of EntityC , try to apply the classificaiton to it . It 
should fail
4) update the classification to have an empty list of classifications.
5) Repeat step 3 and it should now work.


File Attachments (updated)


ATLAS2031.patch
  
https://reviews.apache.org/media/uploaded/files/2017/09/21/28a75f1f-3b35-4ffb-a915-010ebf265a6b__ATLAS2031.patch


Thanks,

David Radley



Add me as a JIRA contributor in Apache Atlas

2017-09-21 Thread Tejas Rawool
Hi Atlas dev,

Please add me as a JIRA contributor for Atlas

My Userid is "tejas_rawool".

Thanks