[jira] [Created] (ATLAS-1282) Remove attribute QueryPlan from Process type when removal of required attributes is supported

2016-11-09 Thread Vimal Sharma (JIRA)
Vimal Sharma created ATLAS-1282:
---

 Summary: Remove attribute QueryPlan from Process type when removal 
of required attributes is supported
 Key: ATLAS-1282
 URL: https://issues.apache.org/jira/browse/ATLAS-1282
 Project: Atlas
  Issue Type: Bug
Reporter: Vimal Sharma


Currently, removal of required attributes from Types is not supported in Atlas. 
When the support is added to remove required attributes, remove the attribute 
queryplan in Process Type.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Build failed in Jenkins: apache-atlas-nightly #469

2016-11-09 Thread Apache Jenkins Server
See 

Changes:

[madhan] ATLAS-1281: audit logs should written only to audit.log and not

--
[...truncated 8169 lines...]
127.0.0.1 - - [10/Nov/2016:06:21:54 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=0=10 
HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:54 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=2147483647=10
 HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:54 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=10=-2 
HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:54 +] "GET 
/api/atlas/discovery/search/fulltext?query=IWT0RKL0Ky=10=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:54 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:54 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=10=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:54 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=10=1 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:54 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=1=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:54 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=1=2 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:54 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:55 +] "GET 
/api/atlas/discovery/search/dsl?query=from+blah HTTP/1.1" 400 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:55 +] "GET 
/api/atlas/discovery/search?query=* HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:55 +] "GET 
/api/atlas/discovery/search?query=from+dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:21:56 +] "GET 
/api/atlas/discovery/search/gremlin?query=g.V.has('type',+'dsl_test_type').toList()
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.958 sec - in 
org.apache.atlas.web.resources.MetadataDiscoveryJerseyResourceIT
Running org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT
127.0.0.1 - - [10/Nov/2016:06:21:59 +] "GET /api/atlas/types/hive_db 
HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [10/Nov/2016:06:22:00 +] "POST /api/atlas/types HTTP/1.1" 400 
- "-" "Java/1.7.0_80"
Tests run: 10, Failures: 1, Errors: 0, Skipped: 9, Time elapsed: 2.628 sec <<< 
FAILURE! - in org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT
setUp(org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT)  Time 
elapsed: 2.537 sec  <<< FAILURE!
org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE failed 
with status 400 (Bad Request) Response Body ({"error":"Unknown datatype: 
DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
 Unknown datatype: DataSet\n\tat 
org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
 
org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
 sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\n\tat
 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
 java.lang.reflect.Method.invoke(Method.java:606)\n\tat 
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
 
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
 
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
 
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat
 

Re: Review Request 53638: ATLAS-1281: audit logs should written only to audit.log and not application.log

2016-11-09 Thread Vimal Sharma

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53638/#review155542
---


Ship it!




Ship It!

- Vimal Sharma


On Nov. 10, 2016, 4:05 a.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/53638/
> ---
> 
> (Updated Nov. 10, 2016, 4:05 a.m.)
> 
> 
> Review request for atlas.
> 
> 
> Bugs: ATLAS-1281
> https://issues.apache.org/jira/browse/ATLAS-1281
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> updated audit logging and log4j configuration to write audit logs only to 
> audit.log and not application.log
> 
> 
> Diffs
> -
> 
>   typesystem/src/main/resources/atlas-log4j.xml 5a48854 
>   webapp/src/main/java/org/apache/atlas/web/filters/AuditFilter.java 866277f 
> 
> Diff: https://reviews.apache.org/r/53638/diff/
> 
> 
> Testing
> ---
> 
> - ran unit tests successfully
> - deployed atlas.war and verified that audit logs are Awritten only to 
> audit.log and
>  not application.log
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>



[jira] [Updated] (ATLAS-1281) Audit logs written to both audit.log and application.log - should only go to audit.log

2016-11-09 Thread Madhan Neethiraj (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-1281:

Attachment: ATLAS-1281.patch

Review board: https://reviews.apache.org/r/53638/

> Audit logs written to both audit.log and application.log - should only go to 
> audit.log
> --
>
> Key: ATLAS-1281
> URL: https://issues.apache.org/jira/browse/ATLAS-1281
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.7-incubating
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
> Attachments: ATLAS-1281.patch
>
>
> Audit logs generated by Atlas server currently go to both audit.log and 
> application.log - as shown below:
> audit.log:
> {noformat}
> 2016-11-09 18:44:30,454  Audit: admin/10.0.2.2-10.0.2.2 performed request GET 
> http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
>  (10.0.2.15) at time 2016-11-10T02:44Z
> {noformat}
> application.log:
> {noformat}
> 2016-11-09 18:44:30,453 INFO  - [qtp317986356-19 - 
> cce44a24-d87a-43a9-87a8-73269a91ded8:] ~ Audit: admin/10.0.2.2 performed 
> request GET 
> http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
>  (10.0.2.15) at time 2016-11-10T02:44Z (AuditFilter:91)
> 2016-11-09 18:44:30,453 INFO  - [qtp317986356-19 - 
> cce44a24-d87a-43a9-87a8-73269a91ded8:] ~ Audit: admin/10.0.2.2-10.0.2.2 
> performed request GET 
> http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
>  (10.0.2.15) at time 2016-11-10T02:44Z (AUDIT:104)
> {noformat}
> This should be fixed so that audit logs will only be written to audit.log 
> file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Review Request 53638: ATLAS-1281: audit logs should written only to audit.log and not application.log

2016-11-09 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53638/
---

Review request for atlas.


Bugs: ATLAS-1281
https://issues.apache.org/jira/browse/ATLAS-1281


Repository: atlas


Description
---

updated audit logging and log4j configuration to write audit logs only to 
audit.log and not application.log


Diffs
-

  typesystem/src/main/resources/atlas-log4j.xml 5a48854 
  webapp/src/main/java/org/apache/atlas/web/filters/AuditFilter.java 866277f 

Diff: https://reviews.apache.org/r/53638/diff/


Testing
---

- ran unit tests successfully
- deployed atlas.war and verified that audit logs are Awritten only to 
audit.log and
 not application.log


Thanks,

Madhan Neethiraj



[jira] [Created] (ATLAS-1281) Audit logs written to both audit.log and application.log - should only go to audit.log

2016-11-09 Thread Madhan Neethiraj (JIRA)
Madhan Neethiraj created ATLAS-1281:
---

 Summary: Audit logs written to both audit.log and application.log 
- should only go to audit.log
 Key: ATLAS-1281
 URL: https://issues.apache.org/jira/browse/ATLAS-1281
 Project: Atlas
  Issue Type: Bug
Affects Versions: 0.7-incubating
Reporter: Madhan Neethiraj
Assignee: Madhan Neethiraj


Audit logs generated by Atlas server currently go to both audit.log and 
application.log - as shown below:

audit.log:
2016-11-09 18:44:30,454  Audit: admin/10.0.2.2-10.0.2.2 performed request GET 
http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
 (10.0.2.15) at time 2016-11-10T02:44Z

application.log:
2016-11-09 18:44:30,453 INFO  - [qtp317986356-19 - 
cce44a24-d87a-43a9-87a8-73269a91ded8:] ~ Audit: admin/10.0.2.2 performed 
request GET 
http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
 (10.0.2.15) at time 2016-11-10T02:44Z (AuditFilter:91)
2016-11-09 18:44:30,453 INFO  - [qtp317986356-19 - 
cce44a24-d87a-43a9-87a8-73269a91ded8:] ~ Audit: admin/10.0.2.2-10.0.2.2 
performed request GET 
http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
 (10.0.2.15) at time 2016-11-10T02:44Z (AUDIT:104)


This should be fixed so that audit logs will only be written to audit.log file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ATLAS-1281) Audit logs written to both audit.log and application.log - should only go to audit.log

2016-11-09 Thread Madhan Neethiraj (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-1281:

Description: 
Audit logs generated by Atlas server currently go to both audit.log and 
application.log - as shown below:

audit.log:
{noformat}
2016-11-09 18:44:30,454  Audit: admin/10.0.2.2-10.0.2.2 performed request GET 
http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
 (10.0.2.15) at time 2016-11-10T02:44Z
{noformat}

application.log:
{noformat}
2016-11-09 18:44:30,453 INFO  - [qtp317986356-19 - 
cce44a24-d87a-43a9-87a8-73269a91ded8:] ~ Audit: admin/10.0.2.2 performed 
request GET 
http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
 (10.0.2.15) at time 2016-11-10T02:44Z (AuditFilter:91)
2016-11-09 18:44:30,453 INFO  - [qtp317986356-19 - 
cce44a24-d87a-43a9-87a8-73269a91ded8:] ~ Audit: admin/10.0.2.2-10.0.2.2 
performed request GET 
http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
 (10.0.2.15) at time 2016-11-10T02:44Z (AUDIT:104)
{noformat}

This should be fixed so that audit logs will only be written to audit.log file.

  was:
Audit logs generated by Atlas server currently go to both audit.log and 
application.log - as shown below:

audit.log:
2016-11-09 18:44:30,454  Audit: admin/10.0.2.2-10.0.2.2 performed request GET 
http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
 (10.0.2.15) at time 2016-11-10T02:44Z

application.log:
2016-11-09 18:44:30,453 INFO  - [qtp317986356-19 - 
cce44a24-d87a-43a9-87a8-73269a91ded8:] ~ Audit: admin/10.0.2.2 performed 
request GET 
http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
 (10.0.2.15) at time 2016-11-10T02:44Z (AuditFilter:91)
2016-11-09 18:44:30,453 INFO  - [qtp317986356-19 - 
cce44a24-d87a-43a9-87a8-73269a91ded8:] ~ Audit: admin/10.0.2.2-10.0.2.2 
performed request GET 
http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
 (10.0.2.15) at time 2016-11-10T02:44Z (AUDIT:104)


This should be fixed so that audit logs will only be written to audit.log file.


> Audit logs written to both audit.log and application.log - should only go to 
> audit.log
> --
>
> Key: ATLAS-1281
> URL: https://issues.apache.org/jira/browse/ATLAS-1281
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.7-incubating
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>
> Audit logs generated by Atlas server currently go to both audit.log and 
> application.log - as shown below:
> audit.log:
> {noformat}
> 2016-11-09 18:44:30,454  Audit: admin/10.0.2.2-10.0.2.2 performed request GET 
> http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
>  (10.0.2.15) at time 2016-11-10T02:44Z
> {noformat}
> application.log:
> {noformat}
> 2016-11-09 18:44:30,453 INFO  - [qtp317986356-19 - 
> cce44a24-d87a-43a9-87a8-73269a91ded8:] ~ Audit: admin/10.0.2.2 performed 
> request GET 
> http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
>  (10.0.2.15) at time 2016-11-10T02:44Z (AuditFilter:91)
> 2016-11-09 18:44:30,453 INFO  - [qtp317986356-19 - 
> cce44a24-d87a-43a9-87a8-73269a91ded8:] ~ Audit: admin/10.0.2.2-10.0.2.2 
> performed request GET 
> http://localhost:21000/api/atlas/discovery/search/dsl?limit=25=Asset&_=1478745825957
>  (10.0.2.15) at time 2016-11-10T02:44Z (AUDIT:104)
> {noformat}
> This should be fixed so that audit logs will only be written to audit.log 
> file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Build failed in Jenkins: apache-atlas-nightly #468

2016-11-09 Thread Apache Jenkins Server
See 

Changes:

[jnhagelberg] Add jnhagelberg as committer in pom.xml

--
[...truncated 8105 lines...]
127.0.0.1 - - [09/Nov/2016:16:21:32 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=0=10 
HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:32 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=2147483647=10
 HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:32 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=10=-2 
HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:32 +] "GET 
/api/atlas/discovery/search/fulltext?query=JzEcyvA1t2=10=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:32 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:32 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=10=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:32 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=10=1 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:32 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=1=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:32 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=1=2 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:32 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:33 +] "GET 
/api/atlas/discovery/search/dsl?query=from+blah HTTP/1.1" 400 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:33 +] "GET 
/api/atlas/discovery/search?query=* HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:33 +] "GET 
/api/atlas/discovery/search?query=from+dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:34 +] "GET 
/api/atlas/discovery/search/gremlin?query=g.V.has('type',+'dsl_test_type').toList()
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.561 sec - in 
org.apache.atlas.web.resources.MetadataDiscoveryJerseyResourceIT
Running org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT
127.0.0.1 - - [09/Nov/2016:16:21:37 +] "GET /api/atlas/types/hive_db 
HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:16:21:38 +] "POST /api/atlas/types HTTP/1.1" 400 
- "-" "Java/1.7.0_80"
Tests run: 10, Failures: 1, Errors: 0, Skipped: 9, Time elapsed: 2.45 sec <<< 
FAILURE! - in org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT
setUp(org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT)  Time 
elapsed: 2.335 sec  <<< FAILURE!
org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE failed 
with status 400 (Bad Request) Response Body ({"error":"Unknown datatype: 
DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
 Unknown datatype: DataSet\n\tat 
org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
 
org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
 sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\n\tat
 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
 java.lang.reflect.Method.invoke(Method.java:606)\n\tat 
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
 
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
 
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
 
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat
 

[jira] [Commented] (ATLAS-1276) webapp test failures

2016-11-09 Thread Ayub Khan (JIRA)

[ 
https://issues.apache.org/jira/browse/ATLAS-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651243#comment-15651243
 ] 

Ayub Khan commented on ATLAS-1276:
--

This change is introduced as part of the new format typedef JSON files. 
Revision number: def9e385cc17c2bceb9450c82947370fadc09c3c

> webapp test failures
> 
>
> Key: ATLAS-1276
> URL: https://issues.apache.org/jira/browse/ATLAS-1276
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Shwetha G S
>Assignee: Ayub Khan
>Priority: Blocker
> Fix For: trunk
>
> Attachments: ATLAS-1276.patch
>
>
> Failed tests:
>   QuickStartIT.runQuickStart:45 » AtlasService Metadata service API 
> CREATE_TYPE ...
>   
> EntityNotificationIT.setUp:73->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> NotificationHookConsumerIT.setUp:48->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> DataSetLineageJerseyResourceIT.setUp:57->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> EntityJerseyResourceIT.setUp:104->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
> Tests run: 86, Failures: 5, Errors: 0, Skipped: 58
> Tests run: 34, Failures: 1, Errors: 0, Skipped: 33, Time elapsed: 1.593 sec 
> <<< FAILURE! - in org.apache.atlas.web.resources.EntityJerseyResourceIT
> setUp(org.apache.atlas.web.resources.EntityJerseyResourceIT)  Time elapsed: 
> 1.446 sec  <<< FAILURE!
> org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE 
> failed with status 400 (Bad Request) Response Body ({"error":"Unknown 
> datatype: 
> DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
>  Unknown datatype: DataSet\n\tat 
> org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
>  
> org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
>  sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat
>  
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
>  java.lang.reflect.Method.invoke(Method.java:497)\n\tat 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)\n\tat
>  
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)\n\tat
>  

[jira] [Comment Edited] (ATLAS-1276) webapp test failures

2016-11-09 Thread Ayub Khan (JIRA)

[ 
https://issues.apache.org/jira/browse/ATLAS-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651237#comment-15651237
 ] 

Ayub Khan edited comment on ATLAS-1276 at 11/9/16 3:35 PM:
---

Attaching patch for review.

[~shwethags] / [~suma.shivaprasad] / [~madhan.neethiraj]


was (Author: ayubkhan):
Attaching patch for review.

> webapp test failures
> 
>
> Key: ATLAS-1276
> URL: https://issues.apache.org/jira/browse/ATLAS-1276
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Shwetha G S
>Assignee: Ayub Khan
>Priority: Blocker
> Fix For: trunk
>
> Attachments: ATLAS-1276.patch
>
>
> Failed tests:
>   QuickStartIT.runQuickStart:45 » AtlasService Metadata service API 
> CREATE_TYPE ...
>   
> EntityNotificationIT.setUp:73->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> NotificationHookConsumerIT.setUp:48->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> DataSetLineageJerseyResourceIT.setUp:57->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> EntityJerseyResourceIT.setUp:104->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
> Tests run: 86, Failures: 5, Errors: 0, Skipped: 58
> Tests run: 34, Failures: 1, Errors: 0, Skipped: 33, Time elapsed: 1.593 sec 
> <<< FAILURE! - in org.apache.atlas.web.resources.EntityJerseyResourceIT
> setUp(org.apache.atlas.web.resources.EntityJerseyResourceIT)  Time elapsed: 
> 1.446 sec  <<< FAILURE!
> org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE 
> failed with status 400 (Bad Request) Response Body ({"error":"Unknown 
> datatype: 
> DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
>  Unknown datatype: DataSet\n\tat 
> org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
>  
> org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
>  sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat
>  
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
>  java.lang.reflect.Method.invoke(Method.java:497)\n\tat 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)\n\tat
>  
> 

Re: Build failed in Jenkins: apache-atlas-nightly #466

2016-11-09 Thread Ayub Khan Pathan
I have submitted a patch for https://issues.apache.org/jira/browse/ATLAS-1276. 
This should fix the below build failure as well.

Thanks
Ayub Khan

On 11/9/16, 1:58 PM, "Apache Jenkins Server"  wrote:

See 

Changes:

[madhan] ATLAS-1278: Added API to get typedef header info

--
[...truncated 8105 lines...]
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=0=10 
HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=2147483647=10
 HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=10=-2 
HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=Z0pRH2tbDG=10=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=10=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=10=1 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=1=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=1=2 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:35 +] "GET 
/api/atlas/discovery/search/dsl?query=from+blah HTTP/1.1" 400 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:35 +] "GET 
/api/atlas/discovery/search?query=* HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:35 +] "GET 
/api/atlas/discovery/search?query=from+dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:36 +] "GET 
/api/atlas/discovery/search/gremlin?query=g.V.has('type',+'dsl_test_type').toList()
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.638 sec 
- in org.apache.atlas.web.resources.MetadataDiscoveryJerseyResourceIT
Running org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT
127.0.0.1 - - [09/Nov/2016:08:21:39 +] "GET /api/atlas/types/hive_db 
HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:40 +] "POST /api/atlas/types HTTP/1.1" 
400 - "-" "Java/1.7.0_80"
Tests run: 10, Failures: 1, Errors: 0, Skipped: 9, Time elapsed: 2.329 sec 
<<< FAILURE! - in org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT
setUp(org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT)  Time 
elapsed: 2.236 sec  <<< FAILURE!
org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE 
failed with status 400 (Bad Request) Response Body ({"error":"Unknown datatype: 
DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
 Unknown datatype: DataSet\n\tat 
org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
 
org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
 sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\n\tat
 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
 java.lang.reflect.Method.invoke(Method.java:606)\n\tat 
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
 

[jira] [Updated] (ATLAS-1276) webapp test failures

2016-11-09 Thread Ayub Khan (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ayub Khan updated ATLAS-1276:
-
Attachment: ATLAS-1276.patch

> webapp test failures
> 
>
> Key: ATLAS-1276
> URL: https://issues.apache.org/jira/browse/ATLAS-1276
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Shwetha G S
>Assignee: Ayub Khan
>Priority: Blocker
> Fix For: trunk
>
> Attachments: ATLAS-1276.patch
>
>
> Failed tests:
>   QuickStartIT.runQuickStart:45 » AtlasService Metadata service API 
> CREATE_TYPE ...
>   
> EntityNotificationIT.setUp:73->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> NotificationHookConsumerIT.setUp:48->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> DataSetLineageJerseyResourceIT.setUp:57->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> EntityJerseyResourceIT.setUp:104->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
> Tests run: 86, Failures: 5, Errors: 0, Skipped: 58
> Tests run: 34, Failures: 1, Errors: 0, Skipped: 33, Time elapsed: 1.593 sec 
> <<< FAILURE! - in org.apache.atlas.web.resources.EntityJerseyResourceIT
> setUp(org.apache.atlas.web.resources.EntityJerseyResourceIT)  Time elapsed: 
> 1.446 sec  <<< FAILURE!
> org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE 
> failed with status 400 (Bad Request) Response Body ({"error":"Unknown 
> datatype: 
> DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
>  Unknown datatype: DataSet\n\tat 
> org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
>  
> org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
>  sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat
>  
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
>  java.lang.reflect.Method.invoke(Method.java:497)\n\tat 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)\n\tat
>  
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)\n\tat
>  javax.servlet.http.HttpServlet.service(HttpServlet.java:790)\n\tat 
> 

[jira] [Assigned] (ATLAS-1276) webapp test failures

2016-11-09 Thread Ayub Khan (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ayub Khan reassigned ATLAS-1276:


Assignee: Ayub Khan

> webapp test failures
> 
>
> Key: ATLAS-1276
> URL: https://issues.apache.org/jira/browse/ATLAS-1276
> Project: Atlas
>  Issue Type: Bug
>Reporter: Shwetha G S
>Assignee: Ayub Khan
>Priority: Blocker
>
> Failed tests:
>   QuickStartIT.runQuickStart:45 » AtlasService Metadata service API 
> CREATE_TYPE ...
>   
> EntityNotificationIT.setUp:73->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> NotificationHookConsumerIT.setUp:48->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> DataSetLineageJerseyResourceIT.setUp:57->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> EntityJerseyResourceIT.setUp:104->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
> Tests run: 86, Failures: 5, Errors: 0, Skipped: 58
> Tests run: 34, Failures: 1, Errors: 0, Skipped: 33, Time elapsed: 1.593 sec 
> <<< FAILURE! - in org.apache.atlas.web.resources.EntityJerseyResourceIT
> setUp(org.apache.atlas.web.resources.EntityJerseyResourceIT)  Time elapsed: 
> 1.446 sec  <<< FAILURE!
> org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE 
> failed with status 400 (Bad Request) Response Body ({"error":"Unknown 
> datatype: 
> DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
>  Unknown datatype: DataSet\n\tat 
> org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
>  
> org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
>  sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat
>  
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
>  java.lang.reflect.Method.invoke(Method.java:497)\n\tat 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)\n\tat
>  
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)\n\tat
>  javax.servlet.http.HttpServlet.service(HttpServlet.java:790)\n\tat 
> com.google.inject.servlet.ServletDefinition.doServiceImpl(ServletDefinition.java:287)\n\tat
>  
> com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:277)\n\tat

[jira] [Updated] (ATLAS-1244) Atlas to Support KnoxSSO Authentication

2016-11-09 Thread Nixon Rodrigues (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nixon Rodrigues updated ATLAS-1244:
---
Attachment: ATLAS-1244-2.patch

> Atlas to Support KnoxSSO Authentication
> ---
>
> Key: ATLAS-1244
> URL: https://issues.apache.org/jira/browse/ATLAS-1244
> Project: Atlas
>  Issue Type: New Feature
>Affects Versions: 0.8-incubating
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1244-1.patch, ATLAS-1244-2.patch, ATLAS-1244.patch
>
>
> Atlas to support KnoxSSO Authentication method.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 53426: ATLAS-1244 - Atlas to Support KnoxSSO Authentication

2016-11-09 Thread Nixon Rodrigues


> On Nov. 3, 2016, 5:33 p.m., Apoorv Naik wrote:
> > webapp/src/main/java/org/apache/atlas/web/filters/AtlasSSOAuthenticationFilter.java,
> >  line 404
> > 
> >
> > Why not use standard library to read the key from the file directly.
> > 
> > Would the following work in this case ?
> > 
> > ```java
> > import java.io.*;
> > import java.nio.*;
> > import java.security.*;
> > import java.security.spec.*;
> > 
> > public class PublicKeyReader {
> > 
> >   public static PublicKey get(String filename)
> > throws Exception {
> > 
> > byte[] keyBytes = Files.readAllBytes(new File(filename).toPath());
> > 
> > X509EncodedKeySpec spec =
> >   new X509EncodedKeySpec(keyBytes);
> > KeyFactory kf = KeyFactory.getInstance("RSA");
> > return kf.generatePublic(spec);
> >   }
> > }
> > 
> > ```

Yes, we can use this approach of reading file also but adding public key from 
Ambari UI will be handy without requiring server access for copying the knox 
public key.


- Nixon


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53426/#review154772
---


On Nov. 9, 2016, 1:02 p.m., Nixon Rodrigues wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/53426/
> ---
> 
> (Updated Nov. 9, 2016, 1:02 p.m.)
> 
> 
> Review request for atlas, Ankita Sinha, keval bhatt, Madhan Neethiraj, 
> Shwetha GS, and Suma Shivaprasad.
> 
> 
> Bugs: ATLAS-1244
> https://issues.apache.org/jira/browse/ATLAS-1244
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This patch includes new filter for Atlas to Support KnoxSSO Authentication.
> 
> 
> Diffs
> -
> 
>   distro/src/conf/atlas-application.properties 0349ccc 
>   webapp/pom.xml 6dbd484 
>   
> webapp/src/main/java/org/apache/atlas/web/filters/AtlasAuthenticationFilter.java
>  30200b5 
>   
> webapp/src/main/java/org/apache/atlas/web/filters/AtlasSSOAuthenticationFilter.java
>  PRE-CREATION 
>   webapp/src/main/java/org/apache/atlas/web/filters/SSOAuthentication.java 
> PRE-CREATION 
>   
> webapp/src/main/java/org/apache/atlas/web/filters/SSOAuthenticationProperties.java
>  PRE-CREATION 
>   
> webapp/src/main/java/org/apache/atlas/web/security/AtlasAbstractAuthenticationProvider.java
>  595387a 
>   
> webapp/src/main/java/org/apache/atlas/web/security/AtlasAuthenticationProvider.java
>  23d3d70 
>   
> webapp/src/main/java/org/apache/atlas/web/security/AtlasAuthenticationSuccessHandler.java
>  8654716 
>   webapp/src/main/resources/spring-security.xml ea9aa94 
>   webapp/src/main/webapp/WEB-INF/web.xml 7c6bc6d 
>   webapp/src/test/webapp/WEB-INF/web.xml 1b152ee 
> 
> Diff: https://reviews.apache.org/r/53426/diff/
> 
> 
> Testing
> ---
> 
> Verified Knox SSO authentication.
> Verified basic authentication process
> Verified form based authentication process
> 
> All existing test cases passing.
> 
> 
> Thanks,
> 
> Nixon Rodrigues
> 
>



Re: Review Request 53426: ATLAS-1244 - Atlas to Support KnoxSSO Authentication

2016-11-09 Thread Nixon Rodrigues

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53426/
---

(Updated Nov. 9, 2016, 1:02 p.m.)


Review request for atlas, Ankita Sinha, keval bhatt, Madhan Neethiraj, Shwetha 
GS, and Suma Shivaprasad.


Changes
---

This patch handles review comments from Madhan.

changed property name to add knox in it.

### KNOX Configs 
atlas.sso.knox.browser.useragent=Mozilla,Chrome,Opera
atlas.sso.knox.enabled=true
atlas.sso.knox.providerurl=https://:8443/gateway/knoxsso/api/v1/websso
atlas.sso.knox.publicKey=


Bugs: ATLAS-1244
https://issues.apache.org/jira/browse/ATLAS-1244


Repository: atlas


Description
---

This patch includes new filter for Atlas to Support KnoxSSO Authentication.


Diffs (updated)
-

  distro/src/conf/atlas-application.properties 0349ccc 
  webapp/pom.xml 6dbd484 
  
webapp/src/main/java/org/apache/atlas/web/filters/AtlasAuthenticationFilter.java
 30200b5 
  
webapp/src/main/java/org/apache/atlas/web/filters/AtlasSSOAuthenticationFilter.java
 PRE-CREATION 
  webapp/src/main/java/org/apache/atlas/web/filters/SSOAuthentication.java 
PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/filters/SSOAuthenticationProperties.java
 PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/security/AtlasAbstractAuthenticationProvider.java
 595387a 
  
webapp/src/main/java/org/apache/atlas/web/security/AtlasAuthenticationProvider.java
 23d3d70 
  
webapp/src/main/java/org/apache/atlas/web/security/AtlasAuthenticationSuccessHandler.java
 8654716 
  webapp/src/main/resources/spring-security.xml ea9aa94 
  webapp/src/main/webapp/WEB-INF/web.xml 7c6bc6d 
  webapp/src/test/webapp/WEB-INF/web.xml 1b152ee 

Diff: https://reviews.apache.org/r/53426/diff/


Testing
---

Verified Knox SSO authentication.
Verified basic authentication process
Verified form based authentication process

All existing test cases passing.


Thanks,

Nixon Rodrigues



Re: Review Request 53426: ATLAS-1244 - Atlas to Support KnoxSSO Authentication

2016-11-09 Thread Nixon Rodrigues


> On Nov. 7, 2016, 6:44 p.m., Madhan Neethiraj wrote:
> > webapp/src/main/java/org/apache/atlas/web/filters/AtlasSSOAuthenticationFilter.java,
> >  line 352
> > 
> >
> > getJwtProperties() - the method seems to be initializing 
> > this.jwtProperties. Is this intentional? Perhaps this should go into 
> > loadJwtProperties() and have getJwtProperties() simply return 
> > this.jwtProperties.

method loadJwtProperties() is responsible of loading SSO configs from 
atlasPropertyConfigs to SSOAuthenticationProperties bean and method 
setJwtProperties() is responsible for setting values to member variable 
authenticationProviderUrl,publicKey etc.


- Nixon


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53426/#review155171
---


On Nov. 7, 2016, 12:59 p.m., Nixon Rodrigues wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/53426/
> ---
> 
> (Updated Nov. 7, 2016, 12:59 p.m.)
> 
> 
> Review request for atlas, Ankita Sinha, keval bhatt, Madhan Neethiraj, 
> Shwetha GS, and Suma Shivaprasad.
> 
> 
> Bugs: ATLAS-1244
> https://issues.apache.org/jira/browse/ATLAS-1244
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This patch includes new filter for Atlas to Support KnoxSSO Authentication.
> 
> 
> Diffs
> -
> 
>   distro/src/conf/atlas-application.properties 0349ccc 
>   webapp/pom.xml 6dbd484 
>   
> webapp/src/main/java/org/apache/atlas/web/filters/AtlasAuthenticationFilter.java
>  30200b5 
>   
> webapp/src/main/java/org/apache/atlas/web/filters/AtlasSSOAuthenticationFilter.java
>  PRE-CREATION 
>   webapp/src/main/java/org/apache/atlas/web/filters/SSOAuthentication.java 
> PRE-CREATION 
>   
> webapp/src/main/java/org/apache/atlas/web/filters/SSOAuthenticationProperties.java
>  PRE-CREATION 
>   
> webapp/src/main/java/org/apache/atlas/web/security/AtlasAbstractAuthenticationProvider.java
>  595387a 
>   
> webapp/src/main/java/org/apache/atlas/web/security/AtlasAuthenticationProvider.java
>  23d3d70 
>   
> webapp/src/main/java/org/apache/atlas/web/security/AtlasAuthenticationSuccessHandler.java
>  8654716 
>   webapp/src/main/resources/spring-security.xml ea9aa94 
>   webapp/src/main/webapp/WEB-INF/web.xml 7c6bc6d 
>   webapp/src/test/webapp/WEB-INF/web.xml 1b152ee 
> 
> Diff: https://reviews.apache.org/r/53426/diff/
> 
> 
> Testing
> ---
> 
> Verified Knox SSO authentication.
> Verified basic authentication process
> Verified form based authentication process
> 
> All existing test cases passing.
> 
> 
> Thanks,
> 
> Nixon Rodrigues
> 
>



Build failed in Jenkins: apache-atlas-nightly #467

2016-11-09 Thread Apache Jenkins Server
See 

Changes:

[visharma] Adding Vimal Sharma as Committer

--
[...truncated 8105 lines...]
127.0.0.1 - - [09/Nov/2016:11:39:00 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=0=10 
HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:00 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=2147483647=10
 HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:00 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=10=-2 
HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:00 +] "GET 
/api/atlas/discovery/search/fulltext?query=FPX19TQvkB=10=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:00 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:00 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=10=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:00 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=10=1 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:00 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=1=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:00 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=1=2 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:00 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:01 +] "GET 
/api/atlas/discovery/search/dsl?query=from+blah HTTP/1.1" 400 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:01 +] "GET 
/api/atlas/discovery/search?query=* HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:01 +] "GET 
/api/atlas/discovery/search?query=from+dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:02 +] "GET 
/api/atlas/discovery/search/gremlin?query=g.V.has('type',+'dsl_test_type').toList()
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.871 sec - in 
org.apache.atlas.web.resources.MetadataDiscoveryJerseyResourceIT
Running org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT
127.0.0.1 - - [09/Nov/2016:11:39:05 +] "GET /api/atlas/types/hive_db 
HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:11:39:06 +] "POST /api/atlas/types HTTP/1.1" 400 
- "-" "Java/1.7.0_80"
Tests run: 10, Failures: 1, Errors: 0, Skipped: 9, Time elapsed: 2.526 sec <<< 
FAILURE! - in org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT
setUp(org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT)  Time 
elapsed: 2.43 sec  <<< FAILURE!
org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE failed 
with status 400 (Bad Request) Response Body ({"error":"Unknown datatype: 
DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
 Unknown datatype: DataSet\n\tat 
org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
 
org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
 sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\n\tat
 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
 java.lang.reflect.Method.invoke(Method.java:606)\n\tat 
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
 
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
 
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
 
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat
 

[jira] [Created] (ATLAS-1280) Build Atlas with Hive2

2016-11-09 Thread Vimal Sharma (JIRA)
Vimal Sharma created ATLAS-1280:
---

 Summary: Build Atlas with Hive2
 Key: ATLAS-1280
 URL: https://issues.apache.org/jira/browse/ATLAS-1280
 Project: Atlas
  Issue Type: Bug
Reporter: Vimal Sharma


Atlas is currently built with Hive version 1.2
Due to significant changes in Hive2(LLAP), it might be useful to build Atlas 
using the Hive 2.1.0 release.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (ATLAS-1247) Support for hive 2.x

2016-11-09 Thread Shwetha G S (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S resolved ATLAS-1247.

Resolution: Duplicate

> Support for hive 2.x
> 
>
> Key: ATLAS-1247
> URL: https://issues.apache.org/jira/browse/ATLAS-1247
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Shwetha G S
>Assignee: Vimal Sharma
> Attachments: hive2_atlas.patch
>
>
> Atlas hive hook works only with hive 1.x. Need support for hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (ATLAS-1279) Remove QueryPlan attribute from Hive Process entity

2016-11-09 Thread Shwetha G S (JIRA)

[ 
https://issues.apache.org/jira/browse/ATLAS-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15650674#comment-15650674
 ] 

Shwetha G S commented on ATLAS-1279:


1. Removing required attribute queryPlan is not supported currently. So, 
instead of removing the attribute, set the value to 'not supported' for now. 
Also, file a bug to remove this attribute when attribute remove is supported. 
2. HiveDataModelGenerator doesn't exist anymore, so rebase the patch
3. Update hive bridge documentation that column level lineage works only in 
hive 1.2.x server and atlas hive hook should also be compiled with hive 1.2.x

> Remove QueryPlan attribute from Hive Process entity
> ---
>
> Key: ATLAS-1279
> URL: https://issues.apache.org/jira/browse/ATLAS-1279
> Project: Atlas
>  Issue Type: Bug
>Reporter: Vimal Sharma
>Assignee: Vimal Sharma
> Attachments: ATLAS-1279.patch
>
>
> The attribute QueryPlan is a required attribute of a Hive Process entity. 
> This attribute is not used anywhere. Further due to API changes in Hive LLAP 
> version, there is conflict in function call to get JSON Plan of query. The 
> function calls in Hive 1.2 and Hive 2 have different method signature.
> Since, QueryPlan is not used, it should be removed so that Atlas code is 
> consistent for Hive 1.x and Hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ATLAS-1279) Remove QueryPlan attribute from Hive Process entity

2016-11-09 Thread Vimal Sharma (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vimal Sharma updated ATLAS-1279:

Attachment: ATLAS-1279.patch

> Remove QueryPlan attribute from Hive Process entity
> ---
>
> Key: ATLAS-1279
> URL: https://issues.apache.org/jira/browse/ATLAS-1279
> Project: Atlas
>  Issue Type: Bug
>Reporter: Vimal Sharma
>Assignee: Vimal Sharma
> Attachments: ATLAS-1279.patch
>
>
> The attribute QueryPlan is a required attribute of a Hive Process entity. 
> This attribute is not used anywhere. Further due to API changes in Hive LLAP 
> version, there is conflict in function call to get JSON Plan of query. The 
> function calls in Hive 1.2 and Hive 2 have different method signature.
> Since, QueryPlan is not used, it should be removed so that Atlas code is 
> consistent for Hive 1.x and Hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (ATLAS-1081) Atlas jetty server configuration

2016-11-09 Thread Shwetha G S (JIRA)

[ 
https://issues.apache.org/jira/browse/ATLAS-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15650528#comment-15650528
 ] 

Shwetha G S commented on ATLAS-1081:


https://wiki.eclipse.org/Jetty/Howto/High_Load

> Atlas jetty server configuration
> 
>
> Key: ATLAS-1081
> URL: https://issues.apache.org/jira/browse/ATLAS-1081
> Project: Atlas
>  Issue Type: Bug
>Reporter: Shwetha G S
>Assignee: Shwetha G S
>Priority: Critical
> Attachments: ATLAS-1081.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (ATLAS-590) HBaseBasedAuditRepository.start() fails

2016-11-09 Thread Shwetha G S (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S resolved ATLAS-590.
---
Resolution: Not A Problem

With the latest atlas package from trunk, I don't see this error

> HBaseBasedAuditRepository.start() fails
> ---
>
> Key: ATLAS-590
> URL: https://issues.apache.org/jira/browse/ATLAS-590
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Shwetha G S
>Assignee: Shwetha G S
>
> The application doesn't fail, but prints this warning. Need to investigate
> {noformat}
> 2016-03-23 11:01:45,496 WARN  - [main:] ~ Failed to identify the fs of dir 
> hdfs://localhost.localdomain:8020/apps/hbase/data/lib, ignored 
> (DynamicClassLoader:106)
> java.io.IOException: No FileSystem for scheme: hdfs
> at 
> org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2644)
> at 
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2651)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92)
> at 
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)
> at 
> org.apache.hadoop.hbase.util.DynamicClassLoader.(DynamicClassLoader.java:104)
> at 
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.(ProtobufUtil.java:241)
> at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
> at 
> org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:75)
> at 
> org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:105)
> at 
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.retrieveClusterId(ConnectionManager.java:879)
> at 
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(ConnectionManager.java:635)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> at 
> org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:238)
> at 
> org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:218)
> at 
> org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119)
> at 
> org.apache.atlas.repository.audit.HBaseBasedAuditRepository.start(HBaseBasedAuditRepository.java:257)
> at org.apache.atlas.service.Services.start(Services.java:45)
> at 
> org.apache.atlas.web.listeners.GuiceServletConfig.startServices(GuiceServletConfig.java:130)
> at 
> org.apache.atlas.web.listeners.GuiceServletConfig.contextInitialized(GuiceServletConfig.java:124)
> at 
> org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)
> at 
> org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)
> at 
> org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
> at 
> org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)
> at 
> org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
> at 
> org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
> at 
> org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
> at 
> org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
> at 
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> at 
> org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
> at org.eclipse.jetty.server.Server.start(Server.java:387)
> at 
> org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
> at 
> org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> at org.eclipse.jetty.server.Server.doStart(Server.java:354)
> at 
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> at 
> org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:93)
> at org.apache.atlas.Atlas.main(Atlas.java:107)
> 2016-03-23 11:01:45,555 INFO  - [main:] ~ Checking if table 

[jira] [Created] (ATLAS-1279) Remove QueryPlan attribute from Hive Process entity

2016-11-09 Thread Vimal Sharma (JIRA)
Vimal Sharma created ATLAS-1279:
---

 Summary: Remove QueryPlan attribute from Hive Process entity
 Key: ATLAS-1279
 URL: https://issues.apache.org/jira/browse/ATLAS-1279
 Project: Atlas
  Issue Type: Bug
Reporter: Vimal Sharma
Assignee: Vimal Sharma


The attribute QueryPlan is a required attribute of a Hive Process entity. This 
attribute is not used anywhere. Further due to API changes in Hive LLAP 
version, there is conflict in function call to get JSON Plan of query. The 
function calls in Hive 1.2 and Hive 2 have different method signature.

Since, QueryPlan is not used, it should be removed so that Atlas code is 
consistent for Hive 1.x and Hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Build failed in Jenkins: apache-atlas-nightly #466

2016-11-09 Thread Apache Jenkins Server
See 

Changes:

[madhan] ATLAS-1278: Added API to get typedef header info

--
[...truncated 8105 lines...]
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=0=10 
HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=2147483647=10
 HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type=10=-2 
HTTP/1.1" 400 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=Z0pRH2tbDG=10=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=10=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=10=1 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=1=0 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/fulltext?query=dsl_test_type=1=2 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:34 +] "GET 
/api/atlas/discovery/search/dsl?query=from+dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:35 +] "GET 
/api/atlas/discovery/search/dsl?query=from+blah HTTP/1.1" 400 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:35 +] "GET 
/api/atlas/discovery/search?query=* HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:35 +] "GET 
/api/atlas/discovery/search?query=from+dsl_test_type HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:36 +] "GET 
/api/atlas/discovery/search/gremlin?query=g.V.has('type',+'dsl_test_type').toList()
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.638 sec - in 
org.apache.atlas.web.resources.MetadataDiscoveryJerseyResourceIT
Running org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT
127.0.0.1 - - [09/Nov/2016:08:21:39 +] "GET /api/atlas/types/hive_db 
HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [09/Nov/2016:08:21:40 +] "POST /api/atlas/types HTTP/1.1" 400 
- "-" "Java/1.7.0_80"
Tests run: 10, Failures: 1, Errors: 0, Skipped: 9, Time elapsed: 2.329 sec <<< 
FAILURE! - in org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT
setUp(org.apache.atlas.web.resources.DataSetLineageJerseyResourceIT)  Time 
elapsed: 2.236 sec  <<< FAILURE!
org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE failed 
with status 400 (Bad Request) Response Body ({"error":"Unknown datatype: 
DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
 Unknown datatype: DataSet\n\tat 
org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
 
org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
 
org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
 sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\n\tat
 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
 java.lang.reflect.Method.invoke(Method.java:606)\n\tat 
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
 
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
 
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
 
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat