See
<https://builds.apache.org/job/Atlas-master-IntegrationTests/266/display/redirect?page=changes>
Changes:
[madhan] ATLAS-2361: Package each Atlas hook in separate tar files
------------------------------------------
[...truncated 141.85 MB...]
2018-01-13 01:49:05,483 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property
hive_process.clusterName from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,484 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Mapping vertex
org.apache.atlas.repository.graphdb.janus.AtlasJanusVertex@4b7144c7 to atlas
entity Asset.name (EntityGraphRetriever:407)
2018-01-13 01:49:05,484 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property Asset.name from
vertex[id=733416 type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f]
(GraphHelper:485)
2018-01-13 01:49:05,484 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property Asset.name from
vertex[id=733416 type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f]
(GraphHelper:485)
2018-01-13 01:49:05,485 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Mapping vertex
org.apache.atlas.repository.graphdb.janus.AtlasJanusVertex@4b7144c7 to atlas
entity hive_process.queryText (EntityGraphRetriever:407)
2018-01-13 01:49:05,485 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property
hive_process.queryText from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,485 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property
hive_process.queryText from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,485 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Mapping vertex
org.apache.atlas.repository.graphdb.janus.AtlasJanusVertex@4b7144c7 to atlas
entity hive_process.startTime (EntityGraphRetriever:407)
2018-01-13 01:49:05,486 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property
hive_process.startTime from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,486 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property
hive_process.startTime from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,486 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Mapping vertex
org.apache.atlas.repository.graphdb.janus.AtlasJanusVertex@4b7144c7 to atlas
entity hive_process.operationType (EntityGraphRetriever:407)
2018-01-13 01:49:05,487 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property
hive_process.operationType from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,487 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property
hive_process.operationType from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,487 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Mapping vertex
org.apache.atlas.repository.graphdb.janus.AtlasJanusVertex@4b7144c7 to atlas
entity hive_process.queryPlan (EntityGraphRetriever:407)
2018-01-13 01:49:05,488 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property
hive_process.queryPlan from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,488 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property
hive_process.queryPlan from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,488 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Mapping vertex
org.apache.atlas.repository.graphdb.janus.AtlasJanusVertex@4b7144c7 to atlas
entity hive_process.endTime (EntityGraphRetriever:407)
2018-01-13 01:49:05,489 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property hive_process.endTime
from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,489 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property hive_process.endTime
from vertex[id=733416 type=hive_process
guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] (GraphHelper:485)
2018-01-13 01:49:05,489 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
__Process.outputs (GraphHelper:296)
2018-01-13 01:49:05,490 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Mapping system attributes for
relationship (EntityGraphRetriever:771)
2018-01-13 01:49:05,490 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ ==>
AtlasTypeRegistry.getType(process_dataset_outputs) (AtlasTypeRegistry:79)
2018-01-13 01:49:05,490 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ <==
AtlasTypeRegistry.getType(process_dataset_outputs):
org.apache.atlas.type.AtlasRelationshipType@a0a5e68 (AtlasTypeRegistry:105)
2018-01-13 01:49:05,491 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Mapping vertex
org.apache.atlas.repository.graphdb.janus.AtlasJanusVertex@4b6ae3e7 to atlas
entity Asset.name (EntityGraphRetriever:407)
2018-01-13 01:49:05,491 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property Asset.name from
vertex[id=315400 type=hive_table guid=f3537e41-700a-4c83-8262-aa99ad8e8374]
(GraphHelper:485)
2018-01-13 01:49:05,491 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property Asset.name from
vertex[id=315400 type=hive_table guid=f3537e41-700a-4c83-8262-aa99ad8e8374]
(GraphHelper:485)
2018-01-13 01:49:05,492 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:AssetLocation (GraphHelper:296)
2018-01-13 01:49:05,492 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:ExternalReferenceLink (GraphHelper:296)
2018-01-13 01:49:05,492 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:AttachedNoteLogEntry (GraphHelper:296)
2018-01-13 01:49:05,493 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:AttachedFeedback (GraphHelper:296)
2018-01-13 01:49:05,493 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
__Process.inputs (GraphHelper:296)
2018-01-13 01:49:05,493 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Mapping system attributes for
relationship (EntityGraphRetriever:771)
2018-01-13 01:49:05,493 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ ==>
AtlasTypeRegistry.getType(dataset_process_inputs) (AtlasTypeRegistry:79)
2018-01-13 01:49:05,494 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ <==
AtlasTypeRegistry.getType(dataset_process_inputs):
org.apache.atlas.type.AtlasRelationshipType@65fb08a0 (AtlasTypeRegistry:105)
2018-01-13 01:49:05,494 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Mapping vertex
org.apache.atlas.repository.graphdb.janus.AtlasJanusVertex@4b6a14af to atlas
entity Asset.name (EntityGraphRetriever:407)
2018-01-13 01:49:05,494 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property Asset.name from
vertex[id=262352 type=hdfs_path guid=961710c8-09d7-44ec-9a6c-879f5c6780a7]
(GraphHelper:485)
2018-01-13 01:49:05,495 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Reading property Asset.name from
vertex[id=262352 type=hdfs_path guid=961710c8-09d7-44ec-9a6c-879f5c6780a7]
(GraphHelper:485)
2018-01-13 01:49:05,495 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:ReferenceableFacets (GraphHelper:296)
2018-01-13 01:49:05,495 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Found null (GraphHelper:418)
2018-01-13 01:49:05,496 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:SoftwareServerAssetUse (GraphHelper:296)
2018-01-13 01:49:05,496 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
__hive_column_lineage.query (GraphHelper:296)
2018-01-13 01:49:05,496 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:SemanticAssignment (GraphHelper:296)
2018-01-13 01:49:05,497 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:ExternalIdentifierLink (GraphHelper:296)
2018-01-13 01:49:05,497 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:AttachedTag (GraphHelper:296)
2018-01-13 01:49:05,497 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:MediaReference (GraphHelper:296)
2018-01-13 01:49:05,497 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:Contributor (GraphHelper:296)
2018-01-13 01:49:05,498 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:AttachedRating (GraphHelper:296)
2018-01-13 01:49:05,498 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:ExternalIdentifierScope (GraphHelper:296)
2018-01-13 01:49:05,498 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:MeetingOnReferencable (GraphHelper:296)
2018-01-13 01:49:05,499 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:ToDoOnReferencable (GraphHelper:296)
2018-01-13 01:49:05,499 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ Finding edges for vertex[id=733416
type=hive_process guid=2c14cd8f-cc4e-48be-81f4-cecf4bdc789f] with label
r:AttachedLike (GraphHelper:296)
2018-01-13 01:49:05,500 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ <==
getById(2c14cd8f-cc4e-48be-81f4-cecf4bdc789f):
AtlasEntityWithExtInfo{entity=AtlasEntity{AtlasStruct{typeName='hive_process',
attributes=[owner:null,
outputs:[AtlasObjectId{guid='f3537e41-700a-4c83-8262-aa99ad8e8374',
typeName='hive_table', uniqueAttributes={}}], queryGraph:null,
recentQueries:[create external table tablempmvhxvrqd(id string) location
'pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/parentpath-data-mka3u1xygk'],
qualifiedName:default.tablempmvhxvrqd@primary:1515808143000,
inputs:[AtlasObjectId{guid='961710c8-09d7-44ec-9a6c-879f5c6780a7',
typeName='hdfs_path', uniqueAttributes={}}], description:null,
userName:jenkins, queryId:create external table tablempmvhxvrqd(id string)
location
'pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/parentpath-data-mka3u1xygk',
clusterName:primary, name:create external table tablempmvhxvrqd(id string)
location
'pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/parentpath-data-mka3u1xygk',
queryText:create external table tablempmvhxvrqd(id string) location
'pfile:/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/parentpath-data-mka3u1xygk',
startTime:Sat Jan 13 01:49:04 UTC 2018, operationType:CREATETABLE,
queryPlan:{}, endTime:Sat Jan 13 01:49:04 UTC
2018]}guid='2c14cd8f-cc4e-48be-81f4-cecf4bdc789f', status=ACTIVE,
createdBy='admin', updatedBy='admin', createTime=2018-01-13T01:49:04.698Z,
updateTime=2018-01-13T01:49:04.698Z, version=0,
relationshipAttributes=[outputs:[AtlasRelatedObjectId{AtlasObjectId{guid='f3537e41-700a-4c83-8262-aa99ad8e8374',
typeName='hive_table', uniqueAttributes={}}displayText='tablempmvhxvrqd',
relationshipGuid='ed4ead19-d3a8-4bcf-aa15-ac53c0f776c8',
relationshipAttributes=AtlasStruct{typeName='process_dataset_outputs',
attributes=[]}}], knownLocations:[], externalReferences:[], notes:[],
comments:[],
inputs:[AtlasRelatedObjectId{AtlasObjectId{guid='961710c8-09d7-44ec-9a6c-879f5c6780a7',
typeName='hdfs_path',
uniqueAttributes={}}displayText='/home/jenkins/jenkins-slave/workspace/atlas-master-integrationtests/addons/hive-bridge/target/parentpath-data-mka3u1xygk',
relationshipGuid='2582599f-8aeb-4e43-a5f7-2cc43698c00d',
relationshipAttributes=AtlasStruct{typeName='dataset_process_inputs',
attributes=[]}}], relatedEntity:null, consumedBy:[], columnLineages:[],
meanings:[], alsoKnownAs:[], tags:[], embeddedMetadata:[], contributor:[],
starRatings:[], managedResources:[], meetings:[], todos:[], likes:[]],
classifications=[], },AtlasEntityExtInfo{referredEntities={}}}
(AtlasEntityStoreV1:111)
2018-01-13 01:49:05,500 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ graph commit
(GraphTransactionInterceptor:65)
2018-01-13 01:49:05,500 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ ==> releaseLockedObjects():
lockedGuids.size: 0 (GraphTransactionInterceptor$ObjectUpdateSynchronizer:187)
2018-01-13 01:49:05,501 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ <== releaseLockedObjects():
lockedGuids.size: 0 (GraphTransactionInterceptor$ObjectUpdateSynchronizer:197)
2018-01-13 01:49:05,501 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ ==>
AtlasTypeRegistry.getType(hive_process) (AtlasTypeRegistry:79)
2018-01-13 01:49:05,501 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ <==
AtlasTypeRegistry.getType(hive_process):
org.apache.atlas.type.AtlasEntityType@1d545944 (AtlasTypeRegistry:105)
2018-01-13 01:49:05,501 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~
PERF|EntityResource.getEntityDefinition(2c14cd8f-cc4e-48be-81f4-cecf4bdc789f)|29
(AtlasPerfTracer:77)
2018-01-13 01:49:05,502 DEBUG - [qtp1290317587-781 -
b8016fff-f0ac-42d9-a423-4f8b6623a6bb:] ~ <==
EntityResource.getEntityDefinition(2c14cd8f-cc4e-48be-81f4-cecf4bdc789f)
(EntityResource:683)
127.0.0.1 - - [13/Jan/2018:01:49:05 +0000] "GET
//localhost:31000/api/atlas/entities/2c14cd8f-cc4e-48be-81f4-cecf4bdc789f
HTTP/1.1" 200 2007 "-" "Java/1.8.0_152"
Tests run: 45, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 423.583 sec
<<< FAILURE! - in TestSuite
testDropDatabaseWithoutCascade(org.apache.atlas.hive.hook.HiveHookIT) Time
elapsed: 5.888 sec <<< FAILURE!
java.lang.AssertionError: Entity was not supposed to exist for typeName =
hive_db, attributeName = qualifiedName, attributeValue = dberarjcukbj@primary
at org.testng.Assert.fail(Assert.java:94)
at
org.apache.atlas.hive.hook.HiveHookIT.testDropDatabaseWithoutCascade(HiveHookIT.java:1493)
Results :
Failed tests:
HiveHookIT.testDropDatabaseWithoutCascade:1493 Entity was not supposed to
exist for typeName = hive_db, attributeName = qualifiedName, attributeValue =
dberarjcukbj@primary
Tests run: 45, Failures: 1, Errors: 0, Skipped: 0
[INFO]
[INFO] --- jetty-maven-plugin:9.3.14.v20161028:stop (stop-jetty) @ hive-bridge
---
[INFO] Waiting 10 seconds for jetty to stop
[INFO] Stopped ServerConnector@568508f6{HTTP/1.1,[http/1.1]}{0.0.0.0:31000}
[INFO] Closing Spring root WebApplicationContext
2018-01-13 01:49:06,120 DEBUG - [ShutdownMonitor:] ~ ==>
AtlasAuthorizationFilter destroy (AtlasAuthorizationFilter:78)
2018-01-13 01:49:06,121 DEBUG - [ShutdownMonitor:] ~ ==> +SimpleAtlasAuthorizer
cleanUp (SimpleAtlasAuthorizer:327)
2018-01-13 01:49:06,121 DEBUG - [ShutdownMonitor:] ~ <== +SimpleAtlasAuthorizer
cleanUp (SimpleAtlasAuthorizer:338)
2018-01-13 01:49:06,121 INFO - [ShutdownMonitor:] ~ Stopping service
org.apache.atlas.notification.NotificationHookConsumer (Services:69)
2018-01-13 01:49:06,122 INFO - [ShutdownMonitor:] ~ ==> stopConsumerThreads()
(NotificationHookConsumer:189)
2018-01-13 01:49:06,122 INFO - [ShutdownMonitor:] ~ ==> HookConsumer
shutdown() (NotificationHookConsumer$HookConsumer:515)
2018-01-13 01:49:06,123 INFO - [ShutdownMonitor:] ~
[atlas-hook-consumer-thread], Shutting down (Logging$class:68)
2018-01-13 01:49:06,125 INFO - [NotificationHookConsumer thread-0:] ~ closing
NotificationConsumer (NotificationHookConsumer$HookConsumer:335)
2018-01-13 01:49:06,132 INFO - [NotificationHookConsumer thread-0:] ~ <==
HookConsumer doWork() (NotificationHookConsumer$HookConsumer:340)
2018-01-13 01:49:06,133 INFO - [ShutdownMonitor:] ~
[atlas-hook-consumer-thread], Shutdown completed (Logging$class:68)
2018-01-13 01:49:06,133 INFO - [NotificationHookConsumer thread-0:] ~
[atlas-hook-consumer-thread], Stopped (Logging$class:68)
2018-01-13 01:49:06,135 INFO - [ShutdownMonitor:] ~ <== HookConsumer
shutdown() (NotificationHookConsumer$HookConsumer:533)
2018-01-13 01:49:06,135 INFO - [ShutdownMonitor:] ~ <== stopConsumerThreads()
(NotificationHookConsumer:199)
2018-01-13 01:49:06,136 INFO - [ShutdownMonitor:] ~ ==>
KafkaNotification.close() (KafkaNotification:163)
2018-01-13 01:49:06,139 INFO - [ShutdownMonitor:] ~ <==
KafkaNotification.close() (KafkaNotification:171)
2018-01-13 01:49:06,139 INFO - [ShutdownMonitor:] ~ Stopping service
org.apache.atlas.kafka.KafkaNotification (Services:69)
2018-01-13 01:49:06,140 INFO - [ShutdownMonitor:] ~ ==>
KafkaNotification.stop() (KafkaNotification:135)
2018-01-13 01:49:06,140 INFO - [ShutdownMonitor:] ~ <==
KafkaNotification.stop() (KafkaNotification:137)
2018-01-13 01:49:06,140 INFO - [ShutdownMonitor:] ~ Stopping service
org.apache.atlas.kafka.EmbeddedKafkaServer (Services:69)
2018-01-13 01:49:06,140 INFO - [ShutdownMonitor:] ~ ==>
EmbeddedKafkaServer.stop(isEmbedded=true) (EmbeddedKafkaServer:91)
2018-01-13 01:49:07,829 INFO - [ShutdownMonitor:] ~ <==
EmbeddedKafka.stop(isEmbedded=true) (EmbeddedKafkaServer:101)
2018-01-13 01:49:07,830 INFO - [ShutdownMonitor:] ~ Stopping service
org.apache.atlas.web.service.ActiveInstanceElectorService (Services:69)
2018-01-13 01:49:07,830 INFO - [ShutdownMonitor:] ~ HA is not enabled, no need
to stop leader election service (ActiveInstanceElectorService:126)
2018-01-13 01:49:07,954 DEBUG - [main-SendThread(localhost:19026):] ~ ==>
InMemoryJAASConfiguration.getAppConfigurationEntry(Client)
(InMemoryJAASConfiguration:208)
2018-01-13 01:49:07,954 DEBUG - [main-SendThread(localhost:19026):] ~ <==
InMemoryJAASConfiguration.getAppConfigurationEntry(Client): {}
(InMemoryJAASConfiguration:238)
2018-01-13 01:49:07,955 WARN - [main-SendThread(localhost:19026):] ~ Session
0x160ed2e404d0000 for server null, unexpected error, closing socket connection
and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
[INFO] Shutting down log4j
[INFO] Stopped
o.e.j.m.p.JettyWebAppContext@5280a489{/,file://<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/webapp/target/atlas-webapp-1.0.0-SNAPSHOT/,UNAVAILABLE}{/home/jenkins/jenkins-slave/workspace/Atlas-master-IntegrationTests/webapp/target/atlas-webapp-1.0.0-SNAPSHOT.war}>
[INFO] Server reports itself as stopped
[INFO]
[INFO] --- maven-source-plugin:2.4:jar-no-fork (attach-sources) @ hive-bridge
---
[INFO] Building jar:
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/addons/hive-bridge/target/hive-bridge-1.0.0-SNAPSHOT-sources.jar>
[INFO]
[INFO] --- maven-source-plugin:2.4:test-jar-no-fork (attach-sources) @
hive-bridge ---
[INFO] Building jar:
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/addons/hive-bridge/target/hive-bridge-1.0.0-SNAPSHOT-test-sources.jar>
[INFO]
[INFO] --- maven-failsafe-plugin:2.18.1:verify (verify) @ hive-bridge ---
[INFO] Failsafe report directory:
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/addons/hive-bridge/target/failsafe-reports>
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Atlas Server Build Tools .................... SUCCESS [ 0.501 s]
[INFO] apache-atlas ....................................... SUCCESS [ 3.370 s]
[INFO] Apache Atlas Test Utility Tools .................... SUCCESS [ 9.309 s]
[INFO] Apache Atlas Integration ........................... SUCCESS [ 17.708 s]
[INFO] Apache Atlas Common ................................ SUCCESS [ 6.778 s]
[INFO] Apache Atlas Client ................................ SUCCESS [ 0.503 s]
[INFO] atlas-client-common ................................ SUCCESS [ 5.941 s]
[INFO] atlas-client-v1 .................................... SUCCESS [ 6.483 s]
[INFO] Apache Atlas Server API ............................ SUCCESS [ 4.897 s]
[INFO] Apache Atlas Notification .......................... SUCCESS [ 8.008 s]
[INFO] atlas-client-v2 .................................... SUCCESS [ 5.161 s]
[INFO] Apache Atlas Graph Database Projects ............... SUCCESS [ 0.391 s]
[INFO] Apache Atlas Graph Database API .................... SUCCESS [ 4.278 s]
[INFO] Graph Database Common Code ......................... SUCCESS [ 4.780 s]
[INFO] Apache Atlas JanusGraph DB Impl .................... SUCCESS [ 10.023 s]
[INFO] Apache Atlas Graph Database Implementation Dependencies SUCCESS [ 1.802
s]
[INFO] Shaded version of Apache hbase client .............. SUCCESS [ 7.448 s]
[INFO] Apache Atlas Titan 0.5.4 Graph DB Impl ............. SUCCESS [ 35.588 s]
[INFO] Shaded version of Apache hbase server .............. SUCCESS [ 19.297 s]
[INFO] Apache Atlas Repository ............................ SUCCESS [ 24.205 s]
[INFO] Apache Atlas Authorization ......................... SUCCESS [ 5.681 s]
[INFO] Apache Atlas UI .................................... SUCCESS [01:05 min]
[INFO] Apache Atlas Web Application ....................... SUCCESS [02:59 min]
[INFO] Apache Atlas Documentation ......................... SUCCESS [ 3.979 s]
[INFO] Apache Atlas FileSystem Model ...................... SUCCESS [ 2.236 s]
[INFO] Apache Atlas Plugin Classloader .................... SUCCESS [ 5.787 s]
[INFO] Apache Atlas Hive Bridge Shim ...................... SUCCESS [ 4.926 s]
[INFO] Apache Atlas Hive Bridge ........................... FAILURE [08:22 min]
[INFO] Apache Atlas Falcon Bridge Shim .................... SKIPPED
[INFO] Apache Atlas Falcon Bridge ......................... SKIPPED
[INFO] Apache Atlas Sqoop Bridge Shim ..................... SKIPPED
[INFO] Apache Atlas Sqoop Bridge .......................... SKIPPED
[INFO] Apache Atlas Storm Bridge Shim ..................... SKIPPED
[INFO] Apache Atlas Storm Bridge .......................... SKIPPED
[INFO] Apache Atlas Hbase Bridge Shim ..................... SKIPPED
[INFO] Apache Atlas Hbase Bridge .......................... SKIPPED
[INFO] Apache Atlas Distribution .......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:48 min
[INFO] Finished at: 2018-01-13T01:49:08Z
[INFO] Final Memory: 562M/3144M
[INFO] ------------------------------------------------------------------------
log4j:WARN No appenders could be found for logger
(org.apache.atlas.security.InMemoryJAASConfiguration).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more
info.
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-failsafe-plugin:2.18.1:verify (verify) on
project hive-bridge: There are test failures.
[ERROR]
[ERROR] Please refer to
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/addons/hive-bridge/target/failsafe-reports>
for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hive-bridge
Build step 'Execute shell' marked build as failure
[CHECKSTYLE] Collecting checkstyle analysis files...
[CHECKSTYLE] Searching for all files in
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/> that match
the pattern **/target/checkstyle-result.xml
[CHECKSTYLE] Parsing 26 files in
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/>
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/addons/hdfs-model/target/checkstyle-result.xml>
with 0 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/addons/hive-bridge-shim/target/checkstyle-result.xml>
with 15 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/authorization/target/checkstyle-result.xml>
with 476 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/client/client-v1/target/checkstyle-result.xml>
with 1356 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/client/client-v2/target/checkstyle-result.xml>
with 1696 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/client/common/target/checkstyle-result.xml>
with 2179 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/client/target/checkstyle-result.xml>
with 2179 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/common/target/checkstyle-result.xml>
with 3115 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/dashboardv2/target/checkstyle-result.xml>
with 3115 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/docs/target/checkstyle-result.xml>
with 3115 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/graphdb/api/target/checkstyle-result.xml>
with 3387 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/graphdb/common/target/checkstyle-result.xml>
with 3586 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/graphdb/graphdb-impls/target/checkstyle-result.xml>
with 3586 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/graphdb/janus/target/checkstyle-result.xml>
with 4585 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/graphdb/target/checkstyle-result.xml>
with 4585 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/graphdb/titan0/target/checkstyle-result.xml>
with 7044 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/intg/target/checkstyle-result.xml>
with 17302 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/notification/target/checkstyle-result.xml>
with 18472 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/plugin-classloader/target/checkstyle-result.xml>
with 18585 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/repository/target/checkstyle-result.xml>
with 36897 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/server-api/target/checkstyle-result.xml>
with 37109 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/shaded/hbase-client-shaded/target/checkstyle-result.xml>
with 37109 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/shaded/hbase-server-shaded/target/checkstyle-result.xml>
with 37109 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/target/checkstyle-result.xml>
with 37109 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/test-tools/target/checkstyle-result.xml>
with 37146 unique warnings and 0 duplicates.
[CHECKSTYLE] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/webapp/target/checkstyle-result.xml>
with 44927 unique warnings and 0 duplicates.
<Git Blamer> Using GitBlamer to create author and commit information for all
warnings.
<Git Blamer> GIT_COMMIT=59c676961bf8aeb31ca2704463ae966665800e6f,
workspace=<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/>
> git rev-parse 59c676961bf8aeb31ca2704463ae966665800e6f^{commit} # timeout=10
[FINDBUGS] Collecting findbugs analysis files...
[FINDBUGS] Searching for all files in
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/> that match
the pattern **/target/findbugs.xml
[FINDBUGS] Parsing 17 files in
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/>
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/addons/hive-bridge-shim/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/authorization/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/client/client-v1/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/client/client-v2/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/client/common/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/common/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/graphdb/api/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/graphdb/common/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/graphdb/janus/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/graphdb/titan0/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/intg/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/notification/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/plugin-classloader/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/repository/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/server-api/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/test-tools/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
[FINDBUGS] Successfully parsed file
<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/webapp/target/findbugs.xml>
with 0 unique warnings and 0 duplicates.
<Git Blamer> Using GitBlamer to create author and commit information for all
warnings.
<Git Blamer> GIT_COMMIT=59c676961bf8aeb31ca2704463ae966665800e6f,
workspace=<https://builds.apache.org/job/Atlas-master-IntegrationTests/ws/>
Archiving artifacts
[Fast Archiver] No prior successful build to compare, so performing full copy
of artifacts
TestNG Reports Processing: START
Looking for TestNG results report in workspace using pattern:
**/target/surefire-reports/testng-results.xml,**/target/failsafe-reports/testng-results.xml
Saving reports...
Processing
'/x1/jenkins/jenkins-home/jobs/Atlas-master-IntegrationTests/builds/266/testng/testng-results-1.xml'
Processing
'/x1/jenkins/jenkins-home/jobs/Atlas-master-IntegrationTests/builds/266/testng/testng-results.xml'
0.584795% of tests failed, which exceeded threshold of 0%. Marking build as
UNSTABLE
TestNG Reports Processing: FINISH
