date:20161017

Re: Web UI problem with Atlas 0.7

2016-10-17 Thread Shwetha Shivalingamurthy

Can you enable debug logs in atlas-log4j.xml and check if there is any
issue with service startup?

Regards,
Shwetha

On 17/10/16, 9:52 PM, "Ismaël Mejía"  wrote:

>Hello again,
>
>I tried with the git master version and I still have the same issue of not
>seeing anything after login in the WebUI.
>
>What other data/table does the GUI depend on ? (apart of the given
>Types/Entities), because I think there is something else that maybe I am
>missing.
>
>Regards,
>Ismaël
>
>On Mon, Oct 17, 2016 at 2:10 PM, Jean-Baptiste Onofré 
>wrote:
>
>> Hi guys,
>>
>> As 0.7.0 is not super useful with this fix, I would propose to release
>> 0.7.1 at least to fix that.
>>
>> I have couple of other Jira in my bucket I would like to include in a
>> 0.7.1 release as well.
>>
>> Thoughts ?
>>
>> Regards
>> JB
>>
>>
>> On 10/17/2016 10:25 AM, Keval Bhatt wrote:
>>
>>> Hi Ismaël
>>>
>>> Recently Atlas UI was not loading after fresh build due to
>>> jquery-asBreadcrumbs plugin changes and this is fixed on master.
>>>
>>> ATLAS-1199  
>>>
>>> Please checkout the latest code from master
>>> 
>>>
>>>
>>> Thanks,
>>> Keval Bhatt
>>>
>>> On Mon, Oct 17, 2016 at 1:15 PM, Ismaël Mejía 
>>>wrote:
>>>
>>> Hello,

 I used Atlas 0.5 and some of the earlier version of Atlas 0.7 with no
 issues.
 However I am trying to use the released version of Atlas 0.7 and I am
 having
 some problems. I built the binary distribution with embedded
hbase/solr
 following the instructions from the website:

 mvn clean package -Pdist,embedded-hbase-solr -DskipTests

 Then I start Atlas like this:

 export MANAGE_LOCAL_SOLR=true
 export MANAGE_LOCAL_HBASE=true
 bin/atlas_start.py

 If I go to the initial webpage http://localhost:21000/

 I see the login/password page and once I log in with the admin user I
 get a
 blank page.

 I considered that maybe I was missing some basic data so I ran the
 quickstart:

 bin/quick_start.py

 Then I log in again but still I can't see any data. Am I missing
 something
 ?

 The weird thing is that I don't have any exception for the web app,
the
 only
 exception in the logs is on atlas_start:

 2016-10-17 09:06:48,174 INFO  - [main:] ~ Guice modules loaded
 (GuiceServletConfig:120)
 2016-10-17 09:06:48,177 INFO  - [main:] ~ Starting services
 (GuiceServletConfig:140)
 2016-10-17 09:06:48,224 WARN  - [main-SendThread(localhost:9026):] ~
 Session 0x0 for server null, unexpected error, closing socket
connection
 and attempting reconnect (ClientCnxn$SendThread:1102)
 java.net.ConnectException: Connection refused
 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
 at
 sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
 at
 org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
 ClientCnxnSocketNIO.java:361)
 at org.apache.zookeeper.ClientCnxn$SendThread.run(
 ClientCnxn.java:1081)
 2016-10-17 09:06:48,255 INFO  - [main:] ~ HA is disabled. Hence
creating
 table on startup. (HBaseBasedAuditRepository:287)
 2016-10-17 09:06:48,256 INFO  - [main:] ~ Checking if table
 apache_atlas_entity_audit exists (HBaseBasedAuditRepository:249)
 2016-10-17 09:06:48,263 INFO  - [main:] ~ Creating table
 apache_atlas_entity_audit (HBaseBasedAuditRepository:251)
 2016-10-17 09:06:49,326 WARN  - [main-SendThread(localhost:9026):] ~
 Session 0x0 for server null, unexpected error, closing socket
connection
 and attempting reconnect (ClientCnxn$SendThread:1102)
 java.net.ConnectException: Connection refused
 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
 at
 sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
 at
 org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
 ClientCnxnSocketNIO.java:361)
 at org.apache.zookeeper.ClientCnxn$SendThread.run(
 ClientCnxn.java:1081)

 and also I found this exception when the quick_start script creates
the
 first entity:

 2016-10-17 09:21:40,566 WARN  - [qtp161960012-16 -
 888beb21-202d-4e96-9750-25d5ebe3bcac:] ~ The configuration
 auto.commit.enable = false was supplied but isn't a known config.
 (AbstractConfig:186)
 2016-10-17 09:21:40,700 WARN  - [kafka-producer-network-thread |
 producer-1:] ~ Error while fetching metadata with correlation id 0 :
 {ATLAS_ENTITIES=LEADER_NOT_AVAILABLE}
 (NetworkClient$DefaultMetadataUpdater:600)
 2016-10-17 09:21:40,732 WARN  -
 [org.apache.atlas.kafka.KafkaNotification:Controller-
 1-to-broker-1-send-thread:]
 ~
 [org.apache.atlas.kafka.KafkaNotification:Controller-
 1-to-broker-1-send-thread],
 Control

Re: Review Request 52954: ATLAS-1227: added support for attribute constraints in the model

2016-10-17 Thread Madhan Neethiraj


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52954/
---

(Updated Oct. 18, 2016, 2:52 a.m.)


Review request for atlas.


Changes
---

updated to address review comments.


Bugs: ATLAS-1227
https://issues.apache.org/jira/browse/ATLAS-1227


Repository: atlas


Description
---

Added support for constraints in entity attributes. Following 2 constraints are 
added in this patch, which provide equivalent of isComposite and 
reverseAtributeName fields in AttributeInfo: foreignKey, mappedFromRef.

Using these constraints, hive_column.table and hive_table.columns would be 
modeled as below:

{
  "name": "hive_column",
  "attributeDefs": [
{
  "name": "table",
  "typeName": "hive_table",
  "constraintDefs": [
{
  "type": "foreignKey",
  "params": {
"onDelete": "cascade"
  }
}
  ]
}
  ]
}

{
  "name": "hive_table",
  "attributeDefs": [
{
  "name": "columns",
  "typeName": "array",
  "constraintDefs": [
{
  "type": "mappedFromRef",
  "params": {
"refAttribute": "table"
  }
}
  ]
}
  ]
}


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 55bff2b 
  intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 8813542 
  intg/src/main/java/org/apache/atlas/type/AtlasTypeUtil.java 264e9a8 
  intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java 5b38e3c 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
 ea1b03b 

Diff: https://reviews.apache.org/r/52954/diff/


Testing
---

- added unit tests
- verified that existing isComposite/reverseAttributeName fields are mapped to 
constraints correctly (when accessing entity-def via TypesREST API)


Thanks,

Madhan Neethiraj

Build failed in Jenkins: apache-atlas-nightly #445

2016-10-17 Thread Apache Jenkins Server

See 

Changes:

[madhan] Added Madhan Neethiraj as committer

--
[...truncated 9704 lines...]
127.0.0.1 - - [17/Oct/2016:21:34:31 +] "GET 
/api/atlas/entities/0d60efaf-27cd-4c10-8ac0-1652a00d4daf HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:31 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:31 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:31 +] "GET 
/api/atlas/entities/0d60efaf-27cd-4c10-8ac0-1652a00d4daf HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:31 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablenokbracryu@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:31 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablenokbracryu@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:31 +] "GET 
/api/atlas/entities/d9f2630b-c430-4f12-a1ba-75f3d6667f89 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:34 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablenokbracryu@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:34 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablenokbracryu@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:34 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablenokbracryu@primary:1476740065000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:34 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablenokbracryu@primary:1476740065000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:34 +] "GET 
/api/atlas/entities/e4bbe333-9ac9-49e8-8e90-a967e6223933 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:34 +] "GET 
/api/atlas/entities/d9f2630b-c430-4f12-a1ba-75f3d6667f89 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:34 +] "GET 
/api/atlas/entities/0d60efaf-27cd-4c10-8ac0-1652a00d4daf HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:34 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:34 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:34 +] "GET 
/api/atlas/entities/0d60efaf-27cd-4c10-8ac0-1652a00d4daf HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:36 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablenokbracryu@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:36 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablenokbracryu@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:37 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablenokbracryu@primary:1476740065000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:37 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablenokbracryu@primary:1476740065000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:37 +] "GET 
/api/atlas/entities/e4bbe333-9ac9-49e8-8e90-a967e6223933 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:37 +] "GET 
/api/atlas/entities/d9f2630b-c430-4f12-a1ba-75f3d6667f89 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:37 +] "GET 
/api/atlas/entities/43077dbd-7548-493d-87fa-a166824300df HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:37 +] "GET 
/api/atlas/entities/0d60efaf-27cd-4c10-8ac0-1652a00d4daf HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:21:34:37 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p

Re: Review Request 52954: ATLAS-1227: added support for attribute constraints in the model

2016-10-17 Thread Suma Shivaprasad


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52954/#review152954
---




intg/src/main/java/org/apache/atlas/type/AtlasStructType.java (line 359)


need to handle case where foreign key is set independently with onDelete = 
null which translates to reverseAttributeName like we discussed


- Suma Shivaprasad


On Oct. 17, 2016, 7:24 p.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/52954/
> ---
> 
> (Updated Oct. 17, 2016, 7:24 p.m.)
> 
> 
> Review request for atlas.
> 
> 
> Bugs: ATLAS-1227
> https://issues.apache.org/jira/browse/ATLAS-1227
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Added support for constraints in entity attributes. Following 2 constraints 
> are added in this patch, which provide equivalent of isComposite and 
> reverseAtributeName fields in AttributeInfo: foreignKey, mappedFromRef.
> 
> Using these constraints, hive_column.table and hive_table.columns would be 
> modeled as below:
> 
> {
>   "name": "hive_column",
>   "attributeDefs": [
> {
>   "name": "table",
>   "typeName": "hive_table",
>   "constraintDefs": [
> {
>   "type": "foreignKey",
>   "params": {
> "onDelete": "cascade"
>   }
> }
>   ]
> }
>   ]
> }
> 
> {
>   "name": "hive_table",
>   "attributeDefs": [
> {
>   "name": "columns",
>   "typeName": "array",
>   "constraintDefs": [
> {
>   "type": "mappedFromRef",
>   "params": {
> "refAttribute": "table"
>   }
> }
>   ]
> }
>   ]
> }
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
> 55bff2b 
>   intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 8813542 
>   intg/src/main/java/org/apache/atlas/type/AtlasTypeUtil.java 264e9a8 
>   intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java 5b38e3c 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
>  ea1b03b 
> 
> Diff: https://reviews.apache.org/r/52954/diff/
> 
> 
> Testing
> ---
> 
> - added unit tests
> - verified that existing isComposite/reverseAttributeName fields are mapped 
> to constraints correctly (when accessing entity-def via TypesREST API)
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>

Re: Review Request 52954: ATLAS-1227: added support for attribute constraints in the model

2016-10-17 Thread Suma Shivaprasad


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52954/#review152953
---




intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java (line 486)


comment needs to be changed for supported type  from foreignKeyRef to 
mappedFromRef


- Suma Shivaprasad


On Oct. 17, 2016, 7:24 p.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/52954/
> ---
> 
> (Updated Oct. 17, 2016, 7:24 p.m.)
> 
> 
> Review request for atlas.
> 
> 
> Bugs: ATLAS-1227
> https://issues.apache.org/jira/browse/ATLAS-1227
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Added support for constraints in entity attributes. Following 2 constraints 
> are added in this patch, which provide equivalent of isComposite and 
> reverseAtributeName fields in AttributeInfo: foreignKey, mappedFromRef.
> 
> Using these constraints, hive_column.table and hive_table.columns would be 
> modeled as below:
> 
> {
>   "name": "hive_column",
>   "attributeDefs": [
> {
>   "name": "table",
>   "typeName": "hive_table",
>   "constraintDefs": [
> {
>   "type": "foreignKey",
>   "params": {
> "onDelete": "cascade"
>   }
> }
>   ]
> }
>   ]
> }
> 
> {
>   "name": "hive_table",
>   "attributeDefs": [
> {
>   "name": "columns",
>   "typeName": "array",
>   "constraintDefs": [
> {
>   "type": "mappedFromRef",
>   "params": {
> "refAttribute": "table"
>   }
> }
>   ]
> }
>   ]
> }
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 
> 55bff2b 
>   intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 8813542 
>   intg/src/main/java/org/apache/atlas/type/AtlasTypeUtil.java 264e9a8 
>   intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java 5b38e3c 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
>  ea1b03b 
> 
> Diff: https://reviews.apache.org/r/52954/diff/
> 
> 
> Testing
> ---
> 
> - added unit tests
> - verified that existing isComposite/reverseAttributeName fields are mapped 
> to constraints correctly (when accessing entity-def via TypesREST API)
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>

Build failed in Jenkins: apache-atlas-nightly #443

2016-10-17 Thread Apache Jenkins Server

See 

Changes:

[sumasai.shivaprasad] ATLAS-1225: Updated AtlasTypeDefGraphStore to use 
AtlasTypesRegistry, to

--
[...truncated 9702 lines...]
127.0.0.1 - - [17/Oct/2016:19:40:00 +] "GET 
/api/atlas/entities/4126e1ab-9446-443f-8e2e-97fe6d581a47 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:00 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:00 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:00 +] "GET 
/api/atlas/entities/4126e1ab-9446-443f-8e2e-97fe6d581a47 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:00 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablejpybp6k5yq@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:00 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablejpybp6k5yq@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:00 +] "GET 
/api/atlas/entities/ea6380b9-f6f6-4ff1-b829-99c185f430bb HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:03 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablejpybp6k5yq@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:03 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablejpybp6k5yq@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:03 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablejpybp6k5yq@primary:1476733194000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:03 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablejpybp6k5yq@primary:1476733194000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:03 +] "GET 
/api/atlas/entities/690153ed-7104-4fd8-ac98-1659a0eefb11 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:03 +] "GET 
/api/atlas/entities/ea6380b9-f6f6-4ff1-b829-99c185f430bb HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:03 +] "GET 
/api/atlas/entities/4126e1ab-9446-443f-8e2e-97fe6d581a47 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:03 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:03 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:03 +] "GET 
/api/atlas/entities/4126e1ab-9446-443f-8e2e-97fe6d581a47 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:05 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablejpybp6k5yq@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:05 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablejpybp6k5yq@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:05 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablejpybp6k5yq@primary:1476733194000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:05 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablejpybp6k5yq@primary:1476733194000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:05 +] "GET 
/api/atlas/entities/690153ed-7104-4fd8-ac98-1659a0eefb11 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:05 +] "GET 
/api/atlas/entities/ea6380b9-f6f6-4ff1-b829-99c185f430bb HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:05 +] "GET 
/api/atlas/entities/e98d673c-69df-4b79-967d-1e243fe7e69b HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:05 +] "GET 
/api/atlas/entities/4126e1ab-9446-443f-8e2e-97fe6d581a47 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:19:40:05 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p

[jira] [Commented] (ATLAS-1227) Add support for attribute constraints in the API

2016-10-17 Thread Madhan Neethiraj (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15583191#comment-15583191
 ] 

Madhan Neethiraj commented on ATLAS-1227:
-

Review board URL: https://reviews.apache.org/r/52954/

> Add support for attribute constraints in the API
> 
>
> Key: ATLAS-1227
> URL: https://issues.apache.org/jira/browse/ATLAS-1227
> Project: Atlas
>  Issue Type: Bug
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
> Attachments: ATLAS-1227.1.patch, ATLAS-1227.patch
>
>
> Currently the typesystem supports AttributeInfo fields 'isComposite' and 
> 'reverseAttributeName' - to model relationships between entities like 
> hive_table to hive_column, via attributes columns and table. An equivalent 
> should be made available in the new structured API introduced in ATLAS-1171.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 52954: ATLAS-1227: added support for attribute constraints in the model

2016-10-17 Thread Madhan Neethiraj


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52954/
---

Review request for atlas.


Bugs: ATLAS-1227
https://issues.apache.org/jira/browse/ATLAS-1227


Repository: atlas


Description
---

Added support for constraints in entity attributes. Following 2 constraints are 
added in this patch, which provide equivalent of isComposite and 
reverseAtributeName fields in AttributeInfo: foreignKey, mappedFromRef.

Using these constraints, hive_column.table and hive_table.columns would be 
modeled as below:

{
  "name": "hive_column",
  "attributeDefs": [
{
  "name": "table",
  "typeName": "hive_table",
  "constraintDefs": [
{
  "type": "foreignKey",
  "params": {
"onDelete": "cascade"
  }
}
  ]
}
  ]
}

{
  "name": "hive_table",
  "attributeDefs": [
{
  "name": "columns",
  "typeName": "array",
  "constraintDefs": [
{
  "type": "mappedFromRef",
  "params": {
"refAttribute": "table"
  }
}
  ]
}
  ]
}


Diffs
-

  intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 55bff2b 
  intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 8813542 
  intg/src/main/java/org/apache/atlas/type/AtlasTypeUtil.java 264e9a8 
  intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java 5b38e3c 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasStructDefStoreV1.java
 ea1b03b 

Diff: https://reviews.apache.org/r/52954/diff/


Testing
---

- added unit tests
- verified that existing isComposite/reverseAttributeName fields are mapped to 
constraints correctly (when accessing entity-def via TypesREST API)


Thanks,

Madhan Neethiraj

Re: Web UI problem with Atlas 0.7

2016-10-17 Thread Ismaël Mejía

Hello again,

I tried with the git master version and I still have the same issue of not
seeing anything after login in the WebUI.

What other data/table does the GUI depend on ? (apart of the given
Types/Entities), because I think there is something else that maybe I am
missing.

Regards,
Ismaël

On Mon, Oct 17, 2016 at 2:10 PM, Jean-Baptiste Onofré 
wrote:

> Hi guys,
>
> As 0.7.0 is not super useful with this fix, I would propose to release
> 0.7.1 at least to fix that.
>
> I have couple of other Jira in my bucket I would like to include in a
> 0.7.1 release as well.
>
> Thoughts ?
>
> Regards
> JB
>
>
> On 10/17/2016 10:25 AM, Keval Bhatt wrote:
>
>> Hi Ismaël
>>
>> Recently Atlas UI was not loading after fresh build due to
>> jquery-asBreadcrumbs plugin changes and this is fixed on master.
>>
>> ATLAS-1199  
>>
>> Please checkout the latest code from master
>> 
>>
>>
>> Thanks,
>> Keval Bhatt
>>
>> On Mon, Oct 17, 2016 at 1:15 PM, Ismaël Mejía  wrote:
>>
>> Hello,
>>>
>>> I used Atlas 0.5 and some of the earlier version of Atlas 0.7 with no
>>> issues.
>>> However I am trying to use the released version of Atlas 0.7 and I am
>>> having
>>> some problems. I built the binary distribution with embedded hbase/solr
>>> following the instructions from the website:
>>>
>>> mvn clean package -Pdist,embedded-hbase-solr -DskipTests
>>>
>>> Then I start Atlas like this:
>>>
>>> export MANAGE_LOCAL_SOLR=true
>>> export MANAGE_LOCAL_HBASE=true
>>> bin/atlas_start.py
>>>
>>> If I go to the initial webpage http://localhost:21000/
>>>
>>> I see the login/password page and once I log in with the admin user I
>>> get a
>>> blank page.
>>>
>>> I considered that maybe I was missing some basic data so I ran the
>>> quickstart:
>>>
>>> bin/quick_start.py
>>>
>>> Then I log in again but still I can't see any data. Am I missing
>>> something
>>> ?
>>>
>>> The weird thing is that I don't have any exception for the web app, the
>>> only
>>> exception in the logs is on atlas_start:
>>>
>>> 2016-10-17 09:06:48,174 INFO  - [main:] ~ Guice modules loaded
>>> (GuiceServletConfig:120)
>>> 2016-10-17 09:06:48,177 INFO  - [main:] ~ Starting services
>>> (GuiceServletConfig:140)
>>> 2016-10-17 09:06:48,224 WARN  - [main-SendThread(localhost:9026):] ~
>>> Session 0x0 for server null, unexpected error, closing socket connection
>>> and attempting reconnect (ClientCnxn$SendThread:1102)
>>> java.net.ConnectException: Connection refused
>>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>> at
>>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
>>> at
>>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
>>> ClientCnxnSocketNIO.java:361)
>>> at org.apache.zookeeper.ClientCnxn$SendThread.run(
>>> ClientCnxn.java:1081)
>>> 2016-10-17 09:06:48,255 INFO  - [main:] ~ HA is disabled. Hence creating
>>> table on startup. (HBaseBasedAuditRepository:287)
>>> 2016-10-17 09:06:48,256 INFO  - [main:] ~ Checking if table
>>> apache_atlas_entity_audit exists (HBaseBasedAuditRepository:249)
>>> 2016-10-17 09:06:48,263 INFO  - [main:] ~ Creating table
>>> apache_atlas_entity_audit (HBaseBasedAuditRepository:251)
>>> 2016-10-17 09:06:49,326 WARN  - [main-SendThread(localhost:9026):] ~
>>> Session 0x0 for server null, unexpected error, closing socket connection
>>> and attempting reconnect (ClientCnxn$SendThread:1102)
>>> java.net.ConnectException: Connection refused
>>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>> at
>>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
>>> at
>>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
>>> ClientCnxnSocketNIO.java:361)
>>> at org.apache.zookeeper.ClientCnxn$SendThread.run(
>>> ClientCnxn.java:1081)
>>>
>>> and also I found this exception when the quick_start script creates the
>>> first entity:
>>>
>>> 2016-10-17 09:21:40,566 WARN  - [qtp161960012-16 -
>>> 888beb21-202d-4e96-9750-25d5ebe3bcac:] ~ The configuration
>>> auto.commit.enable = false was supplied but isn't a known config.
>>> (AbstractConfig:186)
>>> 2016-10-17 09:21:40,700 WARN  - [kafka-producer-network-thread |
>>> producer-1:] ~ Error while fetching metadata with correlation id 0 :
>>> {ATLAS_ENTITIES=LEADER_NOT_AVAILABLE}
>>> (NetworkClient$DefaultMetadataUpdater:600)
>>> 2016-10-17 09:21:40,732 WARN  -
>>> [org.apache.atlas.kafka.KafkaNotification:Controller-
>>> 1-to-broker-1-send-thread:]
>>> ~
>>> [org.apache.atlas.kafka.KafkaNotification:Controller-
>>> 1-to-broker-1-send-thread],
>>> Controller 1 epoch 1 fails to send request
>>> {controller_id=1,controller_epoch=1,partition_states=[{
>>> topic=ATLAS_ENTITIES,partition=0,controller_epoch=
>>> 1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}
>>> ],live_leaders=[{id=1,host=localhost,port=9027}]}
>>> to broker localhost:9027 (id: 1 rack: null). Reconnecting

Re: Web UI problem with Atlas 0.7

2016-10-17 Thread Jean-Baptiste Onofré


Hi guys,

As 0.7.0 is not super useful with this fix, I would propose to release 
0.7.1 at least to fix that.


I have couple of other Jira in my bucket I would like to include in a 
0.7.1 release as well.


Thoughts ?

Regards
JB

On 10/17/2016 10:25 AM, Keval Bhatt wrote:

Hi Ismaël

Recently Atlas UI was not loading after fresh build due to
jquery-asBreadcrumbs plugin changes and this is fixed on master.

ATLAS-1199  

Please checkout the latest code from master



Thanks,
Keval Bhatt

On Mon, Oct 17, 2016 at 1:15 PM, Ismaël Mejía  wrote:


Hello,

I used Atlas 0.5 and some of the earlier version of Atlas 0.7 with no
issues.
However I am trying to use the released version of Atlas 0.7 and I am
having
some problems. I built the binary distribution with embedded hbase/solr
following the instructions from the website:

mvn clean package -Pdist,embedded-hbase-solr -DskipTests

Then I start Atlas like this:

export MANAGE_LOCAL_SOLR=true
export MANAGE_LOCAL_HBASE=true
bin/atlas_start.py

If I go to the initial webpage http://localhost:21000/

I see the login/password page and once I log in with the admin user I get a
blank page.

I considered that maybe I was missing some basic data so I ran the
quickstart:

bin/quick_start.py

Then I log in again but still I can't see any data. Am I missing something
?

The weird thing is that I don't have any exception for the web app, the
only
exception in the logs is on atlas_start:

2016-10-17 09:06:48,174 INFO  - [main:] ~ Guice modules loaded
(GuiceServletConfig:120)
2016-10-17 09:06:48,177 INFO  - [main:] ~ Starting services
(GuiceServletConfig:140)
2016-10-17 09:06:48,224 WARN  - [main-SendThread(localhost:9026):] ~
Session 0x0 for server null, unexpected error, closing socket connection
and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(
ClientCnxn.java:1081)
2016-10-17 09:06:48,255 INFO  - [main:] ~ HA is disabled. Hence creating
table on startup. (HBaseBasedAuditRepository:287)
2016-10-17 09:06:48,256 INFO  - [main:] ~ Checking if table
apache_atlas_entity_audit exists (HBaseBasedAuditRepository:249)
2016-10-17 09:06:48,263 INFO  - [main:] ~ Creating table
apache_atlas_entity_audit (HBaseBasedAuditRepository:251)
2016-10-17 09:06:49,326 WARN  - [main-SendThread(localhost:9026):] ~
Session 0x0 for server null, unexpected error, closing socket connection
and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(
ClientCnxn.java:1081)

and also I found this exception when the quick_start script creates the
first entity:

2016-10-17 09:21:40,566 WARN  - [qtp161960012-16 -
888beb21-202d-4e96-9750-25d5ebe3bcac:] ~ The configuration
auto.commit.enable = false was supplied but isn't a known config.
(AbstractConfig:186)
2016-10-17 09:21:40,700 WARN  - [kafka-producer-network-thread |
producer-1:] ~ Error while fetching metadata with correlation id 0 :
{ATLAS_ENTITIES=LEADER_NOT_AVAILABLE}
(NetworkClient$DefaultMetadataUpdater:600)
2016-10-17 09:21:40,732 WARN  -
[org.apache.atlas.kafka.KafkaNotification:Controller-
1-to-broker-1-send-thread:]
~
[org.apache.atlas.kafka.KafkaNotification:Controller-
1-to-broker-1-send-thread],
Controller 1 epoch 1 fails to send request
{controller_id=1,controller_epoch=1,partition_states=[{
topic=ATLAS_ENTITIES,partition=0,controller_epoch=
1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}
],live_leaders=[{id=1,host=localhost,port=9027}]}
to broker localhost:9027 (id: 1 rack: null). Reconnecting to broker.
(Logging$class:89)
java.io.IOException: Connection to 1 was disconnected before the response
was read
at
kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$
extension$1$$anonfun$apply$1.apply(NetworkClientBlockingOps.scala:87)
at
kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$
extension$1$$anonfun$apply$1.apply(NetworkClientBlockingOps.scala:84)
at scala.Option.foreach(Option.scala:236)
at
kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$
extension$1.apply(NetworkClientBlockingOps.scala:84)
at
kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$
extension$1.apply(NetworkClientBlockingOps.scala:80)
at
kafka.utils.NetworkClientBlockingOps$.recursivePoll$2(
NetworkCli

[jira] [Updated] (ATLAS-916) Return system attributes in get entity definition

2016-10-17 Thread Vimal Sharma (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vimal Sharma updated ATLAS-916:
---
Attachment: ATLAS-916-v3-rebased.patch

> Return system attributes in get entity definition
> -
>
> Key: ATLAS-916
> URL: https://issues.apache.org/jira/browse/ATLAS-916
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Shwetha G S
>Assignee: Vimal Sharma
> Attachments: ATLAS-916-v2.patch, ATLAS-916-v3-rebased.patch, 
> ATLAS-916.patch
>
>
> Atlas should maintain system attributes created time, last modified time, 
> created by user and last modified by user for every entity. This information 
> should be returned in get entity definition



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 52257: Return system attributes in get entity definition

2016-10-17 Thread Vimal Sharma


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52257/
---

(Updated Oct. 17, 2016, 11:44 a.m.)


Review request for atlas.


Changes
---

Rebased the patch. Moved sytem attributes to a new class outside of Id. Added 
tests as suggested by Suma


Bugs: ATLAS-916
https://issues.apache.org/jira/browse/ATLAS-916


Repository: atlas


Description
---

Atlas should maintain system attributes created time, last modified time, 
created by user and last modified by user for every entity. This information 
should be returned in get entity definition


Diffs (updated)
-

  catalog/src/main/java/org/apache/atlas/catalog/DefaultPropertyMapper.java 
2f52b3b 
  common/src/main/java/org/apache/atlas/repository/Constants.java 4a68317 
  repository/src/main/java/org/apache/atlas/repository/graph/DeleteHandler.java 
fb014f2 
  
repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepository.java
 691a12c 
  
repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
 8038815 
  repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
7e47d30 
  
repository/src/main/java/org/apache/atlas/repository/graph/GraphToTypedInstanceMapper.java
 ceb6011 
  
repository/src/main/java/org/apache/atlas/repository/graph/SoftDeleteHandler.java
 92e43cb 
  
repository/src/main/java/org/apache/atlas/repository/graph/TypedInstanceToGraphMapper.java
 47ae5e1 
  
repository/src/test/java/org/apache/atlas/discovery/GraphBackedDiscoveryServiceTest.java
 13b7d22 
  
repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepositoryTest.java
 7a57518 
  
typesystem/src/main/java/org/apache/atlas/typesystem/IReferenceableInstance.java
 9285014 
  typesystem/src/main/java/org/apache/atlas/typesystem/Referenceable.java 
5b8e157 
  
typesystem/src/main/java/org/apache/atlas/typesystem/persistence/AtlasSystemAttributes.java
 PRE-CREATION 
  typesystem/src/main/java/org/apache/atlas/typesystem/persistence/Id.java 
42280d0 
  
typesystem/src/main/java/org/apache/atlas/typesystem/persistence/ReferenceableInstance.java
 561cb62 
  typesystem/src/main/java/org/apache/atlas/typesystem/types/ClassType.java 
6b530a8 
  
typesystem/src/main/scala/org/apache/atlas/typesystem/json/InstanceSerialization.scala
 73b3526 
  
typesystem/src/main/scala/org/apache/atlas/typesystem/json/Serialization.scala 
68c47ec 

Diff: https://reviews.apache.org/r/52257/diff/


Testing
---

Testing done with Hive table creation and updation


Thanks,

Vimal Sharma

[jira] [Commented] (ATLAS-1207) Dataset exists query in lineage APIs takes longer

2016-10-17 Thread Shwetha G S (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581881#comment-15581881
 ] 

Shwetha G S commented on ATLAS-1207:


The attached patch replaces DSL query with direct graph query

> Dataset exists query in lineage APIs takes longer
> -
>
> Key: ATLAS-1207
> URL: https://issues.apache.org/jira/browse/ATLAS-1207
> Project: Atlas
>  Issue Type: Bug
>Reporter: Sharmadha Sainath
>Assignee: Shwetha G S
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1207.patch
>
>
> Hive_column now extends DataSet. Lineage Service uses the DSL query Dataset 
> where __guid =  which maps to the gremlin query g.V().has(supertype, 
> Dataset).has(__guid, ). Since the first filter is on type which returns 
> many vertices, this query is slow. Supertypes is a list property and not sure 
> how adding combined index will work. This can be replaced with graph query 
> directly like 
> {code}
> titanGraph.query().has(Constants.GUID_PROPERTY_KEY, guid)
>   .has(Constants.SUPER_TYPES_PROPERTY_KEY, 
> AtlasClient.DATA_SET_SUPER_TYPE)
> {code}
> Thanks [~ssainath] for helping to test this



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1207) Dataset exists query in lineage APIs takes longer

2016-10-17 Thread Shwetha G S (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-1207:
---
Attachment: ATLAS-1207.patch

> Dataset exists query in lineage APIs takes longer
> -
>
> Key: ATLAS-1207
> URL: https://issues.apache.org/jira/browse/ATLAS-1207
> Project: Atlas
>  Issue Type: Bug
>Reporter: Sharmadha Sainath
>Assignee: Shwetha G S
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1207.patch
>
>
> Hive_column now extends DataSet. Lineage Service uses the DSL query Dataset 
> where __guid =  which maps to the gremlin query g.V().has(supertype, 
> Dataset).has(__guid, ). Since the first filter is on type which returns 
> many vertices, this query is slow. Supertypes is a list property and not sure 
> how adding combined index will work. This can be replaced with graph query 
> directly like 
> {code}
> titanGraph.query().has(Constants.GUID_PROPERTY_KEY, guid)
>   .has(Constants.SUPER_TYPES_PROPERTY_KEY, 
> AtlasClient.DATA_SET_SUPER_TYPE)
> {code}
> Thanks [~ssainath] for helping to test this



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: apache-atlas-nightly #442

2016-10-17 Thread Apache Jenkins Server

See 

Changes:

[sshivalingamurthy] ATLAS-1226 Servlet init-params in web.xml are unused 
(mneethiraj via

[sshivalingamurthy] ATLAS-1221 build failure in windows SyntaxError: invalid 
syntax

--
[...truncated 9978 lines...]
127.0.0.1 - - [17/Oct/2016:09:12:28 +] "GET 
/api/atlas/entities/88ce7df9-2c40-44d1-9771-e6291dd41d1e HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:28 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:28 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:28 +] "GET 
/api/atlas/entities/88ce7df9-2c40-44d1-9771-e6291dd41d1e HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:28 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablefitazmcoxb@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:28 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablefitazmcoxb@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:28 +] "GET 
/api/atlas/entities/ba0d51e9-a13e-4ab0-8214-93bf8459be26 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:31 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablefitazmcoxb@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:31 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablefitazmcoxb@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:31 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablefitazmcoxb@primary:1476695542000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:31 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablefitazmcoxb@primary:1476695542000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:31 +] "GET 
/api/atlas/entities/71e6510d-7e31-40f6-bbd8-7d5393602f64 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:31 +] "GET 
/api/atlas/entities/ba0d51e9-a13e-4ab0-8214-93bf8459be26 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:31 +] "GET 
/api/atlas/entities/88ce7df9-2c40-44d1-9771-e6291dd41d1e HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:31 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:31 +] "GET 
/api/atlas/entities?type=hdfs_path&property=qualifiedName&value=p
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:31 +] "GET 
/api/atlas/entities/88ce7df9-2c40-44d1-9771-e6291dd41d1e HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:33 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablefitazmcoxb@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:33 +] "GET 
/api/atlas/entities?type=hive_table&property=qualifiedName&value=default.tablefitazmcoxb@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:33 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablefitazmcoxb@primary:1476695542000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:33 +] "GET 
/api/atlas/entities?type=hive_process&property=qualifiedName&value=QUERY:default.tablefitazmcoxb@primary:1476695542000-%3E:PATH_WRITE
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:33 +] "GET 
/api/atlas/entities/71e6510d-7e31-40f6-bbd8-7d5393602f64 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:33 +] "GET 
/api/atlas/entities/ba0d51e9-a13e-4ab0-8214-93bf8459be26 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:34 +] "GET 
/api/atlas/entities/159c5f3b-c021-4f63-8722-cf04ffea9b60 HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:34 +] "GET 
/api/atlas/entities/88ce7df9-2c40-44d1-9771-e6291dd41d1e HTTP/1.1" 200 - "-" 
"Java/1.7.0_80"
127.0.0.1 - - [17/Oct/2016:09:12:34 +] "GET 
/api/atlas/entities?ty

Re: Web UI problem with Atlas 0.7

2016-10-17 Thread Ismaël Mejía

Hello,

Thanks Keval, Oh it is good to know about this issue, I will check against
master to see if I it works.
On the other hand, I can't rely on a fix on because I am writing an
integration against 0.7, so It would be nice if we can get the fix released
as a new version.

Thanks,
Ismaël Mejía


On Mon, Oct 17, 2016 at 10:25 AM, Keval Bhatt  wrote:

> Hi Ismaël
>
> Recently Atlas UI was not loading after fresh build due to
> jquery-asBreadcrumbs plugin changes and this is fixed on master.
>
> ATLAS-1199  
>
> Please checkout the latest code from master
> 
>
>
> Thanks,
> Keval Bhatt
>
> On Mon, Oct 17, 2016 at 1:15 PM, Ismaël Mejía  wrote:
>
> > Hello,
> >
> > I used Atlas 0.5 and some of the earlier version of Atlas 0.7 with no
> > issues.
> > However I am trying to use the released version of Atlas 0.7 and I am
> > having
> > some problems. I built the binary distribution with embedded hbase/solr
> > following the instructions from the website:
> >
> > mvn clean package -Pdist,embedded-hbase-solr -DskipTests
> >
> > Then I start Atlas like this:
> >
> > export MANAGE_LOCAL_SOLR=true
> > export MANAGE_LOCAL_HBASE=true
> > bin/atlas_start.py
> >
> > If I go to the initial webpage http://localhost:21000/
> >
> > I see the login/password page and once I log in with the admin user I
> get a
> > blank page.
> >
> > I considered that maybe I was missing some basic data so I ran the
> > quickstart:
> >
> > bin/quick_start.py
> >
> > Then I log in again but still I can't see any data. Am I missing
> something
> > ?
> >
> > The weird thing is that I don't have any exception for the web app, the
> > only
> > exception in the logs is on atlas_start:
> >
> > 2016-10-17 09:06:48,174 INFO  - [main:] ~ Guice modules loaded
> > (GuiceServletConfig:120)
> > 2016-10-17 09:06:48,177 INFO  - [main:] ~ Starting services
> > (GuiceServletConfig:140)
> > 2016-10-17 09:06:48,224 WARN  - [main-SendThread(localhost:9026):] ~
> > Session 0x0 for server null, unexpected error, closing socket connection
> > and attempting reconnect (ClientCnxn$SendThread:1102)
> > java.net.ConnectException: Connection refused
> > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > at
> > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
> > at
> > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> > ClientCnxnSocketNIO.java:361)
> > at org.apache.zookeeper.ClientCnxn$SendThread.run(
> > ClientCnxn.java:1081)
> > 2016-10-17 09:06:48,255 INFO  - [main:] ~ HA is disabled. Hence creating
> > table on startup. (HBaseBasedAuditRepository:287)
> > 2016-10-17 09:06:48,256 INFO  - [main:] ~ Checking if table
> > apache_atlas_entity_audit exists (HBaseBasedAuditRepository:249)
> > 2016-10-17 09:06:48,263 INFO  - [main:] ~ Creating table
> > apache_atlas_entity_audit (HBaseBasedAuditRepository:251)
> > 2016-10-17 09:06:49,326 WARN  - [main-SendThread(localhost:9026):] ~
> > Session 0x0 for server null, unexpected error, closing socket connection
> > and attempting reconnect (ClientCnxn$SendThread:1102)
> > java.net.ConnectException: Connection refused
> > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > at
> > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
> > at
> > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> > ClientCnxnSocketNIO.java:361)
> > at org.apache.zookeeper.ClientCnxn$SendThread.run(
> > ClientCnxn.java:1081)
> >
> > and also I found this exception when the quick_start script creates the
> > first entity:
> >
> > 2016-10-17 09:21:40,566 WARN  - [qtp161960012-16 -
> > 888beb21-202d-4e96-9750-25d5ebe3bcac:] ~ The configuration
> > auto.commit.enable = false was supplied but isn't a known config.
> > (AbstractConfig:186)
> > 2016-10-17 09:21:40,700 WARN  - [kafka-producer-network-thread |
> > producer-1:] ~ Error while fetching metadata with correlation id 0 :
> > {ATLAS_ENTITIES=LEADER_NOT_AVAILABLE}
> > (NetworkClient$DefaultMetadataUpdater:600)
> > 2016-10-17 09:21:40,732 WARN  -
> > [org.apache.atlas.kafka.KafkaNotification:Controller-
> > 1-to-broker-1-send-thread:]
> > ~
> > [org.apache.atlas.kafka.KafkaNotification:Controller-
> > 1-to-broker-1-send-thread],
> > Controller 1 epoch 1 fails to send request
> > {controller_id=1,controller_epoch=1,partition_states=[{
> > topic=ATLAS_ENTITIES,partition=0,controller_epoch=
> > 1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}
> > ],live_leaders=[{id=1,host=localhost,port=9027}]}
> > to broker localhost:9027 (id: 1 rack: null). Reconnecting to broker.
> > (Logging$class:89)
> > java.io.IOException: Connection to 1 was disconnected before the response
> > was read
> > at
> > kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$
> > extension$1$$anonfun$apply$1.apply(NetworkClientBlockingOps.scala:87)
> > at
> > kafka.utils.NetworkClientBl

Re: Atlas UI not loading after fresh build due to jquery-asBreadcrumbs plugin upgrade.

2016-10-17 Thread Shwetha Shivalingamurthy

We should release 0.7.1 with this fix

Regards,
Shwetha

From: Keval Bhatt mailto:kbh...@hortonworks.com>>
Date: Monday, 17 October 2016 at 1:42 PM
To: "dev@atlas.incubator.apache.org" 
mailto:dev@atlas.incubator.apache.org>>
Cc: hwx-atlas-dev 
mailto:hwx-atlas-...@hortonworks.com>>
Subject: Re: Atlas UI not loading after fresh build due to jquery-asBreadcrumbs 
plugin upgrade.

Hi Team,

ATLAS-1199 this issue is 
fixed on master. do we need to fix this issue in incubator-0.7 because if user 
using incubator-0.7 and if they build then they will face same issue.

Thanks

Keval Bhatt.

From: Keval Bhatt
Sent: Thursday, September 29, 2016 11:00 AM
To: dev@atlas.incubator.apache.org
Cc: hwx-atlas-dev
Subject: Atlas UI not loading after fresh build due to jquery-asBreadcrumbs 
plugin upgrade.

Hi Atlas team,

Atlas UI is not loading due to plugin upgrade after fresh build from master.

I have given fix for this issue 
ATLAS-1199

let me know if you find any issue.

Thanks,

Keval Bhatt

Re: Web UI problem with Atlas 0.7

2016-10-17 Thread Keval Bhatt

Hi Ismaël

Recently Atlas UI was not loading after fresh build due to
jquery-asBreadcrumbs plugin changes and this is fixed on master.

ATLAS-1199  

Please checkout the latest code from master



Thanks,
Keval Bhatt

On Mon, Oct 17, 2016 at 1:15 PM, Ismaël Mejía  wrote:

> Hello,
>
> I used Atlas 0.5 and some of the earlier version of Atlas 0.7 with no
> issues.
> However I am trying to use the released version of Atlas 0.7 and I am
> having
> some problems. I built the binary distribution with embedded hbase/solr
> following the instructions from the website:
>
> mvn clean package -Pdist,embedded-hbase-solr -DskipTests
>
> Then I start Atlas like this:
>
> export MANAGE_LOCAL_SOLR=true
> export MANAGE_LOCAL_HBASE=true
> bin/atlas_start.py
>
> If I go to the initial webpage http://localhost:21000/
>
> I see the login/password page and once I log in with the admin user I get a
> blank page.
>
> I considered that maybe I was missing some basic data so I ran the
> quickstart:
>
> bin/quick_start.py
>
> Then I log in again but still I can't see any data. Am I missing something
> ?
>
> The weird thing is that I don't have any exception for the web app, the
> only
> exception in the logs is on atlas_start:
>
> 2016-10-17 09:06:48,174 INFO  - [main:] ~ Guice modules loaded
> (GuiceServletConfig:120)
> 2016-10-17 09:06:48,177 INFO  - [main:] ~ Starting services
> (GuiceServletConfig:140)
> 2016-10-17 09:06:48,224 WARN  - [main-SendThread(localhost:9026):] ~
> Session 0x0 for server null, unexpected error, closing socket connection
> and attempting reconnect (ClientCnxn$SendThread:1102)
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:361)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1081)
> 2016-10-17 09:06:48,255 INFO  - [main:] ~ HA is disabled. Hence creating
> table on startup. (HBaseBasedAuditRepository:287)
> 2016-10-17 09:06:48,256 INFO  - [main:] ~ Checking if table
> apache_atlas_entity_audit exists (HBaseBasedAuditRepository:249)
> 2016-10-17 09:06:48,263 INFO  - [main:] ~ Creating table
> apache_atlas_entity_audit (HBaseBasedAuditRepository:251)
> 2016-10-17 09:06:49,326 WARN  - [main-SendThread(localhost:9026):] ~
> Session 0x0 for server null, unexpected error, closing socket connection
> and attempting reconnect (ClientCnxn$SendThread:1102)
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:361)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1081)
>
> and also I found this exception when the quick_start script creates the
> first entity:
>
> 2016-10-17 09:21:40,566 WARN  - [qtp161960012-16 -
> 888beb21-202d-4e96-9750-25d5ebe3bcac:] ~ The configuration
> auto.commit.enable = false was supplied but isn't a known config.
> (AbstractConfig:186)
> 2016-10-17 09:21:40,700 WARN  - [kafka-producer-network-thread |
> producer-1:] ~ Error while fetching metadata with correlation id 0 :
> {ATLAS_ENTITIES=LEADER_NOT_AVAILABLE}
> (NetworkClient$DefaultMetadataUpdater:600)
> 2016-10-17 09:21:40,732 WARN  -
> [org.apache.atlas.kafka.KafkaNotification:Controller-
> 1-to-broker-1-send-thread:]
> ~
> [org.apache.atlas.kafka.KafkaNotification:Controller-
> 1-to-broker-1-send-thread],
> Controller 1 epoch 1 fails to send request
> {controller_id=1,controller_epoch=1,partition_states=[{
> topic=ATLAS_ENTITIES,partition=0,controller_epoch=
> 1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}
> ],live_leaders=[{id=1,host=localhost,port=9027}]}
> to broker localhost:9027 (id: 1 rack: null). Reconnecting to broker.
> (Logging$class:89)
> java.io.IOException: Connection to 1 was disconnected before the response
> was read
> at
> kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$
> extension$1$$anonfun$apply$1.apply(NetworkClientBlockingOps.scala:87)
> at
> kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$
> extension$1$$anonfun$apply$1.apply(NetworkClientBlockingOps.scala:84)
> at scala.Option.foreach(Option.scala:236)
> at
> kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$
> extension$1.apply(NetworkClientBlockingOps.scala:84)
> at
> kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$
> extension$1.apply(NetworkClientBlockingOps.scala:80)
> at
> kafka.utils.NetworkClientBlockingOps$.recursivePoll$2(
> NetworkClientBlockingOps.scala:137)
> at
> kafka.utils.NetworkClientBlockin

[jira] [Commented] (ATLAS-1221) build failure in windows SyntaxError: invalid syntax

2016-10-17 Thread zhangqiang2 (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581537#comment-15581537
 ] 

zhangqiang2 commented on ATLAS-1221:


 thanks Shwetha G S
 I have do as you say , also  I find the diffierent between "git diff" and "git 
diff --full-index"  .
  when i commit in our atlas project can use  "git diff" .
  when add code in https://reviews.apache.org/ we should use  "git diff 
--full-index". 

> build failure in windows  SyntaxError: invalid syntax
> -
>
> Key: ATLAS-1221
> URL: https://issues.apache.org/jira/browse/ATLAS-1221
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
> Environment: window7(64) +maven3.2.5+git+python3.5(64)+jdk1.7.80
>Reporter: zhangqiang2
>Assignee: zhangqiang2
>Priority: Critical
>  Labels: build
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1221-v2.patch, ATLAS-1221.patch
>
>
> Traceback (most recent call last):
>   File "unitTests.py", line 118, in 
> main()
>   File "unitTests.py", line 87, in main
> suite = all_tests_suite()
>   File "unitTests.py", line 78, in all_tests_suite
> suite = unittest.TestLoader().loadTestsFromNames(tests_list)
>   File "c:\python\lib\unittest\loader.py", line 219, in loadTestsFromNames
> suites = [self.loadTestsFromName(name, module) for name in names]
>   File "c:\python\lib\unittest\loader.py", line 219, in 
> suites = [self.loadTestsFromName(name, module) for name in names]
>   File "c:\python\lib\unittest\loader.py", line 153, in loadTestsFromName
> module = __import__(module_name)
>   File 
> "E:\GITProject-bak\incubator-atlas-eclipse\distro\src\test\python\scripts\TestMetadata.py",
>  line 26, in 
> import atlas_config as mc
>   File 
> "E:\GITProject-bak\incubator-atlas-eclipse\distro\src\bin\atlas_config.py", 
> line 135
> except OSError, e:
>   ^
> SyntaxError: invalid syntax
> [INFO] 
> 
> [INFO] Reactor Summary:
> [INFO]
> [INFO] apache-atlas ... SUCCESS [ 19.819 
> s]
> [INFO] Apache Atlas Common  SUCCESS [ 23.974 
> s]
> [INFO] Apache Atlas Typesystem  SUCCESS [ 44.967 
> s]
> [INFO] Apache Atlas Client  SUCCESS [ 26.070 
> s]
> [INFO] Apache Atlas Server API  SUCCESS [ 18.260 
> s]
> [INFO] Apache Atlas Notification .. SUCCESS [ 24.818 
> s]
> [INFO] Apache Atlas Graph Database Projects ... SUCCESS [  1.996 
> s]
> [INFO] Apache Atlas Graph Database API  SUCCESS [ 12.466 
> s]
> [INFO] Graph Database Common Code . SUCCESS [ 12.562 
> s]
> [INFO] Apache Atlas Titan 0.5.4 Graph DB Impl . SUCCESS [ 52.199 
> s]
> [INFO] Apache Atlas Repository  SUCCESS [ 53.281 
> s]
> [INFO] Apache Atlas Authorization . SUCCESS [ 14.496 
> s]
> [INFO] Apache Atlas Business Catalog .. SUCCESS [ 19.184 
> s]
> [INFO] Apache Atlas UI  SUCCESS [13:55 
> min]
> [INFO] Apache Atlas Web Application ... SUCCESS [02:13 
> min]
> [INFO] Apache Atlas Documentation . SUCCESS [ 14.923 
> s]
> [INFO] Apache Atlas FileSystem Model .. SUCCESS [01:04 
> min]
> [INFO] Apache Atlas Plugin Classloader  SUCCESS [ 12.809 
> s]
> [INFO] Apache Atlas Hive Bridge Shim .. SUCCESS [ 16.498 
> s]
> [INFO] Apache Atlas Hive Bridge ... SUCCESS [02:23 
> min]
> [INFO] Apache Atlas Falcon Bridge Shim  SUCCESS [ 17.179 
> s]
> [INFO] Apache Atlas Falcon Bridge . SUCCESS [02:11 
> min]
> [INFO] Apache Atlas Sqoop Bridge Shim . SUCCESS [  7.781 
> s]
> [INFO] Apache Atlas Sqoop Bridge .. SUCCESS [02:14 
> min]
> [INFO] Apache Atlas Storm Bridge Shim . SUCCESS [  9.031 
> s]
> [INFO] Apache Atlas Storm Bridge .. SUCCESS [02:17 
> min]
> [INFO] Apache Atlas Distribution .. FAILURE [  8.631 
> s]
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time: 33:15 min
> [INFO] Finished at: 2016-10-12T09:06:02+08:00
> [INFO] Final Memory: 159M/857M
> [INFO] 
> 
> [WARNING] The requested profile "env-c

[jira] [Commented] (ATLAS-1221) build failure in windows SyntaxError: invalid syntax

2016-10-17 Thread Shwetha G S (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581525#comment-15581525
 ] 

Shwetha G S commented on ATLAS-1221:


Committed to master. Thanks [~zhangqiang2]

> build failure in windows  SyntaxError: invalid syntax
> -
>
> Key: ATLAS-1221
> URL: https://issues.apache.org/jira/browse/ATLAS-1221
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
> Environment: window7(64) +maven3.2.5+git+python3.5(64)+jdk1.7.80
>Reporter: zhangqiang2
>Assignee: zhangqiang2
>Priority: Critical
>  Labels: build
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1221-v2.patch, ATLAS-1221.patch
>
>
> Traceback (most recent call last):
>   File "unitTests.py", line 118, in 
> main()
>   File "unitTests.py", line 87, in main
> suite = all_tests_suite()
>   File "unitTests.py", line 78, in all_tests_suite
> suite = unittest.TestLoader().loadTestsFromNames(tests_list)
>   File "c:\python\lib\unittest\loader.py", line 219, in loadTestsFromNames
> suites = [self.loadTestsFromName(name, module) for name in names]
>   File "c:\python\lib\unittest\loader.py", line 219, in 
> suites = [self.loadTestsFromName(name, module) for name in names]
>   File "c:\python\lib\unittest\loader.py", line 153, in loadTestsFromName
> module = __import__(module_name)
>   File 
> "E:\GITProject-bak\incubator-atlas-eclipse\distro\src\test\python\scripts\TestMetadata.py",
>  line 26, in 
> import atlas_config as mc
>   File 
> "E:\GITProject-bak\incubator-atlas-eclipse\distro\src\bin\atlas_config.py", 
> line 135
> except OSError, e:
>   ^
> SyntaxError: invalid syntax
> [INFO] 
> 
> [INFO] Reactor Summary:
> [INFO]
> [INFO] apache-atlas ... SUCCESS [ 19.819 
> s]
> [INFO] Apache Atlas Common  SUCCESS [ 23.974 
> s]
> [INFO] Apache Atlas Typesystem  SUCCESS [ 44.967 
> s]
> [INFO] Apache Atlas Client  SUCCESS [ 26.070 
> s]
> [INFO] Apache Atlas Server API  SUCCESS [ 18.260 
> s]
> [INFO] Apache Atlas Notification .. SUCCESS [ 24.818 
> s]
> [INFO] Apache Atlas Graph Database Projects ... SUCCESS [  1.996 
> s]
> [INFO] Apache Atlas Graph Database API  SUCCESS [ 12.466 
> s]
> [INFO] Graph Database Common Code . SUCCESS [ 12.562 
> s]
> [INFO] Apache Atlas Titan 0.5.4 Graph DB Impl . SUCCESS [ 52.199 
> s]
> [INFO] Apache Atlas Repository  SUCCESS [ 53.281 
> s]
> [INFO] Apache Atlas Authorization . SUCCESS [ 14.496 
> s]
> [INFO] Apache Atlas Business Catalog .. SUCCESS [ 19.184 
> s]
> [INFO] Apache Atlas UI  SUCCESS [13:55 
> min]
> [INFO] Apache Atlas Web Application ... SUCCESS [02:13 
> min]
> [INFO] Apache Atlas Documentation . SUCCESS [ 14.923 
> s]
> [INFO] Apache Atlas FileSystem Model .. SUCCESS [01:04 
> min]
> [INFO] Apache Atlas Plugin Classloader  SUCCESS [ 12.809 
> s]
> [INFO] Apache Atlas Hive Bridge Shim .. SUCCESS [ 16.498 
> s]
> [INFO] Apache Atlas Hive Bridge ... SUCCESS [02:23 
> min]
> [INFO] Apache Atlas Falcon Bridge Shim  SUCCESS [ 17.179 
> s]
> [INFO] Apache Atlas Falcon Bridge . SUCCESS [02:11 
> min]
> [INFO] Apache Atlas Sqoop Bridge Shim . SUCCESS [  7.781 
> s]
> [INFO] Apache Atlas Sqoop Bridge .. SUCCESS [02:14 
> min]
> [INFO] Apache Atlas Storm Bridge Shim . SUCCESS [  9.031 
> s]
> [INFO] Apache Atlas Storm Bridge .. SUCCESS [02:17 
> min]
> [INFO] Apache Atlas Distribution .. FAILURE [  8.631 
> s]
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time: 33:15 min
> [INFO] Finished at: 2016-10-12T09:06:02+08:00
> [INFO] Final Memory: 159M/857M
> [INFO] 
> 
> [WARNING] The requested profile "env-common" could not be activated because 
> it does not exist.
> [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec 
> (python-test) on project atlas-distro: Command execution failed. Proce
>  exited with

Web UI problem with Atlas 0.7

2016-10-17 Thread Ismaël Mejía

Hello,

I used Atlas 0.5 and some of the earlier version of Atlas 0.7 with no
issues.
However I am trying to use the released version of Atlas 0.7 and I am having
some problems. I built the binary distribution with embedded hbase/solr
following the instructions from the website:

mvn clean package -Pdist,embedded-hbase-solr -DskipTests

Then I start Atlas like this:

export MANAGE_LOCAL_SOLR=true
export MANAGE_LOCAL_HBASE=true
bin/atlas_start.py

If I go to the initial webpage http://localhost:21000/

I see the login/password page and once I log in with the admin user I get a
blank page.

I considered that maybe I was missing some basic data so I ran the
quickstart:

bin/quick_start.py

Then I log in again but still I can't see any data. Am I missing something ?

The weird thing is that I don't have any exception for the web app, the only
exception in the logs is on atlas_start:

2016-10-17 09:06:48,174 INFO  - [main:] ~ Guice modules loaded
(GuiceServletConfig:120)
2016-10-17 09:06:48,177 INFO  - [main:] ~ Starting services
(GuiceServletConfig:140)
2016-10-17 09:06:48,224 WARN  - [main-SendThread(localhost:9026):] ~
Session 0x0 for server null, unexpected error, closing socket connection
and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2016-10-17 09:06:48,255 INFO  - [main:] ~ HA is disabled. Hence creating
table on startup. (HBaseBasedAuditRepository:287)
2016-10-17 09:06:48,256 INFO  - [main:] ~ Checking if table
apache_atlas_entity_audit exists (HBaseBasedAuditRepository:249)
2016-10-17 09:06:48,263 INFO  - [main:] ~ Creating table
apache_atlas_entity_audit (HBaseBasedAuditRepository:251)
2016-10-17 09:06:49,326 WARN  - [main-SendThread(localhost:9026):] ~
Session 0x0 for server null, unexpected error, closing socket connection
and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)

and also I found this exception when the quick_start script creates the
first entity:

2016-10-17 09:21:40,566 WARN  - [qtp161960012-16 -
888beb21-202d-4e96-9750-25d5ebe3bcac:] ~ The configuration
auto.commit.enable = false was supplied but isn't a known config.
(AbstractConfig:186)
2016-10-17 09:21:40,700 WARN  - [kafka-producer-network-thread |
producer-1:] ~ Error while fetching metadata with correlation id 0 :
{ATLAS_ENTITIES=LEADER_NOT_AVAILABLE}
(NetworkClient$DefaultMetadataUpdater:600)
2016-10-17 09:21:40,732 WARN  -
[org.apache.atlas.kafka.KafkaNotification:Controller-1-to-broker-1-send-thread:]
~
[org.apache.atlas.kafka.KafkaNotification:Controller-1-to-broker-1-send-thread],
Controller 1 epoch 1 fails to send request
{controller_id=1,controller_epoch=1,partition_states=[{topic=ATLAS_ENTITIES,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_leaders=[{id=1,host=localhost,port=9027}]}
to broker localhost:9027 (id: 1 rack: null). Reconnecting to broker.
(Logging$class:89)
java.io.IOException: Connection to 1 was disconnected before the response
was read
at
kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$extension$1$$anonfun$apply$1.apply(NetworkClientBlockingOps.scala:87)
at
kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$extension$1$$anonfun$apply$1.apply(NetworkClientBlockingOps.scala:84)
at scala.Option.foreach(Option.scala:236)
at
kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$extension$1.apply(NetworkClientBlockingOps.scala:84)
at
kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$extension$1.apply(NetworkClientBlockingOps.scala:80)
at
kafka.utils.NetworkClientBlockingOps$.recursivePoll$2(NetworkClientBlockingOps.scala:137)
at
kafka.utils.NetworkClientBlockingOps$.kafka$utils$NetworkClientBlockingOps$$pollContinuously$extension(NetworkClientBlockingOps.scala:143)
at
kafka.utils.NetworkClientBlockingOps$.blockingSendAndReceive$extension(NetworkClientBlockingOps.scala:80)
at
kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:189)
at
kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:180)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
2016-10-17 09:21:40,809 WARN  - [kafka-producer-network-thread |
producer-1:] ~ Error while fetching metadata with correlatio

Re: Web UI problem with Atlas 0.7

Re: Review Request 52954: ATLAS-1227: added support for attribute constraints in the model

Build failed in Jenkins: apache-atlas-nightly #445

Re: Review Request 52954: ATLAS-1227: added support for attribute constraints in the model

Re: Review Request 52954: ATLAS-1227: added support for attribute constraints in the model

Build failed in Jenkins: apache-atlas-nightly #443

[jira] [Commented] (ATLAS-1227) Add support for attribute constraints in the API

Review Request 52954: ATLAS-1227: added support for attribute constraints in the model

Re: Web UI problem with Atlas 0.7

Re: Web UI problem with Atlas 0.7

[jira] [Updated] (ATLAS-916) Return system attributes in get entity definition

Re: Review Request 52257: Return system attributes in get entity definition

[jira] [Commented] (ATLAS-1207) Dataset exists query in lineage APIs takes longer

[jira] [Updated] (ATLAS-1207) Dataset exists query in lineage APIs takes longer

Build failed in Jenkins: apache-atlas-nightly #442

Re: Web UI problem with Atlas 0.7

Re: Atlas UI not loading after fresh build due to jquery-asBreadcrumbs plugin upgrade.

Re: Web UI problem with Atlas 0.7

[jira] [Commented] (ATLAS-1221) build failure in windows SyntaxError: invalid syntax

[jira] [Commented] (ATLAS-1221) build failure in windows SyntaxError: invalid syntax

Web UI problem with Atlas 0.7

21 matches

Site Navigation

Mail list logo

Footer information