[jira] [Comment Edited] (ATLAS-2740) Import-hbase.sh script takes default values for few hbase column family attributes

2018-06-06 Thread Ruchi Solani (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502991#comment-16502991
 ] 

Ruchi Solani edited comment on ATLAS-2740 at 6/6/18 8:39 AM:
-

Above [^ATLAS-2740.patch] is tested with Hbase version - 2.0.0.0 


was (Author: ruchi_solani):
Above Patch is tested with Hbase version - 2.0.0.0 

> Import-hbase.sh script takes default values for few hbase column family 
> attributes
> --
>
> Key: ATLAS-2740
> URL: https://issues.apache.org/jira/browse/ATLAS-2740
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>    Reporter: Ruchi Solani
>Assignee: Ruchi Solani
>Priority: Major
> Fix For: 1.0.0-alpha
>
> Attachments: ATLAS-2740.patch
>
>
> Following attributes are ingested by Atlas with default values even though 
> non default values are provided :
> NEW_VERSION_BEHAVIOR
> IS_MOB
> MOB_COMPACT_PARTITION_POLICY
> IN_MEMORY_COMPACTION
> Hbase hook registers them correctly.Issue is with the import-hbase script.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Comment Edited] (ATLAS-2740) Import-hbase.sh script takes default values for few hbase column family attributes

2018-06-06 Thread Ruchi Solani (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502991#comment-16502991
 ] 

Ruchi Solani edited comment on ATLAS-2740 at 6/6/18 8:34 AM:
-

Above Patch is tested with Hbase version - 2.0.0.0 


was (Author: ruchi_solani):
Above Patch is tested on Hbase version - 2.0.0.0 

> Import-hbase.sh script takes default values for few hbase column family 
> attributes
> --
>
> Key: ATLAS-2740
> URL: https://issues.apache.org/jira/browse/ATLAS-2740
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>    Reporter: Ruchi Solani
>Assignee: Ruchi Solani
>Priority: Major
> Fix For: 1.0.0-alpha
>
> Attachments: ATLAS-2740.patch
>
>
> Following attributes are ingested by Atlas with default values even though 
> non default values are provided :
> NEW_VERSION_BEHAVIOR
> IS_MOB
> MOB_COMPACT_PARTITION_POLICY
> IN_MEMORY_COMPACTION
> Hbase hook registers them correctly.Issue is with the import-hbase script.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-2740) Import-hbase.sh script takes default values for few hbase column family attributes

2018-06-06 Thread Ruchi Solani (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502991#comment-16502991
 ] 

Ruchi Solani commented on ATLAS-2740:
-

Above Patch is tested on Hbase version - 2.0.0.0 

> Import-hbase.sh script takes default values for few hbase column family 
> attributes
> --
>
> Key: ATLAS-2740
> URL: https://issues.apache.org/jira/browse/ATLAS-2740
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>    Reporter: Ruchi Solani
>Assignee: Ruchi Solani
>Priority: Major
> Fix For: 1.0.0-alpha
>
> Attachments: ATLAS-2740.patch
>
>
> Following attributes are ingested by Atlas with default values even though 
> non default values are provided :
> NEW_VERSION_BEHAVIOR
> IS_MOB
> MOB_COMPACT_PARTITION_POLICY
> IN_MEMORY_COMPACTION
> Hbase hook registers them correctly.Issue is with the import-hbase script.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2740) Import-hbase.sh script takes default values for few hbase column family attributes

2018-06-06 Thread Ruchi Solani (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2740:

Attachment: ATLAS-2740.patch

> Import-hbase.sh script takes default values for few hbase column family 
> attributes
> --
>
> Key: ATLAS-2740
> URL: https://issues.apache.org/jira/browse/ATLAS-2740
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>    Reporter: Ruchi Solani
>Assignee: Ruchi Solani
>Priority: Major
> Fix For: 1.0.0-alpha
>
> Attachments: ATLAS-2740.patch
>
>
> Following attributes are ingested by Atlas with default values even though 
> non default values are provided :
> NEW_VERSION_BEHAVIOR
> IS_MOB
> MOB_COMPACT_PARTITION_POLICY
> IN_MEMORY_COMPACTION
> Hbase hook registers them correctly.Issue is with the import-hbase script.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ATLAS-2740) Import-hbase.sh script takes default values for few hbase column family attributes

2018-06-05 Thread Ruchi Solani (JIRA)
Ruchi Solani created ATLAS-2740:
---

 Summary: Import-hbase.sh script takes default values for few hbase 
column family attributes
 Key: ATLAS-2740
 URL: https://issues.apache.org/jira/browse/ATLAS-2740
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 1.0.0
Reporter: Ruchi Solani
Assignee: Ruchi Solani
 Fix For: 1.0.0-alpha


Following attributes are ingested by Atlas with default values even though non 
default values are provided :
NEW_VERSION_BEHAVIOR
IS_MOB
MOB_COMPACT_PARTITION_POLICY
IN_MEMORY_COMPACTION

Hbase hook registers them correctly.Issue is with the import-hbase script.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Review Request 67435: Import-hbase.sh script ignores table's NORMALIZATION_ENABLED attribute.

2018-06-04 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67435/
---

Review request for atlas, Madhan Neethiraj and Nixon Rodrigues.


Bugs: ATLAS-2737
https://issues.apache.org/jira/browse/ATLAS-2737


Repository: atlas


Description
---

When HBase hook is in place , when table is created with NORMALIZATION_ENABLED 
true/false , it is ingested correctly.
If table is created with NORMALIZATION_ENABLED => true and import-hbase script 
is run , request body has NORMALIZATION_ENABLED sent with default false value.


Diffs
-

  
addons/hbase-bridge/src/main/java/org/apache/atlas/hbase/bridge/HBaseAtlasHook.java
 09998cf 
  
addons/hbase-bridge/src/main/java/org/apache/atlas/hbase/bridge/HBaseBridge.java
 8372f02 


Diff: https://reviews.apache.org/r/67435/diff/1/


Testing
---

sanity testing,


Thanks,

Ruchi Solani



[jira] [Updated] (ATLAS-2635) added REST APIs to add/update/remove classifications for an entity given its type and unique attributes

2018-05-03 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2635:

Summary: added REST APIs to add/update/remove classifications for an entity 
given its type and unique attributes  (was: Add method to refer entity by 
unique Attributes)

> added REST APIs to add/update/remove classifications for an entity given its 
> type and unique attributes
> ---
>
> Key: ATLAS-2635
> URL: https://issues.apache.org/jira/browse/ATLAS-2635
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Ruchi Solani
>    Assignee: Ruchi Solani
>Priority: Major
>
> Many of the APIs in EntityREST require entity-guid to be provided. It will be 
> useful to operate on entities given its typeName and uniqueAttributes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2635) Added REST APIs to add/update/remove classifications for an entity given its type and unique attributes

2018-05-03 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2635:

Summary: Added REST APIs to add/update/remove classifications for an entity 
given its type and unique attributes  (was: added REST APIs to 
add/update/remove classifications for an entity given its type and unique 
attributes)

> Added REST APIs to add/update/remove classifications for an entity given its 
> type and unique attributes
> ---
>
> Key: ATLAS-2635
> URL: https://issues.apache.org/jira/browse/ATLAS-2635
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Ruchi Solani
>    Assignee: Ruchi Solani
>Priority: Major
>
> Many of the APIs in EntityREST require entity-guid to be provided. It will be 
> useful to operate on entities given its typeName and uniqueAttributes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Review Request 66929: Add method to refer entity by unique Attributes

2018-05-03 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66929/
---

(Updated May 3, 2018, 6:39 a.m.)


Review request for atlas and Madhan Neethiraj.


Changes
---

added REST APIs to add/update/remove classifications for an entity given its 
type and unique attributes


Bugs: ATLAS-2635
https://issues.apache.org/jira/browse/ATLAS-2635


Repository: atlas


Description
---

Many of the APIs in EntityREST require entity-guid to be provided. It will be 
useful to operate on entities given its typeName and uniqueAttributes.


Diffs (updated)
-

  
repository/src/main/java/org/apache/atlas/repository/store/graph/AtlasEntityStore.java
 eb825c4d3 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasEntityStoreV1.java
 316d78c64 
  webapp/src/main/java/org/apache/atlas/web/rest/EntityREST.java 17a6eced3 
  webapp/src/test/java/org/apache/atlas/web/adapters/TestEntityREST.java 
f0bc9628c 


Diff: https://reviews.apache.org/r/66929/diff/2/

Changes: https://reviews.apache.org/r/66929/diff/1-2/


Testing
---

Done with sanity testing


Thanks,

Ruchi Solani



Review Request 66929: Add method to refer entity by unique Attributes

2018-05-02 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66929/
---

Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2635
https://issues.apache.org/jira/browse/ATLAS-2635


Repository: atlas


Description
---

Many of the APIs in EntityREST require entity-guid to be provided. It will be 
useful to operate on entities given its typeName and uniqueAttributes.


Diffs
-

  
repository/src/main/java/org/apache/atlas/repository/store/graph/AtlasEntityStore.java
 eb825c4 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasEntityStoreV1.java
 316d78c 
  webapp/src/main/java/org/apache/atlas/web/rest/EntityREST.java 17a6ece 
  webapp/src/test/java/org/apache/atlas/web/adapters/TestEntityREST.java 
f0bc962 


Diff: https://reviews.apache.org/r/66929/diff/1/


Testing
---

Done with sanity testing


Thanks,

Ruchi Solani



[jira] [Assigned] (ATLAS-2635) Add method to refer entity by unique Attributes

2018-05-02 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani reassigned ATLAS-2635:
---

Assignee: Ruchi Solani

> Add method to refer entity by unique Attributes
> ---
>
> Key: ATLAS-2635
> URL: https://issues.apache.org/jira/browse/ATLAS-2635
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>    Reporter: Ruchi Solani
>Assignee: Ruchi Solani
>Priority: Major
>
> Many of the APIs in EntityREST require entity-guid to be provided. It will be 
> useful to operate on entities given its typeName and uniqueAttributes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ATLAS-2635) Add API to refer entity by unique Attributes

2018-05-02 Thread Ruchi Solani (JIRA)
Ruchi Solani created ATLAS-2635:
---

 Summary: Add API to refer entity by unique Attributes
 Key: ATLAS-2635
 URL: https://issues.apache.org/jira/browse/ATLAS-2635
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Reporter: Ruchi Solani


Many of the APIs in EntityREST require entity-guid to be provided. It will be 
useful to operate on entities given its typeName and uniqueAttributes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2635) Add method to refer entity by unique Attributes

2018-05-02 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2635:

Summary: Add method to refer entity by unique Attributes  (was: Add API to 
refer entity by unique Attributes)

> Add method to refer entity by unique Attributes
> ---
>
> Key: ATLAS-2635
> URL: https://issues.apache.org/jira/browse/ATLAS-2635
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>    Reporter: Ruchi Solani
>Priority: Major
>
> Many of the APIs in EntityREST require entity-guid to be provided. It will be 
> useful to operate on entities given its typeName and uniqueAttributes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Review Request 66758: Storm atlas hook fails with NPE

2018-04-23 Thread Ruchi Solani
~ Error occurred 
in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook] 
(StormSubmitter:364)
java.lang.RuntimeException: Atlas hook is unable to process the topology.
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:113) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:58) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:275) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:387) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:423)
 [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:404)
 [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at com.hortonworks.storm.st.wrapper.TopoWrap.submit(TopoWrap.java:62) 
[test-classes/:?]
 at 
com.hortonworks.storm.st.wrapper.TopoWrap.submitSuccessfully(TopoWrap.java:112) 
[test-classes/:?]
 at 
com.hortonworks.storm.st.tests.kafka.SpoutRetryTest.testRetry(SpoutRetryTest.java:75)
 [test-classes/:?]
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161]
 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
~[?:1.8.0_161]
 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 ~[?:1.8.0_161]
 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
 at 
org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
 [testng-6.8.5.jar:?]
 at 
org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:46) 
[testng-6.8.5.jar:?]
 at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:37) 
[testng-6.8.5.jar:?]
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
[?:1.8.0_161]
 at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_161]
 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_161]
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_161]
 at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
Caused by: java.lang.NullPointerException
 at 
org.apache.atlas.storm.hook.StormAtlasHook.getKafkaTopicQualifiedName(StormAtlasHook.java:386)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addDataSet(StormAtlasHook.java:207) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addTopologyInputs(StormAtlasHook.java:149)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addTopologyDataSets(StormAtlasHook.java:137)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:95) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 ... 21 more


Diffs
-

  ATLAS-2592.patch PRE-CREATION 
  
addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
 7f725a4 


Diff: https://reviews.apache.org/r/66758/diff/1/


Testing
---

Done with sanity testing


Thanks,

Ruchi Solani



[jira] [Updated] (ATLAS-2592) Storm atlas hook fails with NPE

2018-04-23 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2592:

Description: 
Here is the output of submission request:
{code:java}
2018-04-13 07:34:04,222 INFO - [TestNGInvoker-testRetry():[]] ~ Setting Kafka 
consumer property 'auto.offset.reset' to 'earliest' to ensure at-least-once 
processing (KafkaSpoutConfig:761)
2018-04-13 07:34:04,222 INFO - [TestNGInvoker-testRetry():[]] ~ Setting Kafka 
consumer property 'enable.auto.commit' to 'false', because the spout does not 
support auto-commit (KafkaSpoutConfig:775)
2018-04-13 07:34:04,247 WARN - [TestNGInvoker-testRetry():[]] ~ STORM-VERSION 
new 1.2.1.3.0.0.0-1189 old null (Utils:2286)
2018-04-13 07:34:04,252 INFO - [TestNGInvoker-testRetry():[]] ~ Generated 
ZooKeeper secret payload for MD5-digest: 
-7659255060620243743:-5999822419551893831 (StormSubmitter:87)
2018-04-13 07:34:04,266 INFO - [TestNGInvoker-testRetry():[]] ~ successfully 
logged in. (Login:300)
2018-04-13 07:34:04,278 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader 
nimbus : Host:6627 (NimbusClient:96)
2018-04-13 07:34:04,288 INFO - [TestNGInvoker-testRetry():[]] ~ Got AutoCreds 
[] (AuthUtils:208)
2018-04-13 07:34:04,289 INFO - [TestNGInvoker-testRetry():[]] ~ successfully 
logged in. (Login:300)
2018-04-13 07:34:04,300 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader 
nimbus : host:6627 (NimbusClient:96)
2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading 
dependencies - jars... (StormSubmitter:280)
2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading 
dependencies - artifacts... (StormSubmitter:295)
2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Dependency Blob 
keys - jars : [] / artifacts : [] (StormSubmitter:310)
2018-04-13 07:34:04,306 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading 
topology jar 
/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar
 to assigned location: 
/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar 
(StormSubmitter:475)
Start uploading file 
'/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar'
 to 
'/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar' 
(295334349 bytes)

[ ] 307200 / 295334349
...
[==] 295334349 / 295334349
[==] 295334349 / 295334349
File 
'/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar'
 uploaded to 
'/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar' 
(295334349 bytes)
2018-04-13 07:34:07,245 INFO - [TestNGInvoker-testRetry():[]] ~ Successfully 
uploaded topology jar to assigned location: 
/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar 
(StormSubmitter:500)
2018-04-13 07:34:07,246 INFO - [TestNGInvoker-testRetry():[]] ~ Submitting 
topology SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE in distributed mode 
with conf 
\{"java.security.auth.login.config":"\/etc\/storm\/conf\/client_jaas.conf","storm.zookeeper.topology.auth.scheme":"digest","topology.workers":2,"storm.thrift.transport":"org.apache.storm.security.auth.kerberos.KerberosSaslTransportPlugin","topology.debug":true,"storm.zookeeper.topology.auth.payload":"-7659255060620243743:-5999822419551893831","topology.eventlogger.executors":1}
 (StormSubmitter:320)
2018-04-13 07:34:07,247 WARN - [TestNGInvoker-testRetry():[]] ~ STORM-VERSION 
new 1.2.1.3.0.0.0-1189 old 1.2.1.3.0.0.0-1189 (Utils:2286)
2018-04-13 07:34:13,277 INFO - [TestNGInvoker-testRetry():[]] ~ Finished 
submitting topology: SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE 
(StormSubmitter:328)
2018-04-13 07:34:13,277 INFO - [TestNGInvoker-testRetry():[]] ~ Initializing 
the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook] 
(StormSubmitter:352)
2018-04-13 07:34:13,279 INFO - [TestNGInvoker-testRetry():[]] ~ successfully 
logged in. (Login:300)
2018-04-13 07:34:13,289 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader 
nimbus : host:6627 (NimbusClient:96)
2018-04-13 07:34:13,390 INFO - [TestNGInvoker-testRetry():[]] ~ Invoking the 
registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook] 
(StormSubmitter:360)
2018-04-13 07:34:13,390 INFO - [TestNGInvoker-testRetry():[]] ~ Collecting 
metadata for a new storm topology: 
SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE (StormAtlasHook:88)
2018-04-13 07:34:13,403 WARN - [TestNGInvoker-testRetry():[]] ~ Error occurred 
in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook] 
(StormSubmitter:364)
java.lang.RuntimeException: Atlas hook is unable to process the topology.
 at org.apache.atlas.storm.hook

Re: Review Request 66758: Storm atlas hook fails with NPE

2018-04-23 Thread Ruchi Solani
88)
2018-04-13 07:34:13,403 WARN - [TestNGInvoker-testRetry():[]] ~ Error occurred 
in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook] 
(StormSubmitter:364)
java.lang.RuntimeException: Atlas hook is unable to process the topology.
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:113) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:58) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:275) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:387) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:423)
 [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:404)
 [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at com.hortonworks.storm.st.wrapper.TopoWrap.submit(TopoWrap.java:62) 
[test-classes/:?]
 at 
com.hortonworks.storm.st.wrapper.TopoWrap.submitSuccessfully(TopoWrap.java:112) 
[test-classes/:?]
 at 
com.hortonworks.storm.st.tests.kafka.SpoutRetryTest.testRetry(SpoutRetryTest.java:75)
 [test-classes/:?]
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161]
 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
~[?:1.8.0_161]
 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 ~[?:1.8.0_161]
 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
 at 
org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
 [testng-6.8.5.jar:?]
 at 
org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:46) 
[testng-6.8.5.jar:?]
 at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:37) 
[testng-6.8.5.jar:?]
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
[?:1.8.0_161]
 at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_161]
 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_161]
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_161]
 at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
Caused by: java.lang.NullPointerException
 at 
org.apache.atlas.storm.hook.StormAtlasHook.getKafkaTopicQualifiedName(StormAtlasHook.java:386)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addDataSet(StormAtlasHook.java:207) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addTopologyInputs(StormAtlasHook.java:149)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addTopologyDataSets(StormAtlasHook.java:137)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:95) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 ... 21 more


Diffs
-

  ATLAS-2592.patch PRE-CREATION 
  
addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
 7f725a4 


Diff: https://reviews.apache.org/r/66758/diff/1/


Testing
---

Done with sanity testing


Thanks,

Ruchi Solani



[jira] [Updated] (ATLAS-2592) Storm atlas hook fails with NPE

2018-04-23 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2592:

Attachment: ATLAS-2592.patch

> Storm atlas hook fails with NPE
> ---
>
> Key: ATLAS-2592
> URL: https://issues.apache.org/jira/browse/ATLAS-2592
> Project: Atlas
>  Issue Type: Bug
>        Reporter: Ruchi Solani
>    Assignee: Ruchi Solani
>Priority: Blocker
> Attachments: ATLAS-2592.patch
>
>
> Here is the output of submission request:
> {code}
> 2018-04-13 07:34:04,222 INFO - [TestNGInvoker-testRetry():[]] ~ Setting Kafka 
> consumer property 'auto.offset.reset' to 'earliest' to ensure at-least-once 
> processing (KafkaSpoutConfig:761)
> 2018-04-13 07:34:04,222 INFO - [TestNGInvoker-testRetry():[]] ~ Setting Kafka 
> consumer property 'enable.auto.commit' to 'false', because the spout does not 
> support auto-commit (KafkaSpoutConfig:775)
> 2018-04-13 07:34:04,247 WARN - [TestNGInvoker-testRetry():[]] ~ STORM-VERSION 
> new 1.2.1.3.0.0.0-1189 old null (Utils:2286)
> 2018-04-13 07:34:04,252 INFO - [TestNGInvoker-testRetry():[]] ~ Generated 
> ZooKeeper secret payload for MD5-digest: 
> -7659255060620243743:-5999822419551893831 (StormSubmitter:87)
> 2018-04-13 07:34:04,266 INFO - [TestNGInvoker-testRetry():[]] ~ successfully 
> logged in. (Login:300)
> 2018-04-13 07:34:04,278 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader 
> nimbus : ctr-e138-1518143905142-226131-01-03.hwx.site:6627 
> (NimbusClient:96)
> 2018-04-13 07:34:04,288 INFO - [TestNGInvoker-testRetry():[]] ~ Got AutoCreds 
> [] (AuthUtils:208)
> 2018-04-13 07:34:04,289 INFO - [TestNGInvoker-testRetry():[]] ~ successfully 
> logged in. (Login:300)
> 2018-04-13 07:34:04,300 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader 
> nimbus : ctr-e138-1518143905142-226131-01-03.hwx.site:6627 
> (NimbusClient:96)
> 2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading 
> dependencies - jars... (StormSubmitter:280)
> 2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading 
> dependencies - artifacts... (StormSubmitter:295)
> 2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Dependency 
> Blob keys - jars : [] / artifacts : [] (StormSubmitter:310)
> 2018-04-13 07:34:04,306 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading 
> topology jar 
> /hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar
>  to assigned location: 
> /hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar 
> (StormSubmitter:475)
> Start uploading file 
> '/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar'
>  to 
> '/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar'
>  (295334349 bytes)
> [ ] 307200 / 295334349
> ...
> [==] 295334349 / 295334349
> [==] 295334349 / 295334349
> File 
> '/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar'
>  uploaded to 
> '/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar'
>  (295334349 bytes)
> 2018-04-13 07:34:07,245 INFO - [TestNGInvoker-testRetry():[]] ~ Successfully 
> uploaded topology jar to assigned location: 
> /hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar 
> (StormSubmitter:500)
> 2018-04-13 07:34:07,246 INFO - [TestNGInvoker-testRetry():[]] ~ Submitting 
> topology SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE in distributed 
> mode with conf 
> \{"java.security.auth.login.config":"\/etc\/storm\/conf\/client_jaas.conf","storm.zookeeper.topology.auth.scheme":"digest","topology.workers":2,"storm.thrift.transport":"org.apache.storm.security.auth.kerberos.KerberosSaslTransportPlugin","topology.debug":true,"storm.zookeeper.topology.auth.payload":"-7659255060620243743:-5999822419551893831","topology.eventlogger.executors":1}
>  (StormSubmitter:320)
> 2018-04-13 07:34:07,247 WARN - [TestNGInvoker-testRetry():[]] ~ STORM-VERSION 
> new 1.2.1.3.0.0.0-1189 old 1.2.1.3.0.0.0-1189 (Utils:2286)
> 2018-04-13 07:34:13,277 INFO - [TestNGInvoker-testRetry():[]] ~ Finished 
> submitting topology: SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE 
> (StormSubmitter:328)
> 2018-04-13 07:34:13,277 INFO - [TestNGInvoker-testRetry():[]] ~ Initializing 
> the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook] 
> (StormSubmitt

Re: Review Request 66758: Storm atlas hook fails with NPE

2018-04-23 Thread Ruchi Solani
88)
2018-04-13 07:34:13,403 WARN - [TestNGInvoker-testRetry():[]] ~ Error occurred 
in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook] 
(StormSubmitter:364)
java.lang.RuntimeException: Atlas hook is unable to process the topology.
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:113) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:58) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:275) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:387) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:423)
 [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:404)
 [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at com.hortonworks.storm.st.wrapper.TopoWrap.submit(TopoWrap.java:62) 
[test-classes/:?]
 at 
com.hortonworks.storm.st.wrapper.TopoWrap.submitSuccessfully(TopoWrap.java:112) 
[test-classes/:?]
 at 
com.hortonworks.storm.st.tests.kafka.SpoutRetryTest.testRetry(SpoutRetryTest.java:75)
 [test-classes/:?]
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161]
 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
~[?:1.8.0_161]
 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 ~[?:1.8.0_161]
 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
 at 
org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
 [testng-6.8.5.jar:?]
 at 
org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:46) 
[testng-6.8.5.jar:?]
 at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:37) 
[testng-6.8.5.jar:?]
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
[?:1.8.0_161]
 at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_161]
 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_161]
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_161]
 at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
Caused by: java.lang.NullPointerException
 at 
org.apache.atlas.storm.hook.StormAtlasHook.getKafkaTopicQualifiedName(StormAtlasHook.java:386)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addDataSet(StormAtlasHook.java:207) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addTopologyInputs(StormAtlasHook.java:149)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addTopologyDataSets(StormAtlasHook.java:137)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:95) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 ... 21 more


Diffs
-

  ATLAS-2592.patch PRE-CREATION 
  
addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
 7f725a4 


Diff: https://reviews.apache.org/r/66758/diff/1/


Testing (updated)
---

Done with sanity testing


Thanks,

Ruchi Solani



Review Request 66758: Storm atlas hook fails with NPE

2018-04-23 Thread Ruchi Solani
88)
2018-04-13 07:34:13,403 WARN - [TestNGInvoker-testRetry():[]] ~ Error occurred 
in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook] 
(StormSubmitter:364)
java.lang.RuntimeException: Atlas hook is unable to process the topology.
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:113) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:58) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:275) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:387) 
[storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:423)
 [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at 
org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:404)
 [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
 at com.hortonworks.storm.st.wrapper.TopoWrap.submit(TopoWrap.java:62) 
[test-classes/:?]
 at 
com.hortonworks.storm.st.wrapper.TopoWrap.submitSuccessfully(TopoWrap.java:112) 
[test-classes/:?]
 at 
com.hortonworks.storm.st.tests.kafka.SpoutRetryTest.testRetry(SpoutRetryTest.java:75)
 [test-classes/:?]
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161]
 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
~[?:1.8.0_161]
 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 ~[?:1.8.0_161]
 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
 at 
org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
 [testng-6.8.5.jar:?]
 at 
org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:46) 
[testng-6.8.5.jar:?]
 at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:37) 
[testng-6.8.5.jar:?]
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
[?:1.8.0_161]
 at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_161]
 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_161]
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_161]
 at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
Caused by: java.lang.NullPointerException
 at 
org.apache.atlas.storm.hook.StormAtlasHook.getKafkaTopicQualifiedName(StormAtlasHook.java:386)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addDataSet(StormAtlasHook.java:207) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addTopologyInputs(StormAtlasHook.java:149)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at 
org.apache.atlas.storm.hook.StormAtlasHook.addTopologyDataSets(StormAtlasHook.java:137)
 ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:95) 
~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
 ... 21 more


Diffs
-

  ATLAS-2592.patch PRE-CREATION 
  
addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
 7f725a4 


Diff: https://reviews.apache.org/r/66758/diff/1/


Testing
---

Done with sanitry testing


Thanks,

Ruchi Solani



[jira] [Created] (ATLAS-2592) Storm atlas hook fails with NPE

2018-04-23 Thread Ruchi Solani (JIRA)
Ruchi Solani created ATLAS-2592:
---

 Summary: Storm atlas hook fails with NPE
 Key: ATLAS-2592
 URL: https://issues.apache.org/jira/browse/ATLAS-2592
 Project: Atlas
  Issue Type: Bug
Reporter: Ruchi Solani


Here is the output of submission request:
{code}
2018-04-13 07:34:04,222 INFO - [TestNGInvoker-testRetry():[]] ~ Setting Kafka 
consumer property 'auto.offset.reset' to 'earliest' to ensure at-least-once 
processing (KafkaSpoutConfig:761)
2018-04-13 07:34:04,222 INFO - [TestNGInvoker-testRetry():[]] ~ Setting Kafka 
consumer property 'enable.auto.commit' to 'false', because the spout does not 
support auto-commit (KafkaSpoutConfig:775)
2018-04-13 07:34:04,247 WARN - [TestNGInvoker-testRetry():[]] ~ STORM-VERSION 
new 1.2.1.3.0.0.0-1189 old null (Utils:2286)
2018-04-13 07:34:04,252 INFO - [TestNGInvoker-testRetry():[]] ~ Generated 
ZooKeeper secret payload for MD5-digest: 
-7659255060620243743:-5999822419551893831 (StormSubmitter:87)
2018-04-13 07:34:04,266 INFO - [TestNGInvoker-testRetry():[]] ~ successfully 
logged in. (Login:300)
2018-04-13 07:34:04,278 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader 
nimbus : ctr-e138-1518143905142-226131-01-03.hwx.site:6627 (NimbusClient:96)
2018-04-13 07:34:04,288 INFO - [TestNGInvoker-testRetry():[]] ~ Got AutoCreds 
[] (AuthUtils:208)
2018-04-13 07:34:04,289 INFO - [TestNGInvoker-testRetry():[]] ~ successfully 
logged in. (Login:300)
2018-04-13 07:34:04,300 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader 
nimbus : ctr-e138-1518143905142-226131-01-03.hwx.site:6627 (NimbusClient:96)
2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading 
dependencies - jars... (StormSubmitter:280)
2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading 
dependencies - artifacts... (StormSubmitter:295)
2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Dependency Blob 
keys - jars : [] / artifacts : [] (StormSubmitter:310)
2018-04-13 07:34:04,306 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading 
topology jar 
/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar
 to assigned location: 
/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar 
(StormSubmitter:475)
Start uploading file 
'/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar'
 to 
'/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar' 
(295334349 bytes)

[ ] 307200 / 295334349
...
[==] 295334349 / 295334349
[==] 295334349 / 295334349
File 
'/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar'
 uploaded to 
'/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar' 
(295334349 bytes)
2018-04-13 07:34:07,245 INFO - [TestNGInvoker-testRetry():[]] ~ Successfully 
uploaded topology jar to assigned location: 
/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar 
(StormSubmitter:500)
2018-04-13 07:34:07,246 INFO - [TestNGInvoker-testRetry():[]] ~ Submitting 
topology SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE in distributed mode 
with conf 
\{"java.security.auth.login.config":"\/etc\/storm\/conf\/client_jaas.conf","storm.zookeeper.topology.auth.scheme":"digest","topology.workers":2,"storm.thrift.transport":"org.apache.storm.security.auth.kerberos.KerberosSaslTransportPlugin","topology.debug":true,"storm.zookeeper.topology.auth.payload":"-7659255060620243743:-5999822419551893831","topology.eventlogger.executors":1}
 (StormSubmitter:320)
2018-04-13 07:34:07,247 WARN - [TestNGInvoker-testRetry():[]] ~ STORM-VERSION 
new 1.2.1.3.0.0.0-1189 old 1.2.1.3.0.0.0-1189 (Utils:2286)
2018-04-13 07:34:13,277 INFO - [TestNGInvoker-testRetry():[]] ~ Finished 
submitting topology: SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE 
(StormSubmitter:328)
2018-04-13 07:34:13,277 INFO - [TestNGInvoker-testRetry():[]] ~ Initializing 
the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook] 
(StormSubmitter:352)
2018-04-13 07:34:13,279 INFO - [TestNGInvoker-testRetry():[]] ~ successfully 
logged in. (Login:300)
2018-04-13 07:34:13,289 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader 
nimbus : ctr-e138-1518143905142-226131-01-03.hwx.site:6627 (NimbusClient:96)
2018-04-13 07:34:13,390 INFO - [TestNGInvoker-testRetry():[]] ~ Invoking the 
registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook] 
(StormSubmitter:360)
2018-04-13 07:34:13,390 INFO - [TestNGInvoker-testRetry():[]] ~ Collecting 
metadata for a new storm topology: 
SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE (StormAtlasHook:88)
2018-04-13 07:34:13,403 WARN - [TestNGIn

Re: Review Request 66507: ATLAS-2545 Update Storm hook to use V2 notifications

2018-04-10 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66507/
---

(Updated April 10, 2018, 9:03 a.m.)


Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2545
https://issues.apache.org/jira/browse/ATLAS-2545


Repository: atlas


Description
---

Atlas server was enhanced to process notifications that use V2 data structures 
In 0.8.2 release (ATLAS-2421). HBase hook was updated to replace use of V1 data 
structures in notifications with V2 types. This Jira is to track similar update 
of Storm.


Diffs (updated)
-

  addons/storm-bridge/pom.xml 3446dcb7e 
  
addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
 110ec521f 
  pom.xml 1934abf84 


Diff: https://reviews.apache.org/r/66507/diff/2/

Changes: https://reviews.apache.org/r/66507/diff/1-2/


Testing
---

Done with Sanity Test


Thanks,

Ruchi Solani



[jira] [Updated] (ATLAS-2545) Update Storm hook to use V2 notifications

2018-04-09 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2545:

Attachment: ATLAS-2545.patch

> Update Storm hook to use V2 notifications
> -
>
> Key: ATLAS-2545
> URL: https://issues.apache.org/jira/browse/ATLAS-2545
> Project: Atlas
>  Issue Type: Bug
>        Reporter: Ruchi Solani
>    Assignee: Ruchi Solani
>Priority: Major
> Attachments: ATLAS-2545.patch
>
>
> Atlas server was enhanced to process notifications that use V2 data 
> structures In 0.8.2 release (ATLAS-2421). HBase hook was updated to replace 
> use of V1 data structures in notifications with V2 types. This Jira is to 
> track similar update of Storm.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Review Request 66507: ATLAS-2545 Update Storm hook to use V2 notifications

2018-04-09 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66507/
---

Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2545
https://issues.apache.org/jira/browse/ATLAS-2545


Repository: atlas


Description
---

Atlas server was enhanced to process notifications that use V2 data structures 
In 0.8.2 release (ATLAS-2421). HBase hook was updated to replace use of V1 data 
structures in notifications with V2 types. This Jira is to track similar update 
of Storm.


Diffs
-

  addons/storm-bridge/pom.xml 3446dcb 
  
addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
 110ec52 
  pom.xml 4d2ab73 


Diff: https://reviews.apache.org/r/66507/diff/1/


Testing
---

Done with Sanity Test


Thanks,

Ruchi Solani



[jira] [Assigned] (ATLAS-2545) Update Storm hook to use V2 notifications

2018-04-09 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani reassigned ATLAS-2545:
---

Assignee: Ruchi Solani

> Update Storm hook to use V2 notifications
> -
>
> Key: ATLAS-2545
> URL: https://issues.apache.org/jira/browse/ATLAS-2545
> Project: Atlas
>  Issue Type: Bug
>        Reporter: Ruchi Solani
>    Assignee: Ruchi Solani
>Priority: Major
>
> Atlas server was enhanced to process notifications that use V2 data 
> structures In 0.8.2 release (ATLAS-2421). HBase hook was updated to replace 
> use of V1 data structures in notifications with V2 types. This Jira is to 
> track similar update of Storm.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2545) Update Storm hook to use V2 notifications

2018-04-09 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2545:

Description: Atlas server was enhanced to process notifications that use V2 
data structures In 0.8.2 release (ATLAS-2421). HBase hook was updated to 
replace use of V1 data structures in notifications with V2 types. This Jira is 
to track similar update of Storm.

> Update Storm hook to use V2 notifications
> -
>
> Key: ATLAS-2545
> URL: https://issues.apache.org/jira/browse/ATLAS-2545
> Project: Atlas
>  Issue Type: Bug
>        Reporter: Ruchi Solani
>Priority: Major
>
> Atlas server was enhanced to process notifications that use V2 data 
> structures In 0.8.2 release (ATLAS-2421). HBase hook was updated to replace 
> use of V1 data structures in notifications with V2 types. This Jira is to 
> track similar update of Storm.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ATLAS-2545) Update Storm hook to use V2 notifications

2018-04-09 Thread Ruchi Solani (JIRA)
Ruchi Solani created ATLAS-2545:
---

 Summary: Update Storm hook to use V2 notifications
 Key: ATLAS-2545
 URL: https://issues.apache.org/jira/browse/ATLAS-2545
 Project: Atlas
  Issue Type: Bug
Reporter: Ruchi Solani






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Review Request 65813: ATLAS-2462 Sqoop import for all tables throws NPE for no table provided in command

2018-03-23 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65813/
---

(Updated March 23, 2018, 11:50 a.m.)


Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2462
https://issues.apache.org/jira/browse/ATLAS-2462


Repository: atlas


Description
---

When tried importing a specific table with below command there is no error:

sqoop import --connect jdbc:mysql://localhost/test --table testtable221 
--hive-import --hive-database sqoopimport023 --hive-table hivetesttable221 
--username root -P -m 1 --fetch-size 1

When tried to import all tables from a specific database using below command, 
got NP error:

sqoop import-all-tables --connect jdbc:mysql://localhost/test --hive-import 
--hive-database sqoopimport022 --username root -P -m 1 --fetch-size 1


Diffs (updated)
-

  addons/sqoop-bridge/src/main/java/org/apache/atlas/sqoop/hook/SqoopHook.java 
9e43430 


Diff: https://reviews.apache.org/r/65813/diff/3/

Changes: https://reviews.apache.org/r/65813/diff/2-3/


Testing
---

sanity testing done.


Thanks,

Ruchi Solani



Re: Review Request 65813: ATLAS-2462 Sqoop import for all tables throws NPE for no table provided in command

2018-02-27 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65813/
---

(Updated Feb. 27, 2018, 11:24 a.m.)


Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2462
https://issues.apache.org/jira/browse/ATLAS-2462


Repository: atlas


Description
---

When tried importing a specific table with below command there is no error:

sqoop import --connect jdbc:mysql://localhost/test --table testtable221 
--hive-import --hive-database sqoopimport023 --hive-table hivetesttable221 
--username root -P -m 1 --fetch-size 1

When tried to import all tables from a specific database using below command, 
got NP error:

sqoop import-all-tables --connect jdbc:mysql://localhost/test --hive-import 
--hive-database sqoopimport022 --username root -P -m 1 --fetch-size 1


Diffs (updated)
-

  addons/sqoop-bridge/src/main/java/org/apache/atlas/sqoop/hook/SqoopHook.java 
06a0e9c 
  intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 2f870dc 


Diff: https://reviews.apache.org/r/65813/diff/2/

Changes: https://reviews.apache.org/r/65813/diff/1-2/


Testing
---

sanity testing done.


Thanks,

Ruchi Solani



Review Request 65813: ATLAS-2462 Sqoop import for all tables throws NPE for no table provided in command

2018-02-26 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65813/
---

Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2462
https://issues.apache.org/jira/browse/ATLAS-2462


Repository: atlas


Description
---

When tried importing a specific table with below command there is no error:

sqoop import --connect jdbc:mysql://localhost/test --table testtable221 
--hive-import --hive-database sqoopimport023 --hive-table hivetesttable221 
--username root -P -m 1 --fetch-size 1

When tried to import all tables from a specific database using below command, 
got NP error:

sqoop import-all-tables --connect jdbc:mysql://localhost/test --hive-import 
--hive-database sqoopimport022 --username root -P -m 1 --fetch-size 1


Diffs
-

  addons/sqoop-bridge/src/main/java/org/apache/atlas/sqoop/hook/SqoopHook.java 
06a0e9c 


Diff: https://reviews.apache.org/r/65813/diff/1/


Testing
---

sanity testing done.


Thanks,

Ruchi Solani



[jira] [Updated] (ATLAS-2462) Sqoop import for all tables throws NPE for no table provided in command

2018-02-26 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2462:

Attachment: ATLAS-2462.patch

> Sqoop import for all tables throws NPE for no table provided in command
> ---
>
> Key: ATLAS-2462
> URL: https://issues.apache.org/jira/browse/ATLAS-2462
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0-alpha, 0.8.2
>Reporter: Ruchi Solani
>    Assignee: Ruchi Solani
>Priority: Minor
> Fix For: 1.0.0
>
> Attachments: ATLAS-2462.patch
>
>
> Created a cluster and tried importing tables from mysql using sqoop commands.
>  * When tried importing a specific table with below command there is no error:
> sqoop import --connect jdbc:mysql://localhost/test --table testtable221 
> --hive-import --hive-database sqoopimport023 --hive-table hivetesttable221 
> --username root -P -m 1 --fetch-size 1
>  * When tried to import all tables from a specific database using below 
> command, got below error:
> sqoop import-all-tables --connect jdbc:mysql://localhost/test --hive-import 
> --hive-database sqoopimport022 --username root -P -m 1 --fetch-size 1
> {noformat}
> 17/12/28 05:38:31 WARN mapreduce.PublishJobData: Unable to publish import 
> data to publisher SqoopHook.publish() failed.
> org.apache.atlas.hook.AtlasHookException: SqoopHook.publish() failed.
>   at org.apache.atlas.sqoop.hook.SqoopHook.publish(SqoopHook.java:193)
>   at org.apache.atlas.sqoop.hook.SqoopHook.publish(SqoopHook.java:51)
>   at 
> org.apache.sqoop.mapreduce.PublishJobData.publishJobData(PublishJobData.java:52)
>   at 
> org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:284)
>   at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)
>   at 
> org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)
>   at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:507)
>   at 
> org.apache.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesTool.java:111)
>   at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
>   at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
>   at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
>   at org.apache.sqoop.Sqoop.runTool(Sqoop.java:225)
>   at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
>   at org.apache.sqoop.Sqoop.main(Sqoop.java:243)
> Caused by: java.lang.NullPointerException
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.getTableQualifiedName(HiveMetaStoreBridge.java:383)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.getTableQualifiedName(HiveMetaStoreBridge.java:412)
>   at 
> org.apache.atlas.sqoop.hook.SqoopHook.createHiveTableInstance(SqoopHook.java:88)
>   at org.apache.atlas.sqoop.hook.SqoopHook.publish(SqoopHook.java:183)
>   ... 13 more{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ATLAS-2462) Sqoop import for all tables throws NPE for no table provided in command

2018-02-26 Thread Ruchi Solani (JIRA)
Ruchi Solani created ATLAS-2462:
---

 Summary: Sqoop import for all tables throws NPE for no table 
provided in command
 Key: ATLAS-2462
 URL: https://issues.apache.org/jira/browse/ATLAS-2462
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 0.8.2, 1.0.0-alpha
Reporter: Ruchi Solani
Assignee: Ruchi Solani
 Fix For: 1.0.0


Created a cluster and tried importing tables from mysql using sqoop commands.
 * When tried importing a specific table with below command there is no error:
sqoop import --connect jdbc:mysql://localhost/test --table testtable221 
--hive-import --hive-database sqoopimport023 --hive-table hivetesttable221 
--username root -P -m 1 --fetch-size 1

 * When tried to import all tables from a specific database using below 
command, got below error:
sqoop import-all-tables --connect jdbc:mysql://localhost/test --hive-import 
--hive-database sqoopimport022 --username root -P -m 1 --fetch-size 1

{noformat}
17/12/28 05:38:31 WARN mapreduce.PublishJobData: Unable to publish import data 
to publisher SqoopHook.publish() failed.
org.apache.atlas.hook.AtlasHookException: SqoopHook.publish() failed.
at org.apache.atlas.sqoop.hook.SqoopHook.publish(SqoopHook.java:193)
at org.apache.atlas.sqoop.hook.SqoopHook.publish(SqoopHook.java:51)
at 
org.apache.sqoop.mapreduce.PublishJobData.publishJobData(PublishJobData.java:52)
at 
org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:284)
at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)
at 
org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:507)
at 
org.apache.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesTool.java:111)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:225)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.main(Sqoop.java:243)
Caused by: java.lang.NullPointerException
at 
org.apache.atlas.hive.bridge.HiveMetaStoreBridge.getTableQualifiedName(HiveMetaStoreBridge.java:383)
at 
org.apache.atlas.hive.bridge.HiveMetaStoreBridge.getTableQualifiedName(HiveMetaStoreBridge.java:412)
at 
org.apache.atlas.sqoop.hook.SqoopHook.createHiveTableInstance(SqoopHook.java:88)
at org.apache.atlas.sqoop.hook.SqoopHook.publish(SqoopHook.java:183)
... 13 more{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Review Request 64538: ATLAS-2310 In HA, the passive node redirects the request with wrong URL encoding

2018-01-08 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64538/#review195017
---


Ship it!




Ship It!

- Ruchi Solani


On Dec. 12, 2017, 12:30 p.m., Gergo Barna wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/64538/
> ---
> 
> (Updated Dec. 12, 2017, 12:30 p.m.)
> 
> 
> Review request for atlas, Madhan Neethiraj and Nixon Rodrigues.
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> In HA, the passive node redirects the request with wrong URL encoding. 
> Instead of encoding only the values, the whole query is encoded as a single 
> string.
> 
> 
> Diffs
> -
> 
>   webapp/src/main/java/org/apache/atlas/web/filters/ActiveServerFilter.java 
> c68c4b2 
>   
> webapp/src/test/java/org/apache/atlas/web/filters/ActiveServerFilterTest.java 
> 60f3d48 
> 
> 
> Diff: https://reviews.apache.org/r/64538/diff/1/
> 
> 
> Testing
> ---
> 
> tested locally
> 
> 
> Thanks,
> 
> Gergo Barna
> 
>



[jira] [Created] (ATLAS-2316) Audit when Hive table is created has ENTITY_UPDATE instead of ENTITY_CREATE

2017-12-18 Thread Ruchi Solani (JIRA)
Ruchi Solani created ATLAS-2316:
---

 Summary: Audit when Hive table is created has ENTITY_UPDATE 
instead of ENTITY_CREATE
 Key: ATLAS-2316
 URL: https://issues.apache.org/jira/browse/ATLAS-2316
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 1.0.0
Reporter: Ruchi Solani
Assignee: Ruchi Solani
 Fix For: 1.0.0


* Created hive_table through Hive beeline CLI. Audits for the hive_table has 
ENTITY_UPDATE instead of ENTITY_CREATE.
* Created an hive_db entity through beeline CLI and an hdfs_path entity on 
Atlas UI . Both the entities had ENTITY_CREATE audit.
* Attached the JSON sent to ATLAS_HOOK from Hive.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Re: Review Request 64296: Extra parameter "description" added when creating a type

2017-12-04 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64296/
---

(Updated Dec. 4, 2017, 11:24 a.m.)


Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2294
https://issues.apache.org/jira/browse/ATLAS-2294


Repository: atlas


Description
---

When creating a type , there is inconsistency with "description" parameter of 
the attributes in the type definition.
For example :
1.Adding no description parameter in the POST adds “description” :”” in the 
created type.
2.Adding “description” : “null" in the POST , no description parameter is found 
in the created type.


Diffs
-

  
intg/src/main/java/org/apache/atlas/model/typedef/AtlasRelationshipEndDef.java 
5847eaf 
  intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 8f7f56f 


Diff: https://reviews.apache.org/r/64296/diff/1/


Testing (updated)
---

Done sanity testing.


Thanks,

Ruchi Solani



[jira] [Assigned] (ATLAS-2294) Extra parameter "description" added when creating a type

2017-12-04 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani reassigned ATLAS-2294:
---

Assignee: Ruchi Solani

> Extra parameter "description" added when creating a type
> 
>
> Key: ATLAS-2294
> URL: https://issues.apache.org/jira/browse/ATLAS-2294
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>Reporter: Sharmadha Sainath
>Assignee: Ruchi Solani
> Fix For: 1.0.0
>
> Attachments: ATLAS-2294.patch
>
>
> When creating a type , there is inconsistency with "description" parameter of 
> the attributes in the type definition.
> For example :
> 1.Adding no description parameter in the POST adds “description” :”” in the 
> created type.
> 2.Adding “description” : “null" in the POST , no description parameter is 
> found in the created type.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ATLAS-2294) Extra parameter "description" added when creating a type

2017-12-04 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2294:

Fix Version/s: 1.0.0

> Extra parameter "description" added when creating a type
> 
>
> Key: ATLAS-2294
> URL: https://issues.apache.org/jira/browse/ATLAS-2294
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>Reporter: Sharmadha Sainath
>Assignee: Ruchi Solani
> Fix For: 1.0.0
>
> Attachments: ATLAS-2294.patch
>
>
> When creating a type , there is inconsistency with "description" parameter of 
> the attributes in the type definition.
> For example :
> 1.Adding no description parameter in the POST adds “description” :”” in the 
> created type.
> 2.Adding “description” : “null" in the POST , no description parameter is 
> found in the created type.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ATLAS-2294) Extra parameter "description" added when creating a type

2017-12-04 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2294:

Attachment: ATLAS-2294.patch

> Extra parameter "description" added when creating a type
> 
>
> Key: ATLAS-2294
> URL: https://issues.apache.org/jira/browse/ATLAS-2294
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>Reporter: Sharmadha Sainath
> Attachments: ATLAS-2294.patch
>
>
> When creating a type , there is inconsistency with "description" parameter of 
> the attributes in the type definition.
> For example :
> 1.Adding no description parameter in the POST adds “description” :”” in the 
> created type.
> 2.Adding “description” : “null" in the POST , no description parameter is 
> found in the created type.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Issue Comment Deleted] (ATLAS-1896) Add Cross Origin [CORS] headers for Atlas

2017-07-12 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-1896:

Comment: was deleted

(was: https://reviews.apache.org/r/60794/)

> Add Cross Origin [CORS] headers for Atlas 
> --
>
> Key: ATLAS-1896
> URL: https://issues.apache.org/jira/browse/ATLAS-1896
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>    Assignee: Ruchi Solani
> Attachments: 0001-ATLAS-1896.patch
>
>
> Add Cross Origin [CORS] headers for Atlas, make it configurable from 
> atlas-application properties   



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ATLAS-1896) Add Cross Origin [CORS] headers for Atlas

2017-07-12 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-1896:

Attachment: 0001-ATLAS-1896.patch

https://reviews.apache.org/r/60794/

> Add Cross Origin [CORS] headers for Atlas 
> --
>
> Key: ATLAS-1896
> URL: https://issues.apache.org/jira/browse/ATLAS-1896
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>    Assignee: Ruchi Solani
> Attachments: 0001-ATLAS-1896.patch
>
>
> Add Cross Origin [CORS] headers for Atlas, make it configurable from 
> atlas-application properties   



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Review Request 60794: Add Cross Origin [CORS] headers for Atlas

2017-07-12 Thread Ruchi Solani

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/60794/
---

Review request for atlas and Nixon Rodrigues.


Bugs: ATLAS-1896
https://issues.apache.org/jira/browse/ATLAS-1896


Repository: atlas


Description
---

Add Cross Origin [CORS] headers for Atlas, make it configurable from 
atlas-application properties.

Properties for headers.

atlas.headers.Access-Control-Allow-Origin=*
atlas.headers.Access-Control-Allow-Methods=GET,OPTIONS,HEAD,PUT,POST


Diffs
-

  distro/src/conf/atlas-application.properties 474f253 
  
webapp/src/main/java/org/apache/atlas/web/filters/AtlasAuthenticationFilter.java
 25aede3 


Diff: https://reviews.apache.org/r/60794/diff/1/


Testing
---

Adding header properties and tested by API, All Unit test cases are tested.


Thanks,

Ruchi Solani



[jira] [Updated] (ATLAS-1896) Add Cross Origin [CORS] headers for Atlas

2017-06-30 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-1896:

Attachment: (was: ATLAS-1896.patch)

> Add Cross Origin [CORS] headers for Atlas 
> --
>
> Key: ATLAS-1896
> URL: https://issues.apache.org/jira/browse/ATLAS-1896
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>    Assignee: Ruchi Solani
>
> Add Cross Origin [CORS] headers for Atlas, make it configurable from 
> atlas-application properties   



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ATLAS-1896) Add Cross Origin [CORS] headers for Atlas

2017-06-30 Thread Ruchi Solani (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-1896:

Attachment: ATLAS-1896.patch

> Add Cross Origin [CORS] headers for Atlas 
> --
>
> Key: ATLAS-1896
> URL: https://issues.apache.org/jira/browse/ATLAS-1896
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>    Assignee: Ruchi Solani
> Attachments: ATLAS-1896.patch
>
>
> Add Cross Origin [CORS] headers for Atlas, make it configurable from 
> atlas-application properties   



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)