[jira] [Commented] (ATLAS-4348) Atlas-Kafka Hook : When a producer publishes messages to multiple topics, the latest relationship is marked ACTIVE , rest are marked DELETED

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382369#comment-17382369
 ] 

ASF subversion and git services commented on ATLAS-4348:


Commit 8fb29d30baf9328687916cb6cdf4981a7915d805 in atlas's branch 
refs/heads/branch-2.0 from Radhika Kundam
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=8fb29d3 ]

ATLAS-4348: Atlas-Kafka Hook : When a producer publishes messages to multiple 
topics, the latest relationship is marked ACTIVE , rest are marked DELETED

Signed-off-by: Sarath Subramanian 
(cherry picked from commit 8725f31af9821907ced99a829b9e0dbbf3f6de2b)


> Atlas-Kafka Hook : When a producer publishes messages to multiple topics, the 
> latest relationship is marked ACTIVE , rest are marked DELETED
> 
>
> Key: ATLAS-4348
> URL: https://issues.apache.org/jira/browse/ATLAS-4348
> Project: Atlas
>  Issue Type: Task
>  Components:  atlas-core
>Affects Versions: 2.1.0
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
> Attachments: 
> 0001-ATLAS-4348-Atlas-Kafka-Hook-appendRelationshipsOnPar.patch
>
>
> *Steps to reproduce the issue*:
> Created 2 topics : test1, test2
> Using console consumer produced messages to test1 and test2.
> Relationship between console-producer-lineage and test1 is ACTIVE now.
> Relationship between console-producer-lineage and test1 is set to DELETED 
> when messages are published to test2.
> *Root cause of issue:*
> When messages published on topic, Atlas hook receives partial_update request 
> with only one topic as output and by default partial update deletes 
> relationships between previous topics by considering the only topic(which is 
> in partial_update request) as the active.
> *Proposed Solution:*
> Introducing typedef option "appendRelationshipsOnPartialUpdate" which will 
> hold list of relationship attribute names. While Atlas startup, it will 
> resolve entity type definition and all the specified relationship attributes 
> definitions will be updated with typedef property "isAppendOnPartialUpdate" 
> only for that entity type. 
> With this solution, we can keep all the previous relationship entries active 
> along with latest relationship entry for the specific entity by providing 
> typedef options as below.
>  "typeDefOptions": { "appendRelationshipsOnPartialUpdate": "[\"inputs\", 
> \"outputs\"]"}
>  
> This solution can be used for any entity type to consider all the existing 
> relationship entries as active along with new entries from partial_update.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (ATLAS-4348) Atlas-Kafka Hook : When a producer publishes messages to multiple topics, the latest relationship is marked ACTIVE , rest are marked DELETED

[Sarath Subramanian (Jira)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-4348:
--
Fix Version/s: 2.2.0
   3.0.0

> Atlas-Kafka Hook : When a producer publishes messages to multiple topics, the 
> latest relationship is marked ACTIVE , rest are marked DELETED
> 
>
> Key: ATLAS-4348
> URL: https://issues.apache.org/jira/browse/ATLAS-4348
> Project: Atlas
>  Issue Type: Task
>  Components:  atlas-core
>Affects Versions: 2.1.0
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
> Fix For: 3.0.0, 2.2.0
>
> Attachments: 
> 0001-ATLAS-4348-Atlas-Kafka-Hook-appendRelationshipsOnPar.patch
>
>
> *Steps to reproduce the issue*:
> Created 2 topics : test1, test2
> Using console consumer produced messages to test1 and test2.
> Relationship between console-producer-lineage and test1 is ACTIVE now.
> Relationship between console-producer-lineage and test1 is set to DELETED 
> when messages are published to test2.
> *Root cause of issue:*
> When messages published on topic, Atlas hook receives partial_update request 
> with only one topic as output and by default partial update deletes 
> relationships between previous topics by considering the only topic(which is 
> in partial_update request) as the active.
> *Proposed Solution:*
> Introducing typedef option "appendRelationshipsOnPartialUpdate" which will 
> hold list of relationship attribute names. While Atlas startup, it will 
> resolve entity type definition and all the specified relationship attributes 
> definitions will be updated with typedef property "isAppendOnPartialUpdate" 
> only for that entity type. 
> With this solution, we can keep all the previous relationship entries active 
> along with latest relationship entry for the specific entity by providing 
> typedef options as below.
>  "typeDefOptions": { "appendRelationshipsOnPartialUpdate": "[\"inputs\", 
> \"outputs\"]"}
>  
> This solution can be used for any entity type to consider all the existing 
> relationship entries as active along with new entries from partial_update.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (ATLAS-4348) Atlas-Kafka Hook : When a producer publishes messages to multiple topics, the latest relationship is marked ACTIVE , rest are marked DELETED

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382367#comment-17382367
 ] 

ASF subversion and git services commented on ATLAS-4348:


Commit 8725f31af9821907ced99a829b9e0dbbf3f6de2b in atlas's branch 
refs/heads/master from Radhika Kundam
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=8725f31 ]

ATLAS-4348: Atlas-Kafka Hook : When a producer publishes messages to multiple 
topics, the latest relationship is marked ACTIVE , rest are marked DELETED

Signed-off-by: Sarath Subramanian 


> Atlas-Kafka Hook : When a producer publishes messages to multiple topics, the 
> latest relationship is marked ACTIVE , rest are marked DELETED
> 
>
> Key: ATLAS-4348
> URL: https://issues.apache.org/jira/browse/ATLAS-4348
> Project: Atlas
>  Issue Type: Task
>  Components:  atlas-core
>Affects Versions: 2.1.0
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
> Attachments: 
> 0001-ATLAS-4348-Atlas-Kafka-Hook-appendRelationshipsOnPar.patch
>
>
> *Steps to reproduce the issue*:
> Created 2 topics : test1, test2
> Using console consumer produced messages to test1 and test2.
> Relationship between console-producer-lineage and test1 is ACTIVE now.
> Relationship between console-producer-lineage and test1 is set to DELETED 
> when messages are published to test2.
> *Root cause of issue:*
> When messages published on topic, Atlas hook receives partial_update request 
> with only one topic as output and by default partial update deletes 
> relationships between previous topics by considering the only topic(which is 
> in partial_update request) as the active.
> *Proposed Solution:*
> Introducing typedef option "appendRelationshipsOnPartialUpdate" which will 
> hold list of relationship attribute names. While Atlas startup, it will 
> resolve entity type definition and all the specified relationship attributes 
> definitions will be updated with typedef property "isAppendOnPartialUpdate" 
> only for that entity type. 
> With this solution, we can keep all the previous relationship entries active 
> along with latest relationship entry for the specific entity by providing 
> typedef options as below.
>  "typeDefOptions": { "appendRelationshipsOnPartialUpdate": "[\"inputs\", 
> \"outputs\"]"}
>  
> This solution can be used for any entity type to consider all the existing 
> relationship entries as active along with new entries from partial_update.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (ATLAS-4150) UI : __AtlasAuditEntry appearing in metrics window

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382179#comment-17382179
 ] 

ASF subversion and git services commented on ATLAS-4150:


Commit 295057f78ae988d4397605c85215495773e0ba13 in atlas's branch 
refs/heads/branch-2.0 from Mandar Ambawane
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=295057f ]

ATLAS-4150 Remove System Internal Entity Types from Metrics GET api.

Signed-off-by: Nikhil Bonte 
(cherry picked from commit 4c7aea1a170a1173fa1bb13023c79d52f5f27799)


> UI : __AtlasAuditEntry appearing in metrics window
> --
>
> Key: ATLAS-4150
> URL: https://issues.apache.org/jira/browse/ATLAS-4150
> Project: Atlas
>  Issue Type: Bug
>Reporter: Rahul Kurup
>Assignee: Mandar Ambawane
>Priority: Minor
> Attachments: ATLAS-4150.patch, Screenshot from 2021-02-09 10-38-46.png
>
>
> !Screenshot from 2021-02-09 10-38-46.png|width=584,height=432!
> As seen in the above screenshot, entries for AtlasAuditEntry are visible. 
> That is an system internal entity and should ideally not be visible in the 
> metrics UI.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (ATLAS-4150) UI : __AtlasAuditEntry appearing in metrics window

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382177#comment-17382177
 ] 

ASF subversion and git services commented on ATLAS-4150:


Commit 4c7aea1a170a1173fa1bb13023c79d52f5f27799 in atlas's branch 
refs/heads/master from Mandar Ambawane
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=4c7aea1 ]

ATLAS-4150 Remove System Internal Entity Types from Metrics GET api.

Signed-off-by: Nikhil Bonte 


> UI : __AtlasAuditEntry appearing in metrics window
> --
>
> Key: ATLAS-4150
> URL: https://issues.apache.org/jira/browse/ATLAS-4150
> Project: Atlas
>  Issue Type: Bug
>Reporter: Rahul Kurup
>Assignee: Mandar Ambawane
>Priority: Minor
> Attachments: ATLAS-4150.patch, Screenshot from 2021-02-09 10-38-46.png
>
>
> !Screenshot from 2021-02-09 10-38-46.png|width=584,height=432!
> As seen in the above screenshot, entries for AtlasAuditEntry are visible. 
> That is an system internal entity and should ideally not be visible in the 
> metrics UI.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 73442: ATLAS-4150 Remove System Internal Entity Types from Metrics GET api

[Nikhil Bonte]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73442/#review223237
---


Ship it!




Ship It!

- Nikhil Bonte


On July 9, 2021, 1:11 p.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73442/
> ---
> 
> (Updated July 9, 2021, 1:11 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Jayendra Parab, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-4150
> https://issues.apache.org/jira/browse/ATLAS-4150
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This patch checks all the Super Types of an Entity Type. If any of the Super 
> Types is __internal
> 
> Then it will not allow that Entity Type in Metrics api response.
> 
> 
> Diffs
> -
> 
>   repository/src/main/java/org/apache/atlas/services/MetricsService.java 
> e721108d3 
>   repository/src/test/java/org/apache/atlas/services/MetricsServiceTest.java 
> bea8eb8b5 
> 
> 
> Diff: https://reviews.apache.org/r/73442/diff/1/
> 
> 
> Testing
> ---
> 
> PreCommit: 
> https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/734/consoleFull
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>

Re: Review Request 73442: ATLAS-4150 Remove System Internal Entity Types from Metrics GET api

[Nikhil Bonte]

> On July 16, 2021, 6:44 p.m., Mandar Ambawane wrote:
> > repository/src/main/java/org/apache/atlas/services/MetricsService.java
> > Lines 248 (patched)
> > 
> >
> > I have put this check to make sure there will not be any NPE.
> > Suppose user creates one user-defined entity typedef without having any 
> > super type.
> > Then, there might be a chance of getting Null value for 
> > entityDef.getSuperTypes()

Refer 
https://github.com/apache/atlas/blob/c1dc84cdeeb1b5c3a53f2bec01ae138e5f578dd1/intg/src/main/java/org/apache/atlas/model/typedef/AtlasEntityDef.java#L152
This suggests that there is no possibility of NPE


- Nikhil


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73442/#review223235
---


On July 9, 2021, 1:11 p.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73442/
> ---
> 
> (Updated July 9, 2021, 1:11 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Jayendra Parab, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-4150
> https://issues.apache.org/jira/browse/ATLAS-4150
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This patch checks all the Super Types of an Entity Type. If any of the Super 
> Types is __internal
> 
> Then it will not allow that Entity Type in Metrics api response.
> 
> 
> Diffs
> -
> 
>   repository/src/main/java/org/apache/atlas/services/MetricsService.java 
> e721108d3 
>   repository/src/test/java/org/apache/atlas/services/MetricsServiceTest.java 
> bea8eb8b5 
> 
> 
> Diff: https://reviews.apache.org/r/73442/diff/1/
> 
> 
> Testing
> ---
> 
> PreCommit: 
> https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/734/consoleFull
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>

Re: Review Request 73442: ATLAS-4150 Remove System Internal Entity Types from Metrics GET api

[Mandar Ambawane]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73442/#review223235
---




repository/src/main/java/org/apache/atlas/services/MetricsService.java
Lines 248 (patched)


I have put this check to make sure there will not be any NPE.
Suppose user creates one user-defined entity typedef without having any 
super type.
Then, there might be a chance of getting Null value for 
entityDef.getSuperTypes()


- Mandar Ambawane


On July 9, 2021, 7:41 a.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73442/
> ---
> 
> (Updated July 9, 2021, 7:41 a.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Jayendra Parab, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-4150
> https://issues.apache.org/jira/browse/ATLAS-4150
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This patch checks all the Super Types of an Entity Type. If any of the Super 
> Types is __internal
> 
> Then it will not allow that Entity Type in Metrics api response.
> 
> 
> Diffs
> -
> 
>   repository/src/main/java/org/apache/atlas/services/MetricsService.java 
> e721108d3 
>   repository/src/test/java/org/apache/atlas/services/MetricsServiceTest.java 
> bea8eb8b5 
> 
> 
> Diff: https://reviews.apache.org/r/73442/diff/1/
> 
> 
> Testing
> ---
> 
> PreCommit: 
> https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/734/consoleFull
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>

Re: Review Request 73442: ATLAS-4150 Remove System Internal Entity Types from Metrics GET api

[Nikhil Bonte]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73442/#review223234
---


Fix it, then Ship it!




Fix & Ship


repository/src/main/java/org/apache/atlas/services/MetricsService.java
Lines 248 (patched)


CollectionUtils.isNotEmpty(entityDef.getSuperTypes())

I think this check is not required, please review & remove.


- Nikhil Bonte


On July 9, 2021, 1:11 p.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73442/
> ---
> 
> (Updated July 9, 2021, 1:11 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Jayendra Parab, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-4150
> https://issues.apache.org/jira/browse/ATLAS-4150
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> This patch checks all the Super Types of an Entity Type. If any of the Super 
> Types is __internal
> 
> Then it will not allow that Entity Type in Metrics api response.
> 
> 
> Diffs
> -
> 
>   repository/src/main/java/org/apache/atlas/services/MetricsService.java 
> e721108d3 
>   repository/src/test/java/org/apache/atlas/services/MetricsServiceTest.java 
> bea8eb8b5 
> 
> 
> Diff: https://reviews.apache.org/r/73442/diff/1/
> 
> 
> Testing
> ---
> 
> PreCommit: 
> https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/734/consoleFull
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>

[jira] [Created] (ATLAS-4362) Basic Search : Support filtering with multiple entity/classification type with its corresponding attributes

[Pinal (Jira)]

Pinal created ATLAS-4362:


 Summary: Basic Search : Support filtering with multiple 
entity/classification type with its corresponding attributes
 Key: ATLAS-4362
 URL: https://issues.apache.org/jira/browse/ATLAS-4362
 Project: Atlas
  Issue Type: Improvement
  Components:  atlas-core
Reporter: Pinal
Assignee: Pinal


* Searching with multiple entity/classification type like hive_table, 
hive_column is possible in basic search.
 * Searching with multiple entity/classification type like hive_table, 
hive_column with common attributes like system Attributes or attribute to be 
search present in both the type is possible.
 * But searching with multiple entity/classification type like hive_table, 
hive_column with its respective attributes like hive_table.tableType is not 
possible

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381931#comment-17381931
 ] 

ighack commented on ATLAS-4361:
---

I *kadmin.local -q "ktadd -k /hadoop/app/jztwk.keytab -norandkey 
jztwk/had...@join.com"*

 

jzyc@bigdser5:/hadoop/app$ chmod 777 jztwk.keytab 
jzyc@bigdser5:/hadoop/app$ klist -ke /hadoop/app/jztwk.keytab 
Keytab name: FILE:/hadoop/app/jztwk.keytab
KVNO Principal
 --
 3 jztwk/had...@join.com (aes256-cts-hmac-sha1-96) 
 3 jztwk/had...@join.com (aes128-cts-hmac-sha1-96) 
jzyc@bigdser5:/hadoop/app$ kinit -kt /hadoop/app/jztwk.keytab 
jztwk/had...@join.com
jzyc@bigdser5:/hadoop/app$ klist
Ticket cache: FILE:/tmp/krb5cc_1025
Default principal: jztwk/had...@join.com

Valid starting Expires Service principal
07/16/2021 17:36:48 07/17/2021 17:36:48 
[krbtgt/join@join.com|mailto:krbtgt/join@join.com]

 

and scp all node

 

I also get the same error.

> Hive Hook can't send notification
> -
>
> Key: ATLAS-4361
> URL: https://issues.apache.org/jira/browse/ATLAS-4361
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Blocker
> Attachments: 20210716165232274.png
>
>
> when I create a view
> I get a error 
>  
> Caused by: javax.security.auth.login.LoginException: Could not login: the 
> client is being asked for a password, but the Kafka client code does not 
> currently support obtaining a password from the user. not available to garner 
> authentication information from the user
>  
> but I make sure keytab and principal is correct
> #Enable for Kerberized Kafka clusters
>  atlas.notification.kafka.service.principal=jztwk/had...@join.com
>  atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
>  atlas.kafka.security.protocol=SASL_PLAINTEXT
>  atlas.kafka.sasl.kerberos.service.name=kafka
> ##JAAS Configuration 
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
>  atlas.jaas.KafkaClient.loginModuleControlFlag=required
>  atlas.jaas.KafkaClient.option.useKeyTab=true
>  atlas.jaas.KafkaClient.option.storeKey=true
>  atlas.jaas.KafkaClient.option.serviceName=kafka
>  atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
>  
> [atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]
>  
> and I modify 
> [KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
>  add a debug
> LOG.debug("sasl.jaas.config is " + newJaasProperty);
>  
> I see  
> sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
> keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
> principal="jztwk/had...@join.com" ;*
> in log 
> I use this config to my application.
> that is OK.
>  
> Properties props = new Properties();
>  props.put("bootstrap.servers", 
> "bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
> props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
> required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
> principal=\"jztwk/had...@join.com\" ;");
>  props.put("security.protocol", "SASL_PLAINTEXT");
>  props.put("sasl.kerberos.service.name", "kafka");
> props.put("key.serializer", 
> "org.apache.kafka.common.serialization.StringSerializer");
>  props.put("value.serializer", 
> "org.apache.kafka.common.serialization.StringSerializer");
>  KafkaProducer producer = new KafkaProducer<>(props);
>  
> and I can run import-hive.sh
> so, I don't understand why
>  
> all node I have run *kinit -kt /hadoop/app/jztwk.keytab 
> [jztwk/had...@join.com|mailto:jztwk/had...@join.com]*
> -rwxr-xr-x 1 jzyc jzyc 146 Jul 14 08:46 /hadoop/app/jztwk.keytab
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Comment Edited] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381931#comment-17381931
 ] 

ighack edited comment on ATLAS-4361 at 7/16/21, 9:39 AM:
-

I *kadmin.local -q "ktadd -k /hadoop/app/jztwk.keytab -norandkey 
jztwk/had...@join.com"*

 

jzyc@bigdser5:/hadoop/app$ chmod 777 jztwk.keytab 
 jzyc@bigdser5:/hadoop/app$ klist -ke /hadoop/app/jztwk.keytab 
 Keytab name: FILE:/hadoop/app/jztwk.keytab
 KVNO Principal
  --
 3 jztwk/had...@join.com (aes256-cts-hmac-sha1-96) 
 3 jztwk/had...@join.com (aes128-cts-hmac-sha1-96) 
 jzyc@bigdser5:/hadoop/app$ kinit -kt /hadoop/app/jztwk.keytab 
jztwk/had...@join.com
 jzyc@bigdser5:/hadoop/app$ klist
 Ticket cache: FILE:/tmp/krb5cc_1025
 Default principal: jztwk/had...@join.com

Valid starting Expires Service principal
 07/16/2021 17:36:48 07/17/2021 17:36:48 
[krbtgt/join@join.com|mailto:krbtgt/join@join.com]

 

and scp to all node

 

I also get the same error.


was (Author: ighack):
I *kadmin.local -q "ktadd -k /hadoop/app/jztwk.keytab -norandkey 
jztwk/had...@join.com"*

 

jzyc@bigdser5:/hadoop/app$ chmod 777 jztwk.keytab 
jzyc@bigdser5:/hadoop/app$ klist -ke /hadoop/app/jztwk.keytab 
Keytab name: FILE:/hadoop/app/jztwk.keytab
KVNO Principal
 --
 3 jztwk/had...@join.com (aes256-cts-hmac-sha1-96) 
 3 jztwk/had...@join.com (aes128-cts-hmac-sha1-96) 
jzyc@bigdser5:/hadoop/app$ kinit -kt /hadoop/app/jztwk.keytab 
jztwk/had...@join.com
jzyc@bigdser5:/hadoop/app$ klist
Ticket cache: FILE:/tmp/krb5cc_1025
Default principal: jztwk/had...@join.com

Valid starting Expires Service principal
07/16/2021 17:36:48 07/17/2021 17:36:48 
[krbtgt/join@join.com|mailto:krbtgt/join@join.com]

 

and scp all node

 

I also get the same error.

> Hive Hook can't send notification
> -
>
> Key: ATLAS-4361
> URL: https://issues.apache.org/jira/browse/ATLAS-4361
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Blocker
> Attachments: 20210716165232274.png
>
>
> when I create a view
> I get a error 
>  
> Caused by: javax.security.auth.login.LoginException: Could not login: the 
> client is being asked for a password, but the Kafka client code does not 
> currently support obtaining a password from the user. not available to garner 
> authentication information from the user
>  
> but I make sure keytab and principal is correct
> #Enable for Kerberized Kafka clusters
>  atlas.notification.kafka.service.principal=jztwk/had...@join.com
>  atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
>  atlas.kafka.security.protocol=SASL_PLAINTEXT
>  atlas.kafka.sasl.kerberos.service.name=kafka
> ##JAAS Configuration 
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
>  atlas.jaas.KafkaClient.loginModuleControlFlag=required
>  atlas.jaas.KafkaClient.option.useKeyTab=true
>  atlas.jaas.KafkaClient.option.storeKey=true
>  atlas.jaas.KafkaClient.option.serviceName=kafka
>  atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
>  
> [atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]
>  
> and I modify 
> [KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
>  add a debug
> LOG.debug("sasl.jaas.config is " + newJaasProperty);
>  
> I see  
> sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
> keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
> principal="jztwk/had...@join.com" ;*
> in log 
> I use this config to my application.
> that is OK.
>  
> Properties props = new Properties();
>  props.put("bootstrap.servers", 
> "bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
> props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
> required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
> principal=\"jztwk/had...@join.com\" ;");
>  props.put("security.protocol", "SASL_PLAINTEXT");
>  props.put("sasl.kerberos.service.name", "kafka");
> props.put("key.serializer", 
> "org.apache.kafka.common.serialization.StringSerializer");
>  props.put("value.serializer", 
> "org.apache.kafka.common.serialization.StringSerializer");
>  KafkaProducer producer = new KafkaProducer<>(props);
>  
> and I can run import-hive.sh
> so, I don't understand why
>  
> all node I have run *kinit -kt /hadoop/app/jztwk.keytab 
> [jztwk/had...@join.com|mailto:jztwk/had...@join.com]*
> -rw

[jira] [Comment Edited] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381924#comment-17381924
 ] 

ighack edited comment on ATLAS-4361 at 7/16/21, 9:20 AM:
-

I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 
{code:java}
if (ret == null) {
356 Properties props = new Properties();
357 props.put("bootstrap.servers", 
"bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
358 props.put("acks", "1");
359 props.put("retries", 3);
360 props.put("batch.size", 16384);
361 props.put("linger.ms", 1);
362 props.put("buffer.memory", 33554432);
363 
props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
required  keyTab=\"/hadoop/app/jztwk.keytab\" storeKey=true useKeyTab=true 
serviceName=kafka principal=\"jztwk/had...@join.com\" ;");
364 props.put("security.protocol", "SASL_PLAINTEXT");
365 props.put("sasl.mechanism", "GSSAPI");
366 props.put("sasl.kerberos.service.name", "kafka");
367 props.put("key.serializer", 
"org.apache.kafka.common.serialization.StringSerializer");
368 props.put("value.serializer", 
"org.apache.kafka.common.serialization.StringSerializer");
369 ret = new KafkaProducer(props);
370 //ret = new KafkaProducer(properties);
371 
372 producers.put(notificationType, ret);
373 }

{code}
I also get a error.

*why*


was (Author: ighack):
I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 
{code:java}
if (ret == null) {
356 Properties props = new Properties();
357 props.put("bootstrap.servers", 
"bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
358 props.put("acks", "1");
359 props.put("retries", 3);
360 props.put("batch.size", 16384);
361 props.put("linger.ms", 1);
362 props.put("buffer.memory", 33554432);
363 
props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
required  keyTab=\"/hadoop/app/jztwk.keytab\" storeKey=true useKeyTab=true 
serviceName=kafka principal=\"jztwk/had...@join.com\" ;");
364 props.put("security.protocol", "SASL_PLAINTEXT");
365 props.put("sasl.mechanism", "GSSAPI");
366 props.put("sasl.kerberos.service.name", "kafka");
367 props.put("key.serializer", 
"org.apache.kafka.common.serialization.StringSerializer");
368 props.put("value.serializer", 
"org.apache.kafka.common.serialization.StringSerializer");
369 ret = new KafkaProducer(props);
370 //ret = new KafkaProducer(properties);
371 
372 producers.put(notificationType, ret);
373 }

{code}
I also get a error.

*why*

> Hive Hook can't send notification
> -
>
> Key: ATLAS-4361
> URL: https://issues.apache.org/jira/browse/ATLAS-4361
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Blocker
> Attachments: 20210716165232274.png
>
>
> when I create a view
> I get a error 
>  
> Caused by: javax.security.auth.login.LoginException: Could not login: the 
> client is being asked for a password, but the Kafka client code does not 
> currently support obtaining a password from the user. not available to garner 
> authentication information from the user
>  
> but I make sure keytab and principal is correct
> #Enable for Kerberized Kafka clusters
>  atlas.notification.kafka.service.principal=jztwk/had...@join.com
>  atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
>  atlas.kafka.security.protocol=SASL_PLAINTEXT
>  atlas.kafka.sasl.kerberos.service.name=kafka
> ##JAAS Configuration 
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
>  atlas.jaas.KafkaClient.loginModuleControlFlag=required
>  atlas.jaas.KafkaClient.option.useKeyTab=true
>  atlas.jaas.KafkaClient.option.storeKey=true
>  atlas.jaas.KafkaClient.option.serviceName=kafka
>  atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
>  
> [atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:at

[jira] [Commented] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381924#comment-17381924
 ] 

ighack commented on ATLAS-4361:
---

I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 
{code:java}
if (ret == null) {
356 Properties props = new Properties();
357 props.put("bootstrap.servers", 
"bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
358 props.put("acks", "1");
359 props.put("retries", 3);
360 props.put("batch.size", 16384);
361 props.put("linger.ms", 1);
362 props.put("buffer.memory", 33554432);
363 
props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
required  keyTab=\"/hadoop/app/jztwk.keytab\" storeKey=true useKeyTab=true 
serviceName=kafka principal=\"jztwk/had...@join.com\" ;");
364 props.put("security.protocol", "SASL_PLAINTEXT");
365 props.put("sasl.mechanism", "GSSAPI");
366 props.put("sasl.kerberos.service.name", "kafka");
367 props.put("key.serializer", 
"org.apache.kafka.common.serialization.StringSerializer");
368 props.put("value.serializer", 
"org.apache.kafka.common.serialization.StringSerializer");
369 ret = new KafkaProducer(props);
370 //ret = new KafkaProducer(properties);
371 
372 producers.put(notificationType, ret);
373 }

{code}
I also get a error.

*why*

> Hive Hook can't send notification
> -
>
> Key: ATLAS-4361
> URL: https://issues.apache.org/jira/browse/ATLAS-4361
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Blocker
> Attachments: 20210716165232274.png
>
>
> when I create a view
> I get a error 
>  
> Caused by: javax.security.auth.login.LoginException: Could not login: the 
> client is being asked for a password, but the Kafka client code does not 
> currently support obtaining a password from the user. not available to garner 
> authentication information from the user
>  
> but I make sure keytab and principal is correct
> #Enable for Kerberized Kafka clusters
>  atlas.notification.kafka.service.principal=jztwk/had...@join.com
>  atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
>  atlas.kafka.security.protocol=SASL_PLAINTEXT
>  atlas.kafka.sasl.kerberos.service.name=kafka
> ##JAAS Configuration 
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
>  atlas.jaas.KafkaClient.loginModuleControlFlag=required
>  atlas.jaas.KafkaClient.option.useKeyTab=true
>  atlas.jaas.KafkaClient.option.storeKey=true
>  atlas.jaas.KafkaClient.option.serviceName=kafka
>  atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
>  
> [atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]
>  
> and I modify 
> [KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
>  add a debug
> LOG.debug("sasl.jaas.config is " + newJaasProperty);
>  
> I see  
> sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
> keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
> principal="jztwk/had...@join.com" ;*
> in log 
> I use this config to my application.
> that is OK.
>  
> Properties props = new Properties();
>  props.put("bootstrap.servers", 
> "bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
> props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
> required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
> principal=\"jztwk/had...@join.com\" ;");
>  props.put("security.protocol", "SASL_PLAINTEXT");
>  props.put("sasl.kerberos.service.name", "kafka");
> props.put("key.serializer", 
> "org.apache.kafka.common.serialization.StringSerializer");
>  props.put("value.serializer", 
> "org.apache.kafka.common.serialization.StringSerializer");
>  KafkaProducer producer = new KafkaProducer<>(props);
>  
> and I can run import-hive.sh
> so, I don't understand why
>  
> all node I have run *kinit -kt /hadoop/app/jztwk.keytab 
> [jztwk/had...@join.com|mailto:jztwk/had...@join.com]*
> -rwxr-xr-x 1 jzyc jzyc 146 Jul 14 08:46 /hadoop/app/jztwk.keytab
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Comment Edited] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381906#comment-17381906
 ] 

ighack edited comment on ATLAS-4361 at 7/16/21, 8:55 AM:
-

and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 

 

 
{code:java}
private KafkaProducer getOrCreateProducer(NotificationType notificationType) {
 LOG.debug("==> KafkaNotification.getOrCreateProducer()");
KafkaProducer ret = producers.get(notificationType);
if (ret == null) {
 synchronized (this) {
 ret = producers.get(notificationType);
if (ret == null)
{ LOG.info("sasl.jaas.config is:",properties.getProperty("sasl.jaas.config")); 
LOG.info("security.protocol is:",properties.getProperty("security.protocol")); 
LOG.info("sasl.mechanism is:",properties.getProperty("sasl.mechanism")); 
LOG.info("bootstrap.servers is:",properties.getProperty("bootstrap.servers")); 
LOG.info("properties is:",properties.toString()); 
ret = new KafkaProducer(properties); producers.put(notificationType, ret); }
}
 }
LOG.debug("<== KafkaNotification.getOrCreateProducer()");
return ret;
 }
{code}
 

 

but in log I get null

 

!20210716165232274.png!


was (Author: ighack):
and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 

 

private KafkaProducer getOrCreateProducer(NotificationType notificationType) {
 LOG.debug("==> KafkaNotification.getOrCreateProducer()");

KafkaProducer ret = producers.get(notificationType);

if (ret == null) {
 synchronized (this) {
 ret = producers.get(notificationType);

if (ret == null)

{ LOG.info("sasl.jaas.config is:",properties.getProperty("sasl.jaas.config")); 
LOG.info("security.protocol is:",properties.getProperty("security.protocol")); 
LOG.info("sasl.mechanism is:",properties.getProperty("sasl.mechanism")); 
LOG.info("bootstrap.servers is:",properties.getProperty("bootstrap.servers")); 
LOG.info("properties is:",properties.toString());

ret = new KafkaProducer(properties); producers.put(notificationType, ret); }

}
 }

LOG.debug("<== KafkaNotification.getOrCreateProducer()");

return ret;
 }

 

but in log I get null

 

!20210716165232274.png!

> Hive Hook can't send notification
> -
>
> Key: ATLAS-4361
> URL: https://issues.apache.org/jira/browse/ATLAS-4361
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Blocker
> Attachments: 20210716165232274.png
>
>
> when I create a view
> I get a error 
>  
> Caused by: javax.security.auth.login.LoginException: Could not login: the 
> client is being asked for a password, but the Kafka client code does not 
> currently support obtaining a password from the user. not available to garner 
> authentication information from the user
>  
> but I make sure keytab and principal is correct
> #Enable for Kerberized Kafka clusters
>  atlas.notification.kafka.service.principal=jztwk/had...@join.com
>  atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
>  atlas.kafka.security.protocol=SASL_PLAINTEXT
>  atlas.kafka.sasl.kerberos.service.name=kafka
> ##JAAS Configuration 
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
>  atlas.jaas.KafkaClient.loginModuleControlFlag=required
>  atlas.jaas.KafkaClient.option.useKeyTab=true
>  atlas.jaas.KafkaClient.option.storeKey=true
>  atlas.jaas.KafkaClient.option.serviceName=kafka
>  atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
>  
> [atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]
>  
> and I modify 
> [KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
>  add a debug
> LOG.debug("sasl.jaas.config is " + newJaasProperty);
>  
> I see  
> sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
> keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
> principal="jztwk/had...@join.com" ;*
> in log 
> I use this config to my application.
> that is OK.
>  
> Properties props = new Properties();
>  props.put("bootstrap.servers", 
> "bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
> props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
> required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
> principal=\"jztwk/had...@join.com\" ;");
>  props.put("security.protocol", "SASL_PLAINTEXT");
>  props.put("sasl.kerberos.service.name", "kafka");
> props.put("key.

[jira] [Comment Edited] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381906#comment-17381906
 ] 

ighack edited comment on ATLAS-4361 at 7/16/21, 8:54 AM:
-

and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 

 

private KafkaProducer getOrCreateProducer(NotificationType notificationType) {
 LOG.debug("==> KafkaNotification.getOrCreateProducer()");

KafkaProducer ret = producers.get(notificationType);

if (ret == null) {
 synchronized (this) {
 ret = producers.get(notificationType);

if (ret == null)

{ LOG.info("sasl.jaas.config is:",properties.getProperty("sasl.jaas.config")); 
LOG.info("security.protocol is:",properties.getProperty("security.protocol")); 
LOG.info("sasl.mechanism is:",properties.getProperty("sasl.mechanism")); 
LOG.info("bootstrap.servers is:",properties.getProperty("bootstrap.servers")); 
LOG.info("properties is:",properties.toString());

ret = new KafkaProducer(properties); producers.put(notificationType, ret); }

}
 }

LOG.debug("<== KafkaNotification.getOrCreateProducer()");

return ret;
 }

 

but in log I get null

 

!20210716165232274.png!


was (Author: ighack):
and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 

 

private KafkaProducer getOrCreateProducer(NotificationType notificationType) {
 LOG.debug("==> KafkaNotification.getOrCreateProducer()");

KafkaProducer ret = producers.get(notificationType);

if (ret == null) {
 synchronized (this) {
 ret = producers.get(notificationType);

if (ret == null)

{ LOG.info("sasl.jaas.config is:",properties.getProperty("sasl.jaas.config")); 
LOG.info("security.protocol is:",properties.getProperty("security.protocol")); 
LOG.info("sasl.mechanism is:",properties.getProperty("sasl.mechanism")); 
LOG.info("bootstrap.servers is:",properties.getProperty("bootstrap.servers")); 
LOG.info("properties is:",properties.toString());

ret = new KafkaProducer(properties); producers.put(notificationType, ret); }

}
 }

LOG.debug("<== KafkaNotification.getOrCreateProducer()");

return ret;
 }

 

but in log I get null

 

!20210716165232274.png!

> Hive Hook can't send notification
> -
>
> Key: ATLAS-4361
> URL: https://issues.apache.org/jira/browse/ATLAS-4361
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Blocker
> Attachments: 20210716165232274.png
>
>
> when I create a view
> I get a error 
>  
> Caused by: javax.security.auth.login.LoginException: Could not login: the 
> client is being asked for a password, but the Kafka client code does not 
> currently support obtaining a password from the user. not available to garner 
> authentication information from the user
>  
> but I make sure keytab and principal is correct
> #Enable for Kerberized Kafka clusters
>  atlas.notification.kafka.service.principal=jztwk/had...@join.com
>  atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
>  atlas.kafka.security.protocol=SASL_PLAINTEXT
>  atlas.kafka.sasl.kerberos.service.name=kafka
> ##JAAS Configuration 
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
>  atlas.jaas.KafkaClient.loginModuleControlFlag=required
>  atlas.jaas.KafkaClient.option.useKeyTab=true
>  atlas.jaas.KafkaClient.option.storeKey=true
>  atlas.jaas.KafkaClient.option.serviceName=kafka
>  atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
>  
> [atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]
>  
> and I modify 
> [KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
>  add a debug
> LOG.debug("sasl.jaas.config is " + newJaasProperty);
>  
> I see  
> sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
> keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
> principal="jztwk/had...@join.com" ;*
> in log 
> I use this config to my application.
> that is OK.
>  
> Properties props = new Properties();
>  props.put("bootstrap.servers", 
> "bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
> props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
> required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
> principal=\"jztwk/had...@join.com\" ;");
>  props.put("security.protocol", "SASL_PLAINTEXT");
>  props.put("sasl.kerberos.service.name", "kafka");
> props.put("key.serializer", 
> 

[jira] [Comment Edited] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381906#comment-17381906
 ] 

ighack edited comment on ATLAS-4361 at 7/16/21, 8:54 AM:
-

and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 

 

private KafkaProducer getOrCreateProducer(NotificationType notificationType) {
 LOG.debug("==> KafkaNotification.getOrCreateProducer()");

KafkaProducer ret = producers.get(notificationType);

if (ret == null) {
 synchronized (this) {
 ret = producers.get(notificationType);

if (ret == null)

{ LOG.info("sasl.jaas.config is:",properties.getProperty("sasl.jaas.config")); 
LOG.info("security.protocol is:",properties.getProperty("security.protocol")); 
LOG.info("sasl.mechanism is:",properties.getProperty("sasl.mechanism")); 
LOG.info("bootstrap.servers is:",properties.getProperty("bootstrap.servers")); 
LOG.info("properties is:",properties.toString());

ret = new KafkaProducer(properties); producers.put(notificationType, ret); }

}
 }

LOG.debug("<== KafkaNotification.getOrCreateProducer()");

return ret;
 }

 

but in log I get null

 

!20210716165232274.png!


was (Author: ighack):
and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 

 

private KafkaProducer getOrCreateProducer(NotificationType notificationType) {
 LOG.debug("==> KafkaNotification.getOrCreateProducer()");

KafkaProducer ret = producers.get(notificationType);

if (ret == null) {
 synchronized (this) {
 ret = producers.get(notificationType);

if (ret == null)

{ LOG.info("sasl.jaas.config is:",properties.getProperty("sasl.jaas.config")); 
LOG.info("security.protocol is:",properties.getProperty("security.protocol")); 
LOG.info("sasl.mechanism is:",properties.getProperty("sasl.mechanism")); 
LOG.info("bootstrap.servers is:",properties.getProperty("bootstrap.servers")); 
LOG.info("properties is:",properties.toString());

ret = new KafkaProducer(properties); producers.put(notificationType, ret); }

}
 }

LOG.debug("<== KafkaNotification.getOrCreateProducer()");

return ret;
 }

 

but in log I get null

 

!20210716165232274.png!

> Hive Hook can't send notification
> -
>
> Key: ATLAS-4361
> URL: https://issues.apache.org/jira/browse/ATLAS-4361
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Blocker
> Attachments: 20210716165232274.png
>
>
> when I create a view
> I get a error 
>  
> Caused by: javax.security.auth.login.LoginException: Could not login: the 
> client is being asked for a password, but the Kafka client code does not 
> currently support obtaining a password from the user. not available to garner 
> authentication information from the user
>  
> but I make sure keytab and principal is correct
> #Enable for Kerberized Kafka clusters
>  atlas.notification.kafka.service.principal=jztwk/had...@join.com
>  atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
>  atlas.kafka.security.protocol=SASL_PLAINTEXT
>  atlas.kafka.sasl.kerberos.service.name=kafka
> ##JAAS Configuration 
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
>  atlas.jaas.KafkaClient.loginModuleControlFlag=required
>  atlas.jaas.KafkaClient.option.useKeyTab=true
>  atlas.jaas.KafkaClient.option.storeKey=true
>  atlas.jaas.KafkaClient.option.serviceName=kafka
>  atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
>  
> [atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]
>  
> and I modify 
> [KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
>  add a debug
> LOG.debug("sasl.jaas.config is " + newJaasProperty);
>  
> I see  
> sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
> keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
> principal="jztwk/had...@join.com" ;*
> in log 
> I use this config to my application.
> that is OK.
>  
> Properties props = new Properties();
>  props.put("bootstrap.servers", 
> "bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
> props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
> required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
> principal=\"jztwk/had...@join.com\" ;");
>  props.put("security.protocol", "SASL_PLAINTEXT");
>  props.put("sasl.kerberos.service.name", "kafka");
> props.put("key.serializer", 
> 

[jira] [Comment Edited] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381906#comment-17381906
 ] 

ighack edited comment on ATLAS-4361 at 7/16/21, 8:53 AM:
-

and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 

 

private KafkaProducer getOrCreateProducer(NotificationType notificationType) {
 LOG.debug("==> KafkaNotification.getOrCreateProducer()");

KafkaProducer ret = producers.get(notificationType);

if (ret == null) {
 synchronized (this) {
 ret = producers.get(notificationType);

if (ret == null)

{ LOG.info("sasl.jaas.config is:",properties.getProperty("sasl.jaas.config")); 
LOG.info("security.protocol is:",properties.getProperty("security.protocol")); 
LOG.info("sasl.mechanism is:",properties.getProperty("sasl.mechanism")); 
LOG.info("bootstrap.servers is:",properties.getProperty("bootstrap.servers")); 
LOG.info("properties is:",properties.toString());

ret = new KafkaProducer(properties); producers.put(notificationType, ret); }

}
 }

LOG.debug("<== KafkaNotification.getOrCreateProducer()");

return ret;
 }

 

but in log I get null

 

!20210716165232274.png!


was (Author: ighack):
and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 

 

private KafkaProducer getOrCreateProducer(NotificationType notificationType) {
 LOG.debug("==> KafkaNotification.getOrCreateProducer()");

KafkaProducer ret = producers.get(notificationType);

if (ret == null) {
 synchronized (this) {
 ret = producers.get(notificationType);

if (ret == null) {
 LOG.info("sasl.jaas.config is:",properties.getProperty("sasl.jaas.config"));
 LOG.info("security.protocol is:",properties.getProperty("security.protocol"));
 LOG.info("sasl.mechanism is:",properties.getProperty("sasl.mechanism"));
 LOG.info("bootstrap.servers is:",properties.getProperty("bootstrap.servers"));
 LOG.info("properties is:",properties.toString());
 ret = new KafkaProducer(properties);

producers.put(notificationType, ret);
 }
 }
 }

LOG.debug("<== KafkaNotification.getOrCreateProducer()");

return ret;
 }

 

but in log I get null

 

!20210716165232274.png!

> Hive Hook can't send notification
> -
>
> Key: ATLAS-4361
> URL: https://issues.apache.org/jira/browse/ATLAS-4361
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Blocker
> Attachments: 20210716165232274.png
>
>
> when I create a view
> I get a error 
>  
> Caused by: javax.security.auth.login.LoginException: Could not login: the 
> client is being asked for a password, but the Kafka client code does not 
> currently support obtaining a password from the user. not available to garner 
> authentication information from the user
>  
> but I make sure keytab and principal is correct
> #Enable for Kerberized Kafka clusters
>  atlas.notification.kafka.service.principal=jztwk/had...@join.com
>  atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
>  atlas.kafka.security.protocol=SASL_PLAINTEXT
>  atlas.kafka.sasl.kerberos.service.name=kafka
> ##JAAS Configuration 
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
>  atlas.jaas.KafkaClient.loginModuleControlFlag=required
>  atlas.jaas.KafkaClient.option.useKeyTab=true
>  atlas.jaas.KafkaClient.option.storeKey=true
>  atlas.jaas.KafkaClient.option.serviceName=kafka
>  atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
>  
> [atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]
>  
> and I modify 
> [KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
>  add a debug
> LOG.debug("sasl.jaas.config is " + newJaasProperty);
>  
> I see  
> sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
> keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
> principal="jztwk/had...@join.com" ;*
> in log 
> I use this config to my application.
> that is OK.
>  
> Properties props = new Properties();
>  props.put("bootstrap.servers", 
> "bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
> props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
> required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
> principal=\"jztwk/had...@join.com\" ;");
>  props.put("security.protocol", "SASL_PLAINTEXT");
>  props.put("sasl.kerberos.service.name", "kafka");
> props.put("key.serializer", 

[jira] [Commented] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381906#comment-17381906
 ] 

ighack commented on ATLAS-4361:
---

and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 

 

private KafkaProducer getOrCreateProducer(NotificationType notificationType) {
 LOG.debug("==> KafkaNotification.getOrCreateProducer()");

KafkaProducer ret = producers.get(notificationType);

if (ret == null) {
 synchronized (this) {
 ret = producers.get(notificationType);

if (ret == null) {
 LOG.info("sasl.jaas.config is:",properties.getProperty("sasl.jaas.config"));
 LOG.info("security.protocol is:",properties.getProperty("security.protocol"));
 LOG.info("sasl.mechanism is:",properties.getProperty("sasl.mechanism"));
 LOG.info("bootstrap.servers is:",properties.getProperty("bootstrap.servers"));
 LOG.info("properties is:",properties.toString());
 ret = new KafkaProducer(properties);

producers.put(notificationType, ret);
 }
 }
 }

LOG.debug("<== KafkaNotification.getOrCreateProducer()");

return ret;
 }

 

but in log I get null

 

!20210716165232274.png!

> Hive Hook can't send notification
> -
>
> Key: ATLAS-4361
> URL: https://issues.apache.org/jira/browse/ATLAS-4361
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Blocker
> Attachments: 20210716165232274.png
>
>
> when I create a view
> I get a error 
>  
> Caused by: javax.security.auth.login.LoginException: Could not login: the 
> client is being asked for a password, but the Kafka client code does not 
> currently support obtaining a password from the user. not available to garner 
> authentication information from the user
>  
> but I make sure keytab and principal is correct
> #Enable for Kerberized Kafka clusters
>  atlas.notification.kafka.service.principal=jztwk/had...@join.com
>  atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
>  atlas.kafka.security.protocol=SASL_PLAINTEXT
>  atlas.kafka.sasl.kerberos.service.name=kafka
> ##JAAS Configuration 
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
>  atlas.jaas.KafkaClient.loginModuleControlFlag=required
>  atlas.jaas.KafkaClient.option.useKeyTab=true
>  atlas.jaas.KafkaClient.option.storeKey=true
>  atlas.jaas.KafkaClient.option.serviceName=kafka
>  atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
>  
> [atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]
>  
> and I modify 
> [KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
>  add a debug
> LOG.debug("sasl.jaas.config is " + newJaasProperty);
>  
> I see  
> sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
> keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
> principal="jztwk/had...@join.com" ;*
> in log 
> I use this config to my application.
> that is OK.
>  
> Properties props = new Properties();
>  props.put("bootstrap.servers", 
> "bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
> props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
> required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
> principal=\"jztwk/had...@join.com\" ;");
>  props.put("security.protocol", "SASL_PLAINTEXT");
>  props.put("sasl.kerberos.service.name", "kafka");
> props.put("key.serializer", 
> "org.apache.kafka.common.serialization.StringSerializer");
>  props.put("value.serializer", 
> "org.apache.kafka.common.serialization.StringSerializer");
>  KafkaProducer producer = new KafkaProducer<>(props);
>  
> and I can run import-hive.sh
> so, I don't understand why
>  
> all node I have run *kinit -kt /hadoop/app/jztwk.keytab 
> [jztwk/had...@join.com|mailto:jztwk/had...@join.com]*
> -rwxr-xr-x 1 jzyc jzyc 146 Jul 14 08:46 /hadoop/app/jztwk.keytab
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ighack updated ATLAS-4361:
--
Attachment: 20210716165232274.png

> Hive Hook can't send notification
> -
>
> Key: ATLAS-4361
> URL: https://issues.apache.org/jira/browse/ATLAS-4361
> Project: Atlas
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 2.1.0
>Reporter: ighack
>Priority: Blocker
> Attachments: 20210716165232274.png
>
>
> when I create a view
> I get a error 
>  
> Caused by: javax.security.auth.login.LoginException: Could not login: the 
> client is being asked for a password, but the Kafka client code does not 
> currently support obtaining a password from the user. not available to garner 
> authentication information from the user
>  
> but I make sure keytab and principal is correct
> #Enable for Kerberized Kafka clusters
>  atlas.notification.kafka.service.principal=jztwk/had...@join.com
>  atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
>  atlas.kafka.security.protocol=SASL_PLAINTEXT
>  atlas.kafka.sasl.kerberos.service.name=kafka
> ##JAAS Configuration 
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
>  atlas.jaas.KafkaClient.loginModuleControlFlag=required
>  atlas.jaas.KafkaClient.option.useKeyTab=true
>  atlas.jaas.KafkaClient.option.storeKey=true
>  atlas.jaas.KafkaClient.option.serviceName=kafka
>  atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
>  
> [atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]
>  
> and I modify 
> [KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
>  add a debug
> LOG.debug("sasl.jaas.config is " + newJaasProperty);
>  
> I see  
> sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
> keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
> principal="jztwk/had...@join.com" ;*
> in log 
> I use this config to my application.
> that is OK.
>  
> Properties props = new Properties();
>  props.put("bootstrap.servers", 
> "bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");
> props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
> required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
> principal=\"jztwk/had...@join.com\" ;");
>  props.put("security.protocol", "SASL_PLAINTEXT");
>  props.put("sasl.kerberos.service.name", "kafka");
> props.put("key.serializer", 
> "org.apache.kafka.common.serialization.StringSerializer");
>  props.put("value.serializer", 
> "org.apache.kafka.common.serialization.StringSerializer");
>  KafkaProducer producer = new KafkaProducer<>(props);
>  
> and I can run import-hive.sh
> so, I don't understand why
>  
> all node I have run *kinit -kt /hadoop/app/jztwk.keytab 
> [jztwk/had...@join.com|mailto:jztwk/had...@join.com]*
> -rwxr-xr-x 1 jzyc jzyc 146 Jul 14 08:46 /hadoop/app/jztwk.keytab
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (ATLAS-4361) Hive Hook can't send notification

[ighack (Jira)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ighack updated ATLAS-4361:
--
Description: 
when I create a view

I get a error 

 

Caused by: javax.security.auth.login.LoginException: Could not login: the 
client is being asked for a password, but the Kafka client code does not 
currently support obtaining a password from the user. not available to garner 
authentication information from the user

 

but I make sure keytab and principal is correct

#Enable for Kerberized Kafka clusters
 atlas.notification.kafka.service.principal=jztwk/had...@join.com
 atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
 atlas.kafka.security.protocol=SASL_PLAINTEXT
 atlas.kafka.sasl.kerberos.service.name=kafka

##JAAS Configuration 

atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
 atlas.jaas.KafkaClient.loginModuleControlFlag=required
 atlas.jaas.KafkaClient.option.useKeyTab=true
 atlas.jaas.KafkaClient.option.storeKey=true
 atlas.jaas.KafkaClient.option.serviceName=kafka
 atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
 
[atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]

 

and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 add a debug

LOG.debug("sasl.jaas.config is " + newJaasProperty);

 

I see  

sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
principal="jztwk/had...@join.com" ;*

in log 

I use this config to my application.

that is OK.

 

Properties props = new Properties();
 props.put("bootstrap.servers", 
"bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");

props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
principal=\"jztwk/had...@join.com\" ;");
 props.put("security.protocol", "SASL_PLAINTEXT");
 props.put("sasl.kerberos.service.name", "kafka");

props.put("key.serializer", 
"org.apache.kafka.common.serialization.StringSerializer");
 props.put("value.serializer", 
"org.apache.kafka.common.serialization.StringSerializer");
 KafkaProducer producer = new KafkaProducer<>(props);

 

and I can run import-hive.sh

so, I don't understand why

 

all node I have run *kinit -kt /hadoop/app/jztwk.keytab 
[jztwk/had...@join.com|mailto:jztwk/had...@join.com]*

-rwxr-xr-x 1 jzyc jzyc 146 Jul 14 08:46 /hadoop/app/jztwk.keytab

 

 

  was:
when I create a view

I get a error 

 

Caused by: javax.security.auth.login.LoginException: Could not login: the 
client is being asked for a password, but the Kafka client code does not 
currently support obtaining a password from the user. not available to garner 
authentication information from the user

 

but I make sure keytab and principal is correct

#Enable for Kerberized Kafka clusters
 atlas.notification.kafka.service.principal=jztwk/had...@join.com
 atlas.notification.kafka.keytab.location=/hadoop/app/jztwk.keytab
 atlas.kafka.security.protocol=SASL_PLAINTEXT
 atlas.kafka.sasl.kerberos.service.name=kafka

##JAAS Configuration 

atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
 atlas.jaas.KafkaClient.loginModuleControlFlag=required
 atlas.jaas.KafkaClient.option.useKeyTab=true
 atlas.jaas.KafkaClient.option.storeKey=true
 atlas.jaas.KafkaClient.option.serviceName=kafka
 atlas.jaas.KafkaClient.option.keyTab=/hadoop/app/jztwk.keytab
 
[atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com|mailto:atlas.jaas.KafkaClient.option.principal=jztwk/had...@join.com]

 

and I modify 
[KafkaNotification.java|https://sourcegraph.com/github.com/apache/atlas/-/blob/notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java]
 add a debug

LOG.debug("sasl.jaas.config is " + newJaasProperty);

 

I see  

sasl.jaas.config is  *com.sun.security.auth.module.Krb5LoginModule required 
keyTab="/hadoop/app/jztwk.keytab" storeKey=true useKeyTab=true 
principal="jztwk/had...@join.com" ;*

in log 

I use this config to my application.

that is OK.

 

Properties props = new Properties();
 props.put("bootstrap.servers", 
"bigdser1:9092,bigdser2:9092,bigdser3:9092,bigdser4:9092,bigdser5:9092");

props.put("sasl.jaas.config","com.sun.security.auth.module.Krb5LoginModule 
required keyTab=\"/hadoop/jztwk.keytab\" storeKey=true useKeyTab=true 
principal=\"jztwk/had...@join.com\" ;");
 props.put("security.protocol", "SASL_PLAINTEXT");
 props.put("sasl.kerberos.service.name", "kafka");

props.put("key.serializer", 
"org.apache.kafka.common.serialization.StringSerializer");
 props.put("value.serializer", 
"org.apache.kafka.common.serializat