Re: Kerberos and delegation token
Oops: ignore this - wrong list.
On Tue, Oct 16, 2018 at 1:18 PM Robert Kanter wrote:
> Hi Bala,
>
> It sounds like you'll want to use an HBase Delegation Token within the
> Hive UDF to connect to HBase. The user will need to obtain an HBase
> Delegation Token with their Kerberos Credentials and either give the token
> to Hive or Hive will need to get the token on behalf of the user (like
> Oozie). The code Oozie uses for getting an HBase token is here:
> https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java
>
> Let me know if you need more details. I've also added some oozie lists,
> for people who have used this more recently in case they have any
> additional info.
>
> - Robert
>
> On Tue, Oct 16, 2018 at 1:04 PM Bala Chander
> wrote:
>
>> Hello Robert,
>>
>> I have a customer who is writing a UDF (user defined function) in java
>> for usage in hive/beeline.
>> The UDF contacts HBASE to pull in some data and returns back a single
>> value. The USER of hive/beeline can issue a statement like the following:
>>
>> select a, UDF("xyz") from table_a;
>>
>> Hive/beeline and HBase operate on kerberos secure cluster.
>>
>> Michael Yoder (cc'ed) mentioned something similar in Oozie (Delegation
>> token based connection for Oozie (OOZIE-1457
>> )
>>
>> Do you have a snippet of this code that I can use in above scenario.
>> Thanks in advance for reading through this email.
>>
>> --
>> Thanks and best regards,
>> *Bala Chander * | Solutions Architect, Services | *Cloudera*
>> Phone: +1 408-896-1334
>> bchan...@cloudera.com
>>
>>
Re: Kerberos and delegation token
Hi Bala,
It sounds like you'll want to use an HBase Delegation Token within the Hive
UDF to connect to HBase. The user will need to obtain an HBase Delegation
Token with their Kerberos Credentials and either give the token to Hive or
Hive will need to get the token on behalf of the user (like Oozie). The
code Oozie uses for getting an HBase token is here:
https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java
Let me know if you need more details. I've also added some oozie lists,
for people who have used this more recently in case they have any
additional info.
- Robert
On Tue, Oct 16, 2018 at 1:04 PM Bala Chander wrote:
> Hello Robert,
>
> I have a customer who is writing a UDF (user defined function) in java for
> usage in hive/beeline.
> The UDF contacts HBASE to pull in some data and returns back a single
> value. The USER of hive/beeline can issue a statement like the following:
>
> select a, UDF("xyz") from table_a;
>
> Hive/beeline and HBase operate on kerberos secure cluster.
>
> Michael Yoder (cc'ed) mentioned something similar in Oozie (Delegation
> token based connection for Oozie (OOZIE-1457
> )
>
> Do you have a snippet of this code that I can use in above scenario.
> Thanks in advance for reading through this email.
>
> --
> Thanks and best regards,
> *Bala Chander * | Solutions Architect, Services | *Cloudera*
> Phone: +1 408-896-1334
> bchan...@cloudera.com
>
>
[jira] [Commented] (OOZIE-3369) [core] Upgrade guru.nidi:graphviz-java to 0.7.0
[
https://issues.apache.org/jira/browse/OOZIE-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651414#comment-16651414
]
Andras Piros commented on OOZIE-3369:
-
Thanks for the review [~pbacsko]! Committed to {{master}} and cherry-picked to
{{branch-5.1}}.
> [core] Upgrade guru.nidi:graphviz-java to 0.7.0
> ---
>
> Key: OOZIE-3369
> URL: https://issues.apache.org/jira/browse/OOZIE-3369
> Project: Oozie
> Issue Type: Task
> Components: core
>Affects Versions: 5.1.0
>Reporter: Andras Piros
>Assignee: Andras Piros
>Priority: Major
> Attachments: OOZIE-3369.001.patch
>
>
> There are some transitive dependencies of {{guru.nidi:graphviz-java:0.2.2}}
> that are obsolete and / or are subject to [security
> vulnerabilities|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2018-8013].
> Let's upgrade to latest version {{0.7.0}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (94 issues) Subscriber: ooziedaily Key Summary OOZIE-3369 [core] Upgrade guru.nidi:graphviz-java to 0.7.0 https://issues.apache.org/jira/browse/OOZIE-3369 OOZIE-3367 Using && in EL expressions in oozie bundle.xml files generates parse errors https://issues.apache.org/jira/browse/OOZIE-3367 OOZIE-3366 Update workflow status and subworkflow status on suspend command https://issues.apache.org/jira/browse/OOZIE-3366 OOZIE-3364 Rerunning Oozie bundle jobs starts the coordinators in indeterminate order https://issues.apache.org/jira/browse/OOZIE-3364 OOZIE-3338 Remove SVN references https://issues.apache.org/jira/browse/OOZIE-3338 OOZIE-3326 Sqoop Action should support tez delegation tokens for hive-import https://issues.apache.org/jira/browse/OOZIE-3326 OOZIE-3320 Oozie ShellAction should support absolute bash file path https://issues.apache.org/jira/browse/OOZIE-3320 OOZIE-3319 Log SSH action callback error output https://issues.apache.org/jira/browse/OOZIE-3319 OOZIE-3301 Update NOTICE file https://issues.apache.org/jira/browse/OOZIE-3301 OOZIE-3274 Remove slf4j https://issues.apache.org/jira/browse/OOZIE-3274 OOZIE-3266 Coord action rerun support RERUN_SKIP_NODES option https://issues.apache.org/jira/browse/OOZIE-3266 OOZIE-3265 properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to appear together https://issues.apache.org/jira/browse/OOZIE-3265 OOZIE-3256 refactor OozieCLI class https://issues.apache.org/jira/browse/OOZIE-3256 OOZIE-3249 [tools] Instrumentation log parser https://issues.apache.org/jira/browse/OOZIE-3249 OOZIE-3218 Oozie Sqoop action with command splits the select clause into multiple parts due to delimiter being space https://issues.apache.org/jira/browse/OOZIE-3218 OOZIE-3199 Let system property restriction configurable https://issues.apache.org/jira/browse/OOZIE-3199 OOZIE-3196 Authorization: restrict world readability by user https://issues.apache.org/jira/browse/OOZIE-3196 OOZIE-3194 Oozie should set proper permissions to sharelib after upload https://issues.apache.org/jira/browse/OOZIE-3194 OOZIE-3186 Oozie is unable to use configuration linked using jceks://file/... https://issues.apache.org/jira/browse/OOZIE-3186 OOZIE-3179 Adding a configurable config-default.xml location to a workflow https://issues.apache.org/jira/browse/OOZIE-3179 OOZIE-3170 Oozie Diagnostic Bundle tool fails with NPE due to missing service class https://issues.apache.org/jira/browse/OOZIE-3170 OOZIE-3137 Add support for log4j2 in HiveMain https://issues.apache.org/jira/browse/OOZIE-3137 OOZIE-3135 Configure log4j2 in SqoopMain https://issues.apache.org/jira/browse/OOZIE-3135 OOZIE-3120 maven-assembly-plugin fails when bumped from 2.2.1 https://issues.apache.org/jira/browse/OOZIE-3120 OOZIE-3091 Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper" https://issues.apache.org/jira/browse/OOZIE-3091 OOZIE-3071 Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0 https://issues.apache.org/jira/browse/OOZIE-3071 OOZIE-3063 Sanitizing variables that are part of openjpa.ConnectionProperties https://issues.apache.org/jira/browse/OOZIE-3063 OOZIE-3062 Set HADOOP_CONF_DIR for spark action https://issues.apache.org/jira/browse/OOZIE-3062 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues.apache.org/jira/browse/OOZIE-2952 OOZIE-2949 Escape quotes whitespaces in Sqoop field https://issues.apache.org/jira/browse/OOZIE-2949 OOZIE-2927 Append new line character for Hive2 query using query tag https://issues.apache.org/jira/browse/OOZIE-2927 OOZIE-2834 ParameterVerifier logging non-useful warning for workflow definition https://issues.apache.org/jira/browse/OOZIE-2834 OOZIE-2833 when using uber mode the regex pattern used in the extractHeapSizeMB method does not allow heap sizes specified in bytes. https://issues.apache.org/jira/browse/OOZIE-2833 OOZIE-2812 SparkConfigurationService should support loading configurations from multiple Spark versions https://issues.apache.org/jira/browse/OOZIE-2812 OOZIE-2795 Create lib directory or symlink for Oozie CLI during packaging https://issues.apache.org/jira/browse/OOZIE-2795 OOZIE-2784 Include WEEK as a parameter in the Coordinator Expression Language Evaulator https://issues.apache.org/jira/browse/OOZIE-2784 OOZIE-2779 Mask Hive2 action Beeline JDBC password https://issues.apache.org/jira/browse/OOZIE-2779 OOZIE-2736 Reduce the
