[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sushanth Sowmyan updated HIVE-16973:
Resolution: Fixed
Fix Version/s: 3.0.0
Status: Resolved (was: Patch Available)
Committed to master. Thanks, [~elserj]!
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Fix For: 3.0.0
>
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch,
> HIVE-16973.003.branch-2.patch, HIVE-16973.004-branch-2.patch,
> HIVE-16973.004.branch-2.patch, HIVE-16973.004-master.patch,
> HIVE-16973.005-master.patch, HIVE-16973.006-master.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sushanth Sowmyan updated HIVE-16973:
Attachment: HIVE-16973.006-master.patch
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Sushanth Sowmyan
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch,
> HIVE-16973.003.branch-2.patch, HIVE-16973.004-branch-2.patch,
> HIVE-16973.004.branch-2.patch, HIVE-16973.004-master.patch,
> HIVE-16973.005-master.patch, HIVE-16973.006-master.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sushanth Sowmyan updated HIVE-16973:
Assignee: Josh Elser (was: Sushanth Sowmyan)
Status: Patch Available (was: Open)
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch,
> HIVE-16973.003.branch-2.patch, HIVE-16973.004-branch-2.patch,
> HIVE-16973.004.branch-2.patch, HIVE-16973.004-master.patch,
> HIVE-16973.005-master.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sushanth Sowmyan updated HIVE-16973:
Attachment: HIVE-16973.005-master.patch
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Sushanth Sowmyan
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch,
> HIVE-16973.003.branch-2.patch, HIVE-16973.004-branch-2.patch,
> HIVE-16973.004.branch-2.patch, HIVE-16973.004-master.patch,
> HIVE-16973.005-master.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sushanth Sowmyan updated HIVE-16973:
Status: Open (was: Patch Available)
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch,
> HIVE-16973.003.branch-2.patch, HIVE-16973.004-branch-2.patch,
> HIVE-16973.004.branch-2.patch, HIVE-16973.004-master.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated HIVE-16973:
--
Attachment: HIVE-16973.004-master.patch
Here's the .004 patch, but for master. The relevant unit tests run locally. I'm
going to install 3.0 and do a basic sanity check.
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch,
> HIVE-16973.003.branch-2.patch, HIVE-16973.004-branch-2.patch,
> HIVE-16973.004.branch-2.patch, HIVE-16973.004-master.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16973:
---
Target Version/s: 3.0.0 (was: 2.3.0)
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch,
> HIVE-16973.003.branch-2.patch, HIVE-16973.004-branch-2.patch,
> HIVE-16973.004.branch-2.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated HIVE-16973:
--
Attachment: HIVE-16973.004-branch-2.patch
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch,
> HIVE-16973.003.branch-2.patch, HIVE-16973.004-branch-2.patch,
> HIVE-16973.004.branch-2.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated HIVE-16973:
--
Attachment: HIVE-16973.004.branch-2.patch
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch,
> HIVE-16973.003.branch-2.patch, HIVE-16973.004.branch-2.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated HIVE-16973:
--
Attachment: HIVE-16973.003.branch-2.patch
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch,
> HIVE-16973.003.branch-2.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated HIVE-16973:
--
Attachment: HIVE-16973.002.branch-2.patch
.002 Some more code consolidation/cleanup. Ran unit test and the accumulo
qtests locally.
Spinning up my local install to verify the Kerberos portion wasn't affected.
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Attachments: HIVE-16973.001.patch, HIVE-16973.002.branch-2.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated HIVE-16973:
--
Status: Patch Available (was: Open)
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Attachments: HIVE-16973.001.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2
[
https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Elser updated HIVE-16973:
--
Attachment: HIVE-16973.001.patch
.001 First stab at successful test runs locally with:
* Kerberos
* Local or HiveServer2 execution
* Tested execution engines of local (simple table scan), MapReduce, and Tez.
Need to clean this patch up some more and add some additional tests, but I
wanted to get it off my machine.
> Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in
> HS2
>
>
> Key: HIVE-16973
> URL: https://issues.apache.org/jira/browse/HIVE-16973
> Project: Hive
> Issue Type: Bug
> Components: Accumulo Storage Handler
>Reporter: Josh Elser
>Assignee: Josh Elser
> Attachments: HIVE-16973.001.patch
>
>
> Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken.
> Looking into it, it seems like the bit-rot got pretty bad. You'll see
> something like the following:
> {noformat}
> Caused by: java.io.IOException: Failed to unwrap AuthenticationToken
> at
> org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312)
>
> at
> org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122)
>
> {noformat}
> It appears that some of the code-paths changed since when I first did my
> testing (or I just did poor testing) and the delegation token was never being
> fetched/serialized. There also are some issues with fetching the delegation
> token from Accumulo properly which were addressed in ACCUMULO-4665
> I believe it would also be best to just update the dependency to use Accumulo
> 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would
> otherwise get much more complicated with reflection -- Accumulo has moved on
> past 1.6, so let's do the same in Hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
