[
https://issues.apache.org/jira/browse/HDDS-1925?focusedWorklogId=290674&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-290674
]
ASF GitHub Bot logged work on HDDS-1925:
----------------------------------------
Author: ASF GitHub Bot
Created on: 07/Aug/19 18:22
Start Date: 07/Aug/19 18:22
Worklog Time Spent: 10m
Work Description: adoroszlai commented on pull request #1248: HDDS-1925.
ozonesecure acceptance test broken by HTTP auth requirement
URL: https://github.com/apache/hadoop/pull/1248
## What changes were proposed in this pull request?
Obtain Kerberos ticket for HTTP before web requests and use it for `curl`.
(Unfortunately it works only on the same host, eg. `scm` cannot make request to
`om` using its own HTTP keytab.)
https://issues.apache.org/jira/browse/HDDS-1925
## How was this patch tested?
Ran both secure and unsecure acceptance tests. (Some of them timed out
locally...)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 290674)
Time Spent: 10m
Remaining Estimate: 0h
> ozonesecure acceptance test broken by HTTP auth requirement
> -----------------------------------------------------------
>
> Key: HDDS-1925
> URL: https://issues.apache.org/jira/browse/HDDS-1925
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: docker, test
> Affects Versions: 0.4.1
> Reporter: Doroszlai, Attila
> Assignee: Doroszlai, Attila
> Priority: Critical
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Acceptance test is failing at {{ozonesecure}} with the following error from
> {{jq}}:
> {noformat:title=https://github.com/elek/ozone-ci/blob/325779d34623061e27b80ade3b749210648086d1/byscane/byscane-nightly-ds7lx/acceptance/output.log#L2779}
> parse error: Invalid numeric literal at line 2, column 0
> {noformat}
> Example compose environments wait for datanodes to be up:
> {code:title=https://github.com/apache/hadoop/blob/9cd211ac86bb1124bdee572fddb6f86655b19b73/hadoop-ozone/dist/src/main/compose/testlib.sh#L71-L72}
> docker-compose -f "$COMPOSE_FILE" up -d --scale datanode="${datanode_count}"
> wait_for_datanodes "$COMPOSE_FILE" "${datanode_count}"
> {code}
> The number of datanodes up is determined via HTTP query of JMX endpoint:
> {code:title=https://github.com/apache/hadoop/blob/9cd211ac86bb1124bdee572fddb6f86655b19b73/hadoop-ozone/dist/src/main/compose/testlib.sh#L44-L46}
> #This line checks the number of HEALTHY datanodes registered in scm over
> the
> # jmx HTTP servlet
> datanodes=$(docker-compose -f "${compose_file}" exec -T scm curl -s
> 'http://localhost:9876/jmx?qry=Hadoop:service=SCMNodeManager,name=SCMNodeManagerInfo'
> | jq -r '.beans[0].NodeCount[] | select(.key=="HEALTHY") | .value')
> {code}
> The problem is that no authentication is performed before or during the
> request, which is no longer allowed since HDDS-1901:
> {code}
> $ docker-compose exec -T scm curl -s
> 'http://localhost:9876/jmx?qry=Hadoop:service=SCMNodeManager,name=SCMNodeManagerInfo'
> <html>
> <head>
> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
> <title>Error 401 Authentication required</title>
> </head>
> <body><h2>HTTP ERROR 401</h2>
> <p>Problem accessing /jmx. Reason:
> <pre> Authentication required</pre></p>
> </body>
> </html>
> {code}
> {code}
> $ docker-compose exec -T scm curl -s
> 'http://localhost:9876/jmx?qry=Hadoop:service=SCMNodeManager,name=SCMNodeManagerInfo'
> | jq -r '.beans[0].NodeCount[] | select(.key=="HEALTHY") | .value'
> parse error: Invalid numeric literal at line 2, column 0
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
