t0il3ts0ap opened a new issue #4496: URL: https://github.com/apache/hudi/issues/4496
**Describe the problem you faced** Hudi is not able to report metrics to pushgateway when secured by https **To Reproduce** --hoodie-conf hoodie.metrics.on=true --hoodie-conf hoodie.metrics.reporter.type=PROMETHEUS_PUSHGATEWAY --hoodie-conf hoodie.metrics.pushgateway.host=pushgateway.prod.some-tech.in --hoodie-conf hoodie.metrics.pushgateway.port=443 --hoodie-conf hoodie.metrics.pushgateway.delete.on.shutdown=false --hoodie-conf hoodie.metrics.pushgateway.job.name=loan_origination_manager_statuses_mgck --hoodie-conf hoodie.metrics.pushgateway.random.job.name.suffix=false **Expected behavior** Metrics should be pushed to pushgateway successfully even when using https **Environment Description** * Hudi version : 0.10 * Spark version : 3.0.1 * Storage (HDFS/S3/GCS..) : S3 * Running on Docker? (yes/no) : no **Additional context** https://github.com/prometheus/client_java/blob/ec6def41378f4a408f781a13669e2caf82aa6bf3/simpleclient_pushgateway/src/main/java/io/prometheus/client/exporter/PushGateway.java#L72 Hudi uses above constructor of push gateway client which assumes that pushgateway is connected via http. **Stacktrace** ``` java.io.IOException: Response code from http://pushgateway.prod.some-tech.in:443/metrics/job/loan_origination_manager_statuses_mgck was 400, response body: <html> <head><title>400 The plain HTTP request was sent to HTTPS port</title></head> <body> <center><h1>400 Bad Request</h1></center> <center>The plain HTTP request was sent to HTTPS port</center> </body> </html> at io.prometheus.client.exporter.PushGateway.doRequest(PushGateway.java:325) at io.prometheus.client.exporter.PushGateway.pushAdd(PushGateway.java:160) at org.apache.hudi.metrics.prometheus.PushGatewayReporter.report(PushGatewayReporter.java:72) at org.apache.hudi.metrics.prometheus.PushGatewayMetricsReporter.report(PushGatewayMetricsReporter.java:64) at org.apache.hudi.metrics.Metrics.reportAndCloseReporter(Metrics.java:62) at java.lang.Thread.run(Thread.java:748) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
