GitHub user krutoileshii created a discussion: Getting Apache Polaris to work with Nutanix Objects + Airbyte
I have polaris up and running in generate (standalone). However, I can't seem to figure you how to get it to work with the Airbytes S3 Data Lake destination. It seems like it keeps trying to use the STS which is not available in my case. I would appreciate any help in getting this figured out. I am using Nutanix Objects which doesn't have an STS endpoint as far as i can find. Certificates are already imported for S3 and also using the HTTP endpoints instead of HTTPS for the time being. Polaris Version: 1.2.0 Standalone Settings in applicaiton.properties: ``` polaris.realm-context.realms=POLARIS quarkus.log.console.level=DEBUG quarkus.log.category."io.smallrye.config".level=DEBUG polaris.realm-context.header-name=Polaris-Realm #polaris.realm-context.require-header=true polaris.persistence.type=relational-jdbc quarkus.datasource.db-kind=postgresql quarkus.datasource.username=<username> quarkus.datasource.password=<password> quarkus.datasource.jdbc.url=jdbc:postgresql://<url>/polaris_test polaris.authentication.token-broker.type=rsa-key-pair polaris.authentication.token-broker.rsa-key-pair.public-key-file=/opt/polaris/public.key polaris.authentication.token-broker.rsa-key-pair.private-key-file=/opt/polaris/private.key polaris.authentication.token-broker.max-token-generation=PT1H polaris.bootstrap.credentials=POLARIS,admin,secret polaris.storage.aws.access-key=access_key polaris.storage.aws.secret-key=secret_key aws.accessKeyId=access_key aws.secretAccessKey=secret_key polaris.catalog.s3.no-sts=true polaris.features."SKIP_CREDENTIAL_SUBSCOPING_INDIRECTION": false polaris.features."SUPPORTED_CATALOG_STORAGE_TYPES": ["S3"] ``` ``` 2025-12-22 17:26:42,181 WARN [org.apa.pol.ser.con.ProductionReadinessChecks] [,] [,,,] (main) Refer to https://polaris.apache.org/in-dev/unreleased/configuring-polaris-for-production for more information. 2025-12-22 17:26:42,262 INFO [io.quarkus] [,] [,,,] (main) Apache Polaris Server (incubating) 1.2.0-incubating on JVM (powered by Quarkus 3.28.2) started in 4.542s. Listening on: http://0.0.0.0:8181. Management interface listening on http://0.0.0.0:8182. 2025-12-22 17:26:42,263 INFO [io.quarkus] [,] [,,,] (main) Profile prod activated. 2025-12-22 17:26:42,263 INFO [io.quarkus] [,] [,,,] (main) Installed features: [agroal, amazon-sdk-rds, cdi, hibernate-validator, jdbc-postgresql, micrometer, narayana-jta, oidc, opentelemetry, reactive-routes, rest, rest-jackson, security, smallrye-context-propagation, smallrye-fault-tolerance, smallrye-health, vertx] 2025-12-22 17:27:00,378 DEBUG [io.sma.config] [,] [,,,] (vert.x-eventloop-thread-1) SRCFG01001: The config quarkus.security.events.enabled was loaded from DefaultValuesConfigSource with the value true 2025-12-22 17:27:00,397 DEBUG [io.sma.config] [,] [,,,] (vert.x-eventloop-thread-1) SRCFG01001: The config quarkus.security.events.enabled was loaded from DefaultValuesConfigSource with the value true 2025-12-22 17:27:00,421 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (vert.x-eventloop-thread-1) SRCFG01001: The config quarkus.otel.sdk.disabled was loaded from PropertiesConfigSource[source=jar:file:///opt/polaris/polaris-latest/server/lib/main/org.apache.polaris.polaris-runtime-defaults-1.2.0-incubating.jar!/application.properties]:95 with the value true 2025-12-22 17:27:00,442 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01002: The config quarkus.fault-tolerance.mp-compatibility was not found 2025-12-22 17:27:00,442 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01001: The config smallrye.faulttolerance.mp-compatibility was loaded from DefaultValuesConfigSource with the value false 2025-12-22 17:27:00,443 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01002: The config quarkus.fault-tolerance.enabled was not found 2025-12-22 17:27:00,443 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01002: The config smallrye.faulttolerance.enabled was not found 2025-12-22 17:27:00,444 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01002: The config MP_Fault_Tolerance_NonFallback_Enabled was not found 2025-12-22 17:27:00,444 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01002: The config quarkus.fault-tolerance.metrics.enabled was not found 2025-12-22 17:27:00,444 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01002: The config smallrye.faulttolerance.metrics.enabled was not found 2025-12-22 17:27:00,444 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01002: The config MP_Fault_Tolerance_Metrics_Enabled was not found 2025-12-22 17:27:00,444 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01002: The config quarkus.fault-tolerance.micrometer.disabled was not found 2025-12-22 17:27:00,444 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01002: The config smallrye.faulttolerance.micrometer.disabled was not found 2025-12-22 17:27:00,480 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) SRCFG01001: The config quarkus.http.limits.max-body-size was loaded from PropertiesConfigSource[source=jar:file:///opt/polaris/polaris-latest/server/lib/main/org.apache.polaris.polaris-runtime-defaults-1.2.0-incubating.jar!/application.properties]:46 with the value 10240K 2025-12-22 17:27:00,496 INFO [org.apa.pol.ser.con.PolarisIcebergObjectMapperCustomizer] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) Limiting request body size to 10485760 bytes 2025-12-22 17:27:00,690 INFO [io.qua.htt.access-log] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000001,POLARIS] [,,,] (executor-thread-1) 10.30.3.58 - - [22/Dec/2025:17:27:00 +0000] "POST /api/catalog/v1/oauth/tokens HTTP/1.1" 200 782 2025-12-22 17:27:00,796 DEBUG [io.sma.config] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000002,POLARIS] [,,,] (executor-thread-2) SRCFG01001: The config quarkus.security.events.enabled was loaded from DefaultValuesConfigSource with the value true 2025-12-22 17:27:00,870 INFO [io.qua.htt.access-log] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000002,POLARIS] [,,,] (executor-thread-2) 10.30.3.58 - root [22/Dec/2025:17:27:00 +0000] "GET /api/catalog/v1/config?warehouse=data-warehouse-test HTTP/1.1" 200 2148 2025-12-22 17:27:01,030 INFO [org.apa.pol.ser.cat.ice.IcebergCatalogHandler] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000003,POLARIS] [,,,] (executor-thread-1) Initializing non-federated catalog 2025-12-22 17:27:01,130 INFO [io.qua.htt.access-log] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000003,POLARIS] [,,,] (executor-thread-1) 10.30.3.58 - root [22/Dec/2025:17:27:01 +0000] "GET /api/catalog/v1/data-warehouse-test/namespaces/raw HTTP/1.1" 200 69 2025-12-22 17:27:01,202 INFO [org.apa.pol.ser.exc.IcebergExceptionMapper] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000004,POLARIS] [,,,] (executor-thread-1) Handling runtimeException Table does not exist: raw.airbyte_test_table_33dc07a8_52ad_4164_b052_38bdb798ee10 2025-12-22 17:27:01,232 INFO [io.qua.htt.access-log] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000004,POLARIS] [,,,] (executor-thread-1) 10.30.3.58 - root [22/Dec/2025:17:27:01 +0000] "GET /api/catalog/v1/data-warehouse-test/namespaces/raw/tables/airbyte_test_table_33dc07a8_52ad_4164_b052_38bdb798ee10?snapshots=all HTTP/1.1" 404 146 2025-12-22 17:27:01,314 INFO [org.apa.pol.ser.cat.ice.IcebergCatalogHandler] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000005,POLARIS] [,,,] (executor-thread-1) Initializing non-federated catalog 2025-12-22 17:27:01,328 INFO [org.apa.ice.BaseMetastoreCatalog] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000005,POLARIS] [,,,] (executor-thread-1) Table properties set at catalog level through catalog properties: {} 2025-12-22 17:27:01,334 INFO [org.apa.ice.BaseMetastoreCatalog] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000005,POLARIS] [,,,] (executor-thread-1) Table properties enforced at catalog level through catalog properties: {} 2025-12-22 17:27:01,407 WARN [org.apa.pol.ser.sto.StorageConfiguration] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000005,POLARIS] [,,,] (executor-thread-1) Using hard-coded AWS credentials - this is not recommended for production 2025-12-22 17:27:01,950 INFO [org.apa.pol.ser.exc.IcebergExceptionMapper] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000005,POLARIS] [,,,] (executor-thread-1) Handling runtimeException Failed to get subscoped credentials: (Service: Sts, Status Code: 501, Request ID: 884970bf-ee4e-4aad-6fc5-b8ab76ea1d09+310000+119816+187079+19780, Extended Request ID: 884970bf-ee4e-4aad-6fc5-b8ab76ea1d09+310000+119816+187079+19780) (SDK Attempt Count: 1) 2025-12-22 17:27:01,951 INFO [io.qua.htt.access-log] [7ff494ca-32f6-43b1-b355-6dd3aa51e5b3_0000000000000000005,POLARIS] [,,,] (executor-thread-1) 10.30.3.58 - root [22/Dec/2025:17:27:01 +0000] "POST /api/catalog/v1/data-warehouse-test/namespaces/raw/tables HTTP/1.1" 422 328 ``` GitHub link: https://github.com/apache/polaris/discussions/3315 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
