KodaiD commented on PR #16512:
URL: https://github.com/apache/iceberg/pull/16512#issuecomment-4509132833
I've verified commands in my environment.
```
$ docker exec -it spark-iceberg spark-sql \
--conf spark.sql.catalog.rest=org.apache.iceberg.spark.SparkCatalog \
--conf spark.sql.catalog.rest.type=rest \
--conf spark.sql.catalog.rest.uri=http://rest:8181/ \
--conf spark.sql.catalog.rest.warehouse=s3://warehouse/ \
--conf spark.sql.catalog.rest.io-impl=org.apache.iceberg.aws.s3.S3FileIO
\
--conf spark.sql.catalog.rest.s3.endpoint=http://minio:9000/ \
--conf spark.sql.catalog.rest.s3.path-style-access=true \
--conf spark.sql.defaultCatalog=rest
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use
setLogLevel(newLevel).
26/05/21 07:49:48 WARN NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
26/05/21 07:49:49 WARN Utils: Service 'SparkUI' could not bind on port 4040.
Attempting port 4041.
Spark Web UI available at http://3b96b92e5615:4041/
Spark master: local[*], Application Id: local-1779349789447
spark-sql ()> CREATE DATABASE IF NOT EXISTS rest.db;
Time taken: 0.041 seconds
spark-sql ()> CREATE TABLE rest.db.sample (id int, name string);
Time taken: 0.61 seconds
spark-sql ()>
What's next:
Try Docker Debug for seamless, persistent debugging tools in any
container or image → docker debug spark-iceberg
Learn more at https://docs.docker.com/go/debug-cli/
$ aws s3 ls s3://warehouse --recursive
2026-05-21 16:51:49 728
db/sample/metadata/00000-c0b1cb52-76eb-48cc-aa4f-8ff6193c9f2b.metadata.json
$
```
```
$ docker exec spark-iceberg bash -c 'cat >>
/opt/spark/conf/spark-defaults.conf <<EOF
spark.sql.catalog.rest
org.apache.iceberg.spark.SparkCatalog
spark.sql.catalog.rest.type rest
spark.sql.catalog.rest.uri http://rest:8181/
spark.sql.catalog.rest.warehouse s3://warehouse/
spark.sql.catalog.rest.io-impl
org.apache.iceberg.aws.s3.S3FileIO
spark.sql.catalog.rest.s3.endpoint http://minio:9000/
spark.sql.catalog.rest.s3.path-style-access true
spark.sql.defaultCatalog rest
EOF'
$
$ docker exec -it spark-iceberg spark-sql
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use
setLogLevel(newLevel).
26/05/21 07:57:23 WARN NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
26/05/21 07:57:24 WARN Utils: Service 'SparkUI' could not bind on port 4040.
Attempting port 4041.
Spark Web UI available at http://9c44279abf99:4041/
Spark master: local[*], Application Id: local-1779350244335
spark-sql ()> CREATE DATABASE IF NOT EXISTS rest.db;
Time taken: 0.579 seconds
spark-sql ()> CREATE TABLE rest.db.sample (id int, name string);
Time taken: 0.513 seconds
spark-sql ()>
What's next:
Try Docker Debug for seamless, persistent debugging tools in any
container or image → docker debug spark-iceberg
Learn more at https://docs.docker.com/go/debug-cli/
$ aws s3 ls s3://warehouse --recursive
2026-05-21 16:57:44 728
db/sample/metadata/00000-f1a5abe9-6451-41cc-9d09-ecec1d1c493f.metadata.json
$
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
