chenzl25 opened a new issue, #434:
URL: https://github.com/apache/iceberg-rust/issues/434
If an iceberg table is created and inserted with data by spark, we will get
a manifest list with prefix `s3a`.
```
spark-sql --packages
org.apache.iceberg:iceberg-spark-runtime-3.5_2.12:1.4.3,mysql:mysql-connector-java:8.0.33,org.apache.hadoop:hadoop-aws:3.3.2
\
--conf
spark.sql.extensions=org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions
\
--conf spark.sql.catalog.demo=org.apache.iceberg.spark.SparkCatalog \
--conf spark.sql.catalog.demo.type=hadoop \
--conf spark.sql.catalog.demo.warehouse=s3a://my-iceberg-bucket-5950/ \
--conf
spark.sql.catalog.demo.hadoop.fs.s3a.endpoint=https://s3.ap-southeast-2.amazonaws.com
\
--S --e "CREATE TABLE demo.demo_db.demo_table(seq_id bigint, user_id
bigint, user_name string) TBLPROPERTIES ('format-version'='2');"
```
If I use iceberg-rust to read that table with a `s3` instead of a `s3a`
endpoint, it will end up with this error. Is it expected?
```
Invalid s3 url:
s3a://icebergdata/demo/demo_db/demo_table/metadata/snap-2-1-497e82e7-f4a6-4513-8c76-6267c9497998.avro,
should start with s3://icebergdata/
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
