rajarshisarkar opened a new pull request, #4903: URL: https://github.com/apache/iceberg/pull/4903
Recently, it was reported in Slack general channel that [AWS S3 tagging](https://github.com/apache/iceberg/blob/master/docs/integrations/aws.md#s3-tags) present in master branch is not working for keys with upper case. Reference: https://apache-iceberg.slack.com/archives/C025PH0G1D4/p1653879105452189 This is because we use `CaseInsensitiveStringMap` for options in `SparkCatalog`. This PR uses options as a `CaseSensitiveMap`. With this change, the following Spark configurations: ``` sh spark-sql --conf spark.sql.catalog.my_catalog=org.apache.iceberg.spark.SparkCatalog \ --conf spark.sql.catalog.my_catalog.warehouse=s3://srajars-emr-engg-blore-dev/warehouse.case-sensitive \ --conf spark.sql.catalog.my_catalog.catalog-impl=org.apache.iceberg.aws.glue.GlueCatalog \ --conf spark.sql.catalog.my_catalog.io-impl=org.apache.iceberg.aws.s3.S3FileIO \ --conf spark.sql.catalog.my_catalog.s3.write.tags.my_key=my_val \ --conf spark.sql.catalog.my_catalog.s3.write.tags.MY_key2=my_val2 ``` now saves the S3 tags as: ``` my_key = my_val MY_key2 = my_val2 ``` --- cc: @RussellSpitzer @jackye1995 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
