UFMurphy commented on issue #7570: URL: https://github.com/apache/iceberg/issues/7570#issuecomment-1544702770
@Fokko Thanks for the thoughtful reply. That did not do the trick, unfortunately. What I am learning (the hard way) is that iceberg is a versioning nightmare. This morning, I wiped the slate clean and started over... So I am running the following... Spark 3.3.1 (on spark master/worker and a separate jupyter notebook box) iceberg-spark-runtime: org.apache.iceberg:iceberg-spark-runtime-3.3_2.12:1.1.0 AWS libraries: software.amazon.awssdk:bundle:2.19.19 software.amazon.awssdk:url-connection-client:2.19.19 Spark extensions: org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions Postgres iceberg catalog Local Minio object store I can read files off minio fine. I can also connect to the iceberg catalog ok from spark-sql cli. It's just the pyspark in the notebook - even using same config params. It gets stuck on the region error. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
