CsabaVenczel commented on issue #1389: URL: https://github.com/apache/polaris/issues/1389#issuecomment-4885165867
Dear Polaris team, I would like to report that we are also encountering this issue (#1389) in our environment, specifically when running dbt (data build tool). dbt frequently executes parallel model builds, which generate exactly the kind of concurrent CREATE and DELETE operations on namespaces, tables, and views that trigger this IllegalStateException. This happens quite often in our pipelines and significantly hinders production use cases. The error rate increases with higher threads settings in dbt, forcing us to reduce parallelism significantly. We would be happy to test any preview fixes or provide more logs if needed. I wanted to share this real-world use case to highlight that this is not just an edge-case test scenario but a practical problem for users relying on dbt for data transformations. I hope this additional context helps in prioritizing the fix. Thank you for your work on Polaris! Csaba -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
