subramaniam created SPARK-51134:
-----------------------------------
Summary: List Object operation increased drastically when we
migrated jobs from databricks to oss
Key: SPARK-51134
URL: https://issues.apache.org/jira/browse/SPARK-51134
Project: Spark
Issue Type: Bug
Components: k8s
Affects Versions: 3.5.4
Reporter: subramaniam
We have migrated few of our jobs which are currently running on databricks to
open source and we are seeing sudden increase in the list object operations on
our cloud bucket, we are using delta format. Is there any way oss reads delta
log different from databricks?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
