hello All, I have kubeflow Spark Operator installed on k8s and from what i understand - Spark Shuffle is not officially supported on kubernetes.
Looking for feedback from the community on what approach is being taken to handle this issue - especially since dynamicAllocation cannot be enabled without Spark Shuffle. for eg. Does storing the shuffle data in PVC help ? Pls let me know. tia!
