Hi All, We are in the process of moving our workloads to K8 and looking for some guidance to run Spark Thrift Server on K8. We need the executor pods to autoscale based on the workload vs running it with a static number of executors.
If any one has done it and can share the details, it will be really appreciated. Regards Jayabindu Singh