Creating a memory-efficient AggregateFunction to calculate Median

2021-12-09 Thread Nicholas Chammas
I'm trying to create a new aggregate function. It's my first time working with Catalyst, so it's exciting---but I'm also in a bit over my head. My goal is to create a function to calculate the median . As a very simple solution, I could just

Re: docker image distribution in Kubernetes cluster

2021-12-09 Thread Mich Talebzadeh
Thanks Prasad. My understanding to what you are implying is that we can have multiple docker images to use for different use cases gcloud container images list-tags eu.gcr.io//spark-py e2e71387c295 3.1.1-scala_2.12-8-jre-slim-buster-java8WithPyyaml 2021-12-08T22:56:17 d0bcc195a35f