Spark with GPU

2023-02-05 Thread Irene Markelic
Hello, has anyone used spark with GPUs? I wonder if every worker node in a cluster needs one GPU or if you can have several worker nodes of which only one has a GPU. Thank you! - To unsubscribe e-mail: user-unsubscr...@spa

groupby question

2022-05-05 Thread Irene Markelic
Hi everybody, I have and rdd that I want to group according to some key, but it just doesn't work. I am a Scala beginner. So I have the following RDD: langs: List[String] rdd: RDD[WikipediaArticle]) val meinVal = rdd.flatMap(article=>langs.map(lang=>{if (article.mentionsLanguage(lang){ Tup