Re: Viewing UI for spark jobs running on K8s

> Thanks > Nikhil > -- Regards, Qian Sun

Re: Executor metrics are missing on Prometheus sink

b/spark-dashboard ) > > An additional comment is that there is room for having more sinks > available for Apache Spark metrics, notably for InfluxDB and for Prometheus > (gateway), if someone is interested in working on that. > > > > Best, > > Luca > > > > > > *Fr

Executor metrics are missing on prometheus sink

-instance--executor *How to expose executor metrics on spark exeuctors pod?* *Any help will be appreciated.* -- Regards, Qian Sun

Re: spark on kubernetes

ice accounts token and certificate. > and you are right I have to use `service account cert` to configure > spark.kubernetes.authenticate.caCertFile. > Thanks again. best regards. > > On Sat, Oct 15, 2022 at 4:51 PM Qian Sun wrote: > >> Hi Mohammad >> Did you try this command?

Re: spark on kubernetes

d I found lot's of other similar questions on > stackoverflow without an answer like bellow: > > > https://stackoverflow.com/questions/61982896/how-to-fix-pods-is-forbidden-user-systemanonymous-cannot-watch-resource > > > -- > Best Wishes! > Mohammad Abdollahzade Arani > Computer Engineering @ SBU > > -- Best! Qian Sun

Re: Executor heartbeats on Kubernetes

> To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > -- Best! Qian SUN

Re: Kyro Serializer not getting set : Spark3

ueOfSparkConfigError(QueryCompilationErrors.scala:2322) > > Can we safely skip setting it or is there any changed way? > > Thanks > Rajat > > > -- Best! Qian SUN

Re: running pyspark on kubernetes - no space left on device

tion, printing or other use of, or taking > of any action in reliance upon, this information by persons or entities > other than the intended recipient is prohibited. If you receive this > message in error, please immediately inform the sender by reply email and > delete the message and any attachments. Thank you. > -- Best! Qian SUN

Re: Spark with Hive (Standalone) Metastore

> > > > Spark version : 3.0.2 > > Hive version : 3.1.2 > > > > Best, > > Ankur Khanna > -- Best! Qian SUN

Re: Stickers and Swag

GOOD! Could these are mailed to China? > 2022年6月14日 下午2:04，Xiao Li 写道： > > Hi, all, > > The ASF has an official store at RedBubble > that Apache Community > Development (ComDev) runs. If you are interested in buying Spark Swag, 70 > products

Re: A scene with unstable Spark performance

; job. > > > > Is there a workaround that can solve this problem through Spark Fair > Scheduler? If it can't be solved, would you consider adding a mechanism > like capacity scheduling. > > > > Thank you, > > Bowen Song > -- Best! Qian SUN

Re: Log4j 1.2.17 spark CVE

My understanding is that we don’t need to do anything. Log4j2-core not used in spark. > 2021年12月13日 下午12:45，Pralabh Kumar 写道： > > Hi developers, users > > Spark is built using log4j 1.2.17 . Is there a plan to upgrade based on > recent CVE detected ? > > > Regards > Pralabh kumar

Re: creating database issue

Hi, It seems to be a hms question. Would u like to provide the information about spark version, hive version and spark application configuration? Best > 2021年12月8日 上午9:04，bitfox 写道： > > sorry I am newbie to spark. > > When I created a database in pyspark shell following the book content