Hi There;
�
Wonder if anyone might have experience with running spark app from Eclipse Rich
Client Platform in java. The same code run from Eclipse Rich Client Platform of
spark app is much slower than running from normal Java in Eclipse without Rich
Client Platform.
�
Appreciate any
Hi Amit;
�
Do you have any idea where to find mqtt module. It supposes to be under
pyspark.streaming? I could not find it with the latest version of 3.1.1. I need
to connect the structured streaming via mqtt.
�
Appreciate any help with the matter.
�
Regards,
�
Jian Xu
�
From: Amit
Hi There;
�
I am using spark latest 3.1.1 and try to connect via mqtt with structured
streaming. Seems to me the mqtt does not exist under pyspark.streaming anymore.
Does anyone know where does this module go and load it with the python
application.
�
Appreciate answer.
�
Regards,
�
Hi Amit;
�
Further to my last email, I managed to set the scheduler to fair via code conf
=
SparkConf().setMaster("local").setAppName("HSMSTest1").set("spark.scheduler.mode",
"FAIR")
�
I can see the mode is changed in web view. Though the result is same. This does
not work out. And it
Hi Amit;
�
Thank you for your prompt reply and kind help. Wonder how to set the scheduler
to FAIR mode in python. Following code seems to me does not work out.
�
conf = SparkConf().setMaster("local").setAppName("HSMSTest1")
sc = SparkContext(conf=conf)
Hi There;
�
I am new to spark. We are using spark to develop our app for data streaming
with sensor readings.
�
I am having trouble to get two queries with structured streaming working
concurrently.
�
Following is the code. It can only work with one of them. Wonder if there is
any way
