n running Spark 2.4.5.
>
> El lun, 29 may 2023 a las 13:28, Poorna Murali ()
> escribió:
>
>> Hi,
>>
>> We are using spark version 2.4.5.1. We would like to know the maximum JDK
>> version supported for the same.
>>
>> Thanks,
>> Poorna
>>
Hi,
We are using spark version 2.4.5.1. We would like to know the maximum JDK
version supported for the same.
Thanks,
Poorna
such as:
>
> sparkContext.hadoopConfiguration().set("fs.s3a.connection.maximum",
> Integer.toString(workerCount * 2));
>
>
> This works in our Spark 3.0.1 code; just migrating to 3.2.1 now.
>
> Cheers,
>
> Steve C
>
> On 8 Jun 2022, at 4:28 pm, Poorna Murali wrote:
Hi,
I would like to know if it is possible to get the count of live master and
worker spark nodes running in a system.
Please help to clarify the same.
Thanks,
Poorna
