Hi Gabriel,
The distribution won’t be available for download until Spark supports
Hadoop 3.3.x. At the moment, Spark cannot use Hadoop 3.3.0 because of
various issues. Our best bet is to wait until Hadoop 3.3.1 comes out.
Best,
Chao
On Tue, Jan 19, 2021 at 8:00 PM Gabriel Magno
wrote:
>
Correction: spark-3.0.1-bin-hadoop3.3.tgz
--
Gabriel Magno
Em qua., 20 de jan. de 2021 às 00:34, Gabriel Magno
escreveu:
> Are there any plans to provide a distribution release of Spark with
> Hadoop3.3 (spark-3.0.1-bin-hadoop3.2.tgz) directly in the Spark Download
> page
Are there any plans to provide a distribution release of Spark with
Hadoop3.3 (spark-3.0.1-bin-hadoop3.2.tgz) directly in the Spark Download
page (https://spark.apache.org/downloads.html)?
--
Gabriel Magno
Hello!
When using Spark Standalone & Spark 2.4.4 / 3.0.0 - we are seeing our
standalone Spark "applications" timeout and show as "Finished" after around
an hour of time.
Here is a screenshot from the Spark master before it's marked as finished.
[image: image.png]
Here is a screenshot from the
We are trying to create a customized transformer for a ML pipeline and
also want to persist the trained pipeline and retrieve it for
production. To enable persistency, we will have to implement read/write
functions. However, this is not feasible in Scala since the read/write
methods are
You have to sign up by sending an email - see
http://spark.apache.org/community.html for what to send where.
On Tue, Jan 19, 2021 at 12:25 PM Peter Podlovics <
peter.d.podlov...@gmail.com> wrote:
> Hello,
>
> I would like to subscribe to the above mailing list. I already tried
> subscribing
Hello,
I would like to subscribe to the above mailing list. I already tried
subscribing through the webpage, but I still haven't received the email yet.
Thanks,
Peter
Will do, thanks!
On Tue, Jan 19, 2021 at 1:39 PM Gabor Somogyi
wrote:
> Thanks for double checking the version. Please report back with 3.1
> version whether it works or not.
>
> G
>
>
> On Tue, 19 Jan 2021, 07:41 Eric Beabes, wrote:
>
>> Confirmed. The cluster Admin said his team installed
Thanks for double checking the version. Please report back with 3.1 version
whether it works or not.
G
On Tue, 19 Jan 2021, 07:41 Eric Beabes, wrote:
> Confirmed. The cluster Admin said his team installed the latest version
> from Cloudera which comes with Spark 3.0.0-preview2. They are going
