On 05/26/2016 02:38 AM, Matei Zaharia wrote:
> Just wondering, what is the main use case for the Docker images -- to
> develop apps locally or to deploy a cluster?
I use docker images for both development and deploying on production
cluster. As it makes sure I have the correct version of Java and
OK created this issue https://issues.apache.org/jira/browse/SPARK-15487
please comment on this and also let me know if anyone want to
collaborate on implementing it. Its my first contribution to Spark so
will be exciting.
- Gurvinder
On 05/23/2016 07:55 PM, Gurvinder Singh wrote:
> On 05/23/2
Hi Reynold,
So if that's OK with you, can I go ahead and create JIRA for this. As it
seems this feature is missing currently and can benefit not just for
kubernetes users but in general Spark standalone mode users too.
- Gurvinder
On 05/22/2016 12:49 PM, Gurvinder Singh wrote:
> On 05/22/2016
ynamic nature
of application drivers and to some extent workers too.
- Gurvinder
>> On May 22, 2016, at 14:55, Gurvinder Singh <gurvinder.si...@uninett.no>
>> wrote:
>>
>> On 05/22/2016 08:32 AM, Reynold Xin wrote:
>>> Kubernetes itself already has facil
worker and application UI. Replied in the
detail to Sun Rui's mail where I gave example of possible scenario.
- Gurvinder
>
> On Sat, May 21, 2016 at 9:30 AM, Gurvinder Singh
> <gurvinder.si...@uninett.no <mailto:gurvinder.si...@uninett.no>> wrote:
>
> Hi,
>
> I
in having such a
feature and get together to add it then :)
- Gurvinder
>
> Maybe Apache Knox can help you. Not sure how Knox can integrate with Spark.
>> On May 22, 2016, at 00:30, Gurvinder Singh <gurvinder.si...@uninett.no
>> <mailto:gurvinder.si...@uninett
Hi,
I am currently working on deploying Spark on kuberentes (K8s) and it is
working fine. I am running Spark with standalone mode and checkpointing
the state to shared system. So if master fails K8s starts it and from
checkpoint it recover the earlier state and things just works fine. I
have an
I wonder if anyone got any feedback on it. I can look into implement it
but would like to know if such a functionality can be merged into master
back. If yes then please let me know and point me to the direction to
get started.
Regards,
Gurvinder
On 03/04/2016 09:25 AM, Gurvinder Singh wrote
it ?
Thanks,
Gurvinder
Forwarded Message
Subject: spark master ui to proxy app and worker ui
Date: Thu, 3 Mar 2016 20:12:07 +0100
From: Gurvinder Singh <gurvinder.si...@uninett.no>
To: user <u...@spark.apache.org>
Hi,
I am wondering if it is possible for the spar
examples such as log query. Maybe that'll help
reproduce the issue.
On Monday, October 6, 2014, Gurvinder Singh
gurvinder.si...@uninett.no
mailto:gurvinder.si
On 10/06/2014 08:19 AM, Fairiz Azizi wrote:
The Spark online docs indicate that Spark is compatible with Mesos 0.18.1
I've gotten it to work just fine on 0.18.1 and 0.18.2
Has anyone tried Spark on a newer version of Mesos, i.e. Mesos v0.20.0?
-Fi
Yeah we are using Spark 1.1.0 with
:
(Hit enter too soon...)
What is your setup and steps to repro this?
Tim
On Mon, Oct 6, 2014 at 12:30 AM, Timothy Chen tnac...@gmail.com wrote:
Hi Gurvinder,
I tried fine grain mode before and didn't get into that problem.
On Sun, Oct 5, 2014 at 11:44 PM, Gurvinder Singh
gurvinder.si
On 09/03/2014 04:23 PM, Nicholas Chammas wrote:
On Wed, Sep 3, 2014 at 3:24 AM, Patrick Wendell pwend...@gmail.com wrote:
== What default changes should I be aware of? ==
1. The default value of spark.io.compression.codec is now snappy
-- Old behavior can be restored by switching to lzf
2.
13 matches
Mail list logo
