[
https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127318#comment-14127318
]
Thomas Graves commented on SPARK-3445:
--
We are in progress of moving and the timeline
[
https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127446#comment-14127446
]
Thomas Graves commented on SPARK-3174:
--
{quote}
Yeah so how about we create a sub-tas
[
https://issues.apache.org/jira/browse/SPARK-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3286.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> Cannot view ApplicationMaster UI when Yarn’s url
Thomas Graves created SPARK-3475:
Summary: dev/merge_spark_pr.py fails on mac
Key: SPARK-3475
URL: https://issues.apache.org/jira/browse/SPARK-3475
Project: Spark
Issue Type: Bug
C
[
https://issues.apache.org/jira/browse/SPARK-1713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-1713.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> YarnAllocationHandler starts a thread for every
[
https://issues.apache.org/jira/browse/SPARK-3475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3475.
--
Resolution: Invalid
worked fine on another pr so not sure what happened on this one. I'll look
Thomas Graves created SPARK-3476:
Summary: Yarn ClientBase.validateArgs memory checks wrong
Key: SPARK-3476
URL: https://issues.apache.org/jira/browse/SPARK-3476
Project: Spark
Issue Type: Bu
[
https://issues.apache.org/jira/browse/SPARK-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129026#comment-14129026
]
Thomas Graves commented on SPARK-3476:
--
note https://github.com/apache/spark/pull/225
[
https://issues.apache.org/jira/browse/SPARK-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-3477:
-
Description:
With the addition of new features and supporting multiple versions of yarn the
code
[
https://issues.apache.org/jira/browse/SPARK-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-2140.
--
Resolution: Fixed
Fix Version/s: (was: 1.0.1)
(was: 1.
[
https://issues.apache.org/jira/browse/SPARK-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14130063#comment-14130063
]
Thomas Graves commented on SPARK-2668:
--
note that the mapreduce one was changed in
h
[
https://issues.apache.org/jira/browse/SPARK-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-3374:
-
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-3492
> Spark on Yarn config cleanup
[
https://issues.apache.org/jira/browse/SPARK-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-1891.
--
Resolution: Fixed
> Add admin acls to the Web UI
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-2558.
--
Resolution: Fixed
Fix Version/s: 1.2.0
Target Version/s: 1.2.0 (was: 1.1.0, 1.0
Thomas Graves created SPARK-3508:
Summary: annotate the Spark configs to indicate which ones are
meant for the end user
Key: SPARK-3508
URL: https://issues.apache.org/jira/browse/SPARK-3508
Project: S
[
https://issues.apache.org/jira/browse/SPARK-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3014.
--
Resolution: Fixed
Fix Version/s: 1.2.0
Assignee: Sandy Ryza
> Log a more informa
[
https://issues.apache.org/jira/browse/SPARK-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3456.
--
Resolution: Fixed
Fix Version/s: 1.2.0
Assignee: Thomas Graves
> YarnAllocator c
[
https://issues.apache.org/jira/browse/SPARK-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3410.
--
Resolution: Fixed
Fix Version/s: 1.2.0
Assignee: Kousuke Saruta
> The priority o
[
https://issues.apache.org/jira/browse/SPARK-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3177.
--
Resolution: Fixed
Fix Version/s: (was: 1.1.1)
1.2.0
> Yarn-alpha C
[
https://issues.apache.org/jira/browse/SPARK-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3557.
--
Resolution: Duplicate
> Yarn client config prioritization is backwards
> ---
[
https://issues.apache.org/jira/browse/SPARK-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138993#comment-14138993
]
Thomas Graves commented on SPARK-3557:
--
This is a dup of SPARK-2872, although this ha
[
https://issues.apache.org/jira/browse/SPARK-2872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138996#comment-14138996
]
Thomas Graves commented on SPARK-2872:
--
adding description from spark-3557 as it expl
Thomas Graves created SPARK-3596:
Summary: Support changing the yarn client monitor interval
Key: SPARK-3596
URL: https://issues.apache.org/jira/browse/SPARK-3596
Project: Spark
Issue Type:
Thomas Graves created SPARK-3607:
Summary: ConnectionManager threads.max configs on the thread pools
don't work
Key: SPARK-3607
URL: https://issues.apache.org/jira/browse/SPARK-3607
Project: Spark
Thomas Graves created SPARK-3627:
Summary: spark on yarn reports success even though job fails
Key: SPARK-3627
URL: https://issues.apache.org/jira/browse/SPARK-3627
Project: Spark
Issue Type:
Thomas Graves created SPARK-3632:
Summary: ConnectionManager can run out of receive threads with
authentication on
Key: SPARK-3632
URL: https://issues.apache.org/jira/browse/SPARK-3632
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143438#comment-14143438
]
Thomas Graves commented on SPARK-3627:
--
We could make this a separate issue, but I've
[
https://issues.apache.org/jira/browse/SPARK-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143523#comment-14143523
]
Thomas Graves commented on SPARK-3627:
--
this might be the same as SPARK-3293
> spark
[
https://issues.apache.org/jira/browse/SPARK-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143877#comment-14143877
]
Thomas Graves commented on SPARK-2848:
--
[~vanzin] [~pwendell]
I think the fix version
[
https://issues.apache.org/jira/browse/SPARK-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-2668.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> Add variable of yarn log directory for reference
[
https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144946#comment-14144946
]
Thomas Graves commented on SPARK-3445:
--
Any other comments or objections to this?
>
Thomas Graves created SPARK-3657:
Summary: yarn alpha YarnRMClientImpl throws NPE
appMasterRequest.setTrackingUrl starting spark-shell
Key: SPARK-3657
URL: https://issues.apache.org/jira/browse/SPARK-3657
[
https://issues.apache.org/jira/browse/SPARK-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3477.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> Clean up code in Yarn Client / ClientBase
>
[
https://issues.apache.org/jira/browse/SPARK-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3304.
--
Resolution: Fixed
Fix Version/s: 1.2.0
Assignee: Kousuke Saruta
> ApplicationMas
Thomas Graves created SPARK-3678:
Summary: Yarn app name reported in RM is different between cluster
and client mode
Key: SPARK-3678
URL: https://issues.apache.org/jira/browse/SPARK-3678
Project: Spar
[
https://issues.apache.org/jira/browse/SPARK-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147835#comment-14147835
]
Thomas Graves commented on SPARK-3678:
--
Also note that the spark-submit --name optio
[
https://issues.apache.org/jira/browse/SPARK-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150008#comment-14150008
]
Thomas Graves commented on SPARK-3293:
--
I'm going to fix this under SPARK-3627
> yar
[
https://issues.apache.org/jira/browse/SPARK-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves closed SPARK-3293.
Resolution: Duplicate
> yarn's web show "SUCCEEDED" when the driver throw a exception in yarn-client
[
https://issues.apache.org/jira/browse/SPARK-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150013#comment-14150013
]
Thomas Graves commented on SPARK-3627:
--
I'm going to go through all the exit and stat
[
https://issues.apache.org/jira/browse/SPARK-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-3627:
Assignee: Thomas Graves
> spark on yarn reports success even though job fails
> ---
[
https://issues.apache.org/jira/browse/SPARK-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152308#comment-14152308
]
Thomas Graves commented on SPARK-3732:
--
I think you should just change the name of th
[
https://issues.apache.org/jira/browse/SPARK-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152409#comment-14152409
]
Thomas Graves commented on SPARK-3732:
--
I understand your usecase and need for it, b
[
https://issues.apache.org/jira/browse/SPARK-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152409#comment-14152409
]
Thomas Graves edited comment on SPARK-3732 at 9/29/14 10:19 PM:
[
https://issues.apache.org/jira/browse/SPARK-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153558#comment-14153558
]
Thomas Graves commented on SPARK-3627:
--
[~andrewor] Why was the affects version chan
[
https://issues.apache.org/jira/browse/SPARK-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153777#comment-14153777
]
Thomas Graves commented on SPARK-3627:
--
As far as I am aware the common cases worked
[
https://issues.apache.org/jira/browse/SPARK-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-3627:
-
Affects Version/s: (was: 1.1.0)
1.2.0
> spark on yarn reports success e
[
https://issues.apache.org/jira/browse/SPARK-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3768.
--
Resolution: Fixed
> Modify default YARN memory_overhead-- from an additive constant to a
> mult
Thomas Graves created SPARK-3768:
Summary: Modify default YARN memory_overhead-- from an additive
constant to a multiplier
Key: SPARK-3768
URL: https://issues.apache.org/jira/browse/SPARK-3768
Project
Thomas Graves created SPARK-3778:
Summary: newAPIHadoopRDD doesn't properly pass credentials for
secure hdfs on yarn
Key: SPARK-3778
URL: https://issues.apache.org/jira/browse/SPARK-3778
Project: Spar
Thomas Graves created SPARK-3779:
Summary: yarn spark.yarn.applicationMaster.waitTries config should
be changed to a time period
Key: SPARK-3779
URL: https://issues.apache.org/jira/browse/SPARK-3779
P
Thomas Graves created SPARK-3780:
Summary: YarnAllocator should look at the container completed
diagnostic message
Key: SPARK-3780
URL: https://issues.apache.org/jira/browse/SPARK-3780
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-3778:
Assignee: Thomas Graves
> newAPIHadoopRDD doesn't properly pass credentials for secure hdfs
[
https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14160939#comment-14160939
]
Thomas Graves commented on SPARK-3174:
--
Good write up Andrew.
Just to make sure, the
[
https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14160988#comment-14160988
]
Thomas Graves commented on SPARK-3174:
--
Perhaps I misread it then because the proposa
[
https://issues.apache.org/jira/browse/SPARK-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161891#comment-14161891
]
Thomas Graves commented on SPARK-3797:
--
Nice write up Sandy.
Just to point out on
[
https://issues.apache.org/jira/browse/SPARK-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3627.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> spark on yarn reports success even though job fa
[
https://issues.apache.org/jira/browse/SPARK-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3837.
--
Resolution: Duplicate
duplicate of SPARK-3780
> Warn when YARN is killing containers for exceed
[
https://issues.apache.org/jira/browse/SPARK-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-3780:
-
Issue Type: Improvement (was: Bug)
> YarnAllocator should look at the container completed diagnos
[
https://issues.apache.org/jira/browse/SPARK-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3788.
--
Resolution: Fixed
Fix Version/s: 1.2.0
1.1.1
> Yarn dist cache code is
Thomas Graves created SPARK-3848:
Summary: yarn alpha doesn't build on master
Key: SPARK-3848
URL: https://issues.apache.org/jira/browse/SPARK-3848
Project: Spark
Issue Type: Bug
Co
[
https://issues.apache.org/jira/browse/SPARK-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-3848:
-
Assignee: Kousuke Saruta (was: Thomas Graves)
> yarn alpha doesn't build on master
>
[
https://issues.apache.org/jira/browse/SPARK-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3848.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> yarn alpha doesn't build on master
> ---
[
https://issues.apache.org/jira/browse/SPARK-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165124#comment-14165124
]
Thomas Graves commented on SPARK-3877:
--
this looks like a dup of SPARK-2167. Or actu
[
https://issues.apache.org/jira/browse/SPARK-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174999#comment-14174999
]
Thomas Graves commented on SPARK-3877:
--
[~vanzin] I agree. The user code should be e
[
https://issues.apache.org/jira/browse/SPARK-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3979.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> Yarn backend's default file replication should m
[
https://issues.apache.org/jira/browse/SPARK-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3900.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> ApplicationMaster's shutdown hook fails and Ille
[
https://issues.apache.org/jira/browse/SPARK-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185126#comment-14185126
]
Thomas Graves commented on SPARK-4098:
--
it was changed to deal with when yarn url sch
[
https://issues.apache.org/jira/browse/SPARK-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-4116.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> Delete the abandoned log4j-spark-container.prope
[
https://issues.apache.org/jira/browse/SPARK-4095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-4095.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> [YARN][Minor]extract val isLaunchingDriver in Cl
Thomas Graves created SPARK-4117:
Summary: Spark on Yarn handle AM being told command from RM
Key: SPARK-4117
URL: https://issues.apache.org/jira/browse/SPARK-4117
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-4098.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> use appUIAddress instead of appUIHostPort in yar
[
https://issues.apache.org/jira/browse/SPARK-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3780.
--
Resolution: Fixed
Fix Version/s: 1.2.0
> YarnAllocator should look at the container compl
[
https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194584#comment-14194584
]
Thomas Graves commented on SPARK-2938:
--
What is the status on this? I hope this is s
Thomas Graves created SPARK-8569:
Summary: Documentation for SPARK_HISTORY_OPTS unclear
Key: SPARK-8569
URL: https://issues.apache.org/jira/browse/SPARK-8569
Project: Spark
Issue Type: Bug
Thomas Graves created SPARK-8574:
Summary: org/apache/spark/unsafe doesn't honor the java
source/target versions
Key: SPARK-8574
URL: https://issues.apache.org/jira/browse/SPARK-8574
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-8574:
Assignee: Thomas Graves
> org/apache/spark/unsafe doesn't honor the java source/target vers
Thomas Graves created SPARK-8593:
Summary: History Server doesn't show complete application when one
attempt inprogress
Key: SPARK-8593
URL: https://issues.apache.org/jira/browse/SPARK-8593
Project: S
Thomas Graves created SPARK-8594:
Summary: History Server doesn't show complete application when one
attempt inprogress
Key: SPARK-8594
URL: https://issues.apache.org/jira/browse/SPARK-8594
Project: S
[
https://issues.apache.org/jira/browse/SPARK-8594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves closed SPARK-8594.
Resolution: Duplicate
accidentally filed same jira twice
> History Server doesn't show complete app
Thomas Graves created SPARK-8617:
Summary: Handle history files better
Key: SPARK-8617
URL: https://issues.apache.org/jira/browse/SPARK-8617
Project: Spark
Issue Type: Improvement
C
[
https://issues.apache.org/jira/browse/SPARK-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-8574.
--
Resolution: Fixed
Fix Version/s: 1.4.1
> org/apache/spark/unsafe doesn't honor the java s
[
https://issues.apache.org/jira/browse/SPARK-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603220#comment-14603220
]
Thomas Graves commented on SPARK-1476:
--
we have a lot of jira about the 2G limit. I'
[
https://issues.apache.org/jira/browse/SPARK-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves closed SPARK-1476.
Resolution: Duplicate
> 2GB limit in spark for blocks
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603223#comment-14603223
]
Thomas Graves commented on SPARK-1391:
--
duping this to SPARK-6235. If something is m
[
https://issues.apache.org/jira/browse/SPARK-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves closed SPARK-1391.
Resolution: Duplicate
> BlockManager cannot transfer blocks larger than 2G in size
> ---
[
https://issues.apache.org/jira/browse/SPARK-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14608280#comment-14608280
]
Thomas Graves commented on SPARK-6735:
--
Pull request was up but didn't have time to d
[
https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14608287#comment-14608287
]
Thomas Graves commented on SPARK-6951:
--
This actually happens more then just at start
[
https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993695#comment-14993695
]
Thomas Graves commented on SPARK-10911:
---
If the framework or driver is telling it t
Thomas Graves created SPARK-11555:
-
Summary: spark on yarn spark-class --num-workers allows 0 and
shouldn't
Key: SPARK-11555
URL: https://issues.apache.org/jira/browse/SPARK-11555
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993741#comment-14993741
]
Thomas Graves commented on SPARK-11555:
---
Note I think this was broken with change f
[
https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993743#comment-14993743
]
Thomas Graves commented on SPARK-10911:
---
You could say its a user problem, but its
[
https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993750#comment-14993750
]
Thomas Graves commented on SPARK-11555:
---
I should probably rephrase because after l
[
https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-11555:
--
Summary: spark on yarn spark-class --num-workers doesn't work (was: spark
on yarn spark-class
[
https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-11555:
--
Description:
Using the old spark-class and --num-workers interface, --num-workers parameter
is
[
https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993765#comment-14993765
]
Thomas Graves commented on SPARK-11555:
---
No I'm talking about --num-workers, see th
[
https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993775#comment-14993775
]
Thomas Graves commented on SPARK-11555:
---
Note that it is broken with --num-executor
[
https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-11555:
-
Assignee: Thomas Graves
> spark on yarn spark-class --num-workers doesn't work
> ---
[
https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993815#comment-14993815
]
Thomas Graves commented on SPARK-11555:
---
To fix this we can simply pass in an optio
[
https://issues.apache.org/jira/browse/SPARK-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15000426#comment-15000426
]
Thomas Graves commented on SPARK-11154:
---
It seems unnecessary to me to add new conf
[
https://issues.apache.org/jira/browse/SPARK-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15000438#comment-15000438
]
Thomas Graves commented on SPARK-11154:
---
sorry actually thinking about this more I'
601 - 700 of 1865 matches
Mail list logo