GitHub user nssalian opened a pull request:
https://github.com/apache/spark/pull/8385
[SPARK-9570][Docs][YARN]Consistent recommendation for submitting spark apps
to YARN, -master yarn --deploy-mode x vs -master yarn-x'
Issue link: https://issues.apache.org/jira/browse/SPARK-9570
Changes made:
1) Added the deploy-mode syntax in favor of yarn-cluster method of
submission
Requesting review.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nssalian/spark SPARK-9570
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/8385.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #8385
----
commit fa93415e860cce590c3392079e93d3ae21ffc83c
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-09T02:51:52Z
Added yarn-deploy-mode alternative
commit 437a4d451147f179617628a672eaa795b3b76ea0
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-09T02:54:04Z
Moved Master URLs closer above before the examples
commit 05fe708c24f07f9661a558dfbe51970aa940e4e5
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-10T17:14:59Z
Removed the addition section
commit 98624e89c6b303db4fc30408e14705df021ca591
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-10T17:16:14Z
Added a section for alternative submission. Distinguished from the shifting
of Master URLS
commit b8fdd5cd1b11dd7954d1f05bb71b1a2ae740d065
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-12T01:43:10Z
Added section for preferred yarn and kept the one with deploy-mode for
generic submission to help clear up confusion
commit 8c65676a6b7a692d07face111d8e998f36ca0151
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-12T01:44:36Z
Moved the Standalone examples together
commit 8a331d0444f58d3c14c1c12c4f087f1a02d5b8d1
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-12T21:19:58Z
Moved Master URLs
commit 0fed23b8dc525f62197d1cd332260a0752d7d35c
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-13T23:12:06Z
Added deploy-mode section to YARN submission
commit 670d251db01306ecc6029abaf6fc7d0e7c30dc3f
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-09T02:51:52Z
Added yarn-deploy-mode alternative
commit 40d3b80012f2db351446f8f9d6049f8a9f00bf2b
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-09T02:54:04Z
Moved Master URLs closer above before the examples
commit 89d15bf63741e3c62017586df35508a6bde821c2
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-10T17:14:59Z
Removed the addition section
commit d2c212aa6e3a4537c0a4a7ad49e83412e47e60e7
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-10T17:16:14Z
Added a section for alternative submission. Distinguished from the shifting
of Master URLS
commit 3f25500b5d39b2d6b247a8dca8147c8fd140c7c0
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-12T01:43:10Z
Added section for preferred yarn and kept the one with deploy-mode for
generic submission to help clear up confusion
commit 0766da66ccf16ab55c80614776c1f5a7a1877253
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-12T01:44:36Z
Moved the Standalone examples together
commit 46a24d55ffe99431885b57fda50938289a0ed91b
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-12T21:19:58Z
Moved Master URLs
commit 91758072dbc954e2c31609dcd2b6232a09fbfdb3
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-13T23:12:06Z
Added deploy-mode section to YARN submission
commit 3052c741f13f9c3c842ce7fa20819bf73043e326
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-23T14:32:07Z
Merge branch 'SPARK-9570' of https://github.com/nssalian/spark into
SPARK-9570
commit c91073ef5ab7fa2e5a8cada89983422960b24a1a
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-23T15:11:55Z
Modified Running on YARN doc
commit 3dc79e2d24a76abd32779d09a044240e808ed9fc
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-23T21:21:33Z
Modified submitting applications
commit 67a4255f94e828fcfffc6039ddc4872acc2d717d
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-23T21:44:26Z
Removed extra YARN section, there is already a running without --deploy
example
commit a8b67efb6a8bc28b69a87b4158156b1517e1475d
Author: Neelesh Srinivas Salian <[email protected]>
Date: 2015-08-24T00:14:45Z
Added --deploy-mode flags to the yarn submission sections
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
