Merge pull request #345 from colorant/yarn
support distributing extra files to worker for yarn client mode
So that user doesn't need to package all dependency into one assemble jar as
spark app jar
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit:
Export --file for YarnClient mode to support sending extra files to worker on
yarn cluster
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/67af8031
Tree:
Updated Branches:
refs/heads/master bb6a39a68 - 6eef78d76
Minor typo fix for yarn client
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/da4694a0
Tree:
Updated Branches:
refs/heads/master 6eef78d76 - 5cae05f59
Remove calls to deprecated mapred's OutputCommitter.cleanupJob because since
Hadoop 1.0.4
the mapred OutputCommitter.commitJob should do cleanup job.
In fact the implementation of mapred OutputCommitter.commitJob looks like this:
Updated Branches:
refs/heads/master 5cae05f59 - bdeaeafbd
Add CDH Repository to Maven Build
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/3209a86f
Tree:
Merge pull request #357 from hsaputra/set_boolean_paramname
Set boolean param name for call to SparkHadoopMapReduceUtil.newTaskAttemptID
Set boolean param name for call to SparkHadoopMapReduceUtil.newTaskAttemptID to
make it clear which param being set.
Project:
Resolve PR review over 100 chars
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/aa56585d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/aa56585d
Diff:
Updated Branches:
refs/heads/master bdeaeafbd - 56ebfeaa5
Set boolean param name for two files call to
SparkHadoopMapReduceUtil.newTaskAttemptID to make
it clear which param being set.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit:
Merge pull request #360 from witgo/master
fix make-distribution.sh show version: command not found
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/04d83fc3
Tree:
Updated Branches:
refs/heads/master 56ebfeaa5 - 04d83fc37
fix make-distribution.sh show version: command not found
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/cf4aaf92
Tree:
Updated Branches:
refs/heads/master 04d83fc37 - dceedb466
Fixing config option retained_stages = retainedStages.
This is a very esoteric option and it's out of sync with the style we use.
So it seems fitting to fix it for 0.9.0.
Project:
11 matches
Mail list logo