[
https://issues.apache.org/jira/browse/SPARK-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Dave updated SPARK-1986:
------------------------------
Description:
The org.apache.spark.graphx.lib.Analytics driver is currently hard to run; the
user has to figure out the correct invocation involving spark-submit. Instead,
it should be put into the examples package to enable running it using
bin/run-example.
Here is how Analytics must be invoked currently:
{code}
~/spark/bin/spark-submit --master spark://$(wget -q -O -
http://169.254.169.254/latest/meta-data/public-hostname):7077 --class
org.apache.spark.graphx.lib.Analytics
~/spark/assembly/target/scala-2.10/spark-assembly-1.1.0-SNAPSHOT-hadoop1.0.4.jar
triangles /soc-LiveJournal1.txt --numEPart=256
{code}
Any JAR can be supplied in place of the assembly jar, as long as it exists.
Here is how it will be invoked after this issue is fixed:
{code}
MASTER=spark://$(wget -q -O -
http://169.254.169.254/latest/meta-data/public-hostname):7077
~/spark/bin/run-example GraphXAnalytics triangles /soc-LiveJournal1.txt
--numEPart=256
{code}
was:
The org.apache.spark.graphx.lib.Analytics driver is currently hard to run; the
user has to figure out the correct invocation involving spark-submit. Instead,
it should be put into the examples package to enable running it using
bin/run-example.
Here is how Analytics must be invoked currently:
{code}
~/spark/bin/spark-submit --master spark://$(wget -q -O -
http://169.254.169.254/latest/meta-data/public-hostname):7077 --class
org.apache.spark.graphx.lib.Analytics
~/spark/assembly/target/scala-2.10/spark-assembly-1.1.0-SNAPSHOT-hadoop1.0.4.jar
triangles /soc-LiveJournal1.txt --numEPart=256
{code}
Any JAR can be supplied in place of the assembly jar, as long as it exists.
> lib.Analytics should be in org.apache.spark.examples
> ----------------------------------------------------
>
> Key: SPARK-1986
> URL: https://issues.apache.org/jira/browse/SPARK-1986
> Project: Spark
> Issue Type: Improvement
> Components: GraphX
> Reporter: Ankur Dave
> Assignee: Ankur Dave
>
> The org.apache.spark.graphx.lib.Analytics driver is currently hard to run;
> the user has to figure out the correct invocation involving spark-submit.
> Instead, it should be put into the examples package to enable running it
> using bin/run-example.
> Here is how Analytics must be invoked currently:
> {code}
> ~/spark/bin/spark-submit --master spark://$(wget -q -O -
> http://169.254.169.254/latest/meta-data/public-hostname):7077 --class
> org.apache.spark.graphx.lib.Analytics
> ~/spark/assembly/target/scala-2.10/spark-assembly-1.1.0-SNAPSHOT-hadoop1.0.4.jar
> triangles /soc-LiveJournal1.txt --numEPart=256
> {code}
> Any JAR can be supplied in place of the assembly jar, as long as it exists.
> Here is how it will be invoked after this issue is fixed:
> {code}
> MASTER=spark://$(wget -q -O -
> http://169.254.169.254/latest/meta-data/public-hostname):7077
> ~/spark/bin/run-example GraphXAnalytics triangles /soc-LiveJournal1.txt
> --numEPart=256
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
