[
https://issues.apache.org/jira/browse/BIGTOP-1640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301262#comment-14301262
]
YoungWoo Kim edited comment on BIGTOP-1640 at 2/2/15 1:32 PM:
--------------------------------------------------------------
First patch:
- Add bin/{run-example,spark-sql,beeline}
- Move jars into lib/ for convention
- Move examples to DOC_DIR
Running tests now:
{noformat}
# cd $SPARK_HOME
# ./bin/run-example SparkPi 10
15/02/02 17:56:42 INFO spark.SecurityManager: Changing view acls to: root,
15/02/02 17:56:42 INFO spark.SecurityManager: Changing modify acls to: root,
15/02/02 17:56:42 INFO spark.SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(root, ); users
with modify permissions: Set(root, )
15/02/02 17:56:43 INFO slf4j.Slf4jLogger: Slf4jLogger started
15/02/02 17:56:43 INFO Remoting: Starting remoting
...
Pi is roughly 3.139964
...
15/02/02 17:56:46 INFO spark.SparkContext: Successfully stopped SparkContext
# ./bin/spark-submit /usr/share/doc/spark-1.1.0/examples/src/main/python/pi.py
10
15/02/02 18:01:09 INFO spark.SecurityManager: Changing view acls to: root,
15/02/02 18:01:09 INFO spark.SecurityManager: Changing modify acls to: root,
15/02/02 18:01:09 INFO spark.SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(root, ); users
with modify permissions: Set(root, )
15/02/02 18:01:10 INFO slf4j.Slf4jLogger: Slf4jLogger started
15/02/02 18:01:10 INFO Remoting: Starting remoting
...
Pi is roughly 3.141824
...
15/02/02 18:01:15 INFO remote.RemoteActorRefProvider$RemotingTerminator:
Remoting shut down.
{noformat}
I tried to follow the structure of official Spark's binary distribution and
sync with official documentations. 'bin/run-example' should work for newbie on
Spark :-)
was (Author: warwithin):
First patch:
- Add bin/{run-example,spark-sql,beeline}
- Move jars into lib/ for convention
- Move examples to DOC_DIR
Running tests now:
{noformat}
# cd $SPARK_HOME
# ./bin/run-example SparkPi 10
15/02/02 17:56:42 INFO spark.SecurityManager: Changing view acls to: root,
15/02/02 17:56:42 INFO spark.SecurityManager: Changing modify acls to: root,
15/02/02 17:56:42 INFO spark.SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(root, ); users
with modify permissions: Set(root, )
15/02/02 17:56:43 INFO slf4j.Slf4jLogger: Slf4jLogger started
15/02/02 17:56:43 INFO Remoting: Starting remoting
...
Pi is roughly 3.139964
...
15/02/02 17:56:46 INFO spark.SparkContext: Successfully stopped SparkContext
# ./bin/spark-submit /usr/share/doc/spark-1.1.0/examples/src/main/python/pi.py
10
15/02/02 18:01:09 INFO spark.SecurityManager: Changing view acls to: root,
15/02/02 18:01:09 INFO spark.SecurityManager: Changing modify acls to: root,
15/02/02 18:01:09 INFO spark.SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(root, ); users
with modify permissions: Set(root, )
15/02/02 18:01:10 INFO slf4j.Slf4jLogger: Slf4jLogger started
15/02/02 18:01:10 INFO Remoting: Starting remoting
...
Pi is roughly 3.141824
...
15/02/02 18:01:15 INFO remote.RemoteActorRefProvider$RemotingTerminator:
Remoting shut down.
{noformat}
> Add missing files for Apache Spark
> ----------------------------------
>
> Key: BIGTOP-1640
> URL: https://issues.apache.org/jira/browse/BIGTOP-1640
> Project: Bigtop
> Issue Type: Improvement
> Components: spark
> Reporter: YoungWoo Kim
> Attachments: BIGTOP-1640.1.patch
>
>
> Apache Spark package includes shaded assembly jar but there are missing files
> for Spark's built-on modules.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
