[ 
https://issues.apache.org/jira/browse/BIGTOP-1640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301282#comment-14301282
 ] 

YoungWoo Kim commented on BIGTOP-1640:
--------------------------------------

Off topic!

Spark's packaging is strange to me. I don't know exactly but due to the YARN 
enabled assembly jar, spark-core has jars from modules built on Spark such as 
Spark SQL, MLlib, GraphX. Streaming and Bagel.

Is anyone using 'Spark External for Spark Streaming', 
https://github.com/apache/spark/tree/branch-1.1/external ?? Is it good to have 
this in Bigtop?  

> Add missing files for Apache Spark
> ----------------------------------
>
>                 Key: BIGTOP-1640
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-1640
>             Project: Bigtop
>          Issue Type: Improvement
>          Components: spark
>            Reporter: YoungWoo Kim
>         Attachments: BIGTOP-1640.1.patch
>
>
> Apache Spark package includes shaded assembly jar but there are missing files 
> for Spark's built-on modules.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to