Re: Assembly build on spark 2.0.0

[Radoslaw Gruchalski]

Ah, an uberjar. Normally one would build the uberjar with a Maven Shade plugin. 
Haven't looked into Spark code much recently, it wouldn't make much sense 
having a separate maven command to build an uberjar while building a 
distribution because, from memory, if you open the tgz file, the uberjar sits 
in the lib directory.
-- 
Best regards,
Rad

_
From: Srikanth Sampath <ssampath.apa...@gmail.com>
Sent: Saturday, August 27, 2016 5:24 am
Subject: Re: Assembly build on spark 2.0.0
To: Radoslaw Gruchalski <ra...@gruchalski.com>
Cc:  <dev@spark.apache.org>


Hi,Thanks Radek.  However mvn package does not build the uber jar.  I am 
looking for an uber jar and not a distribution.  I have seen references to the 
uber jar here What I see in the spark 2.0 codeline (assembly/pom.xml) builds a 
distribution. I

    

      bigtop-dist

      

      

        

          

            org.apache.maven.plugins

            maven-assembly-plugin

            

              

                dist

                package

                

                  single

                

                

                  

                    src/main/assembly/assembly.xml

                  

                

              

            

          

...        

      

    




In src/main/assembly/assembly.xml we see



  dist

  

    tar.gz

    dir

  

  false



.



On Sat, Aug 27, 2016 at 1:02 AM, Radoslaw Gruchalski <ra...@gruchalski.com> 
wrote:
mvn package might be the command you’re looking for.




– 
Best regards,
RadekGruchalski
ra...@gruchalski.com

 


On August 26, 2016 at 3:59:24 PM, Srikanth Sampath (ssampath.apa...@gmail.com) 
wrote: Hi,mvn assembly is creating a .tgz distribution.  How can Icreate a 
plain jar archive?  I would like to create 
aspark-assembly-.jar-Srikanth

Re: Assembly build on spark 2.0.0

[Srikanth Sampath]

Found the answer.  This is the reason
https://issues.apache.org/jira/browse/SPARK-11157

-Srikanth

On Sat, Aug 27, 2016 at 8:54 AM, Srikanth Sampath  wrote:

> Hi,
> Thanks Radek.  However mvn package does not build the uber jar.  I am
> looking for an uber jar and not a distribution.  I have seen references to
> the uber jar here
> 
>
> What I see in the spark 2.0 codeline (assembly/pom.xml) builds a
> distribution. I
>
> 
>
>   bigtop-dist
>
>   
>
>   
>
> 
>
>   
>
> org.apache.maven.plugins
>
> maven-assembly-plugin
>
> 
>
>   
>
> dist
>
> package
>
> 
>
>   single
>
> 
>
> 
>
>   
>
> src/main/assembly/assembly.xml
> 
>
>   
>
> 
>
>   
>
> 
>
>   
>
> ...
>
>   
>
> 
>
>
> In src/main/assembly/assembly.xml we see
>
> 
>
>   dist
>
>   
>
> tar.gz
>
> dir
>
>   
>
>   false
>
> .
>
>
>
> On Sat, Aug 27, 2016 at 1:02 AM, Radoslaw Gruchalski  > wrote:
>
>> mvn package might be the command you’re looking for.
>>
>> –
>> Best regards,
>> Radek Gruchalski
>> ra...@gruchalski.com
>>
>>
>> On August 26, 2016 at 3:59:24 PM, Srikanth Sampath (
>> ssampath.apa...@gmail.com) wrote:
>>
>> Hi,
>> mvn assembly is creating a .tgz distribution.  How can I create a plain
>> jar archive?  I would like to create a spark-assembly-.jar
>> -Srikanth
>>
>>
>

Re: Assembly build on spark 2.0.0

[Srikanth Sampath]

Hi,
Thanks Radek.  However mvn package does not build the uber jar.  I am
looking for an uber jar and not a distribution.  I have seen references to
the uber jar here


What I see in the spark 2.0 codeline (assembly/pom.xml) builds a
distribution. I



  bigtop-dist

  

  



  

org.apache.maven.plugins

maven-assembly-plugin



  

dist

package



  single





  

src/main/assembly/assembly.xml

  



  



  

...

  




In src/main/assembly/assembly.xml we see



  dist

  

tar.gz

dir

  

  false

.



On Sat, Aug 27, 2016 at 1:02 AM, Radoslaw Gruchalski 
wrote:

> mvn package might be the command you’re looking for.
>
> –
> Best regards,
> Radek Gruchalski
> ra...@gruchalski.com
>
>
> On August 26, 2016 at 3:59:24 PM, Srikanth Sampath (
> ssampath.apa...@gmail.com) wrote:
>
> Hi,
> mvn assembly is creating a .tgz distribution.  How can I create a plain
> jar archive?  I would like to create a spark-assembly-.jar
> -Srikanth
>
>

Re: Assembly build on spark 2.0.0

[Radoslaw Gruchalski]

mvn package might be the command you’re looking for.

–
Best regards,
Radek Gruchalski
ra...@gruchalski.com


On August 26, 2016 at 3:59:24 PM, Srikanth Sampath (
ssampath.apa...@gmail.com) wrote:

Hi,
mvn assembly is creating a .tgz distribution.  How can I create a plain jar
archive?  I would like to create a spark-assembly-.jar
-Srikanth