Hi,
While adding dependencies, came to a situations where, spark-core-1.2.1
needs org.spark-project.protobuf
<http://mvnrepository.com/artifact/org.spark-project.protobuf/protobuf-java/2.5.0-spark>
in
runtime, and apache.mesos
<http://mvnrepository.com/artifact/org.apache.mesos/mesos/0.18.1> needs the
com.google.protobuf
<http://mvnrepository.com/artifact/com.google.protobuf/protobuf-java/2.5.0> in
runtime. i.e. following two dependencies are needed in runtime.
(AFAIK org.spark-project.protobuf is same as the com.google.protobuf, but
maintained by spark)
<dependency>
<groupId>com.google.protobuf</groupId>
<artifactId>protobuf-java</artifactId>
<version>2.5.0</version>
</dependency>
<dependency>
<groupId>org.spark-project.protobuf</groupId>
<artifactId>protobuf-java</artifactId>
<version>2.5.0-spark</version>
</dependency>
But when I bundle these in the ML feature, one of the jars get replaced by
the other.
i.e.: <bundleDef>org.spark-project.protobuf:protobuf-java</bundleDef>
<bundleDef>com.google.protobuf:protobuf-java</bundleDef>
Here, the first one get replaced by the second one.
Does this happen because of the same artifactIDs? Any possible solutions?
Thanks,
Supun
On Wed, Mar 25, 2015 at 4:43 PM, Sameera Jayasoma <[email protected]> wrote:
> We are badly in need to of a Orbit bundle catalogue :(
>
> Any bright ideas to generate one?
>
> Thanks,
> Sameera.
>
> On Tue, Mar 24, 2015 at 5:47 PM, Nirmal Fernando <[email protected]> wrote:
>
>> This is not scalable model IMO. We can't really get all necessary
>> non-OSGi bundles as separate Orbits thinking someone will use it in future.
>> I think best way would be, if someone wanted to create a new orbit bundle,
>> he needs to search existing orbits and see whether the same jar is being
>> used in another orbit bundle and fix those bundles accordingly after
>> creating the orbit.
>>
>> On Wed, Mar 11, 2015 at 2:57 PM, Supun Sethunga <[email protected]> wrote:
>>
>>> Hi Kasun,
>>>
>>> Then again the problem is, one of the three non-osgi jars: "org.scalanlp
>>> ยป breeze_2.10" has dependencies for another set of non-osgi jars, and so
>>> on. This grows in a tree manner :)
>>>
>>> Please note that the groupId should be in this format -
>>>> org.wso2.orbit.<upstream-groupId>.
>>>
>>> Noted.
>>>
>>> @Harsha : Yes, Scala-lang package is available as OSGI. But the spark
>>> ones (spark-mllib, spark-streaming) are not available as osgi bundles.
>>>
>>> Thanks,
>>> Supun.
>>>
>>> On Wed, Mar 11, 2015 at 2:48 PM, Harsha Thirimanna <[email protected]>
>>> wrote:
>>>
>>>> Yes better to have orbit bundle and did you check whether those
>>>> dependencies available as OSGi in public ? I think there should be for
>>>> scala libraries.
>>>>
>>>>
>>>> *Harsha Thirimanna*
>>>> Senior Software Engineer; WSO2, Inc.; http://wso2.com
>>>> * <http://www.apache.org/>*
>>>> *email: **[email protected]* <[email protected]>* cell: +94 71 5186770 ,
>>>> +94 *
>>>> *774617784twitter: **http://twitter.com/
>>>> <http://twitter.com/afkham_azeez>*
>>>> *harshathirimannlinked-in: **http:
>>>> <http://lk.linkedin.com/in/afkhamazeez>**//www.linkedin.com/pub/harsha-thirimanna/10/ab8/122
>>>> <http://www.linkedin.com/pub/harsha-thirimanna/10/ab8/122>*
>>>>
>>>> *Lean . Enterprise . Middleware*
>>>>
>>>>
>>>> On Wed, Mar 11, 2015 at 2:15 AM, KasunG Gajasinghe <[email protected]>
>>>> wrote:
>>>>
>>>>>
>>>>> It's better to create three separate orbit bundles for the
>>>>> dependencies. Please note that the groupId should be in this format -
>>>>> org.wso2.orbit.<upstream-groupId>.
>>>>>
>>>>> On Wed, Mar 11, 2015 at 2:31 PM, Danushka Fernando <[email protected]
>>>>> > wrote:
>>>>>
>>>>>> Refer to other osgi bundles. AFAIR what we do is add them as
>>>>>> dependencies and import the packages needed for those libraries. We are
>>>>>> not
>>>>>> recommending to use dynamic imports as well. And we export the packages
>>>>>> of
>>>>>> the libraries.
>>>>>>
>>>>>> Thanks & Regards
>>>>>> Danushka Fernando
>>>>>> Software Engineer
>>>>>> WSO2 inc. http://wso2.com/
>>>>>> Mobile : +94716332729
>>>>>>
>>>>>> On Wed, Mar 11, 2015 at 2:24 PM, Supun Sethunga <[email protected]>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Im in the process of creating an orbit bundle for Apache Spark-mllib
>>>>>>> 1.2.1.
>>>>>>> Among the dependencies of mllib, there are three jars that are *not*
>>>>>>> *osgi/orbit* bundles (Refer [1] ).
>>>>>>>
>>>>>>> Thus, whats the correct way of importing these packages to the
>>>>>>> bundle? is it:
>>>>>>> (A) Adding the three libraries as dependencies, and import them
>>>>>>> as private packages under "Private-package" in pom?
>>>>>>> (B) OR, Creating another set of orbit bundles for those three
>>>>>>> dependent non-osgi jars and import them under "Import-package" in pom?
>>>>>>>
>>>>>>> OR is there any other way? Appreciate any clarification.
>>>>>>>
>>>>>>> [1]
>>>>>>> https://docs.google.com/a/wso2.com/spreadsheets/d/1PJKTeNS1zgQ1HbAsg5FQumiaPNKPYxpn2gEVS1v2TC0/edit#gid=0
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Supun
>>>>>>>
>>>>>>> --
>>>>>>> *Supun Sethunga*
>>>>>>> Software Engineer
>>>>>>> WSO2, Inc.
>>>>>>> lean | enterprise | middleware
>>>>>>> Mobile : +94 716546324
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Dev mailing list
>>>>>>> [email protected]
>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc.
>>>>> email: kasung AT spamfree wso2.com
>>>>> linked-in: http://lk.linkedin.com/in/gajasinghe
>>>>> blog: http://kasunbg.org
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Dev mailing list
>>>>> [email protected]
>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> Dev mailing list
>>>> [email protected]
>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>
>>>>
>>>
>>>
>>> --
>>> *Supun Sethunga*
>>> Software Engineer
>>> WSO2, Inc.
>>> http://wso2.com/
>>> lean | enterprise | middleware
>>> Mobile : +94 716546324
>>>
>>> _______________________________________________
>>> Dev mailing list
>>> [email protected]
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>>
>> Thanks & regards,
>> Nirmal
>>
>> Senior Software Engineer- Platform Technologies Team, WSO2 Inc.
>> Mobile: +94715779733
>> Blog: http://nirmalfdo.blogspot.com/
>>
>>
>>
>
>
> --
> Sameera Jayasoma,
> Software Architect,
>
> WSO2, Inc. (http://wso2.com)
> email: [email protected]
> blog: http://blog.sameera.org
> twitter: https://twitter.com/sameerajayasoma
> flickr: http://www.flickr.com/photos/sameera-jayasoma/collections
> Mobile: 0094776364456
>
> Lean . Enterprise . Middleware
>
>
--
*Supun Sethunga*
Software Engineer
WSO2, Inc.
http://wso2.com/
lean | enterprise | middleware
Mobile : +94 716546324
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev
