Re: Apache Myriad Project Status

2018-04-17 Thread Ken Sipe
I’m not sure if that checklist is still “officially” used… but yes.The main 
criteria is following the layout of version-3.x.   Making sure to use the 
resources.json for any external links (docker or tar balls)
There is a build script:  
https://github.com/mesosphere/universe/blob/version-3.x/scripts/build.sh 
 to 
confirm some compliance.
I would focus on the readme at:  https://github.com/mesosphere/universe/ 


Ken 


> On Apr 17, 2018, at 12:46 AM, Javi Roman  wrote:
> 
> Ken,
> 
> Regarding Myriad at DC/Os are these instructions still valid?
> 
> https://bit.ly/2qElS7n
> 
> --
> Javi Roman
> 
> Twitter: @javiromanrh
> GitHub: github.com/javiroman
> Linkedin: es.linkedin.com/in/javiroman
> Big Data Blog: dataintensive.info
> 
> 
> On Mon, Apr 16, 2018 at 7:03 PM, Javi Roman  wrote:
>> On Mon, Apr 16, 2018 at 6:58 PM, Juan P  wrote:
>>> Hi, congratulations for the work and thank you very much. I think Myriad's
>>> rebound is a reality.
>>> 
>>> - In the list of articles, we could add one on the analysis of a dataset
>>> (Titanic) with Spark. Making the attempt to establish a reference
>>> architecture for analysis: SYM2 (Spark-Yarn-Myriad-Mesos)
>> 
>> Great idea, interesting acronym ;-)
>> 
>>> 
>>> - To release the version, we can generate a document with proposals. For me
>>> it would be interesting to upload the Mesos version as a first
>>> approximation. This would allow us to deploy with DCOS and the Mesos
>>> version that is installed.
>>> 
>> 
>> Totally agree, one of the first steps is test with Mesos 1.5
>> 
>>> Now I'm working on reviewing the old PRs to see what we can take advantage
>>> of, then I intend to regularize Jira's bugs and then start with the new
>>> functionality ...
>>> 
>>> 
>>> Thank you very much again
>> 
>> Many thanks for your contributions!
>> 
>>> 
>>> 
>>> On 15 April 2018 at 20:39, Javi Roman  wrote:
>>> 
 Hi Ken,
 
 Good news, slowly we will be able to evolve this interesting project. The
 integration with DC/OS is a guarantee of framework success.
 
 It would be interesting to know the requirements for getting Apache
 Myriad into the community universe.
 
 Many thanks for your help!
 --
 Javi Roman
 
 Twitter: @javiromanrh
 GitHub: github.com/javiroman
 Linkedin: es.linkedin.com/in/javiroman
 Big Data Blog: dataintensive.info
 
 
 On Sat, Apr 14, 2018 at 11:01 PM, Ken Sipe  wrote:
> Javi,
> 
> Well done and Nice work!
> 
> I am one of the original Apache committers on Myriad… however I have
 been MIA for a long time.
> 
> I am willing and interested in helping.   At this time I am not able to
 offer up a lot of time but will help where I can.
> As a part of Mesosphere,   I spent some time being the gatekeeper to the
 DC/OS universe, have written a number CLI subcommands and system
 integration tests and can help in those areas.
> 
> Additional areas I will make time for if needed/wanted:
> 1. PR reviews (and commits)
> 2. Getting into DCOS universe
> 3. Help with articles listed below (in particular 3 & 4)
> 
> Ken
> 
> 
>> On Apr 14, 2018, at 4:18 AM, Javi Roman 
 wrote:
>> 
>> Hi all!
>> 
>> This is an e-mail for tracking the state of Apache Myriad Project.
>> Many things are happening and I am happy to say the project is
>> rebooting slowly but strongly. The following is a list of achievements
>> right now:
>> 
>> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
>> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
>> right now) but this is only the beginning.
>> 3. This list is getting activity again with new active users.
>> 4. A separate document [3] for tracking up the unlocking of JIRA
>> issues and pending PRs. Special thanks to Alvaro for the initiative
>> and Juan P. for working in this necessary housekeeping.
>> 5. We have already a nice local development environment based on
>> Vagrant for Apache Mesos, and for DC/OS community platform.
>> 6. We have new activity at Apache Myriad Twitter account [4]. We are
>> trying to publish at least one post a day. We have to create Apache
>> Myriad own content for creating really interesting Twitter posts.
>> 
>> No ready yet, but planning:
>> 
>> 1. A set of articles in order to get new users. This is the planning:
>> 
>> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
>> 
>> This article explains the state of the project and sets up the targets
>> for the new releases. We need a new release (0.3.0) in order to follow
>> 

Re: Apache Myriad Project Status

2018-04-16 Thread Javi Roman
Ken,

Regarding Myriad at DC/Os are these instructions still valid?

https://bit.ly/2qElS7n

--
Javi Roman

Twitter: @javiromanrh
GitHub: github.com/javiroman
Linkedin: es.linkedin.com/in/javiroman
Big Data Blog: dataintensive.info


On Mon, Apr 16, 2018 at 7:03 PM, Javi Roman  wrote:
> On Mon, Apr 16, 2018 at 6:58 PM, Juan P  wrote:
>> Hi, congratulations for the work and thank you very much. I think Myriad's
>> rebound is a reality.
>>
>> - In the list of articles, we could add one on the analysis of a dataset
>> (Titanic) with Spark. Making the attempt to establish a reference
>> architecture for analysis: SYM2 (Spark-Yarn-Myriad-Mesos)
>
> Great idea, interesting acronym ;-)
>
>>
>> - To release the version, we can generate a document with proposals. For me
>> it would be interesting to upload the Mesos version as a first
>> approximation. This would allow us to deploy with DCOS and the Mesos
>> version that is installed.
>>
>
> Totally agree, one of the first steps is test with Mesos 1.5
>
>> Now I'm working on reviewing the old PRs to see what we can take advantage
>> of, then I intend to regularize Jira's bugs and then start with the new
>> functionality ...
>>
>>
>> Thank you very much again
>
> Many thanks for your contributions!
>
>>
>>
>> On 15 April 2018 at 20:39, Javi Roman  wrote:
>>
>>> Hi Ken,
>>>
>>> Good news, slowly we will be able to evolve this interesting project. The
>>> integration with DC/OS is a guarantee of framework success.
>>>
>>> It would be interesting to know the requirements for getting Apache
>>> Myriad into the community universe.
>>>
>>> Many thanks for your help!
>>> --
>>> Javi Roman
>>>
>>> Twitter: @javiromanrh
>>> GitHub: github.com/javiroman
>>> Linkedin: es.linkedin.com/in/javiroman
>>> Big Data Blog: dataintensive.info
>>>
>>>
>>> On Sat, Apr 14, 2018 at 11:01 PM, Ken Sipe  wrote:
>>> > Javi,
>>> >
>>> > Well done and Nice work!
>>> >
>>> > I am one of the original Apache committers on Myriad… however I have
>>> been MIA for a long time.
>>> >
>>> > I am willing and interested in helping.   At this time I am not able to
>>> offer up a lot of time but will help where I can.
>>> > As a part of Mesosphere,   I spent some time being the gatekeeper to the
>>> DC/OS universe, have written a number CLI subcommands and system
>>> integration tests and can help in those areas.
>>> >
>>> > Additional areas I will make time for if needed/wanted:
>>> > 1. PR reviews (and commits)
>>> > 2. Getting into DCOS universe
>>> > 3. Help with articles listed below (in particular 3 & 4)
>>> >
>>> > Ken
>>> >
>>> >
>>> >> On Apr 14, 2018, at 4:18 AM, Javi Roman 
>>> wrote:
>>> >>
>>> >> Hi all!
>>> >>
>>> >> This is an e-mail for tracking the state of Apache Myriad Project.
>>> >> Many things are happening and I am happy to say the project is
>>> >> rebooting slowly but strongly. The following is a list of achievements
>>> >> right now:
>>> >>
>>> >> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
>>> >> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
>>> >> right now) but this is only the beginning.
>>> >> 3. This list is getting activity again with new active users.
>>> >> 4. A separate document [3] for tracking up the unlocking of JIRA
>>> >> issues and pending PRs. Special thanks to Alvaro for the initiative
>>> >> and Juan P. for working in this necessary housekeeping.
>>> >> 5. We have already a nice local development environment based on
>>> >> Vagrant for Apache Mesos, and for DC/OS community platform.
>>> >> 6. We have new activity at Apache Myriad Twitter account [4]. We are
>>> >> trying to publish at least one post a day. We have to create Apache
>>> >> Myriad own content for creating really interesting Twitter posts.
>>> >>
>>> >> No ready yet, but planning:
>>> >>
>>> >> 1. A set of articles in order to get new users. This is the planning:
>>> >>
>>> >> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
>>> >>
>>> >> This article explains the state of the project and sets up the targets
>>> >> for the new releases. We need a new release (0.3.0) in order to follow
>>> >> the open-source motto "release early, release often".
>>> >>
>>> >> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
>>> >>
>>> >> This article is a way to get new users as easily as possible with an
>>> >> local environment ready for hacking.
>>> >>
>>> >> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
>>> >>
>>> >> This article explains a way for developing Apache Myriad using Docker
>>> >> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
>>> >> executed in production at some time will be at DC/OS.
>>> >>
>>> >> Article 4 - Apache Mesos Data Services a Different Approach
>>> >>
>>> >> This is a more advance article explaining a different way of data
>>> >> service 

Re: Apache Myriad Project Status

2018-04-16 Thread Javi Roman
On Mon, Apr 16, 2018 at 6:58 PM, Juan P  wrote:
> Hi, congratulations for the work and thank you very much. I think Myriad's
> rebound is a reality.
>
> - In the list of articles, we could add one on the analysis of a dataset
> (Titanic) with Spark. Making the attempt to establish a reference
> architecture for analysis: SYM2 (Spark-Yarn-Myriad-Mesos)

Great idea, interesting acronym ;-)

>
> - To release the version, we can generate a document with proposals. For me
> it would be interesting to upload the Mesos version as a first
> approximation. This would allow us to deploy with DCOS and the Mesos
> version that is installed.
>

Totally agree, one of the first steps is test with Mesos 1.5

> Now I'm working on reviewing the old PRs to see what we can take advantage
> of, then I intend to regularize Jira's bugs and then start with the new
> functionality ...
>
>
> Thank you very much again

Many thanks for your contributions!

>
>
> On 15 April 2018 at 20:39, Javi Roman  wrote:
>
>> Hi Ken,
>>
>> Good news, slowly we will be able to evolve this interesting project. The
>> integration with DC/OS is a guarantee of framework success.
>>
>> It would be interesting to know the requirements for getting Apache
>> Myriad into the community universe.
>>
>> Many thanks for your help!
>> --
>> Javi Roman
>>
>> Twitter: @javiromanrh
>> GitHub: github.com/javiroman
>> Linkedin: es.linkedin.com/in/javiroman
>> Big Data Blog: dataintensive.info
>>
>>
>> On Sat, Apr 14, 2018 at 11:01 PM, Ken Sipe  wrote:
>> > Javi,
>> >
>> > Well done and Nice work!
>> >
>> > I am one of the original Apache committers on Myriad… however I have
>> been MIA for a long time.
>> >
>> > I am willing and interested in helping.   At this time I am not able to
>> offer up a lot of time but will help where I can.
>> > As a part of Mesosphere,   I spent some time being the gatekeeper to the
>> DC/OS universe, have written a number CLI subcommands and system
>> integration tests and can help in those areas.
>> >
>> > Additional areas I will make time for if needed/wanted:
>> > 1. PR reviews (and commits)
>> > 2. Getting into DCOS universe
>> > 3. Help with articles listed below (in particular 3 & 4)
>> >
>> > Ken
>> >
>> >
>> >> On Apr 14, 2018, at 4:18 AM, Javi Roman 
>> wrote:
>> >>
>> >> Hi all!
>> >>
>> >> This is an e-mail for tracking the state of Apache Myriad Project.
>> >> Many things are happening and I am happy to say the project is
>> >> rebooting slowly but strongly. The following is a list of achievements
>> >> right now:
>> >>
>> >> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
>> >> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
>> >> right now) but this is only the beginning.
>> >> 3. This list is getting activity again with new active users.
>> >> 4. A separate document [3] for tracking up the unlocking of JIRA
>> >> issues and pending PRs. Special thanks to Alvaro for the initiative
>> >> and Juan P. for working in this necessary housekeeping.
>> >> 5. We have already a nice local development environment based on
>> >> Vagrant for Apache Mesos, and for DC/OS community platform.
>> >> 6. We have new activity at Apache Myriad Twitter account [4]. We are
>> >> trying to publish at least one post a day. We have to create Apache
>> >> Myriad own content for creating really interesting Twitter posts.
>> >>
>> >> No ready yet, but planning:
>> >>
>> >> 1. A set of articles in order to get new users. This is the planning:
>> >>
>> >> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
>> >>
>> >> This article explains the state of the project and sets up the targets
>> >> for the new releases. We need a new release (0.3.0) in order to follow
>> >> the open-source motto "release early, release often".
>> >>
>> >> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
>> >>
>> >> This article is a way to get new users as easily as possible with an
>> >> local environment ready for hacking.
>> >>
>> >> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
>> >>
>> >> This article explains a way for developing Apache Myriad using Docker
>> >> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
>> >> executed in production at some time will be at DC/OS.
>> >>
>> >> Article 4 - Apache Mesos Data Services a Different Approach
>> >>
>> >> This is a more advance article explaining a different way of data
>> >> service development on Apache Mesos. Probably the current approach is
>> >> to create data services (such as Kafka, Spark, Elastic ...) based on
>> >> Apache Mesos Frameworks. The focus of development is to create native
>> >> frameworks for each technology. Mesosphere does a very good work on
>> >> that direction with DC/OS SDK (dcos-commons).
>> >>
>> >> The different approach explained in this article is to shift the
>> >> development focus 

Re: Apache Myriad Project Status

2018-04-16 Thread Juan P
Hi, congratulations for the work and thank you very much. I think Myriad's
rebound is a reality.

- In the list of articles, we could add one on the analysis of a dataset
(Titanic) with Spark. Making the attempt to establish a reference
architecture for analysis: SYM2 (Spark-Yarn-Myriad-Mesos)

- To release the version, we can generate a document with proposals. For me
it would be interesting to upload the Mesos version as a first
approximation. This would allow us to deploy with DCOS and the Mesos
version that is installed.

Now I'm working on reviewing the old PRs to see what we can take advantage
of, then I intend to regularize Jira's bugs and then start with the new
functionality ...


Thank you very much again


On 15 April 2018 at 20:39, Javi Roman  wrote:

> Hi Ken,
>
> Good news, slowly we will be able to evolve this interesting project. The
> integration with DC/OS is a guarantee of framework success.
>
> It would be interesting to know the requirements for getting Apache
> Myriad into the community universe.
>
> Many thanks for your help!
> --
> Javi Roman
>
> Twitter: @javiromanrh
> GitHub: github.com/javiroman
> Linkedin: es.linkedin.com/in/javiroman
> Big Data Blog: dataintensive.info
>
>
> On Sat, Apr 14, 2018 at 11:01 PM, Ken Sipe  wrote:
> > Javi,
> >
> > Well done and Nice work!
> >
> > I am one of the original Apache committers on Myriad… however I have
> been MIA for a long time.
> >
> > I am willing and interested in helping.   At this time I am not able to
> offer up a lot of time but will help where I can.
> > As a part of Mesosphere,   I spent some time being the gatekeeper to the
> DC/OS universe, have written a number CLI subcommands and system
> integration tests and can help in those areas.
> >
> > Additional areas I will make time for if needed/wanted:
> > 1. PR reviews (and commits)
> > 2. Getting into DCOS universe
> > 3. Help with articles listed below (in particular 3 & 4)
> >
> > Ken
> >
> >
> >> On Apr 14, 2018, at 4:18 AM, Javi Roman 
> wrote:
> >>
> >> Hi all!
> >>
> >> This is an e-mail for tracking the state of Apache Myriad Project.
> >> Many things are happening and I am happy to say the project is
> >> rebooting slowly but strongly. The following is a list of achievements
> >> right now:
> >>
> >> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
> >> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
> >> right now) but this is only the beginning.
> >> 3. This list is getting activity again with new active users.
> >> 4. A separate document [3] for tracking up the unlocking of JIRA
> >> issues and pending PRs. Special thanks to Alvaro for the initiative
> >> and Juan P. for working in this necessary housekeeping.
> >> 5. We have already a nice local development environment based on
> >> Vagrant for Apache Mesos, and for DC/OS community platform.
> >> 6. We have new activity at Apache Myriad Twitter account [4]. We are
> >> trying to publish at least one post a day. We have to create Apache
> >> Myriad own content for creating really interesting Twitter posts.
> >>
> >> No ready yet, but planning:
> >>
> >> 1. A set of articles in order to get new users. This is the planning:
> >>
> >> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
> >>
> >> This article explains the state of the project and sets up the targets
> >> for the new releases. We need a new release (0.3.0) in order to follow
> >> the open-source motto "release early, release often".
> >>
> >> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
> >>
> >> This article is a way to get new users as easily as possible with an
> >> local environment ready for hacking.
> >>
> >> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
> >>
> >> This article explains a way for developing Apache Myriad using Docker
> >> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
> >> executed in production at some time will be at DC/OS.
> >>
> >> Article 4 - Apache Mesos Data Services a Different Approach
> >>
> >> This is a more advance article explaining a different way of data
> >> service development on Apache Mesos. Probably the current approach is
> >> to create data services (such as Kafka, Spark, Elastic ...) based on
> >> Apache Mesos Frameworks. The focus of development is to create native
> >> frameworks for each technology. Mesosphere does a very good work on
> >> that direction with DC/OS SDK (dcos-commons).
> >>
> >> The different approach explained in this article is to shift the
> >> development focus towards only one Apache Mesos Framework to maintains
> >> (Apache Myriad) and create applications based on YARN by means of
> >> Apache Slider (a "kind" of YARN SDK). This is really ambitious,
> >> however really interesting point of view from my perspective.
> >>
> >> 2. It's the time for planning the new release (0.3.0). We have to
> 

Re: Apache Myriad Project Status

2018-04-15 Thread Javi Roman
Hi Ken,

Good news, slowly we will be able to evolve this interesting project. The
integration with DC/OS is a guarantee of framework success.

It would be interesting to know the requirements for getting Apache
Myriad into the community universe.

Many thanks for your help!
--
Javi Roman

Twitter: @javiromanrh
GitHub: github.com/javiroman
Linkedin: es.linkedin.com/in/javiroman
Big Data Blog: dataintensive.info


On Sat, Apr 14, 2018 at 11:01 PM, Ken Sipe  wrote:
> Javi,
>
> Well done and Nice work!
>
> I am one of the original Apache committers on Myriad… however I have been MIA 
> for a long time.
>
> I am willing and interested in helping.   At this time I am not able to offer 
> up a lot of time but will help where I can.
> As a part of Mesosphere,   I spent some time being the gatekeeper to the 
> DC/OS universe, have written a number CLI subcommands and system integration 
> tests and can help in those areas.
>
> Additional areas I will make time for if needed/wanted:
> 1. PR reviews (and commits)
> 2. Getting into DCOS universe
> 3. Help with articles listed below (in particular 3 & 4)
>
> Ken
>
>
>> On Apr 14, 2018, at 4:18 AM, Javi Roman  wrote:
>>
>> Hi all!
>>
>> This is an e-mail for tracking the state of Apache Myriad Project.
>> Many things are happening and I am happy to say the project is
>> rebooting slowly but strongly. The following is a list of achievements
>> right now:
>>
>> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
>> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
>> right now) but this is only the beginning.
>> 3. This list is getting activity again with new active users.
>> 4. A separate document [3] for tracking up the unlocking of JIRA
>> issues and pending PRs. Special thanks to Alvaro for the initiative
>> and Juan P. for working in this necessary housekeeping.
>> 5. We have already a nice local development environment based on
>> Vagrant for Apache Mesos, and for DC/OS community platform.
>> 6. We have new activity at Apache Myriad Twitter account [4]. We are
>> trying to publish at least one post a day. We have to create Apache
>> Myriad own content for creating really interesting Twitter posts.
>>
>> No ready yet, but planning:
>>
>> 1. A set of articles in order to get new users. This is the planning:
>>
>> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
>>
>> This article explains the state of the project and sets up the targets
>> for the new releases. We need a new release (0.3.0) in order to follow
>> the open-source motto "release early, release often".
>>
>> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
>>
>> This article is a way to get new users as easily as possible with an
>> local environment ready for hacking.
>>
>> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
>>
>> This article explains a way for developing Apache Myriad using Docker
>> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
>> executed in production at some time will be at DC/OS.
>>
>> Article 4 - Apache Mesos Data Services a Different Approach
>>
>> This is a more advance article explaining a different way of data
>> service development on Apache Mesos. Probably the current approach is
>> to create data services (such as Kafka, Spark, Elastic ...) based on
>> Apache Mesos Frameworks. The focus of development is to create native
>> frameworks for each technology. Mesosphere does a very good work on
>> that direction with DC/OS SDK (dcos-commons).
>>
>> The different approach explained in this article is to shift the
>> development focus towards only one Apache Mesos Framework to maintains
>> (Apache Myriad) and create applications based on YARN by means of
>> Apache Slider (a "kind" of YARN SDK). This is really ambitious,
>> however really interesting point of view from my perspective.
>>
>> 2. It's the time for planning the new release (0.3.0). We have to
>> discuss the minimal features to include for a new release. This is
>> really important for the next months.
>>
>> We have a lot work to do, however I really guess the risk of retiring
>> this podling is far way right now.
>>
>> Please, feel free to comment, feedback is welcome!
>>
>> [1] https://goo.gl/xtD5oT
>> [2] https://gitter.im/apache-myriad/dev
>> [3]  https://goo.gl/u7RMFY
>> [4] https://twitter.com/apachemyriad
>> --
>> Javi Roman
>>
>> Twitter: @javiromanrh
>> GitHub: github.com/javiroman
>> Linkedin: es.linkedin.com/in/javiroman
>> Big Data Blog: dataintensive.info
>


Re: Apache Myriad Project Status

2018-04-14 Thread Ken Sipe
Javi,

Well done and Nice work!  

I am one of the original Apache committers on Myriad… however I have been MIA 
for a long time.

I am willing and interested in helping.   At this time I am not able to offer 
up a lot of time but will help where I can.
As a part of Mesosphere,   I spent some time being the gatekeeper to the DC/OS 
universe, have written a number CLI subcommands and system integration tests 
and can help in those areas.

Additional areas I will make time for if needed/wanted:
1. PR reviews (and commits)
2. Getting into DCOS universe
3. Help with articles listed below (in particular 3 & 4)

Ken 


> On Apr 14, 2018, at 4:18 AM, Javi Roman  wrote:
> 
> Hi all!
> 
> This is an e-mail for tracking the state of Apache Myriad Project.
> Many things are happening and I am happy to say the project is
> rebooting slowly but strongly. The following is a list of achievements
> right now:
> 
> 1. We have got a Project Roadmap [1] that we are accomplishing happily.
> 2. We have a chat channel at [2]. Not much activity yet (only 7 users
> right now) but this is only the beginning.
> 3. This list is getting activity again with new active users.
> 4. A separate document [3] for tracking up the unlocking of JIRA
> issues and pending PRs. Special thanks to Alvaro for the initiative
> and Juan P. for working in this necessary housekeeping.
> 5. We have already a nice local development environment based on
> Vagrant for Apache Mesos, and for DC/OS community platform.
> 6. We have new activity at Apache Myriad Twitter account [4]. We are
> trying to publish at least one post a day. We have to create Apache
> Myriad own content for creating really interesting Twitter posts.
> 
> No ready yet, but planning:
> 
> 1. A set of articles in order to get new users. This is the planning:
> 
> Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot
> 
> This article explains the state of the project and sets up the targets
> for the new releases. We need a new release (0.3.0) in order to follow
> the open-source motto "release early, release often".
> 
> Article 2 - Apache Myriad Development Environment Based on Apache Mesos
> 
> This article is a way to get new users as easily as possible with an
> local environment ready for hacking.
> 
> Article 3 - Apache Myriad Development Environment Based on Apache Mesos
> 
> This article explains a way for developing Apache Myriad using Docker
> and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
> executed in production at some time will be at DC/OS.
> 
> Article 4 - Apache Mesos Data Services a Different Approach
> 
> This is a more advance article explaining a different way of data
> service development on Apache Mesos. Probably the current approach is
> to create data services (such as Kafka, Spark, Elastic ...) based on
> Apache Mesos Frameworks. The focus of development is to create native
> frameworks for each technology. Mesosphere does a very good work on
> that direction with DC/OS SDK (dcos-commons).
> 
> The different approach explained in this article is to shift the
> development focus towards only one Apache Mesos Framework to maintains
> (Apache Myriad) and create applications based on YARN by means of
> Apache Slider (a "kind" of YARN SDK). This is really ambitious,
> however really interesting point of view from my perspective.
> 
> 2. It's the time for planning the new release (0.3.0). We have to
> discuss the minimal features to include for a new release. This is
> really important for the next months.
> 
> We have a lot work to do, however I really guess the risk of retiring
> this podling is far way right now.
> 
> Please, feel free to comment, feedback is welcome!
> 
> [1] https://goo.gl/xtD5oT
> [2] https://gitter.im/apache-myriad/dev
> [3]  https://goo.gl/u7RMFY
> [4] https://twitter.com/apachemyriad
> --
> Javi Roman
> 
> Twitter: @javiromanrh
> GitHub: github.com/javiroman
> Linkedin: es.linkedin.com/in/javiroman
> Big Data Blog: dataintensive.info



Apache Myriad Project Status

2018-04-14 Thread Javi Roman
Hi all!

This is an e-mail for tracking the state of Apache Myriad Project.
Many things are happening and I am happy to say the project is
rebooting slowly but strongly. The following is a list of achievements
right now:

1. We have got a Project Roadmap [1] that we are accomplishing happily.
2. We have a chat channel at [2]. Not much activity yet (only 7 users
right now) but this is only the beginning.
3. This list is getting activity again with new active users.
4. A separate document [3] for tracking up the unlocking of JIRA
issues and pending PRs. Special thanks to Alvaro for the initiative
and Juan P. for working in this necessary housekeeping.
5. We have already a nice local development environment based on
Vagrant for Apache Mesos, and for DC/OS community platform.
6. We have new activity at Apache Myriad Twitter account [4]. We are
trying to publish at least one post a day. We have to create Apache
Myriad own content for creating really interesting Twitter posts.

No ready yet, but planning:

1. A set of articles in order to get new users. This is the planning:

Article 1 - Apache Myriad (Hadoop YARN on Mesos) Reboot

This article explains the state of the project and sets up the targets
for the new releases. We need a new release (0.3.0) in order to follow
the open-source motto "release early, release often".

Article 2 - Apache Myriad Development Environment Based on Apache Mesos

This article is a way to get new users as easily as possible with an
local environment ready for hacking.

Article 3 - Apache Myriad Development Environment Based on Apache Mesos

This article explains a way for developing Apache Myriad using Docker
and Mesosphere Marathon on top of DC/OS. Probably if Apache Myriad is
executed in production at some time will be at DC/OS.

Article 4 - Apache Mesos Data Services a Different Approach

This is a more advance article explaining a different way of data
service development on Apache Mesos. Probably the current approach is
to create data services (such as Kafka, Spark, Elastic ...) based on
Apache Mesos Frameworks. The focus of development is to create native
frameworks for each technology. Mesosphere does a very good work on
that direction with DC/OS SDK (dcos-commons).

The different approach explained in this article is to shift the
development focus towards only one Apache Mesos Framework to maintains
(Apache Myriad) and create applications based on YARN by means of
Apache Slider (a "kind" of YARN SDK). This is really ambitious,
however really interesting point of view from my perspective.

2. It's the time for planning the new release (0.3.0). We have to
discuss the minimal features to include for a new release. This is
really important for the next months.

We have a lot work to do, however I really guess the risk of retiring
this podling is far way right now.

Please, feel free to comment, feedback is welcome!

[1] https://goo.gl/xtD5oT
[2] https://gitter.im/apache-myriad/dev
[3]  https://goo.gl/u7RMFY
[4] https://twitter.com/apachemyriad
--
Javi Roman

Twitter: @javiromanrh
GitHub: github.com/javiroman
Linkedin: es.linkedin.com/in/javiroman
Big Data Blog: dataintensive.info


Re: Myriad status?

2017-12-13 Thread Darin Johnson
Nicolas, we're currently in a bit of a lull.  I'd strongly discourage you
from using Myriad in a production environment.  More than happy to field
questions getting it up and running though.

Darin

On Mon, Dec 11, 2017 at 3:04 PM, Nicolas Tilmans 
wrote:

> Hi!
>
> We were looking at using Myriad, but were noticing that there’s been very
> little development on the GitHub page since Oct. 2016. Is this project
> still live? It certainly looks interesting!
>
> Nicolas
>
>
>
> Nicolas Tilmans
> Sr. Director Data Engineering
> ntilm...@lumiata.com 
> 240.441.3429
> www.lumiata.com 
> Confidentiality Notice | This e-mail message, including any attachments,
> is for the sole use of the intended recipient(s) and may contain
> confidential or proprietary information. Any unauthorized review, use,
> disclosure or distribution is prohibited. If you are not the intended
> recipient, immediately contact the sender by reply e-mail and destroy all
> copies of the original message.
>
>
>


Myriad status?

2017-12-11 Thread Nicolas Tilmans
Hi!

We were looking at using Myriad, but were noticing that there’s been very 
little development on the GitHub page since Oct. 2016. Is this project still 
live? It certainly looks interesting!

Nicolas



Nicolas Tilmans
Sr. Director Data Engineering
ntilm...@lumiata.com 
240.441.3429
www.lumiata.com 
Confidentiality Notice | This e-mail message, including any attachments, is for 
the sole use of the intended recipient(s) and may contain confidential or 
proprietary information. Any unauthorized review, use, disclosure or 
distribution is prohibited. If you are not the intended recipient, immediately 
contact the sender by reply e-mail and destroy all copies of the original 
message.




Re: Myriad development status

2017-11-14 Thread Adam Bordelon
Nicolas,
Myriad is still alive, but hasn't seen much activity lately.
If you don't need YARN, etc. and only need HDFS, you may want to check out
the HDFS package for DC/OS (which is built on Apache Mesos).
https://docs.mesosphere.com/service-docs/hdfs/
There's also a deprecated HDFS package for vanilla Apache Mesos:
https://github.com/mesosphere/hdfs-deprecated

On Tue, Nov 14, 2017 at 12:55 AM, nicolas dutronc <
nicolas.dutr...@soyhuce.fr> wrote:

> Good morning,
>
> I am Nicolas Dutronc and I work in a small company called SoyHuCe. We are
> currently working on setting up a Big Data architecture with Mesos and we
> want to use HDFS to store our master dataset. Myriad seems to be a good
> solution to do it. However, before getting started with Myriad, we want to
> make sure that the development is still in progress. Could you tell me if
> it is the case ?
>
> Thank you very much in advance ! :)
>
> Best regards.
>
> Nicolas Dutronc
>


Myriad development status

2017-11-14 Thread nicolas dutronc
Good morning,

I am Nicolas Dutronc and I work in a small company called SoyHuCe. We are
currently working on setting up a Big Data architecture with Mesos and we
want to use HDFS to store our master dataset. Myriad seems to be a good
solution to do it. However, before getting started with Myriad, we want to
make sure that the development is still in progress. Could you tell me if
it is the case ?

Thank you very much in advance ! :)

Best regards.

Nicolas Dutronc