Re: [VOTE] Release Apache Mesos 1.4.0 (rc3)

2017-08-28 Thread Benjamin Mahler
-1 due to https://issues.apache.org/jira/browse/MESOS-7921

Thanks for reporting this Yan, it unfortunately went unnoticed despite CI
failures since Aug 3rd.

On Mon, Aug 28, 2017 at 12:29 PM, Yan Xu  wrote:

> Also the libprocess refactor seems to have stability issues:
> https://issues.apache.org/jira/browse/MESOS-7921
>
> CI failures this crash caused:
> https://lists.apache.org/list.html?bui...@mesos.apache.org:l
> te=1M:process%3A%3AEventQueue%3A%3AConsumer%3A%3Aempty%28%29%20
>
> ---
> Jiang Yan Xu  | @xujyan 
>
> On Mon, Aug 28, 2017 at 12:01 PM, Michael Park  wrote:
>
> > -1
> >
> > I found MESOS-7922 ,
> > which is an issue around the communication between
> > old masters and new agents. Currently, the new agent re-registers with
> > the tasks and executors in the new format. The new master conditionally
> > upgrades the resources depending on whether the agent has the
> > RESERVATION_REFINEMENT capability, but the old master does not know
> > to this. The old master would incorrectly interpret any reserved
> resources
> > in the tasks / executors as unreserved.
> >
> > On Mon, Aug 28, 2017 at 10:32 AM Kapil Arya  wrote:
> >
> >> Hi all,
> >>
> >> Please vote on releasing the following candidate as Apache Mesos 1.4.0.
> >>
> >> 1.4.0 includes the following:
> >> 
> >> 
> >>   * Ability to recover the agent ID after a host reboot.
> >>   * File-based and image-pull secrets.
> >>   * Linux ambient and bounding capabilities support.
> >>   * Ability to efficiently measure disk usage without enforcing usage
> >> constraints.
> >>   * Hierarchical resource allocation roles. [EXPERIMENTAL]
> >>
> >> The CHANGELOG for the release is available at:
> >> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_
> >> plain;f=CHANGELOG;hb=1.4.0-rc3
> >> 
> 
> >>
> >>
> >> The candidate for Mesos 1.4.0 release is available at:
> >> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/mesos
> -1.4.0.tar.gz
> >>
> >> The tag to be voted on is 1.4.0-rc3:
> >> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=commit
> ;h=1.4.0-rc3
> >>
> >> The MD5 checksum of the tarball can be found at:
> >> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/
> >> mesos-1.4.0.tar.gz.md5
> >>
> >> The signature of the tarball can be found at:
> >> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/
> >> mesos-1.4.0.tar.gz.asc
> >>
> >> The PGP key used to sign the release is here:
> >> https://dist.apache.org/repos/dist/release/mesos/KEYS
> >>
> >> The JAR is up in Maven in a staging repository here:
> >> https://repository.apache.org/content/repositories/orgapachemesos-1212
> >>
> >> Please vote on releasing this package as Apache Mesos 1.4.0!
> >>
> >> The vote is open until Thursday, Aug 31 11:59 PM PDT 2017 and passes if
> a
> >> majority of at least 3 +1 PMC votes are cast.
> >>
> >> [ ] +1 Release this package as Apache Mesos 1.4.0
> >> [ ] -1 Do not release this package because ...
> >>
> >> Thanks,
> >> Anand and Kapil
> >>
> >
>


Re: TaskStatus.uuid for idempotent status handling

2017-08-28 Thread Benjamin Mahler
Yes, the UUID is how you would check for a duplicate due to
re-transmission. These duplicates still need to be acknowledged.

Ben

On Mon, Aug 28, 2017 at 9:59 AM, Christoph Heer 
wrote:

> Hi,
>
> as described in Mesos' documentation [1], a framework scheduler should
> handle status updates idempotent.
> Would it be sufficient to store the uuid of the status update and ignore
> retransmissions with the same uuid?
> Based on Mesos master and agent logs the uuid is stable across
> retransmissions but I couldn't found a statement which confirms my
> assumption.
>
> Thank you in advance.
>
> Best regards,
> Christoph
>
> [1] http://mesos.apache.org/documentation/latest/high-availabili
> ty-framework-guide/
>


Re: [VOTE] Release Apache Mesos 1.4.0 (rc3)

2017-08-28 Thread tommy xiao
-1

2017-08-29 3:29 GMT+08:00 Yan Xu :

> Also the libprocess refactor seems to have stability issues:
> https://issues.apache.org/jira/browse/MESOS-7921
>
> CI failures this crash caused:
> https://lists.apache.org/list.html?bui...@mesos.apache.org:
> lte=1M:process%3A%3AEventQueue%3A%3AConsumer%3A%3Aempty%28%29%20
>
> ---
> Jiang Yan Xu  | @xujyan 
>
> On Mon, Aug 28, 2017 at 12:01 PM, Michael Park  wrote:
>
> > -1
> >
> > I found MESOS-7922 ,
> > which is an issue around the communication between
> > old masters and new agents. Currently, the new agent re-registers with
> > the tasks and executors in the new format. The new master conditionally
> > upgrades the resources depending on whether the agent has the
> > RESERVATION_REFINEMENT capability, but the old master does not know
> > to this. The old master would incorrectly interpret any reserved
> resources
> > in the tasks / executors as unreserved.
> >
> > On Mon, Aug 28, 2017 at 10:32 AM Kapil Arya  wrote:
> >
> >> Hi all,
> >>
> >> Please vote on releasing the following candidate as Apache Mesos 1.4.0.
> >>
> >> 1.4.0 includes the following:
> >> 
> >> 
> >>   * Ability to recover the agent ID after a host reboot.
> >>   * File-based and image-pull secrets.
> >>   * Linux ambient and bounding capabilities support.
> >>   * Ability to efficiently measure disk usage without enforcing usage
> >> constraints.
> >>   * Hierarchical resource allocation roles. [EXPERIMENTAL]
> >>
> >> The CHANGELOG for the release is available at:
> >> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_
> >> plain;f=CHANGELOG;hb=1.4.0-rc3
> >> 
> 
> >>
> >>
> >> The candidate for Mesos 1.4.0 release is available at:
> >> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/
> mesos-1.4.0.tar.gz
> >>
> >> The tag to be voted on is 1.4.0-rc3:
> >> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=
> commit;h=1.4.0-rc3
> >>
> >> The MD5 checksum of the tarball can be found at:
> >> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/
> >> mesos-1.4.0.tar.gz.md5
> >>
> >> The signature of the tarball can be found at:
> >> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/
> >> mesos-1.4.0.tar.gz.asc
> >>
> >> The PGP key used to sign the release is here:
> >> https://dist.apache.org/repos/dist/release/mesos/KEYS
> >>
> >> The JAR is up in Maven in a staging repository here:
> >> https://repository.apache.org/content/repositories/orgapachemesos-1212
> >>
> >> Please vote on releasing this package as Apache Mesos 1.4.0!
> >>
> >> The vote is open until Thursday, Aug 31 11:59 PM PDT 2017 and passes if
> a
> >> majority of at least 3 +1 PMC votes are cast.
> >>
> >> [ ] +1 Release this package as Apache Mesos 1.4.0
> >> [ ] -1 Do not release this package because ...
> >>
> >> Thanks,
> >> Anand and Kapil
> >>
> >
>



-- 
Deshi Xiao
Twitter: xds2000
E-mail: xiaods(AT)gmail.com


Re: [VOTE] Release Apache Mesos 1.4.0 (rc3)

2017-08-28 Thread Yan Xu
Also the libprocess refactor seems to have stability issues:
https://issues.apache.org/jira/browse/MESOS-7921

CI failures this crash caused:
https://lists.apache.org/list.html?bui...@mesos.apache.org:lte=1M:process%3A%3AEventQueue%3A%3AConsumer%3A%3Aempty%28%29%20

---
Jiang Yan Xu  | @xujyan 

On Mon, Aug 28, 2017 at 12:01 PM, Michael Park  wrote:

> -1
>
> I found MESOS-7922 ,
> which is an issue around the communication between
> old masters and new agents. Currently, the new agent re-registers with
> the tasks and executors in the new format. The new master conditionally
> upgrades the resources depending on whether the agent has the
> RESERVATION_REFINEMENT capability, but the old master does not know
> to this. The old master would incorrectly interpret any reserved resources
> in the tasks / executors as unreserved.
>
> On Mon, Aug 28, 2017 at 10:32 AM Kapil Arya  wrote:
>
>> Hi all,
>>
>> Please vote on releasing the following candidate as Apache Mesos 1.4.0.
>>
>> 1.4.0 includes the following:
>> 
>> 
>>   * Ability to recover the agent ID after a host reboot.
>>   * File-based and image-pull secrets.
>>   * Linux ambient and bounding capabilities support.
>>   * Ability to efficiently measure disk usage without enforcing usage
>> constraints.
>>   * Hierarchical resource allocation roles. [EXPERIMENTAL]
>>
>> The CHANGELOG for the release is available at:
>> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_
>> plain;f=CHANGELOG;hb=1.4.0-rc3
>> 
>>
>>
>> The candidate for Mesos 1.4.0 release is available at:
>> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/mesos-1.4.0.tar.gz
>>
>> The tag to be voted on is 1.4.0-rc3:
>> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=commit;h=1.4.0-rc3
>>
>> The MD5 checksum of the tarball can be found at:
>> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/
>> mesos-1.4.0.tar.gz.md5
>>
>> The signature of the tarball can be found at:
>> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/
>> mesos-1.4.0.tar.gz.asc
>>
>> The PGP key used to sign the release is here:
>> https://dist.apache.org/repos/dist/release/mesos/KEYS
>>
>> The JAR is up in Maven in a staging repository here:
>> https://repository.apache.org/content/repositories/orgapachemesos-1212
>>
>> Please vote on releasing this package as Apache Mesos 1.4.0!
>>
>> The vote is open until Thursday, Aug 31 11:59 PM PDT 2017 and passes if a
>> majority of at least 3 +1 PMC votes are cast.
>>
>> [ ] +1 Release this package as Apache Mesos 1.4.0
>> [ ] -1 Do not release this package because ...
>>
>> Thanks,
>> Anand and Kapil
>>
>


Re: [VOTE] Release Apache Mesos 1.4.0 (rc3)

2017-08-28 Thread Michael Park
-1

I found MESOS-7922 ,
which is an issue around the communication between
old masters and new agents. Currently, the new agent re-registers with
the tasks and executors in the new format. The new master conditionally
upgrades the resources depending on whether the agent has the
RESERVATION_REFINEMENT capability, but the old master does not know
to this. The old master would incorrectly interpret any reserved resources
in the tasks / executors as unreserved.

On Mon, Aug 28, 2017 at 10:32 AM Kapil Arya  wrote:

> Hi all,
>
> Please vote on releasing the following candidate as Apache Mesos 1.4.0.
>
> 1.4.0 includes the following:
>
> 
>   * Ability to recover the agent ID after a host reboot.
>   * File-based and image-pull secrets.
>   * Linux ambient and bounding capabilities support.
>   * Ability to efficiently measure disk usage without enforcing usage
> constraints.
>   * Hierarchical resource allocation roles. [EXPERIMENTAL]
>
> The CHANGELOG for the release is available at:
>
> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_plain;f=CHANGELOG;hb=1.4.0-rc3
> 
>
>
> The candidate for Mesos 1.4.0 release is available at:
> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/mesos-1.4.0.tar.gz
>
> The tag to be voted on is 1.4.0-rc3:
> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=commit;h=1.4.0-rc3
>
> The MD5 checksum of the tarball can be found at:
>
> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/mesos-1.4.0.tar.gz.md5
>
> The signature of the tarball can be found at:
>
> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/mesos-1.4.0.tar.gz.asc
>
> The PGP key used to sign the release is here:
> https://dist.apache.org/repos/dist/release/mesos/KEYS
>
> The JAR is up in Maven in a staging repository here:
> https://repository.apache.org/content/repositories/orgapachemesos-1212
>
> Please vote on releasing this package as Apache Mesos 1.4.0!
>
> The vote is open until Thursday, Aug 31 11:59 PM PDT 2017 and passes if a
> majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Mesos 1.4.0
> [ ] -1 Do not release this package because ...
>
> Thanks,
> Anand and Kapil
>


[VOTE] Release Apache Mesos 1.4.0 (rc3)

2017-08-28 Thread Kapil Arya
Hi all,

Please vote on releasing the following candidate as Apache Mesos 1.4.0.

1.4.0 includes the following:

  * Ability to recover the agent ID after a host reboot.
  * File-based and image-pull secrets.
  * Linux ambient and bounding capabilities support.
  * Ability to efficiently measure disk usage without enforcing usage
constraints.
  * Hierarchical resource allocation roles. [EXPERIMENTAL]

The CHANGELOG for the release is available at:
https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_plain;f=CHANGELOG;hb=1.4.0-rc3



The candidate for Mesos 1.4.0 release is available at:
https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/mesos-1.4.0.tar.gz

The tag to be voted on is 1.4.0-rc3:
https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=commit;h=1.4.0-rc3

The MD5 checksum of the tarball can be found at:
https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/mesos-1.4.0.tar.gz.md5

The signature of the tarball can be found at:
https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc3/mesos-1.4.0.tar.gz.asc

The PGP key used to sign the release is here:
https://dist.apache.org/repos/dist/release/mesos/KEYS

The JAR is up in Maven in a staging repository here:
https://repository.apache.org/content/repositories/orgapachemesos-1212

Please vote on releasing this package as Apache Mesos 1.4.0!

The vote is open until Thursday, Aug 31 11:59 PM PDT 2017 and passes if a
majority of at least 3 +1 PMC votes are cast.

[ ] +1 Release this package as Apache Mesos 1.4.0
[ ] -1 Do not release this package because ...

Thanks,
Anand and Kapil


TaskStatus.uuid for idempotent status handling

2017-08-28 Thread Christoph Heer

Hi,

as described in Mesos' documentation [1], a framework scheduler should 
handle status updates idempotent.
Would it be sufficient to store the uuid of the status update and ignore 
retransmissions with the same uuid?
Based on Mesos master and agent logs the uuid is stable across 
retransmissions but I couldn't found a statement which confirms my 
assumption.


Thank you in advance.

Best regards,
Christoph

[1] 
http://mesos.apache.org/documentation/latest/high-availability-framework-guide/


Re: [VOTE] Release Apache Mesos 1.4.0 (rc2)

2017-08-28 Thread Kapil Arya
Hi All,

Due to a discrepancy in the CHANGELOG, we are retracting this release
candidate and will put out a new release candidate for voting in a little
while.

Best,
Anand and Kapil

On Mon, Aug 28, 2017 at 12:44 PM, Kapil Arya  wrote:

> Hi all,
>
> Please vote on releasing the following candidate as Apache Mesos 1.4.0.
>
>
> 1.4.0 includes the following:
> 
> 
>   * Ability to recover the agent ID after a host reboot.
>   * File-based and image-pull secrets.
>   * Linux ambient and bounding capabilities support.
>   * Ability to efficiently measure disk usage without enforcing usage
> constraints.
>   * Hierarchical resource allocation roles. [EXPERIMENTAL]
>
> The CHANGELOG for the release is available at:
> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_
> plain;f=CHANGELOG;hb=1.4.0-rc2
> 
>
>
> The candidate for Mesos 1.4.0 release is available at:
> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc2/mesos-1.4.0.tar.gz
>
> The tag to be voted on is 1.4.0-rc2:
> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=commit;h=1.4.0-rc2
>
> The MD5 checksum of the tarball can be found at:
> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc2/
> mesos-1.4.0.tar.gz.md5
>
> The signature of the tarball can be found at:
> https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc2/
> mesos-1.4.0.tar.gz.asc
>
> The PGP key used to sign the release is here:
> https://dist.apache.org/repos/dist/release/mesos/KEYS
>
> The JAR is up in Maven in a staging repository here:
> https://repository.apache.org/content/repositories/orgapachemesos-1210
>
> Please vote on releasing this package as Apache Mesos 1.4.0!
>
> The vote is open until Thursday, Aug 31 11:59 AM PDT 2017 and passes if a
> majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Mesos 1.4.0
> [ ] -1 Do not release this package because ...
>
> Thanks,
> Anand and Kapil
>


[VOTE] Release Apache Mesos 1.4.0 (rc2)

2017-08-28 Thread Kapil Arya
Hi all,

Please vote on releasing the following candidate as Apache Mesos 1.4.0.


1.4.0 includes the following:


  * Ability to recover the agent ID after a host reboot.
  * File-based and image-pull secrets.
  * Linux ambient and bounding capabilities support.
  * Ability to efficiently measure disk usage without enforcing usage
constraints.
  * Hierarchical resource allocation roles. [EXPERIMENTAL]

The CHANGELOG for the release is available at:
https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_plain;f=CHANGELOG;hb=1.4.0-rc2



The candidate for Mesos 1.4.0 release is available at:
https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc2/mesos-1.4.0.tar.gz

The tag to be voted on is 1.4.0-rc2:
https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=commit;h=1.4.0-rc2

The MD5 checksum of the tarball can be found at:
https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc2/mesos-1.4.0.tar.gz.md5

The signature of the tarball can be found at:
https://dist.apache.org/repos/dist/dev/mesos/1.4.0-rc2/mesos-1.4.0.tar.gz.asc

The PGP key used to sign the release is here:
https://dist.apache.org/repos/dist/release/mesos/KEYS

The JAR is up in Maven in a staging repository here:
https://repository.apache.org/content/repositories/orgapachemesos-1210

Please vote on releasing this package as Apache Mesos 1.4.0!

The vote is open until Thursday, Aug 31 11:59 AM PDT 2017 and passes if a
majority of at least 3 +1 PMC votes are cast.

[ ] +1 Release this package as Apache Mesos 1.4.0
[ ] -1 Do not release this package because ...

Thanks,
Anand and Kapil