Re: [VOTE] Move Aurora to Apache Attic

2020-02-06 Thread John Sirois
+1 On Thu, Feb 6, 2020, 3:34 PM Stephan Erb wrote: > With a heavy heart: > +1 (binding) > On Wed, 2020-02-05 at 08:15 +0900, thinker0 wrote: > > +2 > > 2020년 2월 5일 (수) 오전 2:22, Mauricio Garavaglia < > mauriciogaravag...@gmail.com>님이작성: > > > +1 > > > On Mon, Feb 3, 2020 at 8:27 PM Dave Lester

Re: Build failed in Jenkins: Aurora #1715

2017-01-17 Thread John Sirois
So, this one again: Exception applying rule InvalidSlf4jMessageFormat on file /home/jenkins/jenkins-slave/workspace/Aurora/src/main/java/org/apache/aurora/scheduler/cron/quartz/AuroraCronJob.java, continuing with next rule java.lang.NullPointerException at

Re: Jenkins build is back to normal : Aurora #1692

2016-12-07 Thread John Sirois
Green for real at commit/f5749ceb218bc6b0fd21d32462c1910a082c8199 ( https://builds.apache.org/job/Aurora/1693). Sorry for the thrash! On Dec 7, 2016 11:41 PM, "John Sirois" <john.sir...@gmail.com> wrote: > https://reviews.apache.org/r/54520/ > > On Wed, Dec 7, 201

Re: Jenkins build is back to normal : Aurora #1692

2016-12-07 Thread John Sirois
https://reviews.apache.org/r/54520/ On Wed, Dec 7, 2016 at 8:34 PM, John Sirois <john.sir...@gmail.com> wrote: > There is more going on here, RB coming shortly to address what turns out > to be not running any python tests at all. > > On Wed, Dec 7, 2016 at 8:23 PM, Apa

Re: [DRAFT][REPORT]: Apache Aurora - December 2016

2016-12-07 Thread John Sirois
LGTM On Wed, Dec 7, 2016 at 9:46 AM, Erb, Stephan wrote: > Looks good to me. Thanks! > > On 07/12/16 17:34, "Joshua Cohen" wrote: > > +1, thanks for doing this Jake! > > On Wed, Dec 7, 2016 at 9:55 AM, Jake Farrell >

Re: Jenkins build is back to normal : Aurora #1692

2016-12-07 Thread John Sirois
There is more going on here, RB coming shortly to address what turns out to be not running any python tests at all. On Wed, Dec 7, 2016 at 8:23 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See > >

Re: Build failed in Jenkins: Aurora #1691

2016-12-07 Thread John Sirois
, 2016 at 8:14 PM, John Sirois <john.sir...@gmail.com> wrote: > OK - real stuff going on here. I'm working on a fix - may be in the > Jenkins config (temporarily) since Jenkins test result collection > post-green CI is all that is failing here. > > On Wed, Dec 7, 2016 at 8:10 PM,

Re: Build failed in Jenkins: Aurora #1691

2016-12-07 Thread John Sirois
OK - real stuff going on here. I'm working on a fix - may be in the Jenkins config (temporarily) since Jenkins test result collection post-green CI is all that is failing here. On Wed, Dec 7, 2016 at 8:10 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See

Re: Build failed in Jenkins: Aurora #1689

2016-12-07 Thread John Sirois
Strange failure. I just kicked off a manual rebuild. On Dec 7, 2016 9:30 PM, "Apache Jenkins Server" wrote: > See > > Changes: > > [john.sirois] Get pants using the same thrift binary as gradle. > >

Re: [VOTE] Release Apache Aurora 0.16.0 packages

2016-10-24 Thread John Sirois
Got thrown by the 0.15 link in the original post and failed to read your follow-up. > > On Mon, Oct 24, 2016 at 2:41 PM, John Sirois <john.sir...@gmail.com> wrote: > > > +1 (binding) > > > > Tested using the 3 vagrant test setups under aurora-packaging/test. >

Re: [VOTE] Release Apache Aurora 0.16.0 packages

2016-10-24 Thread John Sirois
+1 (binding) Tested using the 3 vagrant test setups under aurora-packaging/test. There were the `libcurl4-nss-dev` missing dep issues in each of the deb vms that I worked around with `sudo apt-get -f install`, but these issues were merely test setup issues and not issues with the aurora packages

Re: Build failed in Jenkins: Aurora #1642

2016-10-10 Thread John Sirois
Got https://builds.apache.org/computer/ubuntu-eu2 again which appears to be a broken machine. I'll spin the wheel a few more times and only revert tomorrow am (Mountain time US -0600). On Mon, Oct 10, 2016 at 6:31 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See

Re: Build failed in Jenkins: Aurora #1641

2016-10-10 Thread John Sirois
I'll try 1 re-build before reverting... On Mon, Oct 10, 2016 at 6:15 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See > > Changes: > > [john.sirois] Upgrade to pants 1.2.0rc0. > > -- >

Re: A mini postmortem on snapshot failures

2016-10-05 Thread John Sirois
On Tue, Oct 4, 2016 at 11:55 AM, Joshua Cohen wrote: > Hi Zameer, > > Thanks for this writeup! > > I think one other option to consider would be using a connection for > writing the snapshots that's not bound by the pool's maximum checkout time. > I'm not sure if this is

Re: Build failed in Jenkins: aurora-packaging-nightly #440

2016-09-30 Thread John Sirois
On Thu, Sep 29, 2016 at 7:28 PM, John Sirois <jsir...@apache.org> wrote: > This is mine, I'll work up an RB to fix. > Fixed here: https://reviews.apache.org/r/52428/ > > On Sep 29, 2016 7:20 PM, "Apache Jenkins Server" < > jenk...@builds.apache.org> wrote: &

Re: Build failed in Jenkins: aurora-packaging-nightly #440

2016-09-29 Thread John Sirois
This is mine, I'll work up an RB to fix. On Sep 29, 2016 7:20 PM, "Apache Jenkins Server" wrote: See -- [...truncated 1587 lines...] 24% |###

Re: Newbie questions

2016-09-16 Thread John Sirois
Hopefully you found the contributing docs here: http://aurora.apache.org/documentation/latest/contributing/ I just reviewed them and they should do you fine, but to answer your questions: On Fri, Sep 16, 2016 at 11:09 AM, Jing Chen wrote: > Hi guys, > I am new to the

Re: [FEEDBACK] Transitioning Aurora leader election to Apache Curator (`-zk_use_curator`)

2016-08-29 Thread John Sirois
< >> stephan@blue-yonder.com> >> wrote: >> >> > The curator backend has been working well for us so far. I believe it is >> > safe to make it the default for the next release, and to drop the old >> code >> > in the release after tha

Re: Build failed in Jenkins: Aurora #1587

2016-08-29 Thread John Sirois
On Mon, Aug 29, 2016 at 11:19 AM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > > DEBUG] unregistering hello_world Just kicked off a rebuild to see if this is flakiness or real.

Re: [PROPOSAL] Move Aurora discussions to Slack?

2016-08-02 Thread John Sirois
I'm also +0. I am not a Slack fan, but that said, the barrier to entry on the face is the same if we publicize self-signup like mesos has on their community page [1]: https://mesos-slackin.herokuapp.com/ On the negative, we hurt folks like Jake who are connected to many projects via IRC and on

Re: Build failed in Jenkins: aurora-packaging-nightly #360

2016-07-11 Thread John Sirois
I submitted https://reviews.apache.org/r/49900/ to master TBR and things are green again at https://builds.apache.org/job/aurora-packaging-nightly/361 On Mon, Jul 11, 2016 at 6:37 PM, John Sirois <john.sir...@gmail.com> wrote: > The fix for this is in review @ https://reviews.apache.or

Re: Build failed in Jenkins: Aurora #1555

2016-07-08 Thread John Sirois
I'm looking into this, it "should not be possible" any longer. I've re-opened https://issues.apache.org/jira/browse/AURORA-1717 to track. On Fri, Jul 8, 2016 at 5:22 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See > >

Re: [VOTE] Release Apache Aurora 0.15.0 packages

2016-07-06 Thread John Sirois
On Jul 6, 2016 8:34 PM, "John Sirois" <john.sir...@gmail.com> wrote: > > I missed Maxim's ~same fix here: https://reviews.apache.org/r/49732/ > > Folks will need that patch to test, which is not on master, but on the 0.15.x branch of aurora-packaging. > > On

Re: [VOTE] Release Apache Aurora 0.15.0 packages

2016-07-06 Thread John Sirois
I missed Maxim's ~same fix here: https://reviews.apache.org/r/49732/ Folks will need that patch to test, which is not on master, but on the 0.15.x branch of aurora-packaging. On Wed, Jul 6, 2016 at 8:22 PM, John Sirois <john.sir...@gmail.com> wrote: > +1 ... with minor nagging res

Re: [FEEDBACK] Transitioning Aurora leader election to Apache Curator (`-zk_use_curator`)

2016-07-06 Thread John Sirois
heard no negative (or positive) feedback otherwise. [1] https://issues.apache.org/jira/browse/AURORA-1729 [2] https://reviews.apache.org/r/49578/ On Thu, Jun 16, 2016 at 1:18 PM, John Sirois <jsir...@apache.org> wrote: > > > On Thu, Jun 16, 2016 at 12:03 AM, Martin Hrabovčin &l

Re: Build failed in Jenkins: Aurora #1552

2016-07-06 Thread John Sirois
This was supposed to be fixed now: File "/home/jenkins/.cache/pants/setup/bootstrap-Linux-x86_64/1.1.0-pre6/bin/pants", line 7, in from pants.bin.pants_exe import main ImportError: No module named pants.bin.pants_exe I'm re-opening

Re: [VOTE] Release Apache Aurora 0.15.0 RC1

2016-07-01 Thread John Sirois
+1 The verify-release-candidate worked for me after: + side-stepping modern gcc thrift compile errors with clang. Issue tracked here: https://issues.apache.org/jira/browse/AURORA-1727 + entering the vagrant user's password 3x manually in the e2e test, tracked here:

Re: [VOTE] Release Apache Aurora 0.14.0 packages

2016-06-29 Thread John Sirois
+1 as verified for debian-jessie, ubuntu-trusty and centos-7 On Wed, Jun 29, 2016 at 5:11 PM, Maxim Khutornenko wrote: > +1 > > Verified for centos-7 and ubuntu-trusty. > > On Wed, Jun 29, 2016 at 2:20 PM, Erb, Stephan > wrote: > > All, > > > > I

Re: [VOTE] Release Apache Aurora 0.13.0 packages

2016-06-29 Thread John Sirois
+1 the aurora-packaging test instructions worked for me for debian-jessie, ubuntu-trusty and centos-7 On Wed, Jun 29, 2016 at 11:39 AM, Maxim Khutornenko wrote: > +1 > > Tested with pkg_root="https://dl.bintray.com/stephanerb/aurora/centos-7/; > > On Mon, Jun 20, 2016 at 3:56

Re: [FEEDBACK] Transitioning Aurora leader election to Apache Curator (`-zk_use_curator`)

2016-06-15 Thread John Sirois
; > Assuming we don't run into any roadblocks: How about changing the > > default of `-zk_use_curator` from False to True for the next release? > > Then we cane make significant progress with the deprecation while still > > giving operators the possibility to do a fall-back if necessa

Re: Subscribing to Aurora's tasks' event changes

2016-04-28 Thread John Sirois
On Thu, Apr 28, 2016 at 1:03 PM, Jeff Schroeder <jeffschroe...@computer.org> wrote: > On Monday, April 25, 2016, John Sirois <john.sir...@gmail.com> wrote: > > > On Mon, Apr 25, 2016 at 8:15 PM, John Sirois <john.sir...@gmail.com > > <javascript:;>> w

Re: [PROPOSAL] Switch aurora client from service discovery to HTTP redirects.

2016-04-19 Thread John Sirois
ring a `proxy_url` for >>> each cluster. If that's present, then the client will use it rather than >>> performing service discovery to communicate with the scheduler. >>> >>> On Mon, Apr 18, 2016 at 2:03 PM, John Sirois <jsir...@apache.org> wrote: >>>

[PROPOSAL] Switch aurora client from service discovery to HTTP redirects.

2016-04-18 Thread John Sirois
As part of work on switching the Aurora scheduler from using a copy of the Twitter zookeeper libs to the Apache Curator libs [1], I'd like to enable a Curator feature (GUID protection [2]) that will make the scheduler more robust to ZooKeeper outages but has the side-effect of breaking the

Re: [VOTE] Release Apache Aurora 0.13.0 RC0

2016-04-11 Thread John Sirois
+1 - Tested with `./build-support/release/verify-release-candidate 0.13.0-rc0`. On Mon, Apr 11, 2016 at 9:26 PM, Jake Farrell wrote: > All, > > I propose that we accept the following release candidate as the official > Apache Aurora 0.13.0 release. > > Aurora 0.13.0-rc0

Re: Build failed in Jenkins: aurora-packaging-nightly #248

2016-04-04 Thread John Sirois
On Mon, Apr 4, 2016 at 7:08 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See > > Changes: > > [john.sirois] Upgrade build tools. > This was a transient deb fetch error. Trying a rebuild to make sure

Re: Looking for feedback - Setting CommandInfo.user by default when launching tasks.

2016-03-29 Thread John Sirois
On Tue, Mar 29, 2016 at 2:31 PM, Steve Niemitz wrote: > So maybe we add it, but don't change the current default behavior? > Could we use the CommandInfo.uris [1] to solve this? IE: the scheduler would need to learn the credential file path, and with that knowledge, the

Re: Handling migrations if dbScript exists in snapshot?

2016-03-23 Thread John Sirois
On Wed, Mar 23, 2016 at 2:21 PM, Joshua Cohen wrote: > Hi Aurorans, > > As you may have seen (https://issues.apache.org/jira/browse/AURORA-1648), > we ran into an issue when upgrading a cluster that uses dbScripts in > snapshots. To restate the problem from the ticket, when

[RESULT][VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-21 Thread John Sirois
This vote has passed. Vote summary: +1 votes: 3 binding +0 votes: 0 -1 votes: 0 Artifacts are now available in the official Apache Aurora bintray repos: https://bintray.com/apache/aurora/ Thanks folks! On Mon, Mar 14, 2016 at 1:10 PM, John Sirois <jsir...@apache.org> wrote: >

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-21 Thread John Sirois
ra/browse/AURORA-1646 and https://issues.apache.org/jira/browse/AURORA-1647 to fix these. > > Packages in general are fine, so we can leave those two issues for another > day. > > From: John Sirois <jsir...@apache.org> > Sent:

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-21 Thread John Sirois
ime for folks to vote. As such, unless someone is aware of conflicting policy, I'll extend this vote until we get a binding +1 or any -1. Please test if you can find the time! [1] http://www.apache.org/foundation/voting.html On Tue, Mar 15, 2016 at 10:19 AM, John Sirois <jsir...@apache.org&

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-15 Thread John Sirois
; > Verified using instructions starting here: > https://github.com/apache/aurora-packaging/blob/master/test/rpm/centos-7/README.md#released > > and > pkg_root="https://dl.bintray.com/john-sirois/aurora/centos-7/; > > > On Mon, Mar 14, 2016 at 12:10 PM, John Sirois &

Re: [PROPOSAL] Supporting Mesos Universal Containers

2016-03-15 Thread John Sirois
On Tue, Mar 15, 2016 at 8:55 AM, Joshua Cohen wrote: > I've gone ahead and filed some tickets breaking down the work involved in > this effort. They're all contained within this epic: > https://issues.apache.org/jira/browse/AURORA-1634. > > I agree that we should assess our

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-14 Thread John Sirois
On Mon, Mar 14, 2016 at 10:09 AM, John Sirois <j...@conductant.com> wrote: > My sanity may be partially restored, although several things are wonky. > More below on my morning experiments, all after vagrant destroy for sanity > sake in the test/rpm/centos-7 dir of the aurora

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-14 Thread John Sirois
On Mon, Mar 14, 2016 at 10:09 AM, John Sirois <j...@conductant.com> wrote: > My sanity may be partially restored, although several things are wonky. > More below on my morning experiments, all after vagrant destroy for sanity > sake in the test/rpm/centos-7 dir of the aurora

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-14 Thread John Sirois
fine with the caveat s/rpm -i/yum install/. This is enough to invalidate the release though and I'll get out more fixes to the test docs. My install procedure was exactly: version=0.12.0 pkg_root="https://dl.bintray.com/john-sirois/aurora/centos-7/; for rpm in \ aurora-scheduler-${version}-1.el

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-12 Thread John Sirois
uler-startup[8500]: Failed to load native Mesos library from > /usr/lib;/usr/lib64 > I was able to fix this by removing ;/usr/lib64 from > -Djava.library.path='/usr/lib;/usr/lib64', alternatively by removing the > library.path setting and exporting LD_LIBRARY_PATH=/usr/lib. > > Happy to pi

Re: Seeking 0.13.0 release manager

2016-03-11 Thread John Sirois
On Tue, Mar 8, 2016 at 3:32 PM, John Sirois <jsir...@apache.org> wrote: > > > On Tue, Mar 8, 2016 at 11:40 AM, Jake Farrell <jfarr...@apache.org> wrote: > >> I'm happy to step in and take the rm role for .13 if no one else is >> interested >> > > Th

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-11 Thread John Sirois
Pinging this VOTE and noting that the close is Monday at 11am Mountain time. Please test! On Wed, Mar 9, 2016 at 11:03 AM, John Sirois <jsir...@apache.org> wrote: > > > On Wed, Mar 9, 2016 at 11:00 AM, John Sirois <jsir...@apache.org> wrote: > >> I propose that we

[RESULT][VOTE] Release Apache Aurora 0.12.0 debs

2016-03-10 Thread John Sirois
), the old flat namespace is replaced with one level of nesting by target platform, see: https://apache.bintray.com/aurora/ubuntu-trusty/ https://apache.bintray.com/aurora/debian-jessie/ On Mon, Mar 7, 2016 at 9:00 AM, John Sirois <jsir...@apache.org> wrote: > I propose that we accept the

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-09 Thread John Sirois
On Wed, Mar 9, 2016 at 11:00 AM, John Sirois <jsir...@apache.org> wrote: > I propose that we accept the following artifacts as the official rpm packaging > for Apache Aurora 0.12.0. > > *https://dl.bintray.com/john-sirois/aurora/centos-7/ > <https://dl.bintray.com/joh

Re: Seeking 0.13.0 release manager

2016-03-08 Thread John Sirois
it. > > -Jake > > On Tue, Mar 8, 2016 at 12:39 PM, John Sirois <jsir...@apache.org> wrote: > > > On Mon, Feb 8, 2016 at 4:02 PM, John Sirois <jsir...@apache.org> wrote: > > > > > The main 0.12.0 release has just been made and docs/distributions wil

Re: [VOTE] Release Apache Aurora 0.12.0 debs

2016-03-08 Thread John Sirois
r installing and testing in the 2 respective aurora-packaing test/deb/ environments. > > On Mon, Mar 7, 2016 at 8:00 AM, John Sirois <jsir...@apache.org> wrote: > >> I propose that we accept the following artifacts as the official deb >> packaging for >> Apache Auror

[VOTE] Release Apache Aurora 0.12.0 debs

2016-03-07 Thread John Sirois
I propose that we accept the following artifacts as the official deb packaging for Apache Aurora 0.12.0. https://dl.bintray.com/john-sirois/aurora/ubuntu-trusty/ https://dl.bintray.com/john-sirois/aurora/debian-jessie/ The Aurora deb packaging includes the following: --- The CHANGELOG

Re: [RESULT][VOTE] Release Apache Aurora 0.12.0 RC4

2016-03-03 Thread John Sirois
, "Bill Farner" <wfar...@apache.org> wrote: > > IIRC site changes aren't blocked on binaries. I believe the only link is the bintray button, which automatically tracks the latest bintray version. > > https://aurora.apache.org/downloads/ > > On Mon, Feb 29, 2016 at 8:10 A

Re: [DRAFT] [REPORT] Apache Aurora

2016-03-01 Thread John Sirois
; ## Health report: > > > > Aurora has been under active development for this period, with > strong > > > > community engagement. We have placed deliberate effort to build > > release > > > > notes as we iterate towards future releases, which has received

Re: Jenkins build is back to normal : aurora-packaging-nightly #194

2016-02-12 Thread John Sirois
ee <https://builds.apache.org/job/aurora-packaging-nightly/194/> > > -- John Sirois 303-512-3301

Re: Jenkins build is back to normal : aurora-packaging-nightly #194

2016-02-12 Thread John Sirois
aemon: lstat > > /var/lib/docker/aufs/mnt/2bf3bb359dec47586c324e03f190404b312fa6237618c36d23d935105d1b6172/dist: > no such file or directory > Yes - exactly - the aufs overlay missing is the error I see happening alot. > > > On Fri, Feb 12, 2016 at 5:56 PM, John Sirois <j

Re: [PROPOSAL] java gen: Uniform AsyncMethodCallback use in client and server

2016-02-08 Thread John Sirois
Sorry folks - wrong list! Please disregard. On Mon, Feb 8, 2016 at 12:35 PM, John Sirois <jsir...@apache.org> wrote: > I'd like to propose a breaking change in both the java generated service > code and in supporting library code. This change would change > parametrization and

[RESULT][VOTE] Release Apache Aurora 0.12.0 RC4

2016-02-08 Thread John Sirois
://dist.apache.org/repos/dist/release/aurora/0.12.0/apache-aurora-0.12.0.asc The GPG key used to sign the release are available at: https://dist.apache.org/repos/dist/release/aurora/KEYS On Fri, Feb 5, 2016 at 3:14 PM, John Sirois <jsir...@apache.org> wrote: > All, > > I propose

Seeking 0.13.0 release manager

2016-02-08 Thread John Sirois
The main 0.12.0 release has just been made and docs/distributions will soon follow. Though we've barely begun work on it, I'd like to line up a release manager for 0.13.0. I'll be happy to help with pointers and advice. I have a few document and script edits still to come to help smooth out the

Re: 0.12.0 RC status

2016-02-05 Thread John Sirois
r both seem to me to be important to provide to support this selling point. > > On Fri, Feb 5, 2016 at 8:10 AM, John Sirois <jsir...@apache.org> wrote: > >> On Wed, Feb 3, 2016 at 10:58 AM, John Sirois <jsir...@apache.org> wrote: >> >> > >> > &

[VOTE] Release Apache Aurora 0.12.0 RC3

2016-02-05 Thread John Sirois
All, I propose that we accept the following release candidate as the official Apache Aurora 0.12.0 release. Aurora 0.12.0-rc3 includes the following: --- The NEWS for the release is available at: https://git-wip-us.apache.org/repos/asf?p=aurora.git=NEWS=rel/0.12.0-rc3 The CHANGELOG for the

Re: 0.12.0 RC status

2016-02-05 Thread John Sirois
On Wed, Feb 3, 2016 at 10:58 AM, John Sirois <jsir...@apache.org> wrote: > > > On Tue, Feb 2, 2016 at 10:22 AM, Maxim Khutornenko <ma...@apache.org> > wrote: > >> +1 to having 1603 and 1601 as blockers. I am planning to work on 1603 >> today. >> &

Re: Further thoughts on config deprecations

2016-02-03 Thread John Sirois
[1] https://github.com/facebook/codemod > [2] https://github.com/facebook/jscodeshift > -- John Sirois 303-512-3301

Re: NEWS Layout

2016-02-02 Thread John Sirois
e from the 0.11 > > > Aurora blog post: > > > > > > * New/updated > > > * Deprecations and removals > > > > > > [1] https://github.com/apache/aurora/blob/master/NEWS > > > [2] https://aurora.apache.org/blog/aurora-0-11-0-released/ > > > > > > > > > Thoughts? > > > > > > -- John Sirois 303-512-3301

0.12.0 RC status

2016-02-02 Thread John Sirois
Although the last blocker raised for the 0.12.0 RC series has been resolved [1], it looks like resolution of several issues related to rolling back to 0.11.0 are required to cut the next RC: 1. "Scheduler fails to start after rollback": https://issues.apache.org/jira/browse/AURORA-1603 2. "Add a

Re: [PROPOSAL] Change java thrift code gen

2016-02-02 Thread John Sirois
. Once that is complete and released, I'll circle back and re-do an RB like 3/3 ( https://reviews.apache.org/r/42756/) that flips over the codebase to the new apache thrift gen. On Thu, Jan 28, 2016 at 10:08 AM, John Sirois <jsir...@apache.org> wrote: > > > On Thu, Jan 28, 2016 a

[RESULT] [VOTE] Release Apache Aurora 0.12.0 RC2

2016-01-29 Thread John Sirois
This vote has failed. Vote summary: +1 votes: 0 +0 votes: 0 -1 votes: 1 binding On Thu, Jan 28, 2016 at 5:01 PM, John Sirois <jsir...@apache.org> wrote: > All, > > I propose that we accept the following release candidate as the official > Apache Aurora 0.12.0 release. >

[RESULT] [VOTE] Release Apache Aurora 0.12.0 RC0

2016-01-29 Thread John Sirois
Circling back to close this vote in the - I think - appropriate way. This vote has failed. Vote summary: +1 votes: 3 binding +0 votes: 0 -1 votes: 1 binding On Thu, Jan 28, 2016 at 12:21 AM, John Sirois <jsir...@apache.org> wrote: > All, > > I propose that we accept the fo

Re: [PROPOSAL] Change java thrift code gen

2016-01-28 Thread John Sirois
On Thu, Jan 28, 2016 at 8:26 AM, John Sirois <j...@conductant.com> wrote: > On Thu, Jan 28, 2016 at 6:45 AM, Jake Farrell <jfarr...@apache.org> wrote: > > > +1 to making this apart of Thrift, i'm happy to help shepard this on the > > Thrift side and get it in as

Re: [VOTE] Release Apache Aurora 0.12.0 RC0

2016-01-28 Thread John Sirois
016 at 2:49 PM, Bill Farner <wfar...@apache.org> wrote: > > > (moved off private list) > > > > +1 (binding) > > > > Successfully verified using > > ./build-support/release/verify-release-candidate 0.12.0-rc0 > > > > On Wed, Jan 27, 2016

[VOTE] Release Apache Aurora 0.12.0 RC2

2016-01-28 Thread John Sirois
All, I propose that we accept the following release candidate as the official Apache Aurora 0.12.0 release. Aurora 0.12.0-rc2 includes the following: --- The NEWS for the release is available at: https://git-wip-us.apache.org/repos/asf?p=aurora.git=NEWS=rel/0.12.0-rc2 The CHANGELOG for the

Re: [PROPOSAL] Change java thrift code gen

2016-01-27 Thread John Sirois
-- John Sirois 303-512-3301 On Jan 27, 2016 6:08 PM, "Maxim Khutornenko" <ma...@apache.org> wrote: > > I am +1 to making immutable thrift objects solely based on perf numbers. > > My biggest concern though is maintenance of a pretty intricate codebase, > especially

[VOTE] Release Apache Aurora 0.12.0 RC0

2016-01-27 Thread John Sirois
All, I propose that we accept the following release candidate as the official Apache Aurora 0.12.0 release. Aurora 0.12.0-rc0 includes the following: --- The NEWS for the release is available at: https://git-wip-us.apache.org/repos/asf?p=aurora.git=NEWS=rel/0.12.0-rc0 The CHANGELOG for the

Re: [PROPOSAL] Change java thrift code gen

2016-01-26 Thread John Sirois
On Tue, Jan 26, 2016 at 8:47 PM, John Sirois <jsir...@apache.org> wrote: > Context: Aurora uses the official Apache Thrift compiler today plus a > home-grown python code generator [1] for immutable "entity" (I*) wrappers. > > The proposal is to switch from using the

[PROPOSAL] Change java thrift code gen

2016-01-26 Thread John Sirois
Context: Aurora uses the official Apache Thrift compiler today plus a home-grown python code generator [1] for immutable "entity" (I*) wrappers. The proposal is to switch from using the Apache Thrift code generator to a home grown generator. The proposal comes with a concrete example in the form

Re: PROPOSAL: Host and support nightly Aurora builds on Apache servers

2016-01-22 Thread John Sirois
On Fri, Jan 22, 2016 at 1:21 PM, Bill Farner <wfar...@apache.org> wrote: > Oh wow, apparently you ask me! John - would you like access? > Yes - as noted here I'd be happy to self serve: https://issues.apache.org/jira/browse/AURORA-1589 > > On Fri, Jan 22, 2016 at 12:18

Re: Non-exclusive dedicated constraint

2016-01-19 Thread John Sirois
ef8d0/src/main/java/org/apache/aurora/scheduler/configuration/ConfigurationManager.java#L272-L276 > -- John Sirois 303-512-3301

Re: Seeking 0.12.0 release manager

2016-01-15 Thread John Sirois
On Thu, Jan 14, 2016 at 8:55 PM, Bill Farner wrote: > Folks, > > As we approach completion of work for the 0.12.0 release, i would like to > identify a release manager. If nobody is able, i am happy to take this on > myself. However, i think it's a good process to share if

Re: ExecutorConfig data format

2016-01-13 Thread John Sirois
On Wed, Jan 13, 2016 at 7:09 AM, Riccardo Poggi wrote: > Hello, > > Does anybody know what the ExecutorConfig.data json, in the thrift API, is > supposed to loook like? > I'm not sure if there is an easier way to do this - I could only find `aurora` client commands that

Re: [PROPOSAL] Replace commons-args

2016-01-12 Thread John Sirois
> >> > > > >> > Please see this review for a complete example of this part of the > > change: > > >> > https://reviews.apache.org/r/41804 > > >> > > > >> > This is roughly the same amount of overhead for declaring arguments > as > > >> the > > >> > current scenario, with the addition of a very obvious mechanism for > > >> > swapping the source of parameters. This allows us to isolate the > > body of > > >> > code responsible for supplying configuration values, which we lack > > today. > > >> > > > >> > The remaining work is to bridge the gap between a command line > > argument > > >> > system and Parameter interfaces. This is relatively easy to do with > > >> > dynamic proxies. I have posted a proof of concept here: > > >> > https://reviews.apache.org/r/42042 > > >> > > > >> > Regarding (c), i have done some analysis of libraries available and > i > > >> > suggest argparse4j [3]. It has thorough documentation, no > transitive > > >> > dependencies, and is being actively developed (last release Dec > 2015). > > >> > However, i would like to emphasize that i think we should minimize > > >> coupling > > >> > to the argument parsing library so that we may switch in the future. > > >> > Argparse4j has a feature that makes the non-critical feature (d) > > >> possible. > > >> > > > >> > With that, what do you think? Are there other goals we should add? > > Does > > >> > the plan make sense? > > >> > > > >> > [1] > > >> > > > >> > > > https://github.com/apache/aurora/tree/master/commons-args/src/main/java/org/apache/aurora/common/args > > >> > [2] https://github.com/twitter/commons > > >> > [3] https://argparse4j.github.io/ > > >> > > > -- John Sirois 303-512-3301

Re: Parameterize each Job Instance.

2016-01-12 Thread John Sirois
On Mon, Jan 11, 2016 at 11:02 PM, John Sirois <john.sir...@gmail.com> wrote: > > > On Mon, Jan 11, 2016 at 11:00 PM, Bill Farner <wfar...@apache.org> wrote: > >> In the log, tasks are denormalized anyhow: >> >> https://github.com/apache/aurora/blob/master

Re: Parameterize each Job Instance.

2016-01-11 Thread John Sirois
... > > > > jobs = [ > > > > Service( > > > > name = 'logstash', > > > > ... > > > > instanceParameters = { "volume" : ["foo", "bar", "zaa"]}, > > > > instances = 3, > > > > container = Container( > > > > docker = Docker( > > > > image = 'image', > > > > parameters = params > > > > ) > > > > ) > > > > ) > > > > ] > > > > > > > > > > > > Something like that, it would create 3 instances of the tasks, each > one > > > > running in a container that uses the volumes foo, bar, and zaa. > > > > > > > > Does it make sense? I'd be glad to work on it but I want to validate > > the > > > > idea with you first and hear comments about the api/implementation. > > > > > > > > Thanks > > > > > > > > > > > > Mauricio > > > > > > > > > > -- John Sirois 303-512-3301

Re: Parameterize each Job Instance.

2016-01-11 Thread John Sirois
might be handling a structural diff of the thrift for the Tasks to keep the log dedupe optimizations in-play for the most part; ie store Task0 in-full, and Task1-N as thrift struct diffs against 0. Maybe something simpler like a binary diff would be enough too. > > On Mon, Jan 11, 2016 at

Re: Parameterize each Job Instance.

2016-01-11 Thread John Sirois
denormalization systemically in-effective. IIUC its values-equals based denorm, I'd think we'd need diffing in a cluster using, for example, ceph + docker ~exclusively. > > > > > On Mon, Jan 11, 2016 at 9:54 PM, John Sirois <j...@conductant.com> wrote: > > > On Mon

Re: Build failed in Jenkins: Aurora #1316

2016-01-08 Thread John Sirois
On Wed, Jan 6, 2016 at 12:36 PM, John Sirois <j...@conductant.com> wrote: > On Wed, Jan 6, 2016 at 12:22 PM, John Sirois <j...@conductant.com> wrote: > > > > > > > On Wed, Jan 6, 2016 at 10:59 AM, Apache Jenkins Server < > > jenk...@

Re: Build failed in Jenkins: Aurora #1316

2016-01-06 Thread John Sirois
On Wed, Jan 6, 2016 at 12:22 PM, John Sirois <j...@conductant.com> wrote: > > > On Wed, Jan 6, 2016 at 10:59 AM, Apache Jenkins Server < > jenk...@builds.apache.org> wrote: > >> See <https://builds.apache.org/job/Aurora/1316/changes> >> >> Ch

Re: Build failed in Jenkins: Aurora #1312

2016-01-04 Thread John Sirois
On Mon, Jan 4, 2016 at 10:36 PM, John Sirois <j...@conductant.com> wrote: > Looking into this ... pretty sure its the zk rev bump commit due to some > hand-wavy recollections of similar issues at Twitter in the past. > A bit of a shot in the dark that looks like the right thi

Re: [PROPOSAL] Use standard logging practices

2015-12-29 Thread John Sirois
g > > an alternative to java.util.logging, but i suggest we retain that backend > > for now (since it's what we're currently using). > > > > > -- > Text by Jeff, typos by iPhone > -- John Sirois 303-512-3301

Re: [PROPOSAL] Use standard logging practices

2015-12-29 Thread John Sirois
On Tue, Dec 29, 2015 at 5:05 PM, John Sirois <j...@conductant.com> wrote: > > > On Tue, Dec 29, 2015 at 5:02 PM, Jeff Schroeder < > jeffschroe...@computer.org> wrote: > >> Primarily it is faster, uses less memory, and annotates tracebacks with >> package ver

Re: [PROPOSAL] Use standard logging practices

2015-12-29 Thread John Sirois
: > > > > -logtostderr > > > > -alsologtostderr > > > > -vlog > > > > -vmodule > > > > -use_glog_formatter > > > > > > > > Instead of these, we can allow users to customize logging via > standard > > > > java.util.logging inputs (e.g. logging.properties). We could explore > > > using > > > > an alternative to java.util.logging, but i suggest we retain that > > backend > > > > for now (since it's what we're currently using). > > > > > > > > > > > > > -- > > > Text by Jeff, typos by iPhone > > > > > > > > -- > Text by Jeff, typos by iPhone > -- John Sirois 303-512-3301

Re: Commits without reviews

2015-12-29 Thread John Sirois
gt; commit 21c605e > > Author: Bill Farner <wfar...@apache.org> > > Date: Mon Dec 21 14:11:10 2015 -0800 > > > > Fix anchor links in installing.md. > > > > commit 9326fa6 > > Author: Bill Farner <wfar...@apache.org> > > Date: Mon Dec 21 12:21:37 2015 -0800 > > > > Link to install guide from docs/README.md > > > > commit f8e59a4 > > Author: Bill Farner <wfar...@apache.org> > > Date: Mon Dec 21 12:12:56 2015 -0800 > > > > Fix formatting issues in installing doc. > > > -- John Sirois 303-512-3301

Re: [VOTE] Release Apache Aurora 0.11.0 debs

2015-12-28 Thread John Sirois
section to include > > > installing this package or we can fix our packages to list this > > dependency. > > > I'm not sure on how packages should behave, so I am not sure on what we > > > should do here. > > > > > > Maybe we could amend the g

Re: Build failed in Jenkins: aurora-packaging-nightly #142

2015-12-28 Thread John Sirois
t; Loading [22m [9D [0KRun with > [1m> Loading [22m [9D [0K [1A [9C [1m--stacktrace [22m > [1m> Loading [22m [9D [0K [1A [21C option to get the stack trace. Run with > [1m> Loading [22m [9D [0K [1A [62C [1m--info [22m > [1m> Loading [22m [9D [0K [1A [68C or > [1m> Loading [22m [9D [0K [1A [72C [1m--debug [22m > [1m> Loading [22m [9D [0K [1A [79C option to get more log output. > [1m> Loading [22m [9D [0K > [1m> Loading [22m [9D [0K [31mBUILD FAILED [39m > [1m> Loading [22m [9D [0K [1A [12C > [1m> Loading [22m [9D [0K > [1m> Loading [22m [9D [0KTotal time: 4.179 secs > [1m> Loading [22m [9D [0K [0merror: Bad exit status from > /var/tmp/rpm-tmp.zyiWa6 (%build) > > > RPM build errors: > Macro %MESOS_VERSION has empty body > Macro %MESOS_VERSION has empty body > Bad exit status from /var/tmp/rpm-tmp.zyiWa6 (%build) > make: *** [rpm] Error 1 > Build step 'Execute shell' marked build as failure > Skipped archiving because build is not successful > -- John Sirois 303-512-3301

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
access. So fewer, more-powerful endpoints that support complex queries. > > On Mon, Nov 30, 2015 at 12:16 PM, John Sirois <john.sir...@gmail.com> > wrote: > > > I’ve experimenting on https://issues.apache.org/jira/browse/AURORA-987 > for > > the past few weeks and I

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
On Tue, Dec 1, 2015 at 11:21 AM, John Sirois <j...@conductant.com> wrote: > > > On Tue, Dec 1, 2015 at 11:17 AM, Igor Morozov <igm...@gmail.com> wrote: > >> We had very similar concerns here at Uber in regards of Thrift and >> newer REST API that is comin

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
> > > > So yeah, I feel like the API should be more generic with regards to data > > access. So fewer, more-powerful endpoints that support complex queries. > > > > On Mon, Nov 30, 2015 at 12:16 PM, John Sirois <john.sir...@gmail.com> > wrote: > > > &

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
rrently integrating aurora scheduler > > with internal deployment system so more questions are coming ;) ) > > > > Thanks for asking! > > > > -Igor > > > > On Tue, Dec 1, 2015 at 10:21 AM, John Sirois <j...@conductant.com> > wrote: > > > On Tue

[RFC] REST / thrift & AURORA-987

2015-11-30 Thread John Sirois
I’ve experimenting on https://issues.apache.org/jira/browse/AURORA-987 for the past few weeks and I’d like to ask for feedback on the direction I’d like to head. If you’re interested in the evolution of the Aurora REST api, read on. -- AURORA-987 aims to create a

Re: [VOTE] Release Apache Aurora 0.10.0-1 debs

2015-11-27 Thread John Sirois
ease these artifacts because... > > I would like to get the voting started off with my own +1 > +1 nonbinding Tested via the test/deb/ubuntu-trusty vm. -- John Sirois 303-512-3301

  1   2   >