Re: [VOTE] Move Aurora to Apache Attic

2020-02-06 Thread John Sirois
+1 On Thu, Feb 6, 2020, 3:34 PM Stephan Erb wrote: > With a heavy heart: > +1 (binding) > On Wed, 2020-02-05 at 08:15 +0900, thinker0 wrote: > > +2 > > 2020년 2월 5일 (수) 오전 2:22, Mauricio Garavaglia < > mauriciogaravag...@gmail.com>님이작성: > > > +1 > > > On Mon, Feb 3, 2020 at 8:27 PM Dave Lester w

Re: [VOTE] Release Apache Aurora 0.10.0 RC0

2015-11-10 Thread John Sirois
0.0-rc0.tar.gz.md5 > > > > > > > > The signature of the release candidate can be found at: > > > > > > > > > > > > > > https://dist.apache.org/repos/dist/dev/aurora/0.10.0-rc0/apache-aurora-0.10.0-rc0.tar.gz.asc > > > > > > > > The GPG key used to sign the release are available at: > > > > https://dist.apache.org/repos/dist/dev/aurora/KEYS > > > > > > > > Please download, verify, and test. > > > > > > > > The vote will close on Fri Nov 13 12:30:00 PST 2015 > > > > > > > > [ ] +1 Release this as Apache Aurora 0.10.0 > > > > [ ] +0 > > > > [ ] -1 Do not release this as Apache Aurora 0.10.0 because... > > > > > > > > -- > > > > Zameer Manji > > > > > > > > > > -- > > > Zameer Manji > > > > > > > > > -- John Sirois 303-512-3301

Re: [VOTE] Release Apache Aurora 0.10.0 RC0

2015-11-10 Thread John Sirois
On Tue, Nov 10, 2015 at 2:38 PM, John Sirois wrote: > > > On Tue, Nov 10, 2015 at 2:37 PM, Bill Farner wrote: > >> -1 >> >> Build fails on OS X 10.11 (which is also true of master). It's not >> critical that we build on OS X, but it will be great to f

Re: [VOTE] Release Apache Aurora 0.10.0 debs

2015-11-26 Thread John Sirois
Thu Dec 3 8:00:00 PT 2015 > > > > [ ] +1 Release these as the deb packages for Apache Aurora 0.10.0 > > [ ] +0 > > [ ] -1 Do not release these artifacts because... > > > > I would like to get the voting started off with my own +1 > > > -- John Sirois 303-512-3301

Re: [VOTE] Release Apache Aurora 0.10.0 debs

2015-11-26 Thread John Sirois
On Thu, Nov 26, 2015 at 11:01 AM, John Sirois wrote: > -1 nonbinding > Fix proposal here: https://reviews.apache.org/r/40757/ > Although I can successfully run via the test Vagrant environment, creating > the www-data/prod/hello job, I find: > > vagrant@vagrant-ubuntu-trusty-

Re: [VOTE] Release Apache Aurora 0.10.0-1 debs

2015-11-27 Thread John Sirois
gt; > I would like to get the voting started off with my own +1 > +1 nonbinding Tested via the test/deb/ubuntu-trusty vm. -- John Sirois 303-512-3301

Re: [VOTE] Release Apache Aurora 0.10.0-1 debs

2015-11-30 Thread John Sirois
...' than changing this text for every package release. > On Fri, Nov 27, 2015 at 12:54 PM, John Sirois wrote: > > > On Fri, Nov 27, 2015 at 11:34 AM, Bill Farner > wrote: > > > > > I propose that we accept the following artifacts as the official deb > >

[RFC] REST / thrift & AURORA-987

2015-11-30 Thread John Sirois
I’ve experimenting on https://issues.apache.org/jira/browse/AURORA-987 for the past few weeks and I’d like to ask for feedback on the direction I’d like to head. If you’re interested in the evolution of the Aurora REST api, read on. -- AURORA-987 aims to create a first-

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
data > access. So fewer, more-powerful endpoints that support complex queries. > > On Mon, Nov 30, 2015 at 12:16 PM, John Sirois > wrote: > > > I’ve experimenting on https://issues.apache.org/jira/browse/AURORA-987 > for > > the past few weeks and I’d like to ask for

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
t; So yeah, I feel like the API should be more generic with regards to data > > access. So fewer, more-powerful endpoints that support complex queries. > > > > On Mon, Nov 30, 2015 at 12:16 PM, John Sirois > wrote: > > > >> I’ve experimenting on https://issu

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
On Tue, Dec 1, 2015 at 11:21 AM, John Sirois wrote: > > > On Tue, Dec 1, 2015 at 11:17 AM, Igor Morozov wrote: > >> We had very similar concerns here at Uber in regards of Thrift and >> newer REST API that is coming to Aurora scheduler. It feels like >> having a ge

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
grating aurora scheduler > > with internal deployment system so more questions are coming ;) ) > > > > Thanks for asking! > > > > -Igor > > > > On Tue, Dec 1, 2015 at 10:21 AM, John Sirois > wrote: > > > On Tue, Dec 1, 2015 at 11:17 AM, Igor Morozov

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
as attacking the problem based on my current strengths, which favored fixing the glue and worrying about the shape as a detail after. The big assumption being the core entities were in fact modeled well and ~correctly by the existing thrift enums, structs and unions. > On Tue, Dec 1, 2015 at

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
ponse getJobs(1: string ownerRole) (method="GET", returns="GetJobsResult") swagger schema aid: https://github.com/swagger-api/swagger-core/blob/master/modules/swagger-annotations/src/main/java/io/swagger/annotations/ApiResponses.java > > On Tue, Dec 1, 2015 at 11:0

Re: [RFC] REST / thrift & AURORA-987

2015-12-01 Thread John Sirois
On Tue, Dec 1, 2015 at 1:37 PM, John Sirois wrote: > > > On Tue, Dec 1, 2015 at 1:24 PM, Bill Farner wrote: > >> > >> > Well, just to give additional context to that ticket. The ticket >> mentions >> > /apibeta which was literally just a HTTP + TSim

Re: [VOTE] Release Apache Aurora 0.11.0 RC1

2015-12-17 Thread John Sirois
gt; The GPG key used to sign the release are available at: > > https://dist.apache.org/repos/dist/dev/aurora/KEYS > > > > Please download, verify, and test. > > > > The vote will close on Tue Dec 22 15:18:55 PST 2015 > > > > [ ] +1 Release this as Apache Aurora 0.11.0 > > [ ] +0 > > [ ] -1 Do not release this as Apache Aurora 0.11.0 because... > > > -- John Sirois 303-512-3301

Re: [VOTE] Release Apache Aurora 0.11.0 debs

2015-12-23 Thread John Sirois
close on Wed Jan 6 20:00:00 PT 2015 > > > > [ ] +1 Release these as the deb packages for Apache Aurora 0.11.0 > > [ ] +0 > > [ ] -1 Do not release these artifacts because... > > > > I would like to get the voting started off with my own +1 > > > -- John Sirois 303-512-3301

Re: [VOTE] Release Apache Aurora 0.11.0 debs

2015-12-23 Thread John Sirois
On Wed, Dec 23, 2015 at 2:14 PM, John Sirois wrote: > -1 non-binding > > Tested using new installing guide in Vagrant image using 'ubuntu/trusty64' > against mesos 0.24.1. > Everything worked after 2 tweaks: > 1. sudo apt-get install libcurl4-nss-dev > 2. $ diff /

Re: [VOTE] Release Apache Aurora 0.11.0 debs

2015-12-28 Thread John Sirois
ackage or we can fix our packages to list this > > dependency. > > > I'm not sure on how packages should behave, so I am not sure on what we > > > should do here. > > > > > > Maybe we could amend the guide for now, release these debs and figure > out &

Re: Build failed in Jenkins: aurora-packaging-nightly #142

2015-12-28 Thread John Sirois
; Loading [22m [9D [0K* Try: > [1m> Loading [22m [9D [0KRun with > [1m> Loading [22m [9D [0K [1A [9C [1m--stacktrace [22m > [1m> Loading [22m [9D [0K [1A [21C option to get the stack trace. Run with > [1m> Loading [22m [9D [0K [1A [62C [1m--info [22m > [1m> Loading [22m [9D [0K [1A [68C or > [1m> Loading [22m [9D [0K [1A [72C [1m--debug [22m > [1m> Loading [22m [9D [0K [1A [79C option to get more log output. > [1m> Loading [22m [9D [0K > [1m> Loading [22m [9D [0K [31mBUILD FAILED [39m > [1m> Loading [22m [9D [0K [1A [12C > [1m> Loading [22m [9D [0K > [1m> Loading [22m [9D [0KTotal time: 4.179 secs > [1m> Loading [22m [9D [0K [0merror: Bad exit status from > /var/tmp/rpm-tmp.zyiWa6 (%build) > > > RPM build errors: > Macro %MESOS_VERSION has empty body > Macro %MESOS_VERSION has empty body > Bad exit status from /var/tmp/rpm-tmp.zyiWa6 (%build) > make: *** [rpm] Error 1 > Build step 'Execute shell' marked build as failure > Skipped archiving because build is not successful > -- John Sirois 303-512-3301

Re: [PROPOSAL] Use standard logging practices

2015-12-29 Thread John Sirois
> > -vmodule > > > > -use_glog_formatter > > > > > > > > Instead of these, we can allow users to customize logging via > standard > > > > java.util.logging inputs (e.g. logging.properties). We could explore > > > using > > > > an alternative to java.util.logging, but i suggest we retain that > > backend > > > > for now (since it's what we're currently using). > > > > > > > > > > > > > -- > > > Text by Jeff, typos by iPhone > > > > > > > > -- > Text by Jeff, typos by iPhone > -- John Sirois 303-512-3301

Re: [PROPOSAL] Use standard logging practices

2015-12-29 Thread John Sirois
On Tue, Dec 29, 2015 at 5:05 PM, John Sirois wrote: > > > On Tue, Dec 29, 2015 at 5:02 PM, Jeff Schroeder < > jeffschroe...@computer.org> wrote: > >> Primarily it is faster, uses less memory, and annotates tracebacks with >> package versions. The last one seems

Re: [PROPOSAL] Use standard logging practices

2015-12-29 Thread John Sirois
On Tue, Dec 29, 2015 at 5:18 PM, John Sirois wrote: > > > On Tue, Dec 29, 2015 at 5:05 PM, John Sirois wrote: > >> >> >> On Tue, Dec 29, 2015 at 5:02 PM, Jeff Schroeder < >> jeffschroe...@computer.org> wrote: >> >>> Primarily it i

Re: [PROPOSAL] Use standard logging practices

2015-12-29 Thread John Sirois
.util.logging, but i suggest we retain that backend > > for now (since it's what we're currently using). > > > > > -- > Text by Jeff, typos by iPhone > -- John Sirois 303-512-3301

Re: Commits without reviews

2015-12-29 Thread John Sirois
800 > > > > Fix anchor links in installing.md. > > > > commit 9326fa6 > > Author: Bill Farner > > Date: Mon Dec 21 12:21:37 2015 -0800 > > > > Link to install guide from docs/README.md > > > > commit f8e59a4 > > Author: Bill Farner > > Date: Mon Dec 21 12:12:56 2015 -0800 > > > > Fix formatting issues in installing doc. > > > -- John Sirois 303-512-3301

Re: Build failed in Jenkins: Aurora #1312

2016-01-04 Thread John Sirois
mh > :pmdMain > :pmdTest > :test > :jacocoTestReport > Coverage report generated: file://< > https://builds.apache.org/job/Aurora/ws/dist/reports/jacoco/test/html/index.html > > > :analyzeReport > Instruction coverage is 0.8883578431372549, but must be greater than 0.89 > Branch coverage is 0.8169089929994615, but must be greater than 0.835 > :check > :build > :api:assemble > :api:compileTestJava UP-TO-DATE > :api:processTestResources UP-TO-DATE > :api:testClasses UP-TO-DATE > :api:test UP-TO-DATE > :api:check UP-TO-DATE > :api:build > :buildSrc:compileJava UP-TO-DATE > :buildSrc:processResources UP-TO-DATE > :buildSrc:classes UP-TO-DATE > :buildSrc:jar > :buildSrc:assemble > :buildSrc:compileTestJava UP-TO-DATE > :buildSrc:processTestResources UP-TO-DATE > :buildSrc:testClasses UP-TO-DATE > :buildSrc:test UP-TO-DATE > :buildSrc:check UP-TO-DATE > :buildSrc:build > :commons:assemble > :commons:licenseMain > Unknown file extension: > commons/src/main/resources/org/apache/aurora/common/net/http/handlers/ > thrift.st > Unknown file extension: > commons/src/main/resources/org/apache/aurora/common/net/http/handlers/ > logconfig.st > :commons:licenseMain UP-TO-DATE > :commons:licenseTest > Unknown file extension: > commons/src/test/resources/org/apache/aurora/common/util/templating/ > template.st > :commons:licenseTest UP-TO-DATE > :commons:license UP-TO-DATE > :commons:compileTestJavaNote: Writing < > https://builds.apache.org/job/Aurora/ws/commons/dist/classes/test/org/apache/aurora/common/args/apt/cmdline.arg.info.txt.2 > > > Note: Writing < > https://builds.apache.org/job/Aurora/ws/commons/dist/classes/test/META-INF/compiler/resource-mappings/org.apache.aurora.common.args.apt.CmdLineProcessor > > > Note: Some input files use or override a deprecated API. > Note: Recompile with -Xlint:deprecation for details. > Note: < > https://builds.apache.org/job/Aurora/ws/commons/src/test/java/org/apache/aurora/common/collections/Iterables2Test.java> > uses unchecked or unsafe operations. > Note: Recompile with -Xlint:unchecked for details. > > :commons:processTestResources > :commons:testClasses > :commons:testBuild timed out (after 120 minutes). Marking the build as > failed. > Build was aborted > Recording test results > -- John Sirois 303-512-3301

Re: Build failed in Jenkins: Aurora #1312

2016-01-04 Thread John Sirois
On Mon, Jan 4, 2016 at 10:36 PM, John Sirois wrote: > Looking into this ... pretty sure its the zk rev bump commit due to some > hand-wavy recollections of similar issues at Twitter in the past. > A bit of a shot in the dark that looks like the right thing to do anyw

Re: Build failed in Jenkins: Aurora #1316

2016-01-06 Thread John Sirois
y: org.apache.aurora.common.zookeeper.Group$JoinException: Interrupted trying to ensure group at path: /twitter/services/puffin_hosebird at org.apache.aurora.common.zookeeper.Group.lambda$ensurePersistentGroupPath$31(Group.java:288) at org.apache.aurora.common.zookeeper.Group$$Lambda$97/1807633296.get(Unknown Source) at org.apache.aurora.common.util.BackoffHelper.lambda$doUntilSuccess$2(BackoffHelper.java:87) at org.apache.aurora.common.util.BackoffHelper$$Lambda$4/1776514610.get(Unknown Source) at org.apache.aurora.common.util.BackoffHelper.doUntilResult(BackoffHelper.java:104) at org.apache.aurora.common.util.BackoffHelper.doUntilSuccess(BackoffHelper.java:86) at org.apache.aurora.common.zookeeper.Group.ensurePersistentGroupPath(Group.java:282) at org.apache.aurora.common.zookeeper.Group.watch(Group.java:519) ... 48 more Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1302) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231) at org.apache.aurora.common.zookeeper.ZooKeeperClient.get(ZooKeeperClient.java:391) at org.apache.aurora.common.zookeeper.ZooKeeperClient.get(ZooKeeperClient.java:327) at org.apache.aurora.common.zookeeper.ZooKeeperUtils.ensurePathInternal(ZooKeeperUtils.java:132) at org.apache.aurora.common.zookeeper.ZooKeeperUtils.ensurePath(ZooKeeperUtils.java:127) at org.apache.aurora.common.zookeeper.Group.lambda$ensurePersistentGroupPath$31(Group.java:284) ... 55 more > > 197 tests completed, 1 failed > :commons:test FAILED > > FAILURE: Build failed with an exception. > > * What went wrong: > Execution failed for task ':commons:test'. > > There were failing tests. See the report at: file://< > https://builds.apache.org/job/Aurora/ws/commons/dist/reports/tests/index.html > > > > * Try: > Run with --stacktrace option to get the stack trace. Run with --info or > --debug option to get more log output. > > BUILD FAILED > > Total time: 6 mins 41.194 secs > Build step 'Execute shell' marked build as failure > Recording test results > -- John Sirois 303-512-3301

Re: Build failed in Jenkins: Aurora #1316

2016-01-06 Thread John Sirois
On Wed, Jan 6, 2016 at 12:22 PM, John Sirois wrote: > > > On Wed, Jan 6, 2016 at 10:59 AM, Apache Jenkins Server < > jenk...@builds.apache.org> wrote: > >> See <https://builds.apache.org/job/Aurora/1316/changes> >> >> Changes: >>

Re: [VOTE] Release Apache Aurora 0.11.0 debs

2016-01-08 Thread John Sirois
On Wed, Dec 23, 2015 at 2:23 PM, John Sirois wrote: > > > On Wed, Dec 23, 2015 at 2:14 PM, John Sirois wrote: > >> -1 non-binding >> >> Tested using new installing guide in Vagrant image using >> 'ubuntu/trusty64' against mesos 0.24.1. >>

Re: Build failed in Jenkins: Aurora #1316

2016-01-08 Thread John Sirois
On Wed, Jan 6, 2016 at 12:36 PM, John Sirois wrote: > On Wed, Jan 6, 2016 at 12:22 PM, John Sirois wrote: > > > > > > > On Wed, Jan 6, 2016 at 10:59 AM, Apache Jenkins Server < > > jenk...@builds.apache.org> wrote: > > > >> See

Re: Parameterize each Job Instance.

2016-01-11 Thread John Sirois
gt; > jobs = [ > > > > Service( > > > > name = 'logstash', > > > > ... > > > > instanceParameters = { "volume" : ["foo", "bar", "zaa"]}, > > > > instances = 3, > > > > container = Container( > > > > docker = Docker( > > > > image = 'image', > > > > parameters = params > > > > ) > > > > ) > > > > ) > > > > ] > > > > > > > > > > > > Something like that, it would create 3 instances of the tasks, each > one > > > > running in a container that uses the volumes foo, bar, and zaa. > > > > > > > > Does it make sense? I'd be glad to work on it but I want to validate > > the > > > > idea with you first and hear comments about the api/implementation. > > > > > > > > Thanks > > > > > > > > > > > > Mauricio > > > > > > > > > > -- John Sirois 303-512-3301

Re: Parameterize each Job Instance.

2016-01-11 Thread John Sirois
tural diff of the thrift for the Tasks to keep the log dedupe optimizations in-play for the most part; ie store Task0 in-full, and Task1-N as thrift struct diffs against 0. Maybe something simpler like a binary diff would be enough too. > > On Mon, Jan 11, 2016 at 9:20 PM, John Sirois wrot

Re: Parameterize each Job Instance.

2016-01-11 Thread John Sirois
y in-effective. IIUC its values-equals based denorm, I'd think we'd need diffing in a cluster using, for example, ceph + docker ~exclusively. > > > > > On Mon, Jan 11, 2016 at 9:54 PM, John Sirois wrote: > > > On Mon, Jan 11, 2016 at 10:40 PM, Bill Farner &

Re: [PROPOSAL] Replace commons-args

2016-01-12 Thread John Sirois
ete example of this part of the > > change: > > >> > https://reviews.apache.org/r/41804 > > >> > > > >> > This is roughly the same amount of overhead for declaring arguments > as > > >> the > > >> > current scenario, with the addition of a very obvious mechanism for > > >> > swapping the source of parameters. This allows us to isolate the > > body of > > >> > code responsible for supplying configuration values, which we lack > > today. > > >> > > > >> > The remaining work is to bridge the gap between a command line > > argument > > >> > system and Parameter interfaces. This is relatively easy to do with > > >> > dynamic proxies. I have posted a proof of concept here: > > >> > https://reviews.apache.org/r/42042 > > >> > > > >> > Regarding (c), i have done some analysis of libraries available and > i > > >> > suggest argparse4j [3]. It has thorough documentation, no > transitive > > >> > dependencies, and is being actively developed (last release Dec > 2015). > > >> > However, i would like to emphasize that i think we should minimize > > >> coupling > > >> > to the argument parsing library so that we may switch in the future. > > >> > Argparse4j has a feature that makes the non-critical feature (d) > > >> possible. > > >> > > > >> > With that, what do you think? Are there other goals we should add? > > Does > > >> > the plan make sense? > > >> > > > >> > [1] > > >> > > > >> > > > https://github.com/apache/aurora/tree/master/commons-args/src/main/java/org/apache/aurora/common/args > > >> > [2] https://github.com/twitter/commons > > >> > [3] https://argparse4j.github.io/ > > >> > > > -- John Sirois 303-512-3301

Re: Parameterize each Job Instance.

2016-01-12 Thread John Sirois
On Mon, Jan 11, 2016 at 11:02 PM, John Sirois wrote: > > > On Mon, Jan 11, 2016 at 11:00 PM, Bill Farner wrote: > >> In the log, tasks are denormalized anyhow: >> >> https://github.com/apache/aurora/blob/master/api/src/main/thrift/org/apache/aurora/gen/storage.th

Re: ExecutorConfig data format

2016-01-13 Thread John Sirois
On Wed, Jan 13, 2016 at 7:09 AM, Riccardo Poggi wrote: > Hello, > > Does anybody know what the ExecutorConfig.data json, in the thrift API, is > supposed to loook like? > I'm not sure if there is an easier way to do this - I could only find `aurora` client commands that ingest the json format, n

Re: ExecutorConfig data format

2016-01-14 Thread John Sirois
-- John Sirois 303-512-3301 On Jan 14, 2016 6:16 AM, "Riccardo Poggi" wrote: > > Thanks John, > > very nice way to inspect! > > If I understood correctly > > >>> jobs[0].json_dumps() > > will dump the Job Struct, is that what actually goes int

Re: [PROPOSAL] Amend 0.12.0 release goals

2016-01-14 Thread John Sirois
engaged in the meat of the API proposal that is needed assuming no one else has dived in. > > > > Cheers, > > Bill > -- John Sirois 303-512-3301

Re: Seeking 0.12.0 release manager

2016-01-15 Thread John Sirois
On Thu, Jan 14, 2016 at 8:55 PM, Bill Farner wrote: > Folks, > > As we approach completion of work for the 0.12.0 release, i would like to > identify a release manager. If nobody is able, i am happy to take this on > myself. However, i think it's a good process to share if only to advance > too

Re: Non-exclusive dedicated constraint

2016-01-19 Thread John Sirois
t; host OS) or to target a different hardware offering (e.g. GPUs). In > other words, only those jobs that explicitly opt-in to participate in > an experiment or hw offering would be landing on that slave set. > > Thanks, > Maxim > > [1]- > https://github.com/apache/aurora/blob/ee

Re: PROPOSAL: Host and support nightly Aurora builds on Apache servers

2016-01-22 Thread John Sirois
t; releases[1] while Mesos does not[2]. > > > > Thanks, > > Dmitriy. > > > > > > [1] https://www.apache.org/dist/zookeeper/ > > [2] http://archive.apache.org/dist/mesos/ > > > > -- > > Zameer Manji > > > > <http://archive.apache.org/dist/mesos/> > -- John Sirois 303-512-3301

Re: PROPOSAL: Host and support nightly Aurora builds on Apache servers

2016-01-22 Thread John Sirois
ial > > > release cut. > > > > > > This is purely an RFC as I could not find other Apache projects doing > > > nightlies, though I found that some projects eg Zookeeper provide alpha > > > releases[1] while Mesos does not[2]. > > > > > &g

Re: PROPOSAL: Host and support nightly Aurora builds on Apache servers

2016-01-22 Thread John Sirois
On Fri, Jan 22, 2016 at 1:21 PM, Bill Farner wrote: > Oh wow, apparently you ask me! John - would you like access? > Yes - as noted here I'd be happy to self serve: https://issues.apache.org/jira/browse/AURORA-1589 > > On Fri, Jan 22, 2016 at 12:18 PM, John Sirois wrote:

Re: PROPOSAL: Host and support nightly Aurora builds on Apache servers

2016-01-22 Thread John Sirois
see how jenkins deals with the distribution name clobbering. > > On Fri, Jan 22, 2016 at 12:23 PM, John Sirois wrote: > > > On Fri, Jan 22, 2016 at 1:21 PM, Bill Farner wrote: > > > > > Oh wow, apparently you ask me! John - would you like access? > >

[PROPOSAL] Change java thrift code gen

2016-01-26 Thread John Sirois
Context: Aurora uses the official Apache Thrift compiler today plus a home-grown python code generator [1] for immutable "entity" (I*) wrappers. The proposal is to switch from using the Apache Thrift code generator to a home grown generator. The proposal comes with a concrete example in the form

Re: [PROPOSAL] Change java thrift code gen

2016-01-26 Thread John Sirois
On Tue, Jan 26, 2016 at 8:47 PM, John Sirois wrote: > Context: Aurora uses the official Apache Thrift compiler today plus a > home-grown python code generator [1] for immutable "entity" (I*) wrappers. > > The proposal is to switch from using the Apache Thrift code gener

Re: [PROPOSAL] Change java thrift code gen

2016-01-27 Thread John Sirois
-- John Sirois 303-512-3301 On Jan 27, 2016 6:08 PM, "Maxim Khutornenko" wrote: > > I am +1 to making immutable thrift objects solely based on perf numbers. > > My biggest concern though is maintenance of a pretty intricate codebase, > especially when it comes to upgrad

[VOTE] Release Apache Aurora 0.12.0 RC0

2016-01-27 Thread John Sirois
All, I propose that we accept the following release candidate as the official Apache Aurora 0.12.0 release. Aurora 0.12.0-rc0 includes the following: --- The NEWS for the release is available at: https://git-wip-us.apache.org/repos/asf?p=aurora.git&f=NEWS&hb=rel/0.12.0-rc0 The CHANGELOG for the

Re: [PROPOSAL] Change java thrift code gen

2016-01-28 Thread John Sirois
> > > we >> > > > > have less errors in our code. If I understand correctly, the >> ProtoBuf >> > > > > format does this by default, so there some precedent for this >> style >> > of >> > > > cod

Re: [PROPOSAL] Change java thrift code gen

2016-01-28 Thread John Sirois
On Thu, Jan 28, 2016 at 8:26 AM, John Sirois wrote: > On Thu, Jan 28, 2016 at 6:45 AM, Jake Farrell wrote: > > > +1 to making this apart of Thrift, i'm happy to help shepard this on the > > Thrift side and get it in as soon as its ready > > > > I've fil

Re: [VOTE] Release Apache Aurora 0.12.0 RC0

2016-01-28 Thread John Sirois
at 2:49 PM, Bill Farner wrote: > > > (moved off private list) > > > > +1 (binding) > > > > Successfully verified using > > ./build-support/release/verify-release-candidate 0.12.0-rc0 > > > > On Wed, Jan 27, 2016 at 11:21 PM, John Sirois > wrote: >

Re: [VOTE] Release Apache Aurora 0.12.0 RC0

2016-01-28 Thread John Sirois
Noting here that the new RC will be RC2, RC1 was burned on technical release-process issues. On Thu, Jan 28, 2016 at 3:23 PM, John Sirois wrote: > > > On Thu, Jan 28, 2016 at 3:12 PM, Joshua Cohen wrote: > >> Changing my vote to -1. We just found a critical bug with Maxim

[VOTE] Release Apache Aurora 0.12.0 RC2

2016-01-28 Thread John Sirois
All, I propose that we accept the following release candidate as the official Apache Aurora 0.12.0 release. Aurora 0.12.0-rc2 includes the following: --- The NEWS for the release is available at: https://git-wip-us.apache.org/repos/asf?p=aurora.git&f=NEWS&hb=rel/0.12.0-rc2 The CHANGELOG for the

[RESULT] [VOTE] Release Apache Aurora 0.12.0 RC0

2016-01-29 Thread John Sirois
Circling back to close this vote in the - I think - appropriate way. This vote has failed. Vote summary: +1 votes: 3 binding +0 votes: 0 -1 votes: 1 binding On Thu, Jan 28, 2016 at 12:21 AM, John Sirois wrote: > All, > > I propose that we accept the following release candida

[RESULT] [VOTE] Release Apache Aurora 0.12.0 RC2

2016-01-29 Thread John Sirois
This vote has failed. Vote summary: +1 votes: 0 +0 votes: 0 -1 votes: 1 binding On Thu, Jan 28, 2016 at 5:01 PM, John Sirois wrote: > All, > > I propose that we accept the following release candidate as the official > Apache Aurora 0.12.0 release. > > Aurora 0.12.0-rc2 incl

Re: [RESULT] [VOTE] Release Apache Aurora 0.12.0 RC0

2016-01-29 Thread John Sirois
Didn't quite do it right, adding binding vote apache ids. On Fri, Jan 29, 2016 at 2:24 PM, John Sirois wrote: > Circling back to close this vote in the - I think - appropriate way. > > This vote has failed. Vote summary: > > +1 votes: 3 binding > +0 votes: 0 > -1 vot

Re: [RESULT] [VOTE] Release Apache Aurora 0.12.0 RC2

2016-01-29 Thread John Sirois
Adding appropriate apache id's to email to make this official. On Fri, Jan 29, 2016 at 2:30 PM, John Sirois wrote: > This vote has failed. Vote summary: > > +1 votes: 0 > +0 votes: 0 > -1 votes: 1 binding > > On Thu, Jan 28, 2016 at 5:01 PM, John Sirois wrote: >

Re: [PROPOSAL] Change java thrift code gen

2016-02-02 Thread John Sirois
o Apache Thrift. Once that is complete and released, I'll circle back and re-do an RB like 3/3 ( https://reviews.apache.org/r/42756/) that flips over the codebase to the new apache thrift gen. On Thu, Jan 28, 2016 at 10:08 AM, John Sirois wrote: > > > On Thu, Jan 28, 2016 at 8:26 AM

0.12.0 RC status

2016-02-02 Thread John Sirois
Although the last blocker raised for the 0.12.0 RC series has been resolved [1], it looks like resolution of several issues related to rolling back to 0.11.0 are required to cut the next RC: 1. "Scheduler fails to start after rollback": https://issues.apache.org/jira/browse/AURORA-1603 2. "Add a fl

Re: NEWS Layout

2016-02-02 Thread John Sirois
gt; * New/updated > > > * Deprecations and removals > > > > > > [1] https://github.com/apache/aurora/blob/master/NEWS > > > [2] https://aurora.apache.org/blog/aurora-0-11-0-released/ > > > > > > > > > Thoughts? > > > > > > -- John Sirois 303-512-3301

Re: 0.12.0 RC status

2016-02-03 Thread John Sirois
t 0.12.0. > On Tue, Feb 2, 2016 at 7:03 AM, Joshua Cohen wrote: > > > I'd only consider item 1 to be a blocker to 0.12.0, but 2 and 3 should be > > relatively quick so in general this sounds like a reasonable plan of > action > > to me. > > > > On Tue,

Re: New committer and PMC member: Stephan Erb

2016-02-03 Thread John Sirois
On Wed, Feb 3, 2016 at 11:01 AM, Bill Farner wrote: > Folks, > > Please join me in welcoming Stephan Erb, who is now an Aurora committer and > PMC member! I'm sure anyone paying attention has noticed Stephan's > involvement in the community and commitment to improving Aurora! > > Welcome aboard,

Re: Further thoughts on config deprecations

2016-02-03 Thread John Sirois
.com/facebook/codemod > [2] https://github.com/facebook/jscodeshift > -- John Sirois 303-512-3301

Re: 0.12.0 RC status

2016-02-05 Thread John Sirois
On Wed, Feb 3, 2016 at 10:58 AM, John Sirois wrote: > > > On Tue, Feb 2, 2016 at 10:22 AM, Maxim Khutornenko > wrote: > >> +1 to having 1603 and 1601 as blockers. I am planning to work on 1603 >> today. >> >> As for 1605, I don't believe it's

Re: 0.12.0 RC status

2016-02-05 Thread John Sirois
r both seem to me to be important to provide to support this selling point. > > On Fri, Feb 5, 2016 at 8:10 AM, John Sirois wrote: > >> On Wed, Feb 3, 2016 at 10:58 AM, John Sirois wrote: >> >> > >> > >> > On Tue, Feb 2, 2016 at 10:22 AM, Maxim Khuto

[VOTE] Release Apache Aurora 0.12.0 RC3

2016-02-05 Thread John Sirois
All, I propose that we accept the following release candidate as the official Apache Aurora 0.12.0 release. Aurora 0.12.0-rc3 includes the following: --- The NEWS for the release is available at: https://git-wip-us.apache.org/repos/asf?p=aurora.git&f=NEWS&hb=rel/0.12.0-rc3 The CHANGELOG for the

Re: [VOTE] Release Apache Aurora 0.12.0 RC3

2016-02-05 Thread John Sirois
#x27;ll close out this vote. > > On Fri, Feb 5, 2016 at 11:10 AM, John Sirois wrote: > > All, > > > > I propose that we accept the following release candidate as the official > > Apache Aurora 0.12.0 release. > > > > Aurora 0.12.0-rc3 includes the

[RESULT][VOTE] Release Apache Aurora 0.12.0 RC3

2016-02-05 Thread John Sirois
Due to a new backfill issue found by Maxim [1], I'm cancelling this vote. I'll start a new release when that issue is resolved and we've all had time to re-assess RC status. [1] https://issues.apache.org/jira/browse/AURORA-1610 On Fri, Feb 5, 2016 at 12:10 PM, John Sirois wrote

Subject: [VOTE] Release Apache Aurora 0.12.0 RC4

2016-02-05 Thread John Sirois
All, I propose that we accept the following release candidate as the official Apache Aurora 0.12.0 release. Aurora 0.12.0-rc4 includes the following: --- The NEWS for the release is available at: https://git-wip-us.apache.org/repos/asf?p=aurora.git&f=NEWS&hb=rel/0.12.0-rc4 The CHANGELOG for the

Re: [PROPOSAL] Disallow instance removal in job update

2016-02-05 Thread John Sirois
mind, should we block > >> instance removal in the updater and let an explicit killTasks call be > >> the only acceptable action to reduce instance count? Is there any > >> value (aside from arguable convenience factor) in having > >> startJobUpdate ever killing instances? > >> > >> Thanks, > >> Maxim > >> > >> [1] - http://markmail.org/message/2smaej5n5e54li3g > >> > -- John Sirois 303-512-3301

Re: Subject: [VOTE] Release Apache Aurora 0.12.0 RC4

2016-02-05 Thread John Sirois
I'd like to kick-off voting with my own +1 (binding). ./build-support/release/verify-release-candidate 0.12.0-rc4 is green for me. On Fri, Feb 5, 2016 at 3:14 PM, John Sirois wrote: > All, > > I propose that we accept the following release candidate as the official > Apa

Re: [PROPOSAL] Disallow instance removal in job update

2016-02-05 Thread John Sirois
clients or custom clients. > I guess that's true. I concur. > On Fri, Feb 5, 2016 at 3:17 PM, John Sirois wrote: > > > On Fri, Feb 5, 2016 at 4:07 PM, Maxim Khutornenko > > wrote: > > > > > We have had attempts to safeguard client updater command with a

[PROPOSAL] java gen: Uniform AsyncMethodCallback use in client and server

2016-02-08 Thread John Sirois
I'd like to propose a breaking change in both the java generated service code and in supporting library code. This change would change parametrization and use of clients to be symmetric with servers in the java async stack. Today the situation is as described in comments in https://issues.apache.

Re: [PROPOSAL] java gen: Uniform AsyncMethodCallback use in client and server

2016-02-08 Thread John Sirois
Sorry folks - wrong list! Please disregard. On Mon, Feb 8, 2016 at 12:35 PM, John Sirois wrote: > I'd like to propose a breaking change in both the java generated service > code and in supporting library code. This change would change > parametrization and use of clients to be

[RESULT][VOTE] Release Apache Aurora 0.12.0 RC4

2016-02-08 Thread John Sirois
can be found at: https://dist.apache.org/repos/dist/release/aurora/0.12.0/apache-aurora-0.12.0.asc The GPG key used to sign the release are available at: https://dist.apache.org/repos/dist/release/aurora/KEYS On Fri, Feb 5, 2016 at 3:14 PM, John Sirois wrote: > All, > > I propose that we

Seeking 0.13.0 release manager

2016-02-08 Thread John Sirois
The main 0.12.0 release has just been made and docs/distributions will soon follow. Though we've barely begun work on it, I'd like to line up a release manager for 0.13.0. I'll be happy to help with pointers and advice. I have a few document and script edits still to come to help smooth out the p

Re: Jenkins build is back to normal : aurora-packaging-nightly #194

2016-02-12 Thread John Sirois
ee <https://builds.apache.org/job/aurora-packaging-nightly/194/> > > -- John Sirois 303-512-3301

Re: Jenkins build is back to normal : aurora-packaging-nightly #194

2016-02-12 Thread John Sirois
r/lib/docker/aufs/mnt/2bf3bb359dec47586c324e03f190404b312fa6237618c36d23d935105d1b6172/dist: > no such file or directory > Yes - exactly - the aufs overlay missing is the error I see happening alot. > > > On Fri, Feb 12, 2016 at 5:56 PM, John Sirois wrote: > > > I would l

Re: [RESULT][VOTE] Release Apache Aurora 0.12.0 RC4

2016-02-29 Thread John Sirois
;> >> Is there a way we can help out here? >> >> Best, >> Stephan >> >> From: John Sirois >> Sent: Monday, February 8, 2016 23:47 >> To: dev@aurora.apache.org >> Subject: [RESULT][VOTE] Release Apache Aurora 0.12.0 RC4 >> >>

Re: [DRAFT] [REPORT] Apache Aurora

2016-03-01 Thread John Sirois
ith > strong > > > > community engagement. We have placed deliberate effort to build > > release > > > > notes as we iterate towards future releases, which has received > > positive > > > > feedback from users. > > > > > > > >

Re: [RESULT][VOTE] Release Apache Aurora 0.12.0 RC4

2016-03-03 Thread John Sirois
03 AM, "Bill Farner" wrote: > > IIRC site changes aren't blocked on binaries. I believe the only link is the bintray button, which automatically tracks the latest bintray version. > > https://aurora.apache.org/downloads/ > > On Mon, Feb 29, 2016 at 8:10 AM, John Sirois

[VOTE] Release Apache Aurora 0.12.0 debs

2016-03-07 Thread John Sirois
I propose that we accept the following artifacts as the official deb packaging for Apache Aurora 0.12.0. https://dl.bintray.com/john-sirois/aurora/ubuntu-trusty/ https://dl.bintray.com/john-sirois/aurora/debian-jessie/ The Aurora deb packaging includes the following: --- The CHANGELOG is

Re: Seeking 0.13.0 release manager

2016-03-08 Thread John Sirois
On Mon, Feb 8, 2016 at 4:02 PM, John Sirois wrote: > The main 0.12.0 release has just been made and docs/distributions will > soon follow. > > Though we've barely begun work on it, I'd like to line up a release > manager for 0.13.0. > I'll be happy to help with p

Re: [VOTE] Release Apache Aurora 0.12.0 debs

2016-03-08 Thread John Sirois
ing in the 2 respective aurora-packaing test/deb/ environments. > > On Mon, Mar 7, 2016 at 8:00 AM, John Sirois wrote: > >> I propose that we accept the following artifacts as the official deb >> packaging for >> Apache Aurora 0.12.0. >> >> https://dl.bintray.c

Re: Seeking 0.13.0 release manager

2016-03-08 Thread John Sirois
e > > On Tue, Mar 8, 2016 at 12:39 PM, John Sirois wrote: > > > On Mon, Feb 8, 2016 at 4:02 PM, John Sirois wrote: > > > > > The main 0.12.0 release has just been made and docs/distributions will > > > soon follow. > > > > > > Though we&

[VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-09 Thread John Sirois
I propose that we accept the following artifacts as the official rpm packaging for Apache Aurora 0.12.0. *https://dl.bintray.com/john-sirois/aurora/centos-7/ <https://dl.bintray.com/john-sirois/aurora/centos-7/>* The Aurora rpm packaging includes the following: --- The CHANGELOG is viewa

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-09 Thread John Sirois
On Wed, Mar 9, 2016 at 11:00 AM, John Sirois wrote: > I propose that we accept the following artifacts as the official rpm packaging > for Apache Aurora 0.12.0. > > *https://dl.bintray.com/john-sirois/aurora/centos-7/ > <https://dl.bintray.com/john-sirois/aurora/centos-7/>

[RESULT][VOTE] Release Apache Aurora 0.12.0 debs

2016-03-10 Thread John Sirois
old flat namespace is replaced with one level of nesting by target platform, see: https://apache.bintray.com/aurora/ubuntu-trusty/ https://apache.bintray.com/aurora/debian-jessie/ On Mon, Mar 7, 2016 at 9:00 AM, John Sirois wrote: > I propose that we accept the following artifacts as the offic

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-11 Thread John Sirois
Pinging this VOTE and noting that the close is Monday at 11am Mountain time. Please test! On Wed, Mar 9, 2016 at 11:03 AM, John Sirois wrote: > > > On Wed, Mar 9, 2016 at 11:00 AM, John Sirois wrote: > >> I propose that we accept the following artifacts as the official

Re: Seeking 0.13.0 release manager

2016-03-11 Thread John Sirois
On Tue, Mar 8, 2016 at 3:32 PM, John Sirois wrote: > > > On Tue, Mar 8, 2016 at 11:40 AM, Jake Farrell wrote: > >> I'm happy to step in and take the rm role for .13 if no one else is >> interested >> > > Thanks Jake. If no new-releaser (it would be

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-12 Thread John Sirois
ed to load native Mesos library from > /usr/lib;/usr/lib64 > I was able to fix this by removing ;/usr/lib64 from > -Djava.library.path='/usr/lib;/usr/lib64', alternatively by removing the > library.path setting and exporting LD_LIBRARY_PATH=/usr/lib. > > Happy to pitch

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-14 Thread John Sirois
-i/yum install/. This is enough to invalidate the release though and I'll get out more fixes to the test docs. My install procedure was exactly: version=0.12.0 pkg_root="https://dl.bintray.com/john-sirois/aurora/centos-7/"; for rpm in \ aurora-scheduler-${version}-1.el7.centos.aur

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-14 Thread John Sirois
On Mon, Mar 14, 2016 at 10:09 AM, John Sirois wrote: > My sanity may be partially restored, although several things are wonky. > More below on my morning experiments, all after vagrant destroy for sanity > sake in the test/rpm/centos-7 dir of the aurora-packaging repo: > > On Sa

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-14 Thread John Sirois
On Mon, Mar 14, 2016 at 10:09 AM, John Sirois wrote: > My sanity may be partially restored, although several things are wonky. > More below on my morning experiments, all after vagrant destroy for sanity > sake in the test/rpm/centos-7 dir of the aurora-packaging repo: > > On Sa

[VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-14 Thread John Sirois
I propose that we accept the following artifacts as the official rpm packaging for Apache Aurora 0.12.0. *https://dl.bintray.com/john-sirois/aurora/centos-7/ <https://dl.bintray.com/john-sirois/aurora/centos-7/>* The Aurora rpm packaging includes the following: --- The CHANGELOG is viewa

Re: [PROPOSAL] Supporting Mesos Universal Containers

2016-03-15 Thread John Sirois
On Tue, Mar 15, 2016 at 8:55 AM, Joshua Cohen wrote: > I've gone ahead and filed some tickets breaking down the work involved in > this effort. They're all contained within this epic: > https://issues.apache.org/jira/browse/AURORA-1634. > > I agree that we should assess our plans re: containers a

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-15 Thread John Sirois
g instructions starting here: > https://github.com/apache/aurora-packaging/blob/master/test/rpm/centos-7/README.md#released > > and > pkg_root="https://dl.bintray.com/john-sirois/aurora/centos-7/"; > > > On Mon, Mar 14, 2016 at 12:10 PM, John Sirois wrote: > >> I

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-21 Thread John Sirois
ime for folks to vote. As such, unless someone is aware of conflicting policy, I'll extend this vote until we get a binding +1 or any -1. Please test if you can find the time! [1] http://www.apache.org/foundation/voting.html On Tue, Mar 15, 2016 at 10:19 AM, John Sirois wrote: > I&#x

Re: [VOTE] Release Apache Aurora 0.12.0 rpms

2016-03-21 Thread John Sirois
nd https://issues.apache.org/jira/browse/AURORA-1647 to fix these. > > Packages in general are fine, so we can leave those two issues for another > day. > > From: John Sirois > Sent: Monday, March 21, 2016 14:25 > To: Bill Farner > Cc

  1   2   >