Repository: aurora Updated Branches: refs/heads/0.8.0-rc0 [created] 1b0da16bb
Updating CHANGELOG for 0.8.0 release. Project: http://git-wip-us.apache.org/repos/asf/aurora/repo Commit: http://git-wip-us.apache.org/repos/asf/aurora/commit/bd4e7b51 Tree: http://git-wip-us.apache.org/repos/asf/aurora/tree/bd4e7b51 Diff: http://git-wip-us.apache.org/repos/asf/aurora/diff/bd4e7b51 Branch: refs/heads/0.8.0-rc0 Commit: bd4e7b51d82e17e9a1bbf07fda32259d3b8bbba1 Parents: 9a2bbde Author: jfarrell <[email protected]> Authored: Mon May 4 22:34:35 2015 -0400 Committer: jfarrell <[email protected]> Committed: Mon May 4 22:34:35 2015 -0400 ---------------------------------------------------------------------- CHANGELOG | 260 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 260 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/aurora/blob/bd4e7b51/CHANGELOG ---------------------------------------------------------------------- diff --git a/CHANGELOG b/CHANGELOG index 62e68b2..3bc43e1 100644 --- a/CHANGELOG +++ b/CHANGELOG @@ -1,3 +1,263 @@ +Aurora 0.8.0 +-------------------------------------------------------------------------------- +## Bug + * [AURORA-1248] - Client retries 4xx errors + * [AURORA-1266] - Backwards incompatibility - executor does not ignore unknown (new) fields in task definition + * [AURORA-1297] - link to apache git repo on the download page outdated + * [AURORA-1263] - Fetching update details for a large job update takes seconds in the UI + * [AURORA-1285] - Scheduler updater does not resume updates waiting for a pulse after restart + * [AURORA-1300] - Git Repository Not Found for Aurora Download + * [AURORA-1301] - Tests inheriting from AuroraClientCommandTest always pass + * [AURORA-652] - GC Executor termination should be co-ordinated by the scheduler + * [AURORA-643] - Redirect loop when accessing /scheduler// + * [AURORA-654] - "Could not deserialize AssignedTask" from thermos_executor.pex + * [AURORA-629] - Scheduler client does not retry closed connection errors + * [AURORA-602] - e2e tests broken due to "aurora run" hanging + * [AURORA-546] - aurora command not found in vagrant + * [AURORA-578] - observer shouldn't include jquery + * [AURORA-530] - FlagSchemaChanges task isn't wired to ./gradlew build + * [AURORA-490] - aurora create fail due to incorrect UpdateConfig.watch_secs + * [AURORA-487] - clientv2 egg contains source files found in clientv1 egg + * [AURORA-460] - Python build commands regularly fail with ZipImportError + * [AURORA-462] - Client fails with DistributionNotFound: argparse + * [AURORA-330] - aurora update should fail gracefully if job is not a service + * [AURORA-248] - Use Mock with specs in client tests + * [AURORA-197] - aurora client fails in rollback if rolled-back instances already dead + * [AURORA-1106] - Release candidate script does not generate correct branch link + * [AURORA-1124] - Aurora beta-update status command is broken + * [AURORA-1135] - "download" link broken in logs stdout/stderr page + * [AURORA-1108] - The scheduler synchronously writes a backup while writing a snapshot to the replicated log + * [AURORA-1094] - aurora cron start --open-browser fails with stacktrace + * [AURORA-1134] - Quota checks are inaccurate for cron schedule updates + * [AURORA-1137] - Publish centos mesos.native eggs for 0.20.1 + * [AURORA-1133] - Thermos Observer does not export stats via /vars + * [AURORA-1060] - Branch coverage check is flaky + * [AURORA-1046] - Memory leak in CachedClusterState + * [AURORA-1153] - Preemptor frequently reloads loop-invariant host attributes + * [AURORA-1053] - StorageBackupImpl doesn't use streaming + * [AURORA-1138] - aurorabuild.sh should exit on error in any command + * [AURORA-964] - Scheduler updater successfully updates a non-existent job + * [AURORA-1023] - Releasing the update lock trips off scheduler updater + * [AURORA-991] - Documented steps for replicated log don't work for multi-master + * [AURORA-958] - Scheduler does not retry transitions for all transient states + * [AURORA-1020] - The --rollback-on-failure option is meaningless for "aurora job restart" + * [AURORA-993] - Aurora2 client building fails due to broken build path in pants + * [AURORA-1008] - Pystachio section variables don't seem to work as described in the documentation + * [AURORA-1015] - Paused update survives past job lifetime + * [AURORA-950] - aurora job inspect --raw is broken + * [AURORA-1201] - auth_module is not installed in child injector + * [AURORA-1192] - Announced aurora leader information does not respect -hostname flag + * [AURORA-1191] - end-to-end tests no longer rebuilds components + * [AURORA-1217] - Gradle run broken + * [AURORA-1174] - make-python-sdists failing on master + * [AURORA-1173] - JobUpdateController.systemResume() is not called on scheduler startup anymore + * [AURORA-1169] - Version ID in gradle expands to invalid value on Windows + * [AURORA-1155] - GC executor broken / Insufficient automated testing + * [AURORA-794] - Client erroneously prints "Job not found" when job exists + * [AURORA-787] - Avoid using maxWaitToInstanceRunningMs for instance killing wait + * [AURORA-780] - python checkstyle looks at 3rdparty + * [AURORA-882] - CI broken due to UpdaterTest::test_update_instances_wait_for_batch_completion_filled_batch + * [AURORA-926] - Scheduler crashes due to JVM running out of memory on start + * [AURORA-865] - IOError on aurora job status + * [AURORA-847] - Executor error causing end-to-end task failures + * [AURORA-842] - LeaderRedirectTest#testLeader fails in local builds + * [AURORA-860] - aurora job status should not log when writing json + * [AURORA-859] - "No tasks to kill" message is not surfaced to user in v2 + * [AURORA-805] - cannot set verbosity from 'aurora job create' + * [AURORA-773] - Usage text is incorrect for list_jobs subcommand + * [AURORA-759] - Scheduler updater stuck in ROLLING_BACK + * [AURORA-699] - Stack trace in AttributeAggregate + * [AURORA-704] - Update cron documentation + * [AURORA-677] - test_end_to_end_v2.sh fails on config list + * [AURORA-1064] - Gradle version check is too strict + * [AURORA-103] - Scheduler returns an error code for a successful query that returned no results + * [AURORA-1260] - job restart reports successful restart when it fails + * [AURORA-1115] - Observer is no longer finding task sandboxes + * [AURORA-1165] - aurora update status subcommand shows invalid date values + * [AURORA-1256] - git repository references throughout aurora.apache.org are wrong + * [AURORA-916] - test_inotify_diskcollector is flaky + * [AURORA-1166] - aurora update status subcommand does not filter by update status + * [AURORA-1255] - Download links on aurora.apache.org point to old location + * [AURORA-917] - "aurora job create" gives misleading error when used to create a cron job + * [AURORA-1113] - Invalid create commands in the tutorial + * [AURORA-1176] - CommandLine uses print() directly instead of doing so through context + * [AURORA-1163] - "--async_worker_threads" scheduler option has misleading help text + * [AURORA-164] - scheduler does not leave enough resources available to run a GC executor + * [AURORA-1200] - If a user who wasn't the last to update a job changes the # of instances, all instances are updated + +## Epic + * [AURORA-448] - Deprecate stringtemplate library + * [AURORA-429] - Add features to the aurora client to allow users to customize around common patterns + * [AURORA-256] - Implement a centralized logging and analytics framework for aurora + * [AURORA-1034] - Graduate Apache Aurora from Incubator + * [AURORA-999] - Various scheduler performance improvements + * [AURORA-905] - 0.8.0 deprecations + * [AURORA-690] - Add support for external update coordination + +## Story + * [AURORA-1291] - Replace enable_api_security arg with a value for http_authentication_mechanism + * [AURORA-1292] - Replace -enable_api_security=false with -http_authentication_mechanism=NONE + * [AURORA-1275] - Don't delay kill sequence when HTTP teardown signal could not be dispatched + * [AURORA-1299] - UpdateConfigError results in stack trace + * [AURORA-1290] - Allow specifying a shorthand for "well-known" Module FQCNs + * [AURORA-601] - Vagrant should self bootstrap if gradlew is missing + * [AURORA-638] - Build broken due to AURORA-587 + * [AURORA-591] - Benchmark scheduler API operations to catch performance regressions + * [AURORA-592] - Use jenkins performance plugin + * [AURORA-540] - Consider removing ExecutorConfig data from the scheduler + * [AURORA-527] - Better test coverage around exported metrics + * [AURORA-524] - Preemptor should export more detailed statistics + * [AURORA-559] - Move src/resources to src/{test,main}/resources as appropriate + * [AURORA-671] - Surface admin UI more easily than a Ï + * [AURORA-662] - Remove Rack Limit Default + * [AURORA-517] - Building a Python Client for Suro + * [AURORA-518] - Distributed logging from the Scheduler + * [AURORA-476] - Run vagrant-based tests regularly + * [AURORA-472] - V2 end-to-end tests stall for 5 seconds due to "large change" + * [AURORA-434] - document steps to recover replica db from backup + * [AURORA-360] - The scheduler should have authority on reacting to task health check failures + * [AURORA-308] - Move /utilization into aurora UI + * [AURORA-273] - Automate testing the Aurora UI + * [AURORA-31] - Support an authentication mechanism for client-scheduler communication + * [AURORA-217] - Aurora CLI Improvements: Init file + * [AURORA-212] - Modify default rack limit to be something other than 1 (perhaps N/10) + * [AURORA-184] - Implicit scheduling constraints should be removed + * [AURORA-1099] - 0.7.0 missing license headers + * [AURORA-1132] - Thermos Observer does not have Lifecycle Endpoints + * [AURORA-1104] - Upgrade to pants 0.0.28 + * [AURORA-1105] - Update pause and resume RPCs should accept a job key + * [AURORA-1093] - Scheduler updates should be uniquely identified by jobKey + updateId + * [AURORA-1148] - Display All Scheduling Veto Reasons for PENDING tasks + * [AURORA-1027] - Update thermos cli to read checkpoint stream from sandbox + * [AURORA-1152] - Consider preventing host limit when dedicated is set + * [AURORA-1118] - Consider changing TaskStore interfaces to return Iterables instead of Sets + * [AURORA-1144] - Remove SaveAcceptedJob and StoredJob thrift structs + * [AURORA-1028] - Export TASK_LOST source stats from Scheduler + * [AURORA-1001] - Support Mesos TASK_ERROR state + * [AURORA-960] - Update commands should be able to perform actions based on update ids + * [AURORA-979] - Update to virtualenv 12.0 + * [AURORA-1025] - Update gc executor to read checkpoint stream from sandbox + * [AURORA-974] - upgrade pants invocations once pants 0.0.25 is released + * [AURORA-1024] - Implement API for dual reading Thermos checkpoints + * [AURORA-1026] - Update observer to read checkpoint stream from sandbox + * [AURORA-1236] - git repo on aurora.apache.org references old incubator repo which is 404 + * [AURORA-1210] - Aurora Graduation checklist + * [AURORA-1206] - Make update status command more versatile + * [AURORA-1190] - Add a deprecation warning when the client-side updater is used + * [AURORA-1189] - Add a warning in the scheduler when the JVM version is < 1.8 + * [AURORA-1187] - Create JobKey-scoped Permissions and apply to AuroraSchedulerManager + * [AURORA-1231] - Blocked updates missing from cluster-wide in progress view + * [AURORA-1302] - Allow rc script to set an explicit version + * [AURORA-796] - Configurable Health-Endpoint + * [AURORA-913] - Replace MaintenanceMode field with HostAttributes in HostOffer + * [AURORA-909] - Differentiate between dynamic and static vetoes + * [AURORA-911] - Scheduling vetos are only displayed for the first task in a TaskGroup + * [AURORA-857] - aurora cron schedule should ouput url + * [AURORA-821] - Aurora_admin does not persist DRAINED state across scheduler fail-over + * [AURORA-716] - Reconsider default for -require_slave_checkpoint + * [AURORA-746] - LocalSchedulerMain shutdown deadlock + * [AURORA-689] - Start vetting Mesos 0.21.0 + * [AURORA-1112] - support a cluster service job priority + * [AURORA-1066] - Allow a process to have a nice value associated with it + * [AURORA-598] - add -thermos_executor_flags option to scheduler + * [AURORA-459] - CronIT.testJobsAreScheduled takes ~16 seconds + +## Task + * [AURORA-1268] - Executor is not backwards compatible with regards to schema additions + * [AURORA-1276] - Upgrade to mesos 0.22 + * [AURORA-656] - Investigate performance improvements of caching PreparedStatements + * [AURORA-620] - Consider using JCenter over HTTPS instead of Maven Central + * [AURORA-549] - Export a stat to track status update handling delay + * [AURORA-554] - client-commands.md should use v2 syntax for invocations + * [AURORA-532] - Publish twitter.common.python 0.5.7 and publish external docs + * [AURORA-515] - the aurora client should support kerberos + * [AURORA-507] - Make releaseLock return a "Nothing to unlock" message + * [AURORA-383] - Show lock held by a job if any + * [AURORA-364] - gc_executor should not reconcile tasks if AdjustRetainedTask contains an unknown state + * [AURORA-354] - Replace quota consumption table in role and role/env page with pie charts + * [AURORA-289] - Automatically push rendered docs to the website upon commit + * [AURORA-324] - Migrate from Twitter ShutdownRegistry to Guava ServiceManager + * [AURORA-257] - GSoC: Investigate distributed logging systems + * [AURORA-258] - GSoC: add optional command logging to the clientv2 framework + * [AURORA-24] - Build a standalone UI + * [AURORA-241] - Show a warning when ports are requested but not listening + * [AURORA-195] - remove legacy remnants of "aurora" executor + * [AURORA-174] - injected scheduler constraints should be configurable + * [AURORA-1088] - Expose blockIfNoPulseAfterMs setting in updateSettings.html + * [AURORA-1090] - Optimize or remove shard uniqueness check from StorageBackfill + * [AURORA-1081] - Upgrade to latest checkstyle version + * [AURORA-1055] - Remove LiveClusterState + * [AURORA-1077] - Allow message to be stored with update write events + * [AURORA-1121] - Consider changing SchedulingFilter interface return Iterable instead of Set + * [AURORA-1080] - Upgrade mesos dependency to 0.21.1 + * [AURORA-1062] - apache.aurora.executor.common.HealthChecker should export stats + * [AURORA-1141] - Handle new TaskState.TASK_ERROR + * [AURORA-1101] - document how to build a single aurora_client pex for linux and os x + * [AURORA-1119] - Enable UPDATE_COORDINATOR role to access pauseJobUpdate RPC + * [AURORA-1128] - Pin python protobuf dependency to 2.6.1 + * [AURORA-1129] - Upgrade myBatis version to latest + * [AURORA-1097] - Scheduler updater should suppress instance events on resume + * [AURORA-1120] - Add the ability to optionally create an unhooked version of the Aurora client api + * [AURORA-1130] - Review bot is timing out in python tests + * [AURORA-1037] - Community Vote for graduation readiness + * [AURORA-1049] - Expose "blocked" update state due to no heartbeats + * [AURORA-1029] - Remove client YAML support (drop pyaml dependency) + * [AURORA-1071] - Modify UpdateConfig schema to support heartbeats + * [AURORA-1035] - Perform a comprehensive name search + * [AURORA-1040] - Submit Resolution to Board + * [AURORA-973] - Add a document describing thrift deprecation procedure + * [AURORA-1009] - Implement pulseJobUpdates RPC + * [AURORA-1012] - Update documentation to explain the scheduler heartbeat mechanism + * [AURORA-975] - Remove populatedDEPRECATED from PopulateJobResult + * [AURORA-1010] - Modify updater state machine to support heartbeat-driven pause/resume + * [AURORA-1211] - Spread snapshot creation and backup file write + * [AURORA-1194] - Instance update timeout failures don't surface in TaskEvents or update UI + * [AURORA-1219] - Improve preemptor efficiency + * [AURORA-1220] - Add SLA stats tracking job updates + * [AURORA-1214] - Reevaluate "max_schedule_attempts_per_sec" with asynchronous preemptor + * [AURORA-1160] - Rename beta-update to update + * [AURORA-1181] - optimize host_drain to speed up maintenance + * [AURORA-1170] - Add more logging in MaintenanceController + * [AURORA-1159] - NearestFix does not account for certain veto types + * [AURORA-1158] - Consider finding preemption slots asynchronously + * [AURORA-1235] - Observer filebrowser does not set charset on the response + * [AURORA-1156] - Preemptor perf improvements + * [AURORA-1157] - Add end-to-end test coverage for async updates + * [AURORA-791] - upgrade to psutil 2.1.3 + * [AURORA-789] - Resources field should belong to aurora, not thermos + * [AURORA-888] - Update client documentation to reflect the shift to clientv2. + * [AURORA-885] - Improve lock held message in client output + * [AURORA-922] - Confusing message when stuck update needs to be canceled + * [AURORA-892] - Improve specs for command line option mocks in Python tests + * [AURORA-871] - Use optimistic locking when scheduling tasks + * [AURORA-896] - Remove client stack trace redirection + * [AURORA-811] - Add ShiroAopModule, shiro AOP @RequiresPermissions annotations + * [AURORA-809] - Use Apache Shiro for HTTP authentication + * [AURORA-1246] - Mesos warns about executor resources being to small + * [AURORA-712] - update all docs to assume aurora client is standalone v2 + * [AURORA-731] - Add informative messages to update and instance events + * [AURORA-816] - Remove command bridging from v2 client + * [AURORA-817] - Add documentation for HTTP basic and kerberos authentication + * [AURORA-1168] - beta-update list should use a hierarchy for query specifications + * [AURORA-99] - Do not queue task for local gc if it started after the AdjustRetainedTask message was sent + * [AURORA-98] - Updater health checking needs verbose logging + * [AURORA-91] - Thermos observer process timings are confusing for processes that have restarted + * [AURORA-89] - Add support for displaying arbitrary user-defined elements in scheduler pages + * [AURORA-86] - Explore mitigation strategies for "machines of death" + * [AURORA-825] - Cron tasks don't check quota when launched + * [AURORA-510] - Investigate a way to mock patch threading.Event in unit tests + * [AURORA-723] - Create design document for security code refactor + * [AURORA-812] - Wire in SPNEGO HTTP module + * [AURORA-813] - Add ability to configure client to use Kerberos + * [AURORA-815] - Remove remaining deprecated code + * [AURORA-810] - Add an end-to-end test case for http basic auth + * [AURORA-808] - Refactor the scheduler to allow authenticated subject-per-request + * [AURORA-160] - implement the ability to do one-off GC executor runs + * [AURORA-159] - the scheduler http interface should support kerberos + * [AURORA-969] - Create scheduler performance benchmark framework + * [AURORA-1240] - Ignore JobUpdateSettings.maxWaitToInstanceRunningMs in the scheduler + + Aurora 0.7.0 -------------------------------------------------------------------------------- ## Bug
