Re: Review Request 60105: Clean rebooted slave's state if slaveInfo mismatches.

2017-06-23 Thread Jiang Yan Xu
0105/#comment253079> We normally in logs first state what action is taken and then attach the error after `: `. In this case since the error has multiple lines, let's state the action first so it's not buried by the err

Re: Review Request 60105: Clean rebooted slave's state if slaveInfo mismatches.

2017-06-23 Thread Jiang Yan Xu
> On June 23, 2017, 11:21 a.m., Jiang Yan Xu wrote: > > src/slave/slave.cpp > > Line 6003 (original), 6007 (patched) > > <https://reviews.apache.org/r/60105/diff/6/?file=1759987#file1759987line6010> > > > > Empty line above. > > Megha Sharma w

Re: Review Request 56895: Added tests to ensure slave recovery post reboot.

2017-06-23 Thread Jiang Yan Xu
ment253045> Blank line and is the comment necessary? Instead, you could comment on that you are capturing `offers2` in order to get the `slaveId2` (which is what you reall want to verify)? The same applies to `offers1`. src/tests/slave_recovery_tests.cpp Lines 27

Review Request 60400: (WIP) Skipped consulting registry if the agent is in the `slaves.recovered`.

2017-06-23 Thread Jiang Yan Xu
--- Skipped consulting registry if the agent is in the `slaves.recovered`. Diffs - src/master/master.cpp 33eca0d17459781fdc2ea915e8f40c78dd306962 Diff: https://reviews.apache.org/r/60400/diff/1/ Testing --- Thanks, Jiang Yan Xu

Re: Review Request 60105: Clean rebooted slave's state if slaveInfo mismatches.

2017-06-23 Thread Jiang Yan Xu
} ``` src/slave/slave.cpp Line 6003 (original), 6007 (patched) <https://reviews.apache.org/r/60105/#comment253017> Empty line above. src/slave/slave.cpp Line 6004 (original), 6019 (patched) <https://reviews.apache.org/r/60105/#comment253021> Empty line

Re: Review Request 60104: Added rebooted flag to State.

2017-06-23 Thread Jiang Yan Xu
) <https://reviews.apache.org/r/60104/#comment252967> No need for this? - Jiang Yan Xu On June 22, 2017, 2:17 p.m., Megha Sharma wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://

Re: Review Request 60252: Fixed a bug that causes segfault in ProcessManager::finalize.

2017-06-22 Thread Jiang Yan Xu
ault here? It's more likely that the > > segfault was caused by a dereferencing a non-`nullptr` process that had > > already been deallocated (which would not be fixed by this review). > > Jiang Yan Xu wrote: > The use case is something like this: > > ht

Re: Review Request 60252: Fixed a bug that causes segfault in ProcessManager::finalize.

2017-06-21 Thread Jiang Yan Xu
ize() so it segfaulted. Just felt it's not really necessary to fail (and it used to not) in this way? - Jiang Yan --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/60252/#review178522 ----------

Re: Review Request 60103: Changed variable name _ack to statusUpdateAck.

2017-06-21 Thread Jiang Yan Xu
to date and fill out the testing done section, even if it's (e.g.,) "make check together with /r/56895/". - Jiang Yan Xu On June 20, 2017, 8:41 a.m., Megha Sharma wrote: > > --- > This is an automatically generated

Re: Review Request 60105: Added helper method recoverSlaveState.

2017-06-21 Thread Jiang Yan Xu
agent, we are just **not** going to execute `info = slaveState->info.get();` below? src/slave/slave.cpp Line 5965 (original) <https://reviews.apache.org/r/60105/#comment252444> Why remove it? src/slave/slave.cpp Lines 6122-6125 (original) <https://reviews.apache.org/r/60105/#com

Review Request 60252: Fixed a bug that causes segfault in ProcessManager::finalize.

2017-06-20 Thread Jiang Yan Xu
--- We don't need and shouldn't assume pointers in `processes` are non-nullptr. Diffs - 3rdparty/libprocess/src/process.cpp 7ce6d2b13baa68906e091a95c0dd58ee1ca2bc7d Diff: https://reviews.apache.org/r/60252/diff/1/ Testing --- make check. Thanks, Jiang Yan Xu

Re: Review Request 60104: Added rebooted flag to RecoveryInfo and State.

2017-06-20 Thread Jiang Yan Xu
nded and document the commits with more context about what changed and why. - Jiang Yan Xu On June 15, 2017, 12:31 p.m., Megha Sharma wrote: > > --- > This is an automatically generate

Re: Review Request 60103: Changed variable name _ack to statusUpdateAck.

2017-06-19 Thread Jiang Yan Xu
of the variable. If you search `Future _statusUpdateAcknowledgement =` in the same file you can actually see plenty of examples. :) - Jiang Yan Xu On June 15, 2017, 12:30 p.m., Megha Sharma wrote: > > --- > This is an

Re: Review Request 60101: Prevent the fetcher from setting overly-permissive fs permissions.

2017-06-16 Thread Jiang Yan Xu
executor dir using this mode would solve this problem? - Jiang Yan Xu On June 16, 2017, 4:45 p.m., Silas Snider wrote: > > --- > This is an automatically generated e-mail. To reply,

Re: Review Request 59841: Cleaned up use of 'this' pointers in dispatched callback.

2017-06-06 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59841/#review177070 --- Ship it! Ship It! - Jiang Yan Xu On June 6, 2017, 7:48 a.m

Re: Review Request 59734: Show the resources in the allocator CHECK.

2017-06-01 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59734/#review176704 --- Ship it! Ship It! - Jiang Yan Xu On June 1, 2017, 3:35 p.m

Re: Review Request 51879: Autodetect value of resource when not specified in static resources.

2017-05-31 Thread Jiang Yan Xu
rces.cpp Line 619 (original), 619-624 (patched) <https://reviews.apache.org/r/51879/#comment249923> This is exatctly the content of `Resources::fromString` (which was added after we introduced `Resources::fromSimpleString`). - Jiang Yan Xu On May 24, 2017, 12:56 p.m., Anindya Sinha wrote:

Re: Review Request 51879: Autodetect value of resource when not specified in static resources.

2017-05-31 Thread Jiang Yan Xu
> On Dec. 15, 2016, 11:58 p.m., Jiang Yan Xu wrote: > > src/slave/containerizer/containerizer.cpp > > Lines 165-169 (original), 288-305 (patched) > > <https://reviews.apache.org/r/51879/diff/11/?file=1581274#file1581274line327> > > > >

Re: Review Request 59254: Used loop to implement allocator interval-based allocation.

2017-05-30 Thread Jiang Yan Xu
automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59254/#review176348 ----------- On May 30, 2017, 11:12 a.m., Jiang Yan Xu wrote: > > --- > This is a

Re: Review Request 59453: Renamed RegisterAgent.agent to RegisterAgent.agents in acls.proto.

2017-05-30 Thread Jiang Yan Xu
> On May 24, 2017, 10:26 a.m., Jiang Yan Xu wrote: > > Hmm, is this also violating the convention then? > > > > https://github.com/apache/mesos/blob/d225d4d4122e773e2416ba0d0eee653da8ced352/include/mesos/authorizer/acls.proto#L344 > > > > What if later we use

Re: Review Request 59254: Used loop to implement allocator interval-based allocation.

2017-05-30 Thread Jiang Yan Xu
make check. Thanks, Jiang Yan Xu

Re: Review Request 53841: Added metrics for sorting in the role and quota sorters.

2017-05-26 Thread Jiang Yan Xu
is invoked, how much overhead would it cost the sort()? This is probably worth measuring if we add these. - Jiang Yan Xu On May 23, 2017, 9:23 p.m., Anindya Sinha wrote: > > --- > This is an automatically generated e-mail.

Re: Review Request 59453: Renamed RegisterAgent.agent to RegisterAgent.agents in acls.proto.

2017-05-24 Thread Jiang Yan Xu
> On May 24, 2017, 10:26 a.m., Jiang Yan Xu wrote: > > Hmm, is this also violating the convention then? > > > > https://github.com/apache/mesos/blob/d225d4d4122e773e2416ba0d0eee653da8ced352/include/mesos/authorizer/acls.proto#L344 > > > > What if later we use

Re: Review Request 59453: Renamed RegisterAgent.agent to RegisterAgent.agents in acls.proto.

2017-05-24 Thread Jiang Yan Xu
Yan Xu On May 24, 2017, 1:12 a.m., Alexander Rojas wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/59453/ > --

Re: Review Request 59506: Consistently use EXIT() in agent startup.

2017-05-23 Thread Jiang Yan Xu
), 286 (patched) <https://reviews.apache.org/r/59506/#comment249231> Not yours but the trailing period is inconsistent with our convention. Remove it? src/slave/main.cpp Line 293 (original), 291 (patched) <https://reviews.apache.org/r/59506/#comment249232> Ditto. - Jiang

Re: Review Request 53840: Metric in the allocator to track latency in running allocations.

2017-05-23 Thread Jiang Yan Xu
ing.type); EXPECT_GE(timing.as(), 0.0); // The statistics should be generated. foreach (const string& statistic, statistics) { EXPECT_EQ(1u, values.count(statistic)) << "Expected " << statistic << " to

Re: Review Request 55895: Extract a BasicBlocks class for disk block arithmetic.

2017-05-23 Thread Jiang Yan Xu
> On May 12, 2017, 10:13 a.m., Jiang Yan Xu wrote: > > src/slave/containerizer/mesos/isolators/xfs/utils.cpp > > Lines 157-158 (original), 155-156 (patched) > > <https://reviews.apache.org/r/55895/diff/6/?file=1713122#file1713122line157> > > > > Sorry

Re: Review Request 55895: Extract a BasicBlocks class for disk block arithmetic.

2017-05-23 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/55895/#review175768 --- Ship it! Ship It! - Jiang Yan Xu On May 16, 2017, 4:09 p.m

Re: Review Request 55895: Extract a BasicBlocks class for disk block arithmetic.

2017-05-23 Thread Jiang Yan Xu
> On May 12, 2017, 10:13 a.m., Jiang Yan Xu wrote: > > src/slave/containerizer/mesos/isolators/xfs/utils.cpp > > Lines 157-158 (original), 155-156 (patched) > > <https://reviews.apache.org/r/55895/diff/6/?file=1713122#file1713122line157> > > > > Sorry

Re: Review Request 59434: Added a few master log lines.

2017-05-22 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59434/#review175652 --- On May 21, 2017, 10:38 p.m., Jiang Yan Xu wrote: > >

Review Request 59434: Added a few master log lines.

2017-05-21 Thread Jiang Yan Xu
--- - On the agent (re)-registration code paths. - Could be helpful for triaging performance issues. Diffs - src/master/master.cpp 02affe2d6dc76ef91363df04d8d8cbed3beaf34f Diff: https://reviews.apache.org/r/59434/diff/1/ Testing --- make check. Thanks, Jiang Yan Xu

Re: Review Request 59290: Added 'registrar/log/ensemble_size' metric.

2017-05-16 Thread Jiang Yan Xu
167126ee694b Diff: https://reviews.apache.org/r/59290/diff/2/ Changes: https://reviews.apache.org/r/59290/diff/1-2/ Testing --- make check. Thanks, Jiang Yan Xu

Re: Review Request 56681: Use glog to log EXIT() messages.

2017-05-16 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/56681/#review175185 --- Ship it! Ship It! - Jiang Yan Xu On May 16, 2017, 4:19 p.m

Review Request 59300: Updated documentation for `registrar/log/network_size`.

2017-05-15 Thread Jiang Yan Xu
Description --- Updated documentation for `registrar/log/network_size`. Diffs - docs/monitoring.md c42afce0a26dc15e033ee1375b7cb23d55be40ab Diff: https://reviews.apache.org/r/59300/diff/1/ Testing --- Markdown viewer. Thanks, Jiang Yan Xu

Review Request 59290: Added '/log/network_size' metric.

2017-05-15 Thread Jiang Yan Xu
cs.cpp PRE-CREATION src/tests/log_tests.cpp 52b1bfedd8d3f8f2ab3308c4be9f167126ee694b Diff: https://reviews.apache.org/r/59290/diff/1/ Testing --- make check. Thanks, Jiang Yan Xu

Review Request 59289: Refactored log Metrics into separate files.

2017-05-15 Thread Jiang Yan Xu
--- make check. Thanks, Jiang Yan Xu

Re: Review Request 59194: Validate DESTROY operation in `Resources::apply()`.

2017-05-15 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59194/#review175033 --- Ship it! Ship It! - Jiang Yan Xu On May 15, 2017, 11:01 a.m

Re: Review Request 59194: Validate DESTROY operation in `Resources::apply()`.

2017-05-14 Thread Jiang Yan Xu
he code. The error message also reminds the reader about the "additional shared copy". I feel it's clear enough without the sentence. src/tests/resources_tests.cpp Lines 2577 (patched) <https://reviews.apache.org/r/59194/#comment248202> `__total`? - Jiang Yan

Re: Review Request 53840: Metric in the allocator to track latency in running allocations.

2017-05-14 Thread Jiang Yan Xu
- > > (Updated April 21, 2017, 10:53 a.m.) > > > Review request for mesos, James Peach and Jiang Yan Xu. > > > Bugs: MESOS-6579 > https://issues.apache.org/jira/browse/MESOS-6579 > > > Repository: mesos > > > Description > ---

Re: Review Request 53840: Metric in the allocator to track latency in running allocations.

2017-05-14 Thread Jiang Yan Xu
g the same for the new metric. Can we create an independent test? src/tests/hierarchical_allocator_tests.cpp Line 3544 (original), 3544 (patched) <https://reviews.apache.org/r/53840/#comment248195> Can it realistically be 0.0? - Jiang Yan Xu On April 21, 2017, 10:53 a

Review Request 59254: Used loop to implement allocator interval-based allocation.

2017-05-12 Thread Jiang Yan Xu
chical.hpp 123f97cf495bff0f822838e09df0d88818f04da6 src/master/allocator/mesos/hierarchical.cpp b75ed9a20a9a42f958cebbacd91e5e15b0d21394 Diff: https://reviews.apache.org/r/59254/diff/1/ Testing --- make check. Thanks, Jiang Yan Xu

Re: Review Request 56681: Use glog to log EXIT() messages.

2017-05-12 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/56681/#review174837 --- Could you update the "testing done" section? - Jiang Y

Re: Review Request 59194: Validate DESTROY operation in `Resources::apply()`.

2017-05-12 Thread Jiang Yan Xu
Why are we testing CREATE? This test can just literally be a DESTROY operation on a resources object with two volumes (which is simpler) right? - Jiang Yan Xu On May 11, 2017, 1:21 p.m., Anindya Sinha wrote: > > --- > This is a

Re: Review Request 55895: Extract a BasicBlocks class for disk block arithmetic.

2017-05-12 Thread Jiang Yan Xu
> On May 12, 2017, 10:13 a.m., Jiang Yan Xu wrote: > > src/slave/containerizer/mesos/isolators/xfs/utils.cpp > > Lines 157-158 (original), 155-156 (patched) > > <https://reviews.apache.org/r/55895/diff/6/?file=1713122#file1713122line157> > > > > Sorry

Re: Review Request 55895: Extract a BasicBlocks class for disk block arithmetic.

2017-05-12 Thread Jiang Yan Xu
low `limit == 1` if we allow `limit == 513`? Since we don't need `BasicBlocks::BASIC_BLOCK_SIZE` here, we can make it private. Even in some hypothetical scenarios where we needed to compare bytes and BasicBlocks, it should probably be `limit < BasicBlocks(1).bytes()` or we can m

Re: Review Request 55903: Update XFS disk isolator documentation.

2017-05-11 Thread Jiang Yan Xu
(patched) <https://reviews.apache.org/r/55903/#comment247915> s/only// - Jiang Yan Xu On May 11, 2017, 10:55 a.m., James Peach wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: Review Request 56680: Use the EXIT() macro more consistently in agent startup.

2017-05-11 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/56680/#review174611 --- Ship it! Ship It! - Jiang Yan Xu On May 8, 2017, 4:29 p.m

Re: Review Request 55903: Update XFS disk isolator documentation.

2017-05-10 Thread Jiang Yan Xu
n just paste this command to get what they want if they use the isolator. - Jiang Yan Xu On April 25, 2017, 3:38 p.m., James Peach wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > http

Re: Review Request 55897: Add support for not enforcing XFS quotas.

2017-05-10 Thread Jiang Yan Xu
he.org/r/55897/#comment247788> Ditto. - Jiang Yan Xu On May 2, 2017, 10:23 a.m., James Peach wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https

Re: Review Request 59154: Added workaround to unbreak the build with glibc <= 2.12.

2017-05-10 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59154/#review174530 --- Ship it! Ship It! - Jiang Yan Xu On May 10, 2017, 11:59 a.m

Re: Review Request 55895: Extract a BasicBlocks class for disk block arithmetic.

2017-05-09 Thread Jiang Yan Xu
ent247527> We can group the two statements and remove the redundant "// A partial block should round up."? - Jiang Yan Xu On April 29, 2017, 10:41 a.m., James Peach wrote: > > --- > This is an automatically generated e

Re: Review Request 58587: Clarified comments about resource operations through operator API.

2017-05-09 Thread Jiang Yan Xu
src/master/http.cpp e2590a17044ac019b24a24629428d4ec8adc0c31 Diff: https://reviews.apache.org/r/58587/diff/2/ Changes: https://reviews.apache.org/r/58587/diff/1-2/ Testing --- N/A Thanks, Jiang Yan Xu

Re: Review Request 58587: Clarified comments about resource operations through operator API.

2017-05-09 Thread Jiang Yan Xu
don't get what "a > > persistent volume can be destroyed if it is not allocated" means.. > > Jiang Yan Xu wrote: > Ok I guess I shoud say "a persistent volume can be destroyed only if it > is not used". In this case, it's not going to be pendi

Re: Review Request 56681: Use glog to log EXIT() messages.

2017-05-08 Thread Jiang Yan Xu
it: > https://reviews.apache.org/r/56681/ > --- > > (Updated May 8, 2017, 4:30 p.m.) > > > Review request for mesos, haosdent huang and Jiang Yan Xu. > > > Bugs: MESOS-7115 > https://issues.apache.org/jira/browse/MESOS-7115

Re: Review Request 57964: Added a test to verify metrics when shared resources are present.

2017-05-03 Thread Jiang Yan Xu
/persistent_volume_tests.cpp Lines 1192 (patched) <https://reviews.apache.org/r/57964/#comment246757> s/populated/correctly populated/ - Jiang Yan Xu On May 2, 2017, 10:54 a.m., Anindya Sinha wrote: > > --- > This is an automatica

Re: Review Request 57963: Metrics for used resources should incorporate shared resources.

2017-05-03 Thread Jiang Yan Xu
- > > (Updated May 2, 2017, 10:53 a.m.) > > > Review request for mesos and Jiang Yan Xu. > > > Bugs: MESOS-7186 > https://issues.apache.org/jira/browse/MESOS-7186 > > > Repository: mesos > > > Description > --- > > T

Re: Review Request 58892: Added C++11 scoped enumeration to style guide.

2017-05-02 Thread Jiang Yan Xu
58892/diff/1-2/ Testing --- Markdown viewer. Thanks, Jiang Yan Xu

Re: Review Request 58892: Added C++11 scoped enumeration to style guide.

2017-05-02 Thread Jiang Yan Xu
s to which one > > should be used? +1. - Jiang Yan --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58892/#review173566 -----------

Re: Review Request 58587: Clarified comments about resource operations through operator API.

2017-05-02 Thread Jiang Yan Xu
views.apache.org/r/58587/#review173561 --- On May 1, 2017, 2:29 p.m., Jiang Yan Xu wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://revie

Re: Review Request 58916: Fixed a minor bug in setting the agent's `totalResources`.

2017-05-02 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58916/#review173597 --- Ship it! Ship It! - Jiang Yan Xu On May 2, 2017, 1:26 a.m

Re: Review Request 57964: Added a test to verify metrics when shared resources are present.

2017-05-01 Thread Jiang Yan Xu
- > > (Updated April 22, 2017, 10 a.m.) > > > Review request for mesos and Jiang Yan Xu. > > > Bugs: MESOS-7186 > https://issues.apache.org/jira/browse/MESOS-7186 > > > Repository: mesos > > > Description > --- > > Adde

Re: Review Request 57963: Metrics for used resources should incorporate shared resources.

2017-05-01 Thread Jiang Yan Xu
We could use the same wording for the `slaveUsed` case above so all of these comments are consistent (which was my original suggestion). - Jiang Yan Xu On April 22, 2017, 10 a.m., Anindya Sinha wrote: > > --- > This i

Review Request 58587: Clarified comments about resource operations through operator API.

2017-05-01 Thread Jiang Yan Xu
e.org/r/58587/diff/1/ Testing --- N/A Thanks, Jiang Yan Xu

Review Request 58892: Added C++11 scoped enumeration to style guide.

2017-05-01 Thread Jiang Yan Xu
--- We've been using it for new code now. Diffs - docs/c++-style-guide.md ccb81f48e2edc9c1e7c328cc26e44d658b4c43b4 Diff: https://reviews.apache.org/r/58892/diff/1/ Testing --- Markdown viewer. Thanks, Jiang Yan Xu

Re: Review Request 55897: Add support for not enforcing XFS quotas.

2017-04-30 Thread Jiang Yan Xu
isk_used_bytes()` is even if I know it's below `usage->has_disk_limit_bytes()`: it being zero vs. not may help me debug. ``` ASSERT_FALSE(timeout.expired()) << "Disk usage failed to reach " << usage->has_disk_limit_bytes() << " when tim

Re: Review Request 55895: Extract a BasicBlocks class for disk block arithmetic.

2017-04-28 Thread Jiang Yan Xu
Let's chat if you feel strongly about advocating for this style. src/tests/containerizer/xfs_quota_tests.cpp Lines 948 (patched) <https://reviews.apache.org/r/55895/#comment246422> Be consistent in the use of unsigned literal. - Jiang Yan Xu On April 25, 2017, 3:37

Re: Review Request 56732: Remove unnecessary perf version checks.

2017-04-28 Thread Jiang Yan Xu
> On April 28, 2017, 4:06 p.m., Jiang Yan Xu wrote: > > src/linux/perf.cpp > > Line 322 (original), 313 (patched) > > <https://reviews.apache.org/r/56732/diff/1/?file=1635867#file1635867line322> > > > > Now without the `process::collect`. &

Re: Review Request 56732: Remove unnecessary perf version checks.

2017-04-28 Thread Jiang Yan Xu
le: " + result.error()); } foreachvalue (mesos::PerfStatistics& statistics, result.get()) { statistics.set_timestamp(start.secs()); statistics.set_duration(duration.secs()); } return result.get(); }); ``` - Jiang Yan Xu On Fe

Re: Review Request 57534: Added and implemented RegisterAgent ACL.

2017-04-28 Thread Jiang Yan Xu
://reviews.apache.org/r/57534/diff/9/ Changes: https://reviews.apache.org/r/57534/diff/8-9/ Testing --- make check. Thanks, Jiang Yan Xu

Re: Review Request 57534: Added and implemented RegisterAgent ACL.

2017-04-26 Thread Jiang Yan Xu
://reviews.apache.org/r/57534/diff/8/ Changes: https://reviews.apache.org/r/57534/diff/7-8/ Testing --- make check. Thanks, Jiang Yan Xu

Review Request 58676: Logged when an agent (re-)registration request is received.

2017-04-25 Thread Jiang Yan Xu
/r/58676/diff/1/ Testing --- make check. Thanks, Jiang Yan Xu

Re: Review Request 57535: Applied RegisterAgent ACL to the master.

2017-04-25 Thread Jiang Yan Xu
/7-8/ Testing --- make check. The tests added here cover some basic scenarios, I have more tests but will add them when MESOS-7244 is fixed. Thanks, Jiang Yan Xu

Re: Review Request 55897: Add support for not enforcing XFS quotas.

2017-04-24 Thread Jiang Yan Xu
> On April 23, 2017, 10:48 p.m., Jiang Yan Xu wrote: > > src/slave/containerizer/mesos/isolators/xfs/utils.hpp > > Lines 65 (patched) > > <https://reviews.apache.org/r/55897/diff/2/?file=1667425#file1667425line65> > > > > We started to move toward `

Re: Review Request 55897: Add support for not enforcing XFS quotas.

2017-04-23 Thread Jiang Yan Xu
ment mode and don't set it at all in the accounting-only mode? I could be totally mistaken but if I am, we should improve the documentation to clarify for the readers. - Jiang Yan Xu On March 17, 2017, 2:57 p.m., James Peach wrote: > >

Re: Review Request 57964: Added a test to verify metrics when shared resources are present.

2017-04-21 Thread Jiang Yan Xu
4> "sleep 1000" above but "sleep 500" here? Keep them consistent ("sleep 1000")? src/tests/persistent_volume_tests.cpp Lines 1326-1327 (patched) <https://reviews.apache.org/r/57964/#comment245769> Actually this doesn't look necessary, we already wait for

Re: Review Request 57963: Metrics for used resources should incorporate shared resources.

2017-04-21 Thread Jiang Yan Xu
> On April 21, 2017, 10:37 a.m., Jiang Yan Xu wrote: > > LGTM! > > > > Can we have a test? It doesn't have to be a standalone test if we already > > have a test that just launches tasks from two frameworks, then we can just > > add it to the test? If not

Re: Review Request 57963: Metrics for used resources should incorporate shared resources.

2017-04-21 Thread Jiang Yan Xu
ttps://reviews.apache.org/r/57963/#comment245734> Ditto. - Jiang Yan Xu On March 27, 2017, 3:27 p.m., Anindya Sinha wrote: > > --- > This is an automatically generated e-mail. To reply, visit:

Re: Review Request 57730: Fixed example tests which broke due to the new `register_agents` ACL.

2017-04-20 Thread Jiang Yan Xu
) - src/tests/script.cpp 3b68b845b06fe19acb8b08e1ff3dd0bec9117f05 Diff: https://reviews.apache.org/r/57730/diff/2/ Changes: https://reviews.apache.org/r/57730/diff/1-2/ Testing --- make check Thanks, Jiang Yan Xu

Re: Review Request 57730: Fixed example tests which broke due to the new `register_agents` ACL.

2017-04-20 Thread Jiang Yan Xu
sts, so I'd > > expect the agents to try to register without authentication. Should we > > enable agent authentication (and authorization) by default in the tests, > > and only disable it for the rare few tests that don't need it? > > Jiang Yan Xu wrote: > G

Re: Review Request 57535: Applied RegisterAgent ACL to the master.

2017-04-20 Thread Jiang Yan Xu
/57535/diff/6-7/ Testing --- make check. The tests added here cover some basic scenarios, I have more tests but will add them when MESOS-7244 is fixed. Thanks, Jiang Yan Xu

Re: Review Request 58487: Fix allocation quantities when shared resources are removed.

2017-04-20 Thread Jiang Yan Xu
`newAllocation` have the same quantity and then do not modify `allocations[name].scalarQuantities` or `allocations[name].totals[resource.name()]` at all. This is basically what the other does? - Jiang Yan Xu On April 18, 2017, 7:50 p.m., Ani

Re: Review Request 58486: Fixed a race in `updateAllocation()` on DESTORY of a shared volume.

2017-04-20 Thread Jiang Yan Xu
ered out due to being removed from `slave.total` in the allocator, the allocator is itself running and the framework's incorrect allocation can cause issue, e.g., fairness, although there are probably more severe problems. - Jiang Yan Xu On April 18, 2017, 7:50 p.m., Anindya Sinha wrote: >

Re: Review Request 58485: Avoid a corruption while rescinding offers.

2017-04-18 Thread Jiang Yan Xu
eviews.apache.org/r/58485/#comment245379> s/offers/offer/? - Jiang Yan Xu On April 17, 2017, 4:14 p.m., Anindya Sinha wrote: > > --- > This is an automatically generated e-mail. To reply, visit:

Re: Review Request 57730: Fixed example tests which broke due to the new `register_agents` ACL.

2017-04-12 Thread Jiang Yan Xu
- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57730/#review171536 ----------- On March 17, 2017, 8:53 a.m., Jiang Yan Xu wrote: > > ---

Re: Review Request 57535: Applied RegisterAgent ACL to the master.

2017-03-28 Thread Jiang Yan Xu
until we determine their fate. hashmap recovered; ``` - Jiang Yan --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57535/#review170056 -

Re: Review Request 57535: Applied RegisterAgent ACL to the master.

2017-03-28 Thread Jiang Yan Xu
-6/ Testing --- make check. The tests added here cover some basic scenarios, I have more tests but will add them when MESOS-7244 is fixed. Thanks, Jiang Yan Xu

Re: Review Request 57534: Added and implemented RegisterAgent ACL.

2017-03-28 Thread Jiang Yan Xu
://reviews.apache.org/r/57534/diff/6/ Changes: https://reviews.apache.org/r/57534/diff/5-6/ Testing --- make check. Thanks, Jiang Yan Xu

Re: Review Request 57963: Metrics for used resources should incorporate shared resources.

2017-03-27 Thread Jiang Yan Xu
rces.nonRevocable(); } used += slaveUsed.get(name).getOrElse(Value::Scalar()).value(); } return used; } ``` Here and below. - Jiang Yan Xu On March 27, 2017, 11:26 a.m., Anindya Sinha wrote: > > ---

Re: Review Request 57535: Applied RegisterAgent ACL to the master.

2017-03-21 Thread Jiang Yan Xu
://reviews.apache.org/r/57535/diff/5/ Changes: https://reviews.apache.org/r/57535/diff/4-5/ Testing --- make check. The tests added here cover some basic scenarios, I have more tests but will add them when MESOS-7244 is fixed. Thanks, Jiang Yan Xu

Re: Review Request 56680: Apply glog to agent exit messages.

2017-03-20 Thread Jiang Yan Xu
cy does exist for this case elsewhere but to make this method more consistency let's follow the general principle of not printing backtrace in cases where failures are due to external conditions. src/slave/slave.cpp Lines 5546-5552 (original), 5570-5577 (patched) <https://r

Re: Review Request 57535: Applied RegisterAgent ACL to the master.

2017-03-19 Thread Jiang Yan Xu
ing in the agent's reregistration code path to verify? Good catch. I created a `slaveFlags` above but forgot to use it. I should've used `FUTURE_MESSAGE(Eq(SlaveReregisteredMessage().GetTypeName()), _, _);` and that should confirm it. - Jiang Yan ----------

Re: Review Request 57535: Applied RegisterAgent ACL to the master.

2017-03-19 Thread Jiang Yan Xu
added here cover some basic scenarios, I have more tests but will add them when MESOS-7244 is fixed. Thanks, Jiang Yan Xu

Re: Review Request 57534: Added and implemented RegisterAgent ACL.

2017-03-19 Thread Jiang Yan Xu
://reviews.apache.org/r/57534/diff/4/ Changes: https://reviews.apache.org/r/57534/diff/3-4/ Testing --- make check. Thanks, Jiang Yan Xu

Re: Review Request 57534: Added and implemented RegisterAgent ACL.

2017-03-19 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57534/#review169323 ----------- On March 14, 2017, 5:40 p.m., Jiang Yan Xu wrote: > > --

Re: Review Request 57739: Completed frameworks should be tracked based on source.

2017-03-18 Thread Jiang Yan Xu
ivate: BoundedHashMap frameworkIds; BoundedHashMap pids; BoundedHashMap> streamIds; } completed; } frameworks; ``` src/master/master.cpp Lines 2654 (patched) <https://reviews.apache.org/r/57739/#comment241730> Keep the error message consistent: "F

Re: Review Request 56895: Allow agents to recover slave state post a reboot.

2017-03-17 Thread Jiang Yan Xu
-- > > (Updated March 16, 2017, 11:25 a.m.) > > > Review request for mesos, Neil Conway and Jiang Yan Xu. > > > Bugs: MESOS-6223 > https://issues.apache.org/jira/browse/MESOS-6223 > > > Repository: mesos > > > Description > ---

Re: Review Request 57712: No need to set `agent_subsystems` for all the slave tests.

2017-03-17 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57712/#review169259 --- Ship it! - Jiang Yan Xu On March 16, 2017, 5 p.m., Anindya

Review Request 57731: Fix a test in MasterAuthorizationTest.

2017-03-17 Thread Jiang Yan Xu
true. Diffs - src/tests/master_authorization_tests.cpp 1a0285a3f345ef21a8256d4123d8bb684f538da4 Diff: https://reviews.apache.org/r/57731/diff/1/ Testing --- make check. Thanks, Jiang Yan Xu

Review Request 57730: Fixed example tests which broke due to the new `register_agents` ACL.

2017-03-17 Thread Jiang Yan Xu
: https://reviews.apache.org/r/57730/diff/1/ Testing --- make check Thanks, Jiang Yan Xu

Re: Review Request 57710: Added `register_agents` to authorization.md.

2017-03-16 Thread Jiang Yan Xu
://reviews.apache.org/r/57710/diff/1/ Testing (updated) --- via a markdown viewer. Thanks, Jiang Yan Xu

<    1   2   3   4   5   6   7   8   9   10   >