Hi June

are you running Mesos as root, or a non-privileged user? Non-root
won't be able to up their own ulimit too high
(sorry, not an upstart expert as RHELs is laughably incomplete).

On 25 April 2016 at 19:15, June Taylor <[email protected]> wrote:
> What I'm saying is even putting them within the upstart script, per the
> Mesos documentation, isn't working for the file block limit. We're still
> getting 8MB useable, and as a result executors fail when attempting to write
> larger files.
>
>
> Thanks,
> June Taylor
> System Administrator, Minnesota Population Center
> University of Minnesota
>
> On Mon, Apr 25, 2016 at 11:53 AM, haosdent <[email protected]> wrote:
>>
>> If you set in your upstart script, it isn't system wide and only effective
>> in that session. I think need change /etc/security/limits.conf and
>> /etc/sysctl.conf to make your ulimit work globally.
>>
>> On Tue, Apr 26, 2016 at 12:43 AM, June Taylor <[email protected]> wrote:
>>>
>>> Somewhere an 8MB maximum file size is being applied on just one of our
>>> slaves, for example.
>>>
>>>
>>> Thanks,
>>> June Taylor
>>> System Administrator, Minnesota Population Center
>>> University of Minnesota
>>>
>>> On Mon, Apr 25, 2016 at 11:42 AM, June Taylor <[email protected]> wrote:
>>>>
>>>> We are operating a 6-node cluster running on Ubuntu, and have noticed
>>>> that the ulimit settings within the slave context are difficult to set and
>>>> predict.
>>>>
>>>> The documentation is a bit unclear on this point, as well.
>>>>
>>>> We have had some luck adding a configuration line to
>>>> /etc/init/mesos-slave.conf as follows:
>>>> limit nofile 20000 20000
>>>> limit fsize unlimited unlimited
>>>>
>>>> The nofile limit seems to be respected, however the fsize limit does
>>>> not.
>>>>
>>>> It is also mysterious that the system-wide limits are not inherited by
>>>> the slave process. We would prefer to set all of these system-wide and have
>>>> mesos-slave observe them.
>>>>
>>>> Can you please advise where you are setting your ulimits for the
>>>> mesos-slave if it is working for you?
>>>>
>>>> Thanks,
>>>> June Taylor
>>>> System Administrator, Minnesota Population Center
>>>> University of Minnesota
>>>
>>>
>>
>>
>>
>> --
>> Best Regards,
>> Haosdent Huang
>
>

Reply via email to