[jira] [Updated] (MESOS-6001) Aufs backend cannot support the image with numerous layers.

2017-02-07 Thread Alexander Rukletsov (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alexander Rukletsov updated MESOS-6001:
---
Target Version/s: 1.2.0  (was: 1.1.1, 1.2.0)

> Aufs backend cannot support the image with numerous layers.
> ---
>
> Key: MESOS-6001
> URL: https://issues.apache.org/jira/browse/MESOS-6001
> Project: Mesos
>  Issue Type: Bug
>  Components: containerization
> Environment: Ubuntu 14, Ubuntu 12
> Or any other os with aufs module
>Reporter: Gilbert Song
>Assignee: Gilbert Song
>Priority: Critical
>  Labels: aufs, backend, containerizer
> Fix For: 1.2.0
>
>
> This issue was exposed in this unit test 
> `ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller` by manually 
> specifying the `bind` backend. Most likely mounting the aufs with specific 
> options is limited by string length.
> {noformat}
> [20:13:07] :   [Step 10/10] [ RUN  ] 
> DockerRuntimeIsolatorTest.ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.615844 23416 cluster.cpp:155] 
> Creating default 'local' authorizer
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.624106 23416 leveldb.cpp:174] 
> Opened db in 8.148813ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627252 23416 leveldb.cpp:181] 
> Compacted db in 3.126629ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627275 23416 leveldb.cpp:196] 
> Created db iterator in 4410ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627282 23416 leveldb.cpp:202] 
> Seeked to beginning of db in 763ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627287 23416 leveldb.cpp:271] 
> Iterated through 0 keys in the db in 491ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627301 23416 replica.cpp:776] 
> Replica recovered with log positions 0 -> 0 with 1 holes and 0 unlearned
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627563 23434 recover.cpp:451] 
> Starting replica recovery
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627800 23437 recover.cpp:477] 
> Replica is in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628113 23431 replica.cpp:673] 
> Replica in EMPTY status received a broadcasted recover request from 
> __req_res__(5852)@172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628243 23430 recover.cpp:197] 
> Received a recover response from a replica in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628365 23437 recover.cpp:568] 
> Updating replica status to STARTING
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628744 23432 master.cpp:375] 
> Master dd755a55-0dd1-4d2d-9a49-812a666015cb (ip-172-30-2-138.mesosphere.io) 
> started on 172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628758 23432 master.cpp:377] Flags 
> at startup: --acls="" --agent_ping_timeout="15secs" 
> --agent_reregister_timeout="10mins" --allocation_interval="1secs" 
> --allocator="HierarchicalDRF" --authenticate_agents="true" 
> --authenticate_frameworks="true" --authenticate_http_frameworks="true" 
> --authenticate_http_readonly="true" --authenticate_http_readwrite="true" 
> --authenticators="crammd5" --authorizers="local" 
> --credentials="/tmp/OZHDIQ/credentials" --framework_sorter="drf" 
> --help="false" --hostname_lookup="true" --http_authenticators="basic" 
> --http_framework_authenticators="basic" --initialize_driver_logging="true" 
> --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" 
> --max_agent_ping_timeouts="5" --max_completed_frameworks="50" 
> --max_completed_tasks_per_framework="1000" --quiet="false" 
> --recovery_agent_removal_limit="100%" --registry="replicated_log" 
> --registry_fetch_timeout="1mins" --registry_store_timeout="100secs" 
> --registry_strict="true" --root_submissions="true" --user_sorter="drf" 
> --version="false" --webui_dir="/usr/local/share/mesos/webui" 
> --work_dir="/tmp/OZHDIQ/master" --zk_session_timeout="10secs"
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628893 23432 master.cpp:427] 
> Master only allowing authenticated frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628900 23432 master.cpp:441] 
> Master only allowing authenticated agents to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628902 23432 master.cpp:454] 
> Master only allowing authenticated HTTP frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628906 23432 credentials.hpp:37] 
> Loading credentials for authentication from '/tmp/OZHDIQ/credentials'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628999 23432 master.cpp:499] Using 
> default 'crammd5' authenticator
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629041 23432 http.cpp:883] Using 
> default 'basic' HTTP authenticator for realm 'mesos-master-readonly'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629114 23432 http.cpp:883] 

[jira] [Updated] (MESOS-6001) Aufs backend cannot support the image with numerous layers.

2017-01-19 Thread Gilbert Song (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gilbert Song updated MESOS-6001:

Priority: Critical  (was: Blocker)

> Aufs backend cannot support the image with numerous layers.
> ---
>
> Key: MESOS-6001
> URL: https://issues.apache.org/jira/browse/MESOS-6001
> Project: Mesos
>  Issue Type: Bug
>  Components: containerization
> Environment: Ubuntu 14, Ubuntu 12
> Or any other os with aufs module
>Reporter: Gilbert Song
>Assignee: Gilbert Song
>Priority: Critical
>  Labels: aufs, backend, containerizer
>
> This issue was exposed in this unit test 
> `ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller` by manually 
> specifying the `bind` backend. Most likely mounting the aufs with specific 
> options is limited by string length.
> {noformat}
> [20:13:07] :   [Step 10/10] [ RUN  ] 
> DockerRuntimeIsolatorTest.ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.615844 23416 cluster.cpp:155] 
> Creating default 'local' authorizer
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.624106 23416 leveldb.cpp:174] 
> Opened db in 8.148813ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627252 23416 leveldb.cpp:181] 
> Compacted db in 3.126629ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627275 23416 leveldb.cpp:196] 
> Created db iterator in 4410ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627282 23416 leveldb.cpp:202] 
> Seeked to beginning of db in 763ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627287 23416 leveldb.cpp:271] 
> Iterated through 0 keys in the db in 491ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627301 23416 replica.cpp:776] 
> Replica recovered with log positions 0 -> 0 with 1 holes and 0 unlearned
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627563 23434 recover.cpp:451] 
> Starting replica recovery
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627800 23437 recover.cpp:477] 
> Replica is in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628113 23431 replica.cpp:673] 
> Replica in EMPTY status received a broadcasted recover request from 
> __req_res__(5852)@172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628243 23430 recover.cpp:197] 
> Received a recover response from a replica in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628365 23437 recover.cpp:568] 
> Updating replica status to STARTING
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628744 23432 master.cpp:375] 
> Master dd755a55-0dd1-4d2d-9a49-812a666015cb (ip-172-30-2-138.mesosphere.io) 
> started on 172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628758 23432 master.cpp:377] Flags 
> at startup: --acls="" --agent_ping_timeout="15secs" 
> --agent_reregister_timeout="10mins" --allocation_interval="1secs" 
> --allocator="HierarchicalDRF" --authenticate_agents="true" 
> --authenticate_frameworks="true" --authenticate_http_frameworks="true" 
> --authenticate_http_readonly="true" --authenticate_http_readwrite="true" 
> --authenticators="crammd5" --authorizers="local" 
> --credentials="/tmp/OZHDIQ/credentials" --framework_sorter="drf" 
> --help="false" --hostname_lookup="true" --http_authenticators="basic" 
> --http_framework_authenticators="basic" --initialize_driver_logging="true" 
> --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" 
> --max_agent_ping_timeouts="5" --max_completed_frameworks="50" 
> --max_completed_tasks_per_framework="1000" --quiet="false" 
> --recovery_agent_removal_limit="100%" --registry="replicated_log" 
> --registry_fetch_timeout="1mins" --registry_store_timeout="100secs" 
> --registry_strict="true" --root_submissions="true" --user_sorter="drf" 
> --version="false" --webui_dir="/usr/local/share/mesos/webui" 
> --work_dir="/tmp/OZHDIQ/master" --zk_session_timeout="10secs"
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628893 23432 master.cpp:427] 
> Master only allowing authenticated frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628900 23432 master.cpp:441] 
> Master only allowing authenticated agents to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628902 23432 master.cpp:454] 
> Master only allowing authenticated HTTP frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628906 23432 credentials.hpp:37] 
> Loading credentials for authentication from '/tmp/OZHDIQ/credentials'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628999 23432 master.cpp:499] Using 
> default 'crammd5' authenticator
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629041 23432 http.cpp:883] Using 
> default 'basic' HTTP authenticator for realm 'mesos-master-readonly'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629114 23432 http.cpp:883] Using 
> default 'basic' HTTP authenticator for realm 

[jira] [Updated] (MESOS-6001) Aufs backend cannot support the image with numerous layers.

2017-01-19 Thread Gilbert Song (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gilbert Song updated MESOS-6001:

Sprint: Mesosphere Sprint 47, Mesosphere Sprint 48, Mesosphere Sprint 50  
(was: Mesosphere Sprint 47, Mesosphere Sprint 48, Mesosphere Sprint 49)

> Aufs backend cannot support the image with numerous layers.
> ---
>
> Key: MESOS-6001
> URL: https://issues.apache.org/jira/browse/MESOS-6001
> Project: Mesos
>  Issue Type: Bug
>  Components: containerization
> Environment: Ubuntu 14, Ubuntu 12
> Or any other os with aufs module
>Reporter: Gilbert Song
>Assignee: Gilbert Song
>Priority: Blocker
>  Labels: aufs, backend, containerizer
>
> This issue was exposed in this unit test 
> `ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller` by manually 
> specifying the `bind` backend. Most likely mounting the aufs with specific 
> options is limited by string length.
> {noformat}
> [20:13:07] :   [Step 10/10] [ RUN  ] 
> DockerRuntimeIsolatorTest.ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.615844 23416 cluster.cpp:155] 
> Creating default 'local' authorizer
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.624106 23416 leveldb.cpp:174] 
> Opened db in 8.148813ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627252 23416 leveldb.cpp:181] 
> Compacted db in 3.126629ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627275 23416 leveldb.cpp:196] 
> Created db iterator in 4410ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627282 23416 leveldb.cpp:202] 
> Seeked to beginning of db in 763ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627287 23416 leveldb.cpp:271] 
> Iterated through 0 keys in the db in 491ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627301 23416 replica.cpp:776] 
> Replica recovered with log positions 0 -> 0 with 1 holes and 0 unlearned
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627563 23434 recover.cpp:451] 
> Starting replica recovery
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627800 23437 recover.cpp:477] 
> Replica is in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628113 23431 replica.cpp:673] 
> Replica in EMPTY status received a broadcasted recover request from 
> __req_res__(5852)@172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628243 23430 recover.cpp:197] 
> Received a recover response from a replica in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628365 23437 recover.cpp:568] 
> Updating replica status to STARTING
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628744 23432 master.cpp:375] 
> Master dd755a55-0dd1-4d2d-9a49-812a666015cb (ip-172-30-2-138.mesosphere.io) 
> started on 172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628758 23432 master.cpp:377] Flags 
> at startup: --acls="" --agent_ping_timeout="15secs" 
> --agent_reregister_timeout="10mins" --allocation_interval="1secs" 
> --allocator="HierarchicalDRF" --authenticate_agents="true" 
> --authenticate_frameworks="true" --authenticate_http_frameworks="true" 
> --authenticate_http_readonly="true" --authenticate_http_readwrite="true" 
> --authenticators="crammd5" --authorizers="local" 
> --credentials="/tmp/OZHDIQ/credentials" --framework_sorter="drf" 
> --help="false" --hostname_lookup="true" --http_authenticators="basic" 
> --http_framework_authenticators="basic" --initialize_driver_logging="true" 
> --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" 
> --max_agent_ping_timeouts="5" --max_completed_frameworks="50" 
> --max_completed_tasks_per_framework="1000" --quiet="false" 
> --recovery_agent_removal_limit="100%" --registry="replicated_log" 
> --registry_fetch_timeout="1mins" --registry_store_timeout="100secs" 
> --registry_strict="true" --root_submissions="true" --user_sorter="drf" 
> --version="false" --webui_dir="/usr/local/share/mesos/webui" 
> --work_dir="/tmp/OZHDIQ/master" --zk_session_timeout="10secs"
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628893 23432 master.cpp:427] 
> Master only allowing authenticated frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628900 23432 master.cpp:441] 
> Master only allowing authenticated agents to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628902 23432 master.cpp:454] 
> Master only allowing authenticated HTTP frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628906 23432 credentials.hpp:37] 
> Loading credentials for authentication from '/tmp/OZHDIQ/credentials'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628999 23432 master.cpp:499] Using 
> default 'crammd5' authenticator
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629041 23432 http.cpp:883] Using 
> default 'basic' HTTP authenticator for realm 'mesos-master-readonly'
> [20:13:07]W:   

[jira] [Updated] (MESOS-6001) Aufs backend cannot support the image with numerous layers.

2017-01-19 Thread Gilbert Song (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gilbert Song updated MESOS-6001:

Priority: Blocker  (was: Major)

> Aufs backend cannot support the image with numerous layers.
> ---
>
> Key: MESOS-6001
> URL: https://issues.apache.org/jira/browse/MESOS-6001
> Project: Mesos
>  Issue Type: Bug
>  Components: containerization
> Environment: Ubuntu 14, Ubuntu 12
> Or any other os with aufs module
>Reporter: Gilbert Song
>Assignee: Gilbert Song
>Priority: Blocker
>  Labels: aufs, backend, containerizer
>
> This issue was exposed in this unit test 
> `ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller` by manually 
> specifying the `bind` backend. Most likely mounting the aufs with specific 
> options is limited by string length.
> {noformat}
> [20:13:07] :   [Step 10/10] [ RUN  ] 
> DockerRuntimeIsolatorTest.ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.615844 23416 cluster.cpp:155] 
> Creating default 'local' authorizer
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.624106 23416 leveldb.cpp:174] 
> Opened db in 8.148813ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627252 23416 leveldb.cpp:181] 
> Compacted db in 3.126629ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627275 23416 leveldb.cpp:196] 
> Created db iterator in 4410ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627282 23416 leveldb.cpp:202] 
> Seeked to beginning of db in 763ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627287 23416 leveldb.cpp:271] 
> Iterated through 0 keys in the db in 491ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627301 23416 replica.cpp:776] 
> Replica recovered with log positions 0 -> 0 with 1 holes and 0 unlearned
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627563 23434 recover.cpp:451] 
> Starting replica recovery
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627800 23437 recover.cpp:477] 
> Replica is in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628113 23431 replica.cpp:673] 
> Replica in EMPTY status received a broadcasted recover request from 
> __req_res__(5852)@172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628243 23430 recover.cpp:197] 
> Received a recover response from a replica in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628365 23437 recover.cpp:568] 
> Updating replica status to STARTING
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628744 23432 master.cpp:375] 
> Master dd755a55-0dd1-4d2d-9a49-812a666015cb (ip-172-30-2-138.mesosphere.io) 
> started on 172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628758 23432 master.cpp:377] Flags 
> at startup: --acls="" --agent_ping_timeout="15secs" 
> --agent_reregister_timeout="10mins" --allocation_interval="1secs" 
> --allocator="HierarchicalDRF" --authenticate_agents="true" 
> --authenticate_frameworks="true" --authenticate_http_frameworks="true" 
> --authenticate_http_readonly="true" --authenticate_http_readwrite="true" 
> --authenticators="crammd5" --authorizers="local" 
> --credentials="/tmp/OZHDIQ/credentials" --framework_sorter="drf" 
> --help="false" --hostname_lookup="true" --http_authenticators="basic" 
> --http_framework_authenticators="basic" --initialize_driver_logging="true" 
> --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" 
> --max_agent_ping_timeouts="5" --max_completed_frameworks="50" 
> --max_completed_tasks_per_framework="1000" --quiet="false" 
> --recovery_agent_removal_limit="100%" --registry="replicated_log" 
> --registry_fetch_timeout="1mins" --registry_store_timeout="100secs" 
> --registry_strict="true" --root_submissions="true" --user_sorter="drf" 
> --version="false" --webui_dir="/usr/local/share/mesos/webui" 
> --work_dir="/tmp/OZHDIQ/master" --zk_session_timeout="10secs"
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628893 23432 master.cpp:427] 
> Master only allowing authenticated frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628900 23432 master.cpp:441] 
> Master only allowing authenticated agents to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628902 23432 master.cpp:454] 
> Master only allowing authenticated HTTP frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628906 23432 credentials.hpp:37] 
> Loading credentials for authentication from '/tmp/OZHDIQ/credentials'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628999 23432 master.cpp:499] Using 
> default 'crammd5' authenticator
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629041 23432 http.cpp:883] Using 
> default 'basic' HTTP authenticator for realm 'mesos-master-readonly'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629114 23432 http.cpp:883] Using 
> default 'basic' HTTP authenticator for realm 

[jira] [Updated] (MESOS-6001) Aufs backend cannot support the image with numerous layers.

2017-01-06 Thread Artem Harutyunyan (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Artem Harutyunyan updated MESOS-6001:
-
Sprint: Mesosphere Sprint 47, Mesosphere Sprint 48, Mesosphere Sprint 49  
(was: Mesosphere Sprint 47, Mesosphere Sprint 48)

> Aufs backend cannot support the image with numerous layers.
> ---
>
> Key: MESOS-6001
> URL: https://issues.apache.org/jira/browse/MESOS-6001
> Project: Mesos
>  Issue Type: Bug
>  Components: containerization
> Environment: Ubuntu 14, Ubuntu 12
> Or any other os with aufs module
>Reporter: Gilbert Song
>Assignee: Gilbert Song
>  Labels: aufs, backend, containerizer
>
> This issue was exposed in this unit test 
> `ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller` by manually 
> specifying the `bind` backend. Most likely mounting the aufs with specific 
> options is limited by string length.
> {noformat}
> [20:13:07] :   [Step 10/10] [ RUN  ] 
> DockerRuntimeIsolatorTest.ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.615844 23416 cluster.cpp:155] 
> Creating default 'local' authorizer
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.624106 23416 leveldb.cpp:174] 
> Opened db in 8.148813ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627252 23416 leveldb.cpp:181] 
> Compacted db in 3.126629ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627275 23416 leveldb.cpp:196] 
> Created db iterator in 4410ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627282 23416 leveldb.cpp:202] 
> Seeked to beginning of db in 763ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627287 23416 leveldb.cpp:271] 
> Iterated through 0 keys in the db in 491ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627301 23416 replica.cpp:776] 
> Replica recovered with log positions 0 -> 0 with 1 holes and 0 unlearned
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627563 23434 recover.cpp:451] 
> Starting replica recovery
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627800 23437 recover.cpp:477] 
> Replica is in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628113 23431 replica.cpp:673] 
> Replica in EMPTY status received a broadcasted recover request from 
> __req_res__(5852)@172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628243 23430 recover.cpp:197] 
> Received a recover response from a replica in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628365 23437 recover.cpp:568] 
> Updating replica status to STARTING
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628744 23432 master.cpp:375] 
> Master dd755a55-0dd1-4d2d-9a49-812a666015cb (ip-172-30-2-138.mesosphere.io) 
> started on 172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628758 23432 master.cpp:377] Flags 
> at startup: --acls="" --agent_ping_timeout="15secs" 
> --agent_reregister_timeout="10mins" --allocation_interval="1secs" 
> --allocator="HierarchicalDRF" --authenticate_agents="true" 
> --authenticate_frameworks="true" --authenticate_http_frameworks="true" 
> --authenticate_http_readonly="true" --authenticate_http_readwrite="true" 
> --authenticators="crammd5" --authorizers="local" 
> --credentials="/tmp/OZHDIQ/credentials" --framework_sorter="drf" 
> --help="false" --hostname_lookup="true" --http_authenticators="basic" 
> --http_framework_authenticators="basic" --initialize_driver_logging="true" 
> --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" 
> --max_agent_ping_timeouts="5" --max_completed_frameworks="50" 
> --max_completed_tasks_per_framework="1000" --quiet="false" 
> --recovery_agent_removal_limit="100%" --registry="replicated_log" 
> --registry_fetch_timeout="1mins" --registry_store_timeout="100secs" 
> --registry_strict="true" --root_submissions="true" --user_sorter="drf" 
> --version="false" --webui_dir="/usr/local/share/mesos/webui" 
> --work_dir="/tmp/OZHDIQ/master" --zk_session_timeout="10secs"
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628893 23432 master.cpp:427] 
> Master only allowing authenticated frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628900 23432 master.cpp:441] 
> Master only allowing authenticated agents to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628902 23432 master.cpp:454] 
> Master only allowing authenticated HTTP frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628906 23432 credentials.hpp:37] 
> Loading credentials for authentication from '/tmp/OZHDIQ/credentials'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628999 23432 master.cpp:499] Using 
> default 'crammd5' authenticator
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629041 23432 http.cpp:883] Using 
> default 'basic' HTTP authenticator for realm 'mesos-master-readonly'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629114 23432 

[jira] [Updated] (MESOS-6001) Aufs backend cannot support the image with numerous layers.

2016-12-08 Thread Vinod Kone (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinod Kone updated MESOS-6001:
--
Sprint: Mesosphere Sprint 47, Mesosphere Sprint 48  (was: Mesosphere Sprint 
47)

> Aufs backend cannot support the image with numerous layers.
> ---
>
> Key: MESOS-6001
> URL: https://issues.apache.org/jira/browse/MESOS-6001
> Project: Mesos
>  Issue Type: Bug
>  Components: containerization
> Environment: Ubuntu 14, Ubuntu 12
> Or any other os with aufs module
>Reporter: Gilbert Song
>Assignee: Gilbert Song
>  Labels: aufs, backend, containerizer
>
> This issue was exposed in this unit test 
> `ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller` by manually 
> specifying the `bind` backend. Most likely mounting the aufs with specific 
> options is limited by string length.
> {noformat}
> [20:13:07] :   [Step 10/10] [ RUN  ] 
> DockerRuntimeIsolatorTest.ROOT_CURL_INTERNET_DockerDefaultEntryptRegistryPuller
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.615844 23416 cluster.cpp:155] 
> Creating default 'local' authorizer
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.624106 23416 leveldb.cpp:174] 
> Opened db in 8.148813ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627252 23416 leveldb.cpp:181] 
> Compacted db in 3.126629ms
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627275 23416 leveldb.cpp:196] 
> Created db iterator in 4410ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627282 23416 leveldb.cpp:202] 
> Seeked to beginning of db in 763ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627287 23416 leveldb.cpp:271] 
> Iterated through 0 keys in the db in 491ns
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627301 23416 replica.cpp:776] 
> Replica recovered with log positions 0 -> 0 with 1 holes and 0 unlearned
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627563 23434 recover.cpp:451] 
> Starting replica recovery
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.627800 23437 recover.cpp:477] 
> Replica is in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628113 23431 replica.cpp:673] 
> Replica in EMPTY status received a broadcasted recover request from 
> __req_res__(5852)@172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628243 23430 recover.cpp:197] 
> Received a recover response from a replica in EMPTY status
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628365 23437 recover.cpp:568] 
> Updating replica status to STARTING
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628744 23432 master.cpp:375] 
> Master dd755a55-0dd1-4d2d-9a49-812a666015cb (ip-172-30-2-138.mesosphere.io) 
> started on 172.30.2.138:44256
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628758 23432 master.cpp:377] Flags 
> at startup: --acls="" --agent_ping_timeout="15secs" 
> --agent_reregister_timeout="10mins" --allocation_interval="1secs" 
> --allocator="HierarchicalDRF" --authenticate_agents="true" 
> --authenticate_frameworks="true" --authenticate_http_frameworks="true" 
> --authenticate_http_readonly="true" --authenticate_http_readwrite="true" 
> --authenticators="crammd5" --authorizers="local" 
> --credentials="/tmp/OZHDIQ/credentials" --framework_sorter="drf" 
> --help="false" --hostname_lookup="true" --http_authenticators="basic" 
> --http_framework_authenticators="basic" --initialize_driver_logging="true" 
> --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" 
> --max_agent_ping_timeouts="5" --max_completed_frameworks="50" 
> --max_completed_tasks_per_framework="1000" --quiet="false" 
> --recovery_agent_removal_limit="100%" --registry="replicated_log" 
> --registry_fetch_timeout="1mins" --registry_store_timeout="100secs" 
> --registry_strict="true" --root_submissions="true" --user_sorter="drf" 
> --version="false" --webui_dir="/usr/local/share/mesos/webui" 
> --work_dir="/tmp/OZHDIQ/master" --zk_session_timeout="10secs"
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628893 23432 master.cpp:427] 
> Master only allowing authenticated frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628900 23432 master.cpp:441] 
> Master only allowing authenticated agents to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628902 23432 master.cpp:454] 
> Master only allowing authenticated HTTP frameworks to register
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628906 23432 credentials.hpp:37] 
> Loading credentials for authentication from '/tmp/OZHDIQ/credentials'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.628999 23432 master.cpp:499] Using 
> default 'crammd5' authenticator
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629041 23432 http.cpp:883] Using 
> default 'basic' HTTP authenticator for realm 'mesos-master-readonly'
> [20:13:07]W:   [Step 10/10] I0805 20:13:07.629114 23432 http.cpp:883] Using 
> default 'basic' HTTP authenticator for