[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Launchpad Bug Tracker]

This bug was fixed in the package apt - 1.0.1ubuntu2.18

---
apt (1.0.1ubuntu2.18) trusty; urgency=medium

  * ExecFork: Use /proc/self/fd to determine which files to close
(Closes: #764204) (LP: #1332440).

 -- Julian Andres Klode   Mon, 09 Apr 2018 15:32:09
+0200

** Changed in: apt (Ubuntu Trusty)
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Fix Released
Status in apt source package in Trusty:
  Fix Released

Bug description:
  [Impact]
  apt is slow at spawning subprocesses, as it calls fcntl() on each file 
descriptor, causing significant slowdown. On my container:

  0.71user 1.26system 0:01.98elapsed 99%CPU (0avgtext+0avgdata
  34164maxresident)k

  0.14user 0.05system 0:00.20elapsed 99%CPU (0avgtext+0avgdata
  34428maxresident)k

  - a 10 times difference.

  [Test case]
  (1) Run strace -f -c apt-cache search test >/dev/null, count getrlimit() and 
fcntl() calls
  (2) Upgrade libapt-pkg4.12 to proposed
  (3) Run (1) again, make sure it's significantly lower.

  
  [Regression potential]
  Isolated fix in closing "unwanted" file descriptors. Has been in use for 
years now, but if there were a regression it would probably be an fd leak.

  [Original bug report]
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Julian Andres Klode]

I have verified that none of these failures are regressions; they all
appear in previous apt uploads/run against other triggers too.

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Fix Released
Status in apt source package in Trusty:
  Fix Committed

Bug description:
  [Impact]
  apt is slow at spawning subprocesses, as it calls fcntl() on each file 
descriptor, causing significant slowdown. On my container:

  0.71user 1.26system 0:01.98elapsed 99%CPU (0avgtext+0avgdata
  34164maxresident)k

  0.14user 0.05system 0:00.20elapsed 99%CPU (0avgtext+0avgdata
  34428maxresident)k

  - a 10 times difference.

  [Test case]
  (1) Run strace -f -c apt-cache search test >/dev/null, count getrlimit() and 
fcntl() calls
  (2) Upgrade libapt-pkg4.12 to proposed
  (3) Run (1) again, make sure it's significantly lower.

  
  [Regression potential]
  Isolated fix in closing "unwanted" file descriptors. Has been in use for 
years now, but if there were a regression it would probably be an fd leak.

  [Original bug report]
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Robie Basak]

There are some dep8 regressions reported in http://people.canonical.com
/~ubuntu-archive/pending-sru.html. I've requested some retries. If
they're still failing, please could you take a look?

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Fix Released
Status in apt source package in Trusty:
  Fix Committed

Bug description:
  [Impact]
  apt is slow at spawning subprocesses, as it calls fcntl() on each file 
descriptor, causing significant slowdown. On my container:

  0.71user 1.26system 0:01.98elapsed 99%CPU (0avgtext+0avgdata
  34164maxresident)k

  0.14user 0.05system 0:00.20elapsed 99%CPU (0avgtext+0avgdata
  34428maxresident)k

  - a 10 times difference.

  [Test case]
  (1) Run strace -f -c apt-cache search test >/dev/null, count getrlimit() and 
fcntl() calls
  (2) Upgrade libapt-pkg4.12 to proposed
  (3) Run (1) again, make sure it's significantly lower.

  
  [Regression potential]
  Isolated fix in closing "unwanted" file descriptors. Has been in use for 
years now, but if there were a regression it would probably be an fd leak.

  [Original bug report]
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Julian Andres Klode]

Time for apt-cache policy apt also decreased from 1.86 seconds to 0.04
seconds :)

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Fix Released
Status in apt source package in Trusty:
  Fix Committed

Bug description:
  [Impact]
  apt is slow at spawning subprocesses, as it calls fcntl() on each file 
descriptor, causing significant slowdown. On my container:

  0.71user 1.26system 0:01.98elapsed 99%CPU (0avgtext+0avgdata
  34164maxresident)k

  0.14user 0.05system 0:00.20elapsed 99%CPU (0avgtext+0avgdata
  34428maxresident)k

  - a 10 times difference.

  [Test case]
  (1) Run strace -f -c apt-cache search test >/dev/null, count getrlimit() and 
fcntl() calls
  (2) Upgrade libapt-pkg4.12 to proposed
  (3) Run (1) again, make sure it's significantly lower.

  
  [Regression potential]
  Isolated fix in closing "unwanted" file descriptors. Has been in use for 
years now, but if there were a regression it would probably be an fd leak.

  [Original bug report]
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Julian Andres Klode]

Verified. (BTW, I aborted the initial run as it simply took too long so
actual numbers would have been much higher)

root@t:~# apt-cache  policy libapt-pkg4.12
libapt-pkg4.12:
  Installed: 1.0.1ubuntu2.17
  Candidate: 1.0.1ubuntu2.18
  Version table:
 1.0.1ubuntu2.18 0
500 http://archive.ubuntu.com/ubuntu/ trusty-proposed/main amd64 
Packages
 *** 1.0.1ubuntu2.17 0
500 http://archive.ubuntu.com/ubuntu/ trusty-updates/main amd64 Packages
500 http://security.ubuntu.com/ubuntu/ trusty-security/main amd64 
Packages
100 /var/lib/dpkg/status
 1.0.1ubuntu2 0
500 http://archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages
root@t:~# strace -f -c apt-cache search test >/dev/null
Process 2338 attached
^CProcess 2337 detached
Process 2338 detached
% time seconds  usecs/call callserrors syscall
-- --- --- - - 
 50.320.827909   3329234   getrlimit
 49.550.815234   2329234329227 fcntl
  0.030.000510  1050   mmap
  0.020.000407  1040   open
  0.010.000225  1023   mprotect
  0.010.000212   634   read
  0.010.000209   540   close
  0.010.000202   729   fstat
  0.010.000167  131313 access
  0.000.44   6 8 2 stat
  0.000.27  14 2   getdents
  0.000.18   9 2   munmap
  0.000.18   6 3   brk
  0.000.16  16 1   execve
  0.000.08   8 1   pipe
  0.000.07   7 1   openat
  0.000.04   4 1 1 lseek
  0.000.04   4 1   clone
  0.000.03   3 1 1 ioctl
  0.000.03   3 1   arch_prctl
  0.000.00   0 6   rt_sigaction
-- --- --- - - 
100.001.645227658725329244 total
root@t:~# apt install libapt-pkg4.12
Reading package lists... Done
Building dependency tree   
Reading state information... Done
The following packages were automatically installed and are no longer required:
  libfreetype6 os-prober
Use 'apt-get autoremove' to remove them.
The following packages will be upgraded:
  libapt-pkg4.12
1 upgraded, 0 newly installed, 0 to remove and 18 not upgraded.
Need to get 638 kB of archives.
After this operation, 0 B of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu/ trusty-proposed/main libapt-pkg4.12 
amd64 1.0.1ubuntu2.18 [638 kB]
Fetched 638 kB in 0s (687 kB/s) 
(Reading database ... 25096 files and directories currently installed.)
Preparing to unpack .../libapt-pkg4.12_1.0.1ubuntu2.18_amd64.deb ...
Unpacking libapt-pkg4.12:amd64 (1.0.1ubuntu2.18) over (1.0.1ubuntu2.17) ...
Setting up libapt-pkg4.12:amd64 (1.0.1ubuntu2.18) ...
Processing triggers for libc-bin (2.19-0ubuntu6.14) ...
# strace -f -c apt-cache search test >/dev/null
Process 2389 attached
Process 2390 attached
Process 2391 attached
% time seconds  usecs/call callserrors syscall
-- --- --- - - 
 21.800.002285  10   22524 stat
 14.360.001505  6822   munmap
 13.310.001395   8   16924 open
  9.960.001044   2   644   read
  9.440.000990   6   162   close
  9.210.000966   6   154   mmap
  5.690.000597   6   103   fstat
  3.820.000401  1822   getdents
  2.410.000253   553   mprotect
  1.640.000172  57 3   wait4
  1.250.000131  1211   openat
  1.170.000123  21 6 6 statfs
  1.130.000118   255   fcntl
  1.120.000117   43231 access
  0.730.77   323   brk
  0.540.57   149 3 lseek
  0.530.56  19 3   pipe
  0.400.42   154   write
  0.350.37   167   umask
  0.310.32   4 9   dup2
  0.270.28   6 5 5 ioctl
  0.250.26   9 3   clone
  0.170.18   5 4   arch_prctl
  0.130.14   4 4   execve
  0.000.00   018   rt_sigaction
  0.000.00   0 1   msync
-- --- 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Łukasz Zemczak]

Hello tom916, or anyone else affected,

Accepted apt into trusty-proposed. The package will build now and be
available at https://launchpad.net/ubuntu/+source/apt/1.0.1ubuntu2.18 in
a few hours, and then in the -proposed repository.

Please help us by testing this new package.  See
https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how
to enable and use -proposed.Your feedback will aid us getting this
update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug,
mentioning the version of the package you tested and change the tag from
verification-needed-trusty to verification-done-trusty. If it does not
fix the bug for you, please add a comment stating that, and change the
tag to verification-failed-trusty. In either case, without details of
your testing we will not be able to proceed.

Further information regarding the verification process can be found at
https://wiki.ubuntu.com/QATeam/PerformingSRUVerification .  Thank you in
advance!

** Changed in: apt (Ubuntu Trusty)
   Status: In Progress => Fix Committed

** Tags added: verification-needed verification-needed-trusty

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Fix Released
Status in apt source package in Trusty:
  Fix Committed

Bug description:
  [Impact]
  apt is slow at spawning subprocesses, as it calls fcntl() on each file 
descriptor, causing significant slowdown. On my container:

  0.71user 1.26system 0:01.98elapsed 99%CPU (0avgtext+0avgdata
  34164maxresident)k

  0.14user 0.05system 0:00.20elapsed 99%CPU (0avgtext+0avgdata
  34428maxresident)k

  - a 10 times difference.

  [Test case]
  (1) Run strace -f -c apt-cache search test >/dev/null, count getrlimit() and 
fcntl() calls
  (2) Upgrade libapt-pkg4.12 to proposed
  (3) Run (1) again, make sure it's significantly lower.

  
  [Regression potential]
  Isolated fix in closing "unwanted" file descriptors. Has been in use for 
years now, but if there were a regression it would probably be an fd leak.

  [Original bug report]
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Julian Andres Klode]

** Description changed:

  [Impact]
  apt is slow at spawning subprocesses, as it calls fcntl() on each file 
descriptor, causing significant slowdown. On my container:
  
  0.71user 1.26system 0:01.98elapsed 99%CPU (0avgtext+0avgdata
  34164maxresident)k
  
  0.14user 0.05system 0:00.20elapsed 99%CPU (0avgtext+0avgdata
  34428maxresident)k
  
  - a 10 times difference.
  
  [Test case]
  (1) Run strace -f -c apt-cache search test >/dev/null, count getrlimit() and 
fcntl() calls
  (2) Upgrade libapt-pkg4.12 to proposed
  (3) Run (1) again, make sure it's significantly lower.
+ 
+ 
+ [Regression potential]
+ Isolated fix in closing "unwanted" file descriptors. Has been in use for 
years now, but if there were a regression it would probably be an fd leak.
  
  [Original bug report]
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'
  
  ubuntu 14.04
  
  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374
  
  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Julian Andres Klode]

This was fixed in 1.0.10 or something, and I just uploaded a fixed
version to trusty (1.0.1ubuntu2.18).

** Description changed:

+ [Impact]
+ apt is slow at spawning subprocesses, as it calls fcntl() on each file 
descriptor, causing significant slowdown. On my container:
+ 
+ 0.71user 1.26system 0:01.98elapsed 99%CPU (0avgtext+0avgdata
+ 34164maxresident)k
+ 
+ 0.14user 0.05system 0:00.20elapsed 99%CPU (0avgtext+0avgdata
+ 34428maxresident)k
+ 
+ - a 10 times difference.
+ 
+ [Test case]
+ (1) Run strace -f -c apt-cache search test >/dev/null, count getrlimit() and 
fcntl() calls
+ (2) Upgrade libapt-pkg4.12 to proposed
+ (3) Run (1) again, make sure it's significantly lower.
+ 
+ [Original bug report]
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'
  
  ubuntu 14.04
  
  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374
- 
  
  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Julian Andres Klode]

** Also affects: apt (Ubuntu Trusty)
   Importance: Undecided
   Status: New

** Changed in: apt (Ubuntu Trusty)
   Status: New => Triaged

** Changed in: apt (Ubuntu Trusty)
 Assignee: (unassigned) => Julian Andres Klode (juliank)

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Fix Released
Status in apt source package in Trusty:
  Triaged

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(10, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(11, 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Julian Andres Klode]

** Changed in: apt (Ubuntu)
   Status: Confirmed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Fix Released
Status in apt source package in Trusty:
  Triaged

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(10, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(12, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Toby Corkindale]

Apologies, I retract that -- looks like the issue was related to MTU and
PMTU discovery.. It just happened that the machines with the mtu issues
were also the ones with huge ulimits configured.

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Confirmed

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(10, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Toby Corkindale]

I'm still seeing this as a problem (I think) on Ubuntu 15.10 Wily,
kernel 4.2.0-25-generic.

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Confirmed

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(10, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(12, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Jon Skarpeteig]

When running Ubuntu 14.04 inside Docker I've seen this issue with CentOS
as well:

CentOS 7.2
3.10.0-327.4.4.el7.x86_64

I tested a few kernels with Ubuntu 14.04 as host OS and I found:

apt-get update extremely slow on kernels:

3.13.0-76
3.13.0-65
3.13.0-30
3.13.0-29

apt-get update fast on kernel:

3.13.0-45

So my workaround for now is to install and run kernel 3.13.0-45

My working setup is;

# docker --version
Docker version 1.9.1, build a34a1d5
# uname -a
Linux lys-jenkins 3.13.0-45-generic #74-Ubuntu SMP Tue Jan 13 19:36:28 UTC 2015 
x86_64 x86_64 x86_64 GNU/Linux

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Confirmed

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers 
  Original-Maintainer: APT Development Team 
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), 
openjdk-6-jdk (<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 
0)
  Depends: libapt-pkg4.12 (>= 0.9.16), libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), 
libstdc++6 (>= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (>= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt (<< 0.7.93.2~)
  Breaks: manpages-it (<< 2.80-4~), manpages-pl (<< 20060617-3~), openjdk-6-jdk 
(<< 6b24-1.11-0ubuntu1~), sun-java5-jdk (>> 0), sun-java6-jdk (>> 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat("/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS",
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat("/usr/lib/apt/methods/bzip2", {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_GETFL 
  [pid 20538] <... rt_sigaction resumed> {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... fcntl resumed> )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(11 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] close(13 
  [pid 20538] <... rt_sigaction resumed> {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] <... close resumed> )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  
  [pid 20525] select(10, [9], NULL, NULL, NULL 
  [pid 20538] <... rt_sigaction resumed> {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Ian Babrou]

Yep, it's not fixed:

~ λ docker run --rm ubuntu:14.04 bash -c 'ulimit -n 50  apt-get install 
strace  strace -c -f apt-get update'
Reading package lists...
Building dependency tree...
Reading state information...
The following NEW packages will be installed:
  strace
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 113 kB of archives.
After this operation, 504 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu/ trusty/main strace amd64 4.8-1ubuntu5 
[113 kB]
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
dpkg-preconfigure: unable to re-open stdin:
Fetched 113 kB in 0s (179 kB/s)
Selecting previously unselected package strace.
(Reading database ... 11527 files and directories currently installed.)
Preparing to unpack .../strace_4.8-1ubuntu5_amd64.deb ...
Unpacking strace (4.8-1ubuntu5) ...
Setting up strace (4.8-1ubuntu5) ...
Process 47 attached
Process 48 attached
Process 49 attached
Ign http://archive.ubuntu.com trusty InRelease
Ign http://archive.ubuntu.com trusty-updates InRelease
Ign http://archive.ubuntu.com trusty-security InRelease
Hit http://archive.ubuntu.com trusty Release.gpg
Get:1 http://archive.ubuntu.com trusty-updates Release.gpg [933 B]
Get:2 http://archive.ubuntu.com trusty-security Release.gpg [933 B]
Process 50 attached
Process 51 attached
Hit http://archive.ubuntu.com trusty Release
Get:3 http://archive.ubuntu.com trusty-updates Release [63.5 kB]
Process 52 attached
Process 53 attached
Get:4 http://archive.ubuntu.com trusty-security Release [63.5 kB]
Process 54 attached
Get:5 http://archive.ubuntu.com trusty/main Sources [1335 kB]
Process 55 attached
Process 56 attached
^CGet:6 http://archive.ubuntu.com trusty/restricted Sources [5335 B]
Get:7 http://archive.ubuntu.com trusty/universe Sources [7926 kB]
Get:8 http://archive.ubuntu.com trusty/main amd64 Packages [1743 kB]
Get:9 http://archive.ubuntu.com trusty/restricted amd64 Packages [16.0 kB]
Get:10 http://archive.ubuntu.com trusty/universe amd64 Packages [7589 kB]
Get:11 http://archive.ubuntu.com trusty-updates/main Sources [248 kB]
Get:12 http://archive.ubuntu.com trusty-updates/restricted Sources [2310 B]
Get:13 http://archive.ubuntu.com trusty-updates/universe Sources [141 kB]
Get:14 http://archive.ubuntu.com trusty-updates/main amd64 Packages [636 kB]
Get:15 http://archive.ubuntu.com trusty-updates/restricted amd64 Packages [15.1 
kB]
Get:16 http://archive.ubuntu.com trusty-updates/universe amd64 Packages [356 kB]
Get:17 http://archive.ubuntu.com trusty-security/main Sources [97.7 kB]
Get:18 http://archive.ubuntu.com trusty-security/restricted Sources [1874 B]
Get:19 http://archive.ubuntu.com trusty-security/universe Sources [23.3 kB]
Get:20 http://archive.ubuntu.com trusty-security/main amd64 Packages [329 kB]
Get:21 http://archive.ubuntu.com trusty-security/restricted amd64 Packages 
[14.8 kB]
Get:22 http://archive.ubuntu.com trusty-security/universe amd64 Packages [128 
kB]
FATA[0368] Error response from daemon: Cannot destroy container 
327825463e914c72c59f01a5aa1ab25b8ab13eeae55ac961159a729e0f4f3599: Failed to set 
container state to RemovalInProgress: Status is already RemovalInProgress
~ λ docker run --rm ubuntu:14.04 bash -c 'ulimit -n 500  apt-get install 
strace  time strace -c -f apt-get update'
Reading package lists...
Building dependency tree...
Reading state information...
The following NEW packages will be installed:
  strace
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 113 kB of archives.
After this operation, 504 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu/ trusty/main strace amd64 4.8-1ubuntu5 
[113 kB]
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
dpkg-preconfigure: unable to re-open stdin:
Fetched 113 kB in 0s (170 kB/s)
Selecting previously unselected package strace.
(Reading database ... 11527 files and directories currently installed.)
Preparing to unpack .../strace_4.8-1ubuntu5_amd64.deb ...
Unpacking strace (4.8-1ubuntu5) ...
Setting up strace (4.8-1ubuntu5) ...
Process 48 attached
Process 49 attached
Process 50 attached
Ign http://archive.ubuntu.com trusty InRelease
Ign http://archive.ubuntu.com trusty-updates InRelease
Ign http://archive.ubuntu.com trusty-security InRelease
Hit http://archive.ubuntu.com trusty Release.gpg
Get:1 http://archive.ubuntu.com trusty-updates Release.gpg [933 B]
Get:2 http://archive.ubuntu.com trusty-security Release.gpg [933 B]
Process 51 attached

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Scrivs]

If it's been fixed, I don't know what in. This still appears to be an
issue for me. If I've failed to apply some update that fixed it, I'd
love to know what it was.

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Confirmed

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers ubuntu-devel-disc...@lists.ubuntu.com
  Original-Maintainer: APT Development Team de...@lists.debian.org
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), 
openjdk-6-jdk ( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 
0)
  Depends: libapt-pkg4.12 (= 0.9.16), libc6 (= 2.15), libgcc1 (= 1:4.1.1), 
libstdc++6 (= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt ( 0.7.93.2~)
  Breaks: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), openjdk-6-jdk 
( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat(/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS,
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat(/usr/lib/apt/methods/bzip2, {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_GETFL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(11 unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(13 unfinished ...
  [pid 20538] ... rt_sigaction resumed {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] select(10, [9], NULL, NULL, NULL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(10, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Ian Babrou]

Looks like it was fixed in some update. Can anyone confirm that?

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in apt package in Ubuntu:
  Confirmed

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers ubuntu-devel-disc...@lists.ubuntu.com
  Original-Maintainer: APT Development Team de...@lists.debian.org
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), 
openjdk-6-jdk ( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 
0)
  Depends: libapt-pkg4.12 (= 0.9.16), libc6 (= 2.15), libgcc1 (= 1:4.1.1), 
libstdc++6 (= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt ( 0.7.93.2~)
  Breaks: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), openjdk-6-jdk 
( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat(/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS,
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat(/usr/lib/apt/methods/bzip2, {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_GETFL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(11 unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(13 unfinished ...
  [pid 20538] ... rt_sigaction resumed {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] select(10, [9], NULL, NULL, NULL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(10, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(12, F_SETFD, FD_CLOEXEC) = 0
 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Jason]

I can also confirm this running docker with the library/ubuntu:14.04
image on a virtualbox host running ubuntu 14.04

running apt-get update times out or takes an extremely long time.

Host Virtualbox:

$ ulimit -n
1024

docker container:

root@1518e024f53a:/# ulimit -n
524288

root@1518e024f53a:/# time apt-get update

real0m47.489s
user0m24.408s
sys 0m21.516s

root@1518e024f53a:/# ulimit -n 10
root@1518e024f53a:/# time apt-get update

real0m11.165s
user0m6.598s
sys 0m4.359s

root@1518e024f53a:/# ulimit -n 1024  
root@1518e024f53a:/# time apt-get update

real0m3.109s
user0m2.543s
sys 0m0.374s

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in “apt” package in Ubuntu:
  Confirmed

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers ubuntu-devel-disc...@lists.ubuntu.com
  Original-Maintainer: APT Development Team de...@lists.debian.org
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), 
openjdk-6-jdk ( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 
0)
  Depends: libapt-pkg4.12 (= 0.9.16), libc6 (= 2.15), libgcc1 (= 1:4.1.1), 
libstdc++6 (= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt ( 0.7.93.2~)
  Breaks: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), openjdk-6-jdk 
( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat(/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS,
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat(/usr/lib/apt/methods/bzip2, {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_GETFL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(11 unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(13 unfinished ...
  [pid 20538] ... rt_sigaction resumed {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] select(10, [9], NULL, NULL, NULL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Jon Skarpeteig]

Running apt-get update takes ~80 seconds for me running:

* Virtualbox 4.3.12
* Ubuntu 14.04 LTS 64 bit desktop (3.13.0-30-generic #55-Ubuntu SMP)
* Docker version 1.0.1, build 990021a
* Official 'ubuntu:14.04' docker image

In the VirtualBox machine it takes  10s

Running a similar setup in VMware does not display this behavior:

* VMware ESXi 5.5
* Ubuntu 14.04 LTS 64 bit server (3.13.0-30-generic #55-Ubuntu SMP)
* Docker version 1.0.1, build 990021a

apt-get executed in 9.87 seconds
* Official 'ubuntu:14.04' docker image

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in “apt” package in Ubuntu:
  Confirmed

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers ubuntu-devel-disc...@lists.ubuntu.com
  Original-Maintainer: APT Development Team de...@lists.debian.org
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), 
openjdk-6-jdk ( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 
0)
  Depends: libapt-pkg4.12 (= 0.9.16), libc6 (= 2.15), libgcc1 (= 1:4.1.1), 
libstdc++6 (= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt ( 0.7.93.2~)
  Breaks: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), openjdk-6-jdk 
( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat(/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS,
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat(/usr/lib/apt/methods/bzip2, {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_GETFL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(11 unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(13 unfinished ...
  [pid 20538] ... rt_sigaction resumed {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] select(10, [9], NULL, NULL, NULL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Launchpad Bug Tracker]

Status changed to 'Confirmed' because the bug affects multiple users.

** Changed in: apt (Ubuntu)
   Status: New = Confirmed

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in “apt” package in Ubuntu:
  Confirmed

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers ubuntu-devel-disc...@lists.ubuntu.com
  Original-Maintainer: APT Development Team de...@lists.debian.org
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), 
openjdk-6-jdk ( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 
0)
  Depends: libapt-pkg4.12 (= 0.9.16), libc6 (= 2.15), libgcc1 (= 1:4.1.1), 
libstdc++6 (= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt ( 0.7.93.2~)
  Breaks: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), openjdk-6-jdk 
( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat(/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS,
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat(/usr/lib/apt/methods/bzip2, {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_GETFL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(11 unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(13 unfinished ...
  [pid 20538] ... rt_sigaction resumed {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] select(10, [9], NULL, NULL, NULL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(10, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[TimK.]

Same problem with Docker containers, apt-get update take forever or just
fails.

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in “apt” package in Ubuntu:
  Confirmed

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers ubuntu-devel-disc...@lists.ubuntu.com
  Original-Maintainer: APT Development Team de...@lists.debian.org
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), 
openjdk-6-jdk ( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 
0)
  Depends: libapt-pkg4.12 (= 0.9.16), libc6 (= 2.15), libgcc1 (= 1:4.1.1), 
libstdc++6 (= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt ( 0.7.93.2~)
  Breaks: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), openjdk-6-jdk 
( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat(/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS,
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat(/usr/lib/apt/methods/bzip2, {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_GETFL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(11 unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(13 unfinished ...
  [pid 20538] ... rt_sigaction resumed {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] select(10, [9], NULL, NULL, NULL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(10, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(12, F_SETFD, 

[Touch-packages] [Bug 1332440] Re: apt-get update very slow when ulimit -n is big

[Ian Babrou]

Building docker image with ulimit -n 500k takes literally forever in
virtualbox. Iterating 500k fds that are not even open on every fork in
apt (and there are many of them) is not okay.

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/1332440

Title:
  apt-get update very slow when ulimit -n is big

Status in “apt” package in Ubuntu:
  New

Bug description:
  I use strace to see why apt-get update is too slow,
  finally I found apt-get loop 3~n to '(? , F_SETFD, FD_CLOEXEC) = 0'

  ubuntu 14.04

  root@dev2:/tmp/apt-1.0.1ubuntu2.1# apt-cache show apt
  Package: apt
  Priority: important
  Section: admin
  Installed-Size: 3576
  Maintainer: Ubuntu Developers ubuntu-devel-disc...@lists.ubuntu.com
  Original-Maintainer: APT Development Team de...@lists.debian.org
  Architecture: amd64
  Version: 1.0.1ubuntu2.1
  Replaces: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), 
openjdk-6-jdk ( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 
0)
  Depends: libapt-pkg4.12 (= 0.9.16), libc6 (= 2.15), libgcc1 (= 1:4.1.1), 
libstdc++6 (= 4.6), ubuntu-keyring, gnupg
  Suggests: aptitude | synaptic | wajig, dpkg-dev (= 1.17.2), apt-doc, 
python-apt
  Conflicts: python-apt ( 0.7.93.2~)
  Breaks: manpages-it ( 2.80-4~), manpages-pl ( 20060617-3~), openjdk-6-jdk 
( 6b24-1.11-0ubuntu1~), sun-java5-jdk ( 0), sun-java6-jdk ( 0)
  Filename: pool/main/a/apt/apt_1.0.1ubuntu2.1_amd64.deb
  Size: 952374

  
  [pid 20525] 
stat(/var/lib/apt/lists/mirrors.163.com_ubuntu_dists_trusty-updates_universe_i18n_Translation-en%5fUS,
 0x7fffaabe5b30) = -1 ENOENT (No such file or directory)
  [pid 20525] stat(/usr/lib/apt/methods/bzip2, {st_mode=S_IFREG|0755, 
st_size=23056, ...}) = 0
  [pid 20525] pipe([9, 11])   = 0
  [pid 20525] pipe([13, 14])  = 0
  [pid 20525] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(11, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(13, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] fcntl(14, F_SETFD, FD_CLOEXEC) = 0
  [pid 20525] clone(child_stack=0, 
flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0x7f99f1ea9a50) = 20538
  Process 20538 attached
  [pid 20525] fcntl(9, F_GETFL)   = 0 (flags O_RDONLY)
  [pid 20525] fcntl(9, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
  [pid 20538] rt_sigaction(SIGPIPE, {SIG_DFL, [PIPE], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_GETFL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_IGN, [PIPE], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0x1 (flags O_WRONLY)
  [pid 20538] rt_sigaction(SIGQUIT, {SIG_DFL, [QUIT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... fcntl resumed )   = 0
  [pid 20538] rt_sigaction(SIGINT, {SIG_DFL, [INT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(11 unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGWINCH, {SIG_DFL, [WINCH], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] close(13 unfinished ...
  [pid 20538] ... rt_sigaction resumed {0x409140, [WINCH], 
SA_RESTORER|SA_RESTART, 0x7f99f0e72ff0}, 8) = 0
  [pid 20525] ... close resumed )   = 0
  [pid 20538] rt_sigaction(SIGCONT, {SIG_DFL, [CONT], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0},  unfinished ...
  [pid 20525] select(10, [9], NULL, NULL, NULL unfinished ...
  [pid 20538] ... rt_sigaction resumed {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] rt_sigaction(SIGTSTP, {SIG_DFL, [TSTP], SA_RESTORER|SA_RESTART, 
0x7f99f0e72ff0}, {SIG_DFL, [], 0}, 8) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(3, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(4, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(5, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(6, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(7, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(8, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(9, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(10, F_SETFD, FD_CLOEXEC) = 0
  [pid 20538] getrlimit(RLIMIT_NOFILE, {rlim_cur=100, rlim_max=100}) = 0
  [pid 20538] fcntl(11, F_SETFD, FD_CLOEXEC) = 0