On 2020, ജൂലൈ 3 6:34:57 PM IST, Frederik Himpe <[email protected]> wrote: >Package: gitlab >Version: 13.1.2-1+fto10+1 >Severity: important > >Dear Maintainer, > >Since upgrading from 12.10.3-1+fto10+1 to 13.1.2-1+fto10+1, all users >cannot push anything any more to any repository, either via SSH, HTTPS, >or by editing and committing a file in the web interface. The error >always comes down to: Internal API unreachable.
This was fixed in 13.1.2-1+fto10+2. Can you check the contents of /usr/share/gitlab/lib/gitlab/gl_repository/identifier.rb line 52? >For example using SSH: >$ git push >Enumerating objects: 5, done. >Counting objects: 100% (5/5), done. >Writing objects: 100% (3/3), 249 bytes | 249.00 KiB/s, done. >Total 3 (delta 0), reused 0 (delta 0), pack-reused 0 >remote: GitLab: Failed to authorize your Git request: internal API unreachable >To gitlab.example.com:user/test.git > ! [remote rejected] master -> master (pre-receive hook declined) >error: failed to push some refs to 'gitlab.example.com:user/test.git' > >I cannot see any error or backtrace in >/var/log/gitlab-shell/gitlab-shell.log or >/var/log/gitlab/producation.log > >Cloning the repository works fine though. > > >gitlab:check says the internal API is available: ># runuser -u gitlab -- sh -c '/usr/bin/bundle exec rake gitlab:check >RAILS_ENV=production' >fatal: not a git repository (or any of the parent directories): .git >fatal: not a git repository (or any of the parent directories): .git >fatal: not a git repository (or any of the parent directories): .git >Attention: used pure ruby version of MurmurHash3 >DEPRECATION WARNING: ActionDispatch::Http::ParameterFilter is deprecated and >will be removed from Rails 6.1. Use ActiveSupport::ParameterFilter instead. >(called from <top (required)> at >/usr/lib/ruby/vendor_ruby/grape_logging/util/parameter_filter.rb:2) >/usr/share/gitlab/lib/gitlab.rb:38: warning: already initialized constant >Gitlab::COM_URL >/usr/share/gitlab/lib/gitlab.rb:38: warning: previous definition of COM_URL >was here >/usr/share/gitlab/lib/gitlab.rb:39: warning: already initialized constant >Gitlab::STAGING_COM_URL >/usr/share/gitlab/lib/gitlab.rb:39: warning: previous definition of >STAGING_COM_URL was here >/usr/share/gitlab/lib/gitlab.rb:40: warning: already initialized constant >Gitlab::APP_DIRS_PATTERN >/usr/share/gitlab/lib/gitlab.rb:40: warning: previous definition of >APP_DIRS_PATTERN was here >/usr/share/gitlab/lib/gitlab.rb:41: warning: already initialized constant >Gitlab::SUBDOMAIN_REGEX >/usr/share/gitlab/lib/gitlab.rb:41: warning: previous definition of >SUBDOMAIN_REGEX was here >/usr/share/gitlab/lib/gitlab.rb:42: warning: already initialized constant >Gitlab::VERSION >/usr/share/gitlab/lib/gitlab.rb:42: warning: previous definition of VERSION >was here >/usr/share/gitlab/lib/gitlab.rb:43: warning: already initialized constant >Gitlab::INSTALLATION_TYPE >/usr/share/gitlab/lib/gitlab.rb:43: warning: previous definition of >INSTALLATION_TYPE was here >/usr/share/gitlab/lib/gitlab.rb:44: warning: already initialized constant >Gitlab::HTTP_PROXY_ENV_VARS >/usr/share/gitlab/lib/gitlab.rb:44: warning: previous definition of >HTTP_PROXY_ENV_VARS was here >/usr/share/gitlab/config/initializers/2_app.rb:6: warning: already initialized >constant Gitlab::VERSION >/usr/share/gitlab/lib/gitlab.rb:42: warning: previous definition of VERSION >was here >Checking GitLab subtasks ... > >Checking GitLab Shell ... > >GitLab Shell: ... GitLab Shell version >= 13.3.0 ? ... OK (13.3.0) >Running /usr/share/gitlab-shell/bin/check >Internal API available: OK >Redis available via internal API: OK >gitlab-shell self-check successful > >Checking GitLab Shell ... Finished > >Checking Gitaly ... > >Gitaly: ... default ... OK > >Checking Gitaly ... Finished > >Checking Sidekiq ... > >Sidekiq: ... Running? ... yes >Number of Sidekiq processes ... 1 > >Checking Sidekiq ... Finished > >Checking Incoming Email ... > >Incoming Email: ... Reply by email is disabled in config/gitlab.yml > >Checking Incoming Email ... Finished > >Checking LDAP ... > >LDAP: ... Server: ldapmain >LDAP authentication... Anonymous. No `bind_dn` or `password` configured >LDAP users with access to your GitLab server (only showing the first 100 >results) >[....] >Checking LDAP ... Finished > >Checking GitLab App ... > >Git configured correctly? ... yes >Database config exists? ... yes >All migrations up? ... yes >Database contains orphaned GroupMembers? ... no >GitLab config exists? ... yes >GitLab config up to date? ... yes >Log directory writable? ... yes >Tmp directory writable? ... yes >Uploads directory exists? ... yes >Uploads directory has correct permissions? ... yes >Uploads directory tmp has correct permissions? ... yes >Init script exists? ... yes >Init script up-to-date? ... yes >Projects have namespace: ... >[...] >Redis version >= 4.0.0? ... yes >Ruby version >= 2.5.3 ? ... yes (2.5.5) >Git version >= 2.22.0 ? ... yes (2.26.2) >Git user has default SSH configuration? ... yes >Active users: ... 171 >Is authorized keys file accessible? ... yes >GitLab configured to store new projects in hashed storage? ... yes >All projects are in hashed storage? ... no > Try fixing it: > Please migrate all projects to hashed storage > as legacy storage is deprecated in 13.0 and support will be removed in 14.0. > For more information see: > doc/administration/repository_storage_types.md > >Checking GitLab App ... Finished > > >Checking GitLab subtasks ... Finished > > >● gitlab.service - GitLab Services > Loaded: loaded (/lib/systemd/system/gitlab.service; enabled; vendor preset: > enabled) > Active: active (exited) since Fri 2020-07-03 14:58:10 CEST; 2min 19s ago > Process: 18276 ExecStart=/bin/true (code=exited, status=0/SUCCESS) > Main PID: 18276 (code=exited, status=0/SUCCESS) > >jul 03 14:58:10 ai-gitlab systemd[1]: Started GitLab Services. >root@ai-gitlab:/home/fhimpe# systemctl status gitlab-workhorse >● gitlab-workhorse.service - Gitlab Workhorse handles slow HTTP requests for >Gitlab. > Loaded: loaded (/lib/systemd/system/gitlab-workhorse.service; enabled; > vendor preset: enabled) > Drop-In: /etc/systemd/system/gitlab-workhorse.service.d > └─override.conf > Active: active (running) since Fri 2020-07-03 14:57:36 CEST; 2min 56s ago > Main PID: 18097 (gitlab-workhors) > Tasks: 8 (limit: 4915) > Memory: 16.7M > CGroup: /system.slice/gitlab-workhorse.service > └─18097 /usr/bin/gitlab-workhorse -listenUmask 0 -authBackend > http://127.0.0.1:8080 -authSocket /run/gitlab/gitlab.socket -documentRoot > /usr/share/gitlab/public -listenNetwork tcp -listenAddr 127.0.0.1:8181 > ># systemctl status gitaly >● gitaly.service - Gitaly > Loaded: loaded (/lib/systemd/system/gitaly.service; enabled; vendor preset: > enabled) > Drop-In: /etc/systemd/system/gitaly.service.d > └─override.conf > Active: active (running) since Fri 2020-07-03 11:17:32 CEST; 3h 43min ago > Docs: https://gitlab.com/gitlab-org/gitaly > Main PID: 12710 (gitaly) > Tasks: 94 (limit: 4915) > Memory: 282.9M > CGroup: /system.slice/gitaly.service > ├─12710 /usr/bin/gitaly /etc/gitaly/config.toml > ├─12719 ruby /usr/share/gitaly/ruby/bin/gitaly-ruby 12710 > /tmp/gitaly-internal890824655/ruby.0 > └─12720 ruby /usr/share/gitaly/ruby/bin/gitaly-ruby 12710 > /tmp/gitaly-internal890824655/ruby.1 > ># systemctl status gitlab-unicorn >● gitlab-unicorn.service - GitLab Unicorn Server > Loaded: loaded (/etc/systemd/system/gitlab-unicorn.service; enabled; vendor > preset: enabled) > Active: active (running) since Fri 2020-07-03 14:57:36 CEST; 5min ago > Main PID: 18095 (unicorn_rails) > Tasks: 30 (limit: 4915) > Memory: 1.4G > CGroup: /system.slice/gitlab-unicorn.service > ├─18095 unicorn_rails master -c config/unicorn.rb -E production > ├─18292 unicorn_rails worker[0] -c config/unicorn.rb -E production > ├─18295 unicorn_rails worker[1] -c config/unicorn.rb -E production > └─18298 unicorn_rails worker[2] -c config/unicorn.rb -E production > >It seems upstream is using Puma instead of Unicorn: >https://docs.gitlab.com/omnibus/settings/puma.html >I don't know whether this can be related to the problem. > >-- System Information: >Debian Release: 10.4 > APT prefers stable > APT policy: (700, 'stable'), (650, 'proposed-updates'), (640, > 'buster-backports'), (630, 'buster-fasttrack'), (600, 'oldstable'), (550, > 'oldstable-proposed-updates'), (500, 'oldoldstable'), (500, 'testing'), (200, > 'unstable'), (160, 'experimental') >Architecture: amd64 (x86_64) > >Kernel: Linux 4.19.0-9-amd64 (SMP w/4 CPU cores) >Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8), >LANGUAGE=en_GB:en (charmap=UTF-8) >Shell: /bin/sh linked to /bin/dash >Init: systemd (via /run/systemd/system) > >Versions of packages gitlab depends on: >ii apache2 [httpd] 2.4.38-3+deb10u3 >ii asciidoctor 2.0.10-2~bpo10+1 >ii bc 1.07.1-2+b1 >ii bundler 1.17.3-3 >ii bzip2 1.0.6-9.2~deb10u1 >ii dbconfig-pgsql 2.0.11+deb10u1 >ii debconf [debconf-2.0] 1.5.71 >ii gitlab-common 13.1.0+dfsg-1~bpo10+1 >ii gitlab-workhorse 8.36.0+debian-1~bpo10+1 >ii libjs-bootstrap4 [node-bootstrap] 4.3.1+dfsg2-1 >ii libjs-popper.js [node-popper.js] 1.14.6+ds2-1 >ii libjs-uglify 2.8.29-6 >ii lsb-base 10.2019051400 >ii node-autosize 4.0.2~dfsg1-3 >ii node-axios 0.17.1+dfsg-2 >ii node-babel-loader 8.1.0-3~bpo10+1 >ii node-babel7 7.4.5+~cs7.3.8-1~bpo10+1 >ii node-brace-expansion 1.1.8-1 >ii node-cache-loader 4.1.0-1~bpo10+1 >ii node-chart.js 2.7.3+dfsg-5 >ii node-clipboard 2.0.6+ds-1~bpo10+1 >ii node-compression-webpack-plugin 3.0.1-1~bpo10+1 >ii node-core-js 3.6.5-1 >ii node-css-loader 2.1.1-1~bpo10+1 >ii node-d3-scale 2.2.2-2 >ii node-d3-selection 1.4.0-5 >ii node-dateformat 3.0.0-1 >ii node-exports-loader 0.7.0-2~bpo10+1 >ii node-fuzzaldrin-plus 0.5.0+dfsg-1 >ii node-glob 7.1.6-1~bpo10+1 >ii node-imports-loader 0.8.0-2~bpo10+1 >ii node-jed 1.1.1-1 >ii node-jquery 3.5.1+dfsg-4 >ii node-jquery-ujs 1.2.2-2 >ii node-js-cookie 2.2.0-2 >ii node-jszip 3.2.2+dfsg-1 >ii node-jszip-utils 0.0.2+dfsg-1 >ii node-lodash 4.17.15+dfsg-2 >ii node-marked 0.5.1+dfsg-1 >ii node-mousetrap 1.6.1+ds-1 >ii node-prismjs 1.11.0+dfsg-3 >ii node-prosemirror-model 1.9.0-3 >ii node-raven-js 3.22.1+dfsg-2 >ii node-three-orbit-controls 82.1.0-2 >ii node-three-stl-loader 1.0.6-2 >ii node-timeago.js 4.0.2-2 >ii node-underscore 1.9.1~dfsg-1 >ii node-url-loader 3.0.0-1~bpo10+1 >ii node-vue 2.6.11+dfsg-1~bpo10+1 >ii node-vue-resource 1.5.1+dfsg-6 >ii node-webpack-stats-plugin 0.2.1-1 >ii node-worker-loader 2.0.0-2~bpo10+1 >ii node-xterm 3.8.1-4 >ii nodejs 10.21.0~dfsg-1~deb10u1 >ii openssh-client 1:7.9p1-10+deb10u2 >ii postfix [mail-transport-agent] 3.4.10-0+deb10u1 >ii postgresql-client 11+200+deb10u3 >ii postgresql-client-11 [postgresql-client] 11.7-0+deb10u1 >ii postgresql-contrib 11+200+deb10u3 >ii puma 3.12.0-2+deb10u1 >ii rake 12.3.1-3+deb10u1 >ii redis-server 5:5.0.3-4+deb10u1 >ii ruby 1:2.5.1 >ii ruby-ace-rails-ap 4.1.1-1 >ii ruby-acme-client 2.0.5-1~bpo10+1 >ii ruby-activerecord-explain-analyze 0.1.0-2~bpo10+1 >ii ruby-acts-as-taggable-on 6.5.0-2~bpo10+1 >ii ruby-addressable 2.7.0-1~bpo10+1 >ii ruby-akismet 3.0.0-1~bpo10+1 >ii ruby-apollo-upload-server 2.0.0~beta3-1~bpo10+1 >ii ruby-asana 0.9.3-3~bpo10+1 >ii ruby-asciidoctor-include-ext 0.3.1-2~bpo10+1 >ii ruby-asciidoctor-plantuml 0.0.12-1~bpo10+1 >ii ruby-attr-encrypted 3.1.0-2~bpo10+1 >ii ruby-aws-sdk 2.9.32-2 >ii ruby-babosa 1.0.2-2 >ii ruby-base32 0.3.2-3 >ii ruby-batch-loader 1.4.1+dfsg.1-1~bpo10+1 >ii ruby-bcrypt-pbkdf 1.0.0-2 >ii ruby-benchmark-memory 0.1.2-2~bpo10+1 >ii ruby-bootsnap 1.4.6-1~bpo10+1 >ii ruby-bootstrap-form 4.2.0-2 >ii ruby-browser 2.5.3-1 >ii ruby-carrierwave 1.3.1-2 >ii ruby-charlock-holmes 0.7.6-1 >ii ruby-chronic [ruby-gitlab-chronic] 0.10.5-2~bpo10+1 >ii ruby-chronic-duration [ruby-gitlab-chronic-du 0.10.6.2-2~bpo10+1 >ii ruby-commonmarker 0.20.2-1~bpo10+1 >ii ruby-connection-pool 2.2.2-1 >ii ruby-countries 3.0.0-2~bpo10+1 >ii ruby-creole 0.5.0-2 >ii ruby-default-value-for 3.3.0-1~bpo10+1 >ii ruby-derailed-benchmarks 1.7.0-2~bpo10+1 >ii ruby-device-detector 1.0.1-2 >ii ruby-devise 4.7.1-2~bpo10+1 >ii ruby-devise-two-factor 3.1.0-2~bpo10+1 >ii ruby-diff-match-patch 0.1.0-2~bpo10+1 >ii ruby-diffy 3.3.0-1~bpo10+1 >ii ruby-discordrb-webhooks 3.3.0-1 >ii ruby-doorkeeper 5.0.3-1~bpo10+1 >ii ruby-doorkeeper-openid-connect 1.6.3-2~bpo10+1 >ii ruby-ed25519 1.2.4-1 >ii ruby-elasticsearch 6.8.1-2~bpo10+1 >ii ruby-elasticsearch-api 6.8.1-2~bpo10+1 >ii ruby-email-reply-trimmer 0.1.6-1 >ii ruby-erubi 1.9.0-1~bpo10+1 >ii ruby-escape-utils 1.2.1-1+b1 >ii ruby-excon 0.72.0-2~bpo10+1 >ii ruby-faraday 0.17.3-1~bpo10+1 >ii ruby-fast-blank 1.0.0-1+b1 >ii ruby-flipper [ruby-flipper-active-support-cac 0.17.1-4~bpo10+1 >pn ruby-flipper-active-record <none> >ii ruby-flowdock 0.7.1-1 >ii ruby-fog-aliyun 0.3.2-4 >ii ruby-fog-aws 3.5.2-1~bpo10+1 >ii ruby-fog-core 2.1.0-3 >ii ruby-fog-google 1.10.0-2~bpo10+1 >ii ruby-fog-local 0.6.0-1 >ii ruby-fog-openstack 1.0.8-2 >ii ruby-fog-rackspace 0.1.6-2 >ii ruby-fogbugz 0.2.1-3 >ii ruby-font-awesome-rails 4.7.0.5-1~bpo10+1 >ii ruby-fugit 1.3.3+gh-1~bpo10+1 >ii ruby-gemojione 3.3.0-1 >ii ruby-gettext-i18n-rails 1.8.0-1 >ii ruby-gettext-i18n-rails-js 1.3.0+dfsg-2 >ii ruby-gitaly 13.1.0+dfsg-1~bpo10+1 >ii ruby-github-markup 1.7.0+dfsg-2 >ii ruby-gitlab-labkit 0.12.0-2~bpo10+1 >ii ruby-gitlab-sidekiq-fetcher 0.5.2-1~bpo10+1 >ii ruby-gon 6.2.1-1 >ii ruby-google-api-client 0.33.0-2~bpo10+1 >ii ruby-google-protobuf 3.11.4-3~bpo10+1 >ii ruby-gpgme 2.0.19-1~bpo10+1 >ii ruby-grape 1.3.3-1~bpo10+1 >ii ruby-grape-entity 0.8.0-1~bpo10+1 >ii ruby-grape-logging 1.7.0-1 >ii ruby-grape-path-helpers 1.3.0-1~bpo10+1 >ii ruby-graphiql-rails 1.4.10-1 >ii ruby-graphql 1.10.7-2~bpo10+1 >ii ruby-grpc 1.26.0-2~bpo10+1 >ii ruby-hamlit 2.11.0-2~bpo10+1 >ii ruby-hangouts-chat 0.0.5-2 >ii ruby-hashie-forbidden-attributes 0.1.1-1 >ii ruby-health-check 2.6.0-1 >ii ruby-hipchat 1.5.2-3 >ii ruby-html-pipeline 2.12.3-1~bpo10+1 >ii ruby-html2text 0.2.0-1 >ii ruby-httparty 0.17.0-1 >ii ruby-icalendar 2.4.1-2 >ii ruby-invisible-captcha 0.12.2-2~bpo10+1 >ii ruby-jira 2.0.0-2~bpo10+1 >ii ruby-jquery-atwho-rails 1.5.4+dfsg-1 >ii ruby-js-regex 3.1.1-1 >ii ruby-json 2.3.0+dfsg-1~bpo10+1 >ii ruby-json-schema 2.8.1-1 >ii ruby-jwt 2.1.0-2~bpo10+1 >ii ruby-kaminari 1.2.1-1~bpo10+1 >ii ruby-kgio 2.11.2-1+b1 >ii ruby-kubeclient 4.6.0-1 >ii ruby-licensee 8.9.2-1 >ii ruby-lockbox 0.3.5-2~bpo10+1 >ii ruby-lograge 0.10.0-1 >ii ruby-loofah 2.4.0+dfsg-1~bpo10+1 >ii ruby-lru-redux 1.1.0-2~bpo10+1 >ii ruby-mail 2.7.1+dfsg1-1 >ii ruby-mail-room 0.10.0+really0.0.6-1~bpo10+1 >ii ruby-marginalia 1.8.0-2~bpo10+1 >ii ruby-memory-profiler 0.9.14-2~bpo10+1 >ii ruby-method-source 1.0.0-1~bpo10+1 >ii ruby-mimemagic 0.3.2+dfsg-1 >ii ruby-mini-magick 4.9.2-1+deb10u1 >ii ruby-nakayoshi-fork 0.0.4-1 >ii ruby-net-dns [ruby-gitlab-net-dns] 0.9.1-2~bpo10+1 >ii ruby-net-ldap 0.16.1-1 >ii ruby-net-ntp 2.1.3-2~bpo10+1 >ii ruby-net-ssh 1:6.0.2-2~bpo10+1 >ii ruby-nokogiri 1.10.9+dfsg-1~bpo10+1 >ii ruby-ntlm 0.6.1-2 >ii ruby-oauth2 1.4.4-1~bpo10+1 >ii ruby-octokit 4.17.0-2~bpo10+1 >ii ruby-omniauth 1.9.0-1~bpo10+1 >ii ruby-omniauth-auth0 2.0.0-1 >ii ruby-omniauth-authentiq 0.3.3-1 >ii ruby-omniauth-azure-oauth2 0.0.10-1 >ii ruby-omniauth-cas3 1.1.4-2 >ii ruby-omniauth-crowd 2.4.0-1 >ii ruby-omniauth-facebook 4.0.0-2 >ii ruby-omniauth-github 1.4.0-1~bpo10+1 >ii ruby-omniauth-gitlab 1.0.2-1 >ii ruby-omniauth-google-oauth2 0.6.0-2~bpo10+1 >ii ruby-omniauth-kerberos 0.3.0-3 >ii ruby-omniauth-ldap 2.1.1-1 >ii ruby-omniauth-oauth2-generic 0.2.2-1 >ii ruby-omniauth-openid-connect 0.3.5-1~bpo10+1 >ii ruby-omniauth-salesforce 1.0.5-2~bpo10+1 >ii ruby-omniauth-saml 1.10.0-1 >ii ruby-omniauth-shibboleth 1.3.0-1 >ii ruby-omniauth-twitter 1.4.0-1 >ii ruby-org 0.9.12-2 >ii ruby-peek 1.1.0-1~bpo10+1 >ii ruby-pg 1.1.3-3 >ii ruby-posix-spawn 0.3.13-2+b1 >ii ruby-premailer-rails 1.10.3-1~bpo10+1 >ii ruby-prof 1.3.1-1~bpo10+1 >ii ruby-progressbar 1.9.0-2 >ii ruby-prometheus-client-mmap 0.10.0-1+b1 >ii ruby-rack 2.1.1-4~bpo10+1 >ii ruby-rack-attack 6.3.1-1~bpo10+1 >ii ruby-rack-cors 1.1.1-1 >ii ruby-rack-oauth2 1.11.0-2 >ii ruby-rack-proxy 0.6.1-2 >ii ruby-rack-timeout 0.4.2-1 >ii ruby-rails 2:6.0.3.1+dfsg-1~bpo10+1 >ii ruby-rails-i18n 6.0.0-2~bpo10+1 >ii ruby-rainbow 3.0.0-2 >ii ruby-raindrops 0.19.0-1+b2 >ii ruby-rbtrace 0.4.10-1 >ii ruby-re2 1.2.0-1~bpo10+1 >ii ruby-recaptcha 4.11.1-2 >ii ruby-redcloth 4.3.2-3+b1 >ii ruby-redis 4.1.2-4~bpo10+1 >ii ruby-redis-actionpack 5.2.0-2~bpo10+1 >ii ruby-redis-activesupport 5.2.0-1~bpo10+1 >ii ruby-redis-namespace 1.6.0-1 >ii ruby-redis-rails 5.0.2-3 >ii ruby-request-store 1.5.0-2~bpo10+1 >ii ruby-responders 3.0.0-3~bpo10+1 >ii ruby-retriable 3.1.2-1~bpo10+1 >ii ruby-rouge 3.19.0-1~bpo10+1 >ii ruby-rqrcode-rails3 0.1.7-1 >ii ruby-ruby-parser 3.11.0-4~bpo10+1 >ii ruby-rugged 0.28.4.1+ds-1+b1 >ii ruby-sanitize 4.6.6-2 >ii ruby-sassc 2.0.1-2~bpo10+1 >ii ruby-sassc-rails 2.1.2-3~bpo10+1 >ii ruby-seed-fu 2.3.7-3~bpo10+1 >ii ruby-sentry-raven 2.13.0-1 >ii ruby-settingslogic 2.0.9-3 >ii ruby-sidekiq 5.2.7+dfsg-1~bpo10+1 >ii r -- Sent from my Android device with K-9 Mail. Please excuse my brevity. _______________________________________________ Pkg-ruby-extras-maintainers mailing list [email protected] https://alioth-lists.debian.net/cgi-bin/mailman/listinfo/pkg-ruby-extras-maintainers
