Slow networking for release management

Originally created by @CyrilBrulebois on #17414 (Redmine)

(Opening as suggested by intrigeri.)

I’m regularly getting very slow transfers when performing release management duties, e.g. sync-ing stuff with git-annex right now:

kibi@armor:~/work/clients/tails/release/isos.git$ git annex get tails-amd64-4.*
get tails-amd64-4.0~beta1/tails-amd64-4.0~beta1.apt-sources (from origin...) 
SHA256E-s455--8759b3d834ba480061a814178fcaba653183e063ec554d2792da7cab31244d1d
            455 100%  444.34kB/s    0:00:00 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta1/tails-amd64-4.0~beta1.build-manifest (from origin...) 
SHA256E-s115862--f1ad4992232b8f026e612affecfa5d44c28061736d3fd82d35fc34029b3c743e
        115,862 100%  367.36kB/s    0:00:00 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta1/tails-amd64-4.0~beta1.buildlog (from origin...) 
SHA256E-s1167089--21d7a15c8065b52e49662273c6a7a0d734ea4bf7c69f623266774767ecc767ec
      1,167,089 100%    2.32MB/s    0:00:00 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta1/tails-amd64-4.0~beta1.img (from origin...) 
SHA256E-s1136656384--384db4d74da56c31a4e50bf093526c962d0eb3dee19de3e127fd5acccc063f9b.img
  1,136,656,384 100%    6.09MB/s    0:02:58 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta1/tails-amd64-4.0~beta1.img.sig (from origin...) 
SHA256E-s833--b8d1f3e4843d9586b811c16272df34759a6fab8c89c26839e0c0373f091ab343.img.sig
            833 100%  813.48kB/s    0:00:00 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta1/tails-amd64-4.0~beta1.iso (from origin...) 
SHA256E-s1126864896--c4c25d9689d8c5927f8ce1569454503fc92494ce53af236532ddb0d6fb34cff3.iso
  1,126,864,896 100%    3.93MB/s    0:04:33 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta1/tails-amd64-4.0~beta1.iso.sig (from origin...) 
SHA256E-s833--924ed01855ed92471526c9d68db40d692d6b3dfe970554333f52f3297d6f4f1a.iso.sig
            833 100%  813.48kB/s    0:00:00 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta1/tails-amd64-4.0~beta1.packages (from origin...) 
SHA256E-s46699--7d7ce059b09604f08676561e2a62c6142ff3226878257b695f20269f4eab6e8d
         46,699 100%   44.54MB/s    0:00:00 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta2/tails-amd64-4.0~beta2.build-manifest (from origin...) 
SHA256E-s115583--95117b4429829ce7e0f29fa887789e1c29c37d6ff9414a2a8e898d88099f426e
        115,583 100%  714.39kB/s    0:00:00 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta2/tails-amd64-4.0~beta2.buildlog (from origin...) 
SHA256E-s1165670--352f0e02919afccacaf763a9831497678a9175211f423aae0fa63465018f79bd
      1,165,670 100%    3.32MB/s    0:00:00 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta2/tails-amd64-4.0~beta2.img (from origin...) 
SHA256E-s1136656384--920e48fb7b8ab07573f6ad334749dd965c453794b6d33766d545c943c21296ad.img
  1,136,656,384 100%    4.05MB/s    0:04:27 (xfr#1, to-chk=0/1)
(checksum...) ok
get tails-amd64-4.0~beta2/tails-amd64-4.0~beta2.img.sig (from origin...) 
SHA256E-s228--212807a88aca27d186eaebe66e7045b88888ab7f8e806e77ca780a8a8646697e.img.sig
            228 100%  222.66kB/s    0:00:00 (xfr#1, to-chk=0/1)

Meanwhile, I’m easily reaching 20+ MB/s when downloading some big files from other servers, so that’s definitely not a bandwidth issue on my side.

FWIW this is with a git-annex that leverages a direct connection to git.puppet.tails.boum.org defined as an SSH alias to lizard, so there’s no tor involved.

At other times, I can get up to 15 MB/s from the iso history HTTPS access, or over SSH. But it usually only happens when I’m double-checking the numbers after mentioning this issue to my fellow RMs, while I’m getting the slowness moments when such transfers are on the critical path to a release.

Please let me know what you need from me to help you help me. Thanks!

Related issues

• Related to tails#17361 (closed)