Update Jenkins core and plugins (2024Q1 edition)

Last time: #18038 (closed)

Preparation

• Go through the changelog, paying attention to changes on how agents connect to controller, config changes that may need update, important changes in plugins, etc.
  • Current version: 2.426.2
  • Available version: 2.440.1

Deployment

• Use the Groovy scripts to get a list of queued and running jobs to manually restart in the end of this process
• Deploy Jenkins upgrade to latest version available
• Use the Groovy and Python3 scripts to generate a list of up-to-date plugins
• Deploy plugin upgrades
• Restart all agents:

  for i in isobuilder{1,2,3,4} isoworker{1,2,3,4,5,6,7,8}; ssh $i sudo systemctl reboot; end

• Manually run the Update jobs script (may be needed so XML is valid with current Jenkins):

  sudo -u jenkins /usr/local/sbin/deploy_jenkins_jobs update

• Go through warnings in Jenkins interface.
• Manually uninstall removed plugins via Jenkins interface.
• Manually delete removed plugins from /var/lib/jenkins/plugins.

Wrap up

• Restart builds that were interrupted by Jenkins restarts.
• Schedule next update.