Automate incremental upgrades manual test

Implementation idea:

Give this scenario the @release tag, and (once #17772 (closed) is done) add logic so that tag is run for releases. This also makes it easy to filter out this test when running locally, e.g. when developing tests and running them against the latest release.

Parent task: #10250 (closed)