Changes
Page history
Adjust for ikiwiki → GitLab wiki
authored
Jan 12, 2021
by
intrigeri
Hide whitespace changes
Inline
Side-by-side
CI_usability.md
View page @
a5d53a93
[[!meta title="CI usability issues"]]
---
title
:
CI usability issues
---
Here, we collect CI usability issues.
Here, we collect CI usability issues.
This effort started with
[[!
tails
_ticket
16959
]]
, in order to have a better
This effort started with tails
/tails#
16959, in order to have a better
understanding of how our current setup feels to its users.
understanding of how our current setup feels to its users.
This data will help us define our strategy for the future of our CI (e.g.
This data will help us define our strategy for the future of our CI (e.g.
switching to GitLab CI, switching to Jenkins pipelines, or merely removing some
switching to GitLab CI, switching to Jenkins pipelines, or merely removing some
UX stumbling blocks without changing the big picture of our setup).
UX stumbling blocks without changing the big picture of our setup).
[[!toc levels=2]]
[[
_TOC_
]]
# Cumbersome navigation
# Cumbersome navigation
...
@@ -17,10 +22,10 @@ UX stumbling blocks without changing the big picture of our setup).
...
@@ -17,10 +22,10 @@ UX stumbling blocks without changing the big picture of our setup).
-
Jenkins does not readily expose the full CI pipeline progress & outcome
-
Jenkins does not readily expose the full CI pipeline progress & outcome
⇒ developers and reviewers need to track/check the result of 3 different jobs.
⇒ developers and reviewers need to track/check the result of 3 different jobs.
([
[!
tails
_gitlab
tails/sysadmin/-/issues/17071
]]
)
(
[
tails
/sysadmin/-/issues/17071
](
https://gitlab.tails.boum.org/
tails/sysadmin/-/issues/17071
)
)
-
CI results are not visible on GitLab MRs
-
CI results are not visible on GitLab MRs
([
[!
tails
_gitlab
tails/sysadmin/-/issues/17070
]]
)
(
[
tails
/sysadmin/-/issues/17070
](
https://gitlab.tails.boum.org/
tails/sysadmin/-/issues/17070
)
)
# Misleading output
# Misleading output
...
@@ -35,22 +40,21 @@ UX stumbling blocks without changing the big picture of our setup).
...
@@ -35,22 +40,21 @@ UX stumbling blocks without changing the big picture of our setup).
# Missing information
# Missing information
*
When a Jenkins build aborts due to a timeout, no summary of the scenarios
*
When a Jenkins build aborts due to a timeout, no summary of the scenarios
that did run is generated. (
[[!
tails
_ticket
17678
]]
)
that did run is generated. (tails
/tails#
17678)
# Suboptimal jobs prioritizing
# Suboptimal jobs prioritizing
*
The fact all jobs are treated equally causes trouble during our release
*
The fact all jobs are treated equally causes trouble during our release
process: the RM sometimes has to wait a long time for the builds they care
process: the RM sometimes has to wait a long time for the builds they care
about to run, while our CI resources are kept busy by other builds that
about to run, while our CI resources are kept busy by other builds that
arguably could wait a bit longer. ([[!tails_gitlab
arguably could wait a bit longer. (
[
tails/sysadmin/-/issues/9760
](
https://gitlab.tails.boum.org/tails/sysadmin/-/issues/9760
)
)
tails/sysadmin/-/issues/9760]])
# Very long feedback loop
# Very long feedback loop
As of August 2020, a full CI pipeline takes almost 7 hours to run.
As of August 2020, a full CI pipeline takes almost 7 hours to run.
This problem is tracked on [
[!
tails
_gitlab
tails/sysadmin/-/issues/16960
]]
and
This problem is tracked on
[
tails
/sysadmin/-/issues/16960
](
https://gitlab.tails.boum.org/
tails/sysadmin/-/issues/16960
)
and
[
[a dedicated blueprint
|blueprint/
hardware_for_automated_tests_take3
]]
, which
[
a dedicated blueprint
](
hardware_for_automated_tests_take3
)
, which
focuses on the hard facts.
focuses on the hard facts.
Here we focus on feelings and human perception.
Here we focus on feelings and human perception.
...
@@ -84,6 +88,6 @@ Note: this is not about robustness problems inherent to our test suite,
...
@@ -84,6 +88,6 @@ Note: this is not about robustness problems inherent to our test suite,
that don't depend much on _how_ we run the test suite.
that don't depend much on _how_ we run the test suite.
*
When GitLab is down or connectivity between lizard and GitLab is poor, many
*
When GitLab is down or connectivity between lizard and GitLab is poor, many
Jenkins jobs — if not all — fail. ([
[!
tails
_gitlab
Jenkins jobs — if not all — fail. (
[
tails
/sysadmin/-/issues/17715
](
https://gitlab.tails.boum.org/tails/sysadmin/-/issues/17715
)
)
tails/sysadmin/-/issues/17715]])