This only adds back buttons to pages with a single parent. For pages
with different parents (like /install/copy) we should probably duplicate
their content in different pages which would then have a single parent.