We want to be able to persist the password file, so we can't delete it.
And since the password is now hashed and salted, we don't have to delete
it anymore.