Finalize the background migration, deal with possible leftovers, and
remove the after_commit logic which is not necessary anymore.

Changelog: changed