This lets deferred cleanup to be run instead of whole process being
killed without having a chance to preserve external data in consistent
state.