Resolve "Notifications for when pipelines are fixed"

Closes #24309

See merge request gitlab-org/gitlab!16951