Turns out we do need to do d_delete() on individual files (and symlinks)
when removing them the tree, to make sure they actually get removed from
the hierarchy.