if previous test fail to build, compile dir is there for inspection. We
don't want to check binaries in there.