Handle error case of not being able to reopen which
requires us to remove table from thread's open list
and table_cache.