Now that we can handle hot remove there is no need for usecounts
for interfaces.
Signed-off-by: Corey Minyard <cminyard@mvista.com>