This reverts commit 99f81afc.

It was papering over the real problem, which is fixed by commit
f555f34f ("net: phy: fix auto-negotiation stall due to unavailable
interrupt")
Signed-off-by: David S. Miller <davem@davemloft.net>