Otherwise we have delays on noticing interrupts from the
WLAN card when idle.
Signed-off-by: Tony Lindgren <tony@atomide.com>