Make sure to disable runtime PM also on driver unbind.

Fixes: ac0d2399 ("phy: qcom-qmp: Add support for runtime PM").
Signed-off-by: Johan Hovold <johan+linaro@kernel.org>
Reviewed-by: Dmitry Baryshkov <dmitry.baryshkov@linaro.org>
Link: https://lore.kernel.org/r/20220907110728.19092-10-johan+linaro@kernel.orgSigned-off-by: Vinod Koul <vkoul@kernel.org>