There was too much knowledge about internals if serio in the pass-through
handling, clean it up.
Signed-off-by: Dmitry Torokhov <dtor@mail.ru>