When doing name resolution, do the same what WHERE/ON clauses do:
they don't count in select_lex->non_agg_field_used().