Councillors said Jon Surman's change of use application would ‘displace current longstanding tenants’ from their homes.