The grandfather of footballer Jesse Lingard told a court he was not an "ogre" while denying allegations of sexual assault.