"A rumor like that could tarnish his integrity,"