"...it'll look like I'm abandoning him. I'll be ostracized from the community."