"I actually think it would be the best for him, but it would be hard for me"