"We can't very well just kick Joe out."