"Look, he's a great guy, and I love being with him, but, you know..."