"You don't have to play with the Yankees, but it's no insult to be asked."