"But it's not going to be easy, because when I'm with Amy"