"The children are in the main house now. I've been banished to a cottage."