A rectory is the residence of an Anglican Parson, also referred to as vicarage or parsonage. Rectory is also sometimes used by the Roman Catholic Church.
(Wikipedia)