The current Duke's father, Robert, was the 5th Duke of Westminster. When the 4th Duke died, he and his family moved from Northern Ireland to Eaton where they set about building a new home, the Dennys Hall.

Robert married Viola on 3rd December 1946 at Chester Cathedral. Viola was an accomplished pianist and was responsible for converting the courtyard stables at Eaton into events rooms for concerts and fundraising evenings.