Summerson was born in Darlington and became interested in architecture after a childhood visit to Riber Castle, Matlock. He held many teaching posts and professorships at Oxford and Cambridge. He was curator of Sir John Soane's Museum in London (1945-84). Summerson's many publications include Georgian London (1946), Architecture in Britain 1550-1850 (1953) and the essay collection The Unromantic Castle (1990). His work laid the basis for modern architectural criticism.