Sidney James Agar succeeded his father as Earl in 1896. A Deputy Lieutenant for Hampshire, Agar married Lady Amy Frederica Alice Byng [d. 1961], daughter of the 4th Earl of Strafford, on 3 November 1894. They had seven daughters and a son; the latter (Edward) succeeded his father as 5th Earl in 1933.