Son of the 2nd Viscount Clifden, George Agar-Ellis was created Baron Dover in 1831. He did not succeed his father as Viscount, having died within the latter's lifetime. He married Lady Georgiana Howard [d. 1860], daughter of George, 6th Earl of Carlisle and granddaughter of the 5th Duke of Devonshire, on 7 March 1822. They had two daughters and two sons, including Henry, who would become the 2nd Baron Dover and 3rd Viscount Clifden.