Fayet was a wealthy vineyard owner, artist, collector, and friend of artists. He had a significant collection of works by van Gogh, Redon, and above all Gauguin. In 1908 he and his wife, Madeleine d'Andoque de Sérièse, bought the Abby of Fontfroide, near Norbonne. At this time he sold some, but not all, of his paintings.
