From the 14th century onwards, Verfeuil is mentioned as being the property of the Grimoard family, one of whose members was Pope Urban V. This family also owned the castles of Grizac (Le Pont-de-Montvert) and Bellegarde (St-Privat-de-Vallongue). According to the archives, the order to dismantle Verfeuil was given by the Governor of Languedoc province in 1586, during the religious wars. The site may have been abandoned before then. Castra were frequently deserted from the 14th century onwards in favour of less steep and more comfortable sites.