The castle's foundations were still visible in the early 1900s when historian Westropp documented the site, but by 1944, even these traces had vanished; much of the limestone rock itself had been quarried away for road metal, erasing centuries of history along with it.

The castle's story stretches back to 1199, when King John granted the lands to William de Naish, along with the territories of Lirickmadh and the cantred of Huheny. Over the following centuries, Carrickittle passed through numerous hands, each leaving their mark on its turbulent history. The castle changed ownership frequently through medieval times, held by various Anglo-Norman families including the de Londres, before falling into the possession of Walter Bourke around 1410, who assigned it to his third son Tiboit. In 1510, Garret, Earl of Kildare, rebuilt the structure, breathing new life into the ancient stronghold, though this renewal would prove temporary.

The castle's final chapter came during the Desmond Rebellions of the late 16th century. In 1583, Gerald, Earl of Desmond, held what was then described as a "little castle or peel situated on the top of a mount in Kiltyly" when he entered into rebellion against the Crown. After his defeat, the castle was forfeited and eventually came into the possession of Sir Edward Fitton in 1605, then Sir Maurice Hurley by 1655. The 1654-7 Down Survey map depicts a tower-like structure at the site, one of the last visual records of this once-important fortification. Today, Carrickittle Rock stands as a testament to Ireland's layered history, where ancient castles can disappear not through warfare or abandonment, but simply through the mundane needs of road construction.