Among the remains scattered across this small, storm-battered outcrop is a penitential station, a designated site where pilgrims would perform prescribed acts of prayer and physical penance, typically walking barefoot circuits around sacred markers such as crosses, stones, or wells, often reciting specific prayers at each stopping point. The practice, known in Irish as a turas, persists at several Irish sites to this day, though the tradition on High Island belongs to a much older and largely discontinued chapter of that devotional culture.

High Island, known in Irish as Ard Oileán, was home to a early medieval monastic settlement associated with Saint Féchín of Fore, who died in 665 AD. The monastery's remains include a cashel wall, a small oratory, beehive cells, and inscribed cross slabs, and the penitential station would have formed part of this broader sacred landscape. The island was never permanently inhabited in the modern era, which has left its archaeology in a comparatively undisturbed state. Seamus Heaney, who spent time on the island in the early 1970s as a guest of the poet and scholar Richard Murphy, wrote a sequence of poems drawn from the experience, giving the site a modest literary afterlife alongside its religious one.